Sign In
Scorer Agent
by UiPath
0
Prebuilt Agent
<100
Summary
Summary
Pre-built agent that evaluates a given output based on custom criteria and an expected output (optional)
Overview
Overview
The Scorer agent allows users to evaluate an input based on custom defined criteria with the option to distribute the weight of each criterion evenly (default) or assign a custom weighting scheme. Additionally, users can include an optional expected output to judge the input by offering further reinforcement for the score. The overall score will be a number between 0-100 (low to high) that represents how closely the input follows the decision criteria (+ expected output if used). Additionally, there will be a score and justification for each criteria, citations (if expected output used) and relevancy
This is a generalist. foundational agent that should be applicable to many use cases, but will be particularly useful in incorporating thresholds for escalations or for human-in-the-loop steps.
Features
Features
- Standard inputs for that which is being evaluated, evaluation criteria (w/ optional weights), and optional expected output
- Numeric score as output for overall score
- Numeric conciseness and relevance score
- Numeric citations match and justification relating to any citations included in the actual output compared to the expected output
- Prompt finds and applies penalty to the score for critical discrepancy (between actual and expected or if the actual has discrepancies in itself)
All scores on a 0-100 scale
Similar Listings
