Commit eb08648
authored
Add trace-based evaluation in agent evaluation metrics to get correct score (#478)
* Add trace-based evaluation in agent evaluation metrics to get correct score
* check reason is provided
* remove credentials
* fix the failure due to dependency
* fix the failure due to dependency
* fix scorecardpy version to 0.1.9.6
* fix copyright1 parent 509a0ef commit eb08648
21 files changed
Lines changed: 9335 additions & 9537 deletions
File tree
- notebooks
- code_sharing/operational_deposit
- how_to
- data_and_datasets
- tests
- explore_tests
- run_tests/configure_tests
- tutorials
- model_development
- model_validation
- use_cases/agents
- tests/unit_tests/data_validation
- validmind
- datasets/credit_risk
- scorers/llm/deepeval
- tests/data_validation
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1132 | 1132 | | |
1133 | 1133 | | |
1134 | 1134 | | |
| 1135 | + | |
1135 | 1136 | | |
1136 | 1137 | | |
1137 | 1138 | | |
| |||
Lines changed: 982 additions & 981 deletions
Large diffs are not rendered by default.
Lines changed: 789 additions & 788 deletions
Large diffs are not rendered by default.
Lines changed: 4435 additions & 4434 deletions
Large diffs are not rendered by default.
Lines changed: 675 additions & 675 deletions
Large diffs are not rendered by default.
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
960 | 960 | | |
961 | 961 | | |
962 | 962 | | |
| 963 | + | |
963 | 964 | | |
964 | 965 | | |
965 | 966 | | |
| |||
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1205 | 1205 | | |
1206 | 1206 | | |
1207 | 1207 | | |
| 1208 | + | |
1208 | 1209 | | |
1209 | 1210 | | |
1210 | 1211 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | 3 | | |
| 4 | + | |
4 | 5 | | |
5 | 6 | | |
6 | 7 | | |
| |||
79 | 80 | | |
80 | 81 | | |
81 | 82 | | |
| 83 | + | |
82 | 84 | | |
83 | 85 | | |
84 | 86 | | |
| |||
279 | 281 | | |
280 | 282 | | |
281 | 283 | | |
282 | | - | |
283 | | - | |
| 284 | + | |
| 285 | + | |
284 | 286 | | |
285 | 287 | | |
286 | 288 | | |
| |||
308 | 310 | | |
309 | 311 | | |
310 | 312 | | |
| 313 | + | |
311 | 314 | | |
312 | 315 | | |
313 | 316 | | |
| |||
362 | 365 | | |
363 | 366 | | |
364 | 367 | | |
| 368 | + | |
365 | 369 | | |
366 | 370 | | |
367 | 371 | | |
| |||
Lines changed: 2176 additions & 2196 deletions
Large diffs are not rendered by default.
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
0 commit comments