Skip to content

add evaluation parameter metadata to output file #45

@wyatt-avilla

Description

@wyatt-avilla

This should be another JSON object at the top of the output file, containing metadata about the evaluation parameters and other helpful info (e.g, the datetime when the evaluation took place).

For example:

{
    "evaluation_type": "single-turn",
    "threshold": 0.7,
    "test_case_groups": ["group1"]
}

If we support a metadata object like this, it would make sense to simplify the default output file names.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions