Skip to content

Add functionality for projecting chrF3 from confidence and estimating usability scores #784

@mshannon-sil

Description

@mshannon-sil

As part of the early NT process, we're planning to estimate chrF3 from confidence scores, and then estimate the usability of each chapter and book based on the projected verse chrF3 scores and a usability distribution over chrF3 determined beforehand. Functionality needs to be added to SILNLP to handle this automatically, as it's been a partially manual process up until now.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestpipeline 5: testIssue relating to testing a model quality with Bleu or other metrics.pipeline 6: inferIssue related to using a trained model to translate.

Projects

Status

🆕 New

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions