List view

Add METEOR metric

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

New metric

topic: Text

Status: Open.

#595 In Lightning-AI/torchmetrics;

· stancld opened on Oct 29, 2021

Add <code>CharacTER</code>

enhancementNew feature or requestNew feature or request

New metric

topic: Text

Status: Open.

#633 In Lightning-AI/torchmetrics;

· stancld opened on Nov 24, 2021

Instance Weighting

enhancementNew feature or requestNew feature or request

Status: Open.

#784 In Lightning-AI/torchmetrics;

· mossaab0 opened on Jan 20, 2022

Add <code>BaryScore</code>

enhancementNew feature or requestNew feature or request

New metric

topic: Text

Status: Open.

#852 In Lightning-AI/torchmetrics;

· stancld opened on Feb 21, 2022

Add <code>DepthScore</code>

enhancementNew feature or requestNew feature or request

New metric

topic: Text

Status: Open.

#854 In Lightning-AI/torchmetrics;

· stancld opened on Feb 22, 2022

Support sequence tagging evaluation metrics (NLP)

enhancementNew feature or requestNew feature or request

New metric

waiting on author

Status: Open.

#1158 In Lightning-AI/torchmetrics;

· pietrolesci opened on Jul 22, 2022

Almost All Image Metrics Save All Images In a Buffer

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

topic: Image

Status: Open.

#1224 In Lightning-AI/torchmetrics;

· Queuecumber opened on Sep 14, 2022

Supporting advanced metrics for image generation

enhancementNew feature or requestNew feature or request

topic: Image

Status: Open.

#1483 In Lightning-AI/torchmetrics;

· sayakpaul opened on Feb 6, 2023

F score over boundaries

enhancementNew feature or requestNew feature or request

Status: Open.

#1500 In Lightning-AI/torchmetrics;

· bhack opened on Feb 12, 2023

Supporting mask

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#1282 In Lightning-AI/torchmetrics;

· ZhaofengWu opened on Oct 20, 2022

Add <code>GEMBA</code> (GPT-based metric for assessment of translation quality)

enhancementNew feature or requestNew feature or request

New metric

topic: Text

Status: Open.

#1579 In Lightning-AI/torchmetrics;

· stancld opened on Mar 2, 2023

Add OKS metric

enhancementNew feature or requestNew feature or request

New metric

Status: Open.

#1361 In Lightning-AI/torchmetrics;

· MihailMihaylov97 opened on Nov 24, 2022

Parameter of MulticlassStatScores and MultilabelStatScores to control which classes/labels to include the averages

enhancementNew feature or requestNew feature or request

Status: Open.

#1723 In Lightning-AI/torchmetrics;

· plonerma opened on Apr 21, 2023

Support masks in audio metrics

enhancementNew feature or requestNew feature or request

topic: Audio

Status: Open.

#1735 In Lightning-AI/torchmetrics;

· pfeatherstone opened on Apr 25, 2023

Add Precision-Recall-Gain curve, Area Under Precision Recall Gain curve, and FGain1 score

enhancementNew feature or requestNew feature or request

Status: Open.

#1775 In Lightning-AI/torchmetrics;

· siemdejong opened on May 11, 2023

Allow arbitrary types for metric states

enhancementNew feature or requestNew feature or request

questionFurther information is requestedFurther information is requested

Status: Open.

#987 In Lightning-AI/torchmetrics;

· LarsHill opened on Apr 26, 2022

<code>binary_auroc</code> has various bugs on MPS device

bug / fixSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

v0.11.x

Status: Open.

#1727 In Lightning-AI/torchmetrics;

· GabrielDamsholt opened on Apr 23, 2023

Support for Torchvision Datapoints?

enhancementNew feature or requestNew feature or request

Status: Open.

#1846 In Lightning-AI/torchmetrics;

· edwardclem opened on Jun 17, 2023

Investigate use of <code>join</code> context for distributed sync

distributedDDP, etc.DDP, etc.

enhancementNew feature or requestNew feature or request

Status: Open.

#1338 In Lightning-AI/torchmetrics;

· SkafteNicki opened on Nov 15, 2022

Implement the Brier score and it's decomposition into resolution, reliability and uncertainty.

enhancementNew feature or requestNew feature or request

New metric

Status: Open.

#2196 In Lightning-AI/torchmetrics;

· konstantinos-p opened on Oct 31, 2023

add optional ignore_index in all metrics

enhancementNew feature or requestNew feature or request

Status: Open.

#2273 In Lightning-AI/torchmetrics;

· fabricecarles opened on Dec 18, 2023

Add a CW-SSIM support for torchmetrics

enhancementNew feature or requestNew feature or request

New metric

Status: Open.

#2428 In Lightning-AI/torchmetrics;

· michael080808 opened on Mar 5, 2024

Contribution: Add new audio/speech metrics for generative audio

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

New metric

topic: Audio

Status: Open.

#2464 In Lightning-AI/torchmetrics;

· d-caviedes opened on Mar 20, 2024

Ordinal classification metrics

enhancementNew feature or requestNew feature or request

New metric

Status: Open.

#2509 In Lightning-AI/torchmetrics;

· Zhylkaaa opened on Apr 18, 2024

Need higher level RAG metrics

enhancementNew feature or requestNew feature or request

Importantmilestonishmilestonish

New metric

Status: Open.

#2598 In Lightning-AI/torchmetrics;

· devinbost opened on Jun 14, 2024