Skip to content

Add real-article reference lists to test-sets/real-articles/ #3

@cpitzi

Description

@cpitzi

Summary

We've run the auditor against several real published articles but the reference lists and results haven't been committed to the repo. These are needed for ongoing false-positive rate validation.

Known completed audits

The following articles have been audited in previous sessions:

  • Hawkins (2025) — JOGNN
  • Dziadkowiec (2025) — JOGNN
  • Cardon & Karr (2026) — (journal TBD)
  • Phan, Bethune, & Lathrop (2026) — (journal TBD)

Acceptance Criteria

  • Each article's reference list saved as test-sets/real-articles/{first-author-year}.md
  • Table in test-sets/real-articles/README.md updated with article name, journal, date tested, and result summary
  • ≥90% Defensible classification rate for clean articles (anything lower indicates false-positive drift)

Notes

Extract reference lists from the original articles. If the full reference list isn't available from a prior chat session, re-extract from the published PDF.

Metadata

Metadata

Assignees

No one assigned

    Labels

    testingTest sets and validationv3Current production version

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions