-
Notifications
You must be signed in to change notification settings - Fork 0
Add real-article reference lists to test-sets/real-articles/ #3
Copy link
Copy link
Open
Labels
testingTest sets and validationTest sets and validationv3Current production versionCurrent production version
Description
Summary
We've run the auditor against several real published articles but the reference lists and results haven't been committed to the repo. These are needed for ongoing false-positive rate validation.
Known completed audits
The following articles have been audited in previous sessions:
- Hawkins (2025) — JOGNN
- Dziadkowiec (2025) — JOGNN
- Cardon & Karr (2026) — (journal TBD)
- Phan, Bethune, & Lathrop (2026) — (journal TBD)
Acceptance Criteria
- Each article's reference list saved as
test-sets/real-articles/{first-author-year}.md - Table in
test-sets/real-articles/README.mdupdated with article name, journal, date tested, and result summary - ≥90% Defensible classification rate for clean articles (anything lower indicates false-positive drift)
Notes
Extract reference lists from the original articles. If the full reference list isn't available from a prior chat session, re-extract from the published PDF.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
testingTest sets and validationTest sets and validationv3Current production versionCurrent production version