Related eval: REFUTE scientific critique + calibration

[connerlambden]

Proposal

Related eval pointer: REFUTE measures scientific critique honesty + calibration on recent paper summaries (judge-free; Brier/ECE). Critique skill and calibration often come apart.

• https://bgpt.pro/refute
• https://github.com/connerlambden/refute-inspect
• https://bio.tools/bgpt-refute
• https://ascl.net/code/v/4795
• https://doi.org/10.7910/DVN/IGAJWO (Dataverse, in review)

Happy to PR. contact@bgpt.pro