Skip to content

Conversation

@mdsage1
Copy link
Contributor

@mdsage1 mdsage1 commented Aug 12, 2025

Organizers would like to rank participant submissions for each task by using bootstrapping techniques previously employed in the 2024 Oflactory challenge.
Objectives:

  • Obtain 2024 bootstrapping R/Python scripts written by @vpchung and @gaiaandreoletti
  • Modify the scripts to align with current project specifications
  • Ensure that bootstrapping script is in Python
    - [x] Create Python scripts that mirror the R markdown scripts previously used
    - [x] Update packages/libraries to align with Python rather than R
    - [x] Ensure that the gold standard parameters have been updated to match the current gold standard formatting as the new gold standard has 20+ additional columns and none of the column names are the same
  • Ensure that results are formatted according to Organizer specifications

@mdsage1 mdsage1 self-assigned this Aug 12, 2025
@mdsage1 mdsage1 requested a review from vpchung August 12, 2025 21:53
@mdsage1 mdsage1 changed the title Add python file for bootstrapping submissions feat(bootstrapping_predictions): add bootstrapping of final round latest submissions Aug 13, 2025
@mdsage1
Copy link
Contributor Author

mdsage1 commented Oct 14, 2025

Organizers had issues with locating and downloading submissions data for post-challenge independent analysis. An additional script get_submissions.ipynb has been created, and provided to the Organizers, that pulls the most recent submission by team and the submissions data. The file will create a CSV for each task with all of the teams latest submissions. It's located in the 2025_analysis subfolder.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants