Add some basic analysis

[bluecoconut]

As per https://x.com/GregKamradt/status/1870185940641296670

I did some quick analysis and wanted to share the code.

running uv run analysis.py open_ai_o3_high_20241220 open_ai_o3_low_20241220

Most correlated feature to scores are all area of task correlated variables (based out of the set of features computed so far)

Here are some of the plots that it generates.

This script can serve as a starting point if anyone wants to add other features or check for other variables.

I gitignored the 'plots' directory (which includes all the .pngs it produces as well as the report.html file)

To view the report i run uv run --python 3.12.0 -m http.server 8000 and browse to report.html

To fully reproduce and view results, navigate to the analysis directory and run:

uv run analysis.py open_ai_o3_high_20241220 open_ai_o3_low_20241220
uv run --python 3.12.0 -m http.server 8000