Skip to content

Conversation

@AdnanElAssadi56
Copy link
Contributor

@AdnanElAssadi56 AdnanElAssadi56 commented Jan 5, 2026

The "N/A" format in revision messes up the directory structure in the Results Repo as it gets intepreted as two subdirectories.

languages=["eng-Latn"],
open_weights=True,
revision="N/A",
revision="no_revision",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this was added in other pr too

Copy link
Contributor Author

@AdnanElAssadi56 AdnanElAssadi56 Jan 6, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think so. I did the changes for the other models in their active PRs. These were already merged so created new one.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

isn't the revision: 30fcde30f19b87502b8435427b5f5068e401d5f6 and 53615c10408485422e09a12cda191a747f4bbe34
should we instead write:

30fcde30f19b87502b8435427b5f5068e401d5f6-53615c10408485422e09a12cda191a747f4bbe34 and just split the string on init?

Copy link
Member

@Samoed Samoed Jan 6, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think so. I did the changes for the other models in their active PRs. These were already merged so created new one.

I confused this with clap

isn't the revision: 30fcde30f19b87502b8435427b5f5068e401d5f6 and 53615c10408485422e09a12cda191a747f4bbe34 should we instead write:

30fcde30f19b87502b8435427b5f5068e401d5f6-53615c10408485422e09a12cda191a747f4bbe34 and just split the string on init?

Agree, this is good solution

Copy link
Contributor

@KennethEnevoldsen KennethEnevoldsen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we want no-revision. I suggested an alternative. We might need to make an exception in tests

languages=["eng-Latn"],
open_weights=True,
revision="N/A",
revision="no_revision",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

isn't the revision: 30fcde30f19b87502b8435427b5f5068e401d5f6 and 53615c10408485422e09a12cda191a747f4bbe34
should we instead write:

30fcde30f19b87502b8435427b5f5068e401d5f6-53615c10408485422e09a12cda191a747f4bbe34 and just split the string on init?

@AdnanElAssadi56
Copy link
Contributor Author

Done. I've also fixed directory structure in the Results Repo.

isaac-chung and others added 2 commits January 7, 2026 14:06
Merged latest changes from maeb branch and ran lint to fix formatting.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <[email protected]>
@isaac-chung isaac-chung merged commit a5c3751 into embeddings-benchmark:maeb Jan 7, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants