Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test Grok-3 #4

Open
youyc22 opened this issue Feb 24, 2025 · 2 comments
Open

Test Grok-3 #4

youyc22 opened this issue Feb 24, 2025 · 2 comments
Assignees
@mbalunovic

Comments

@youyc22
Copy link

youyc22 commented Feb 24, 2025

Have you guys considered testing grok-3?
@mbalunovic mbalunovic self-assigned this Feb 24, 2025
@mbalunovic
Copy link
Collaborator

Hi, we will evaluate Grok for the upcoming competitions once the API is released. As we don't evaluate models retroactively on past competitions that happened before their release, we will not go back and evaluate it on AIME'25 and HMMT.

@youyc22
Copy link
Author

youyc22 commented Feb 24, 2025

Hi, we will evaluate Grok for the upcoming competitions once the API is released. As we don't evaluate models retroactively on past competitions that happened before their release, we will not go back and evaluate it on AIME'25 and HMMT.

Thanks for answering

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mbalunovic mbalunovic

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@mbalunovic @youyc22