Sync request: Include ProKope-AI/ProKope-7B from live MMLU-Pro & GPQA APIs

#4
by AlanCantoFTW - opened

Hello OpenEvals team!

ProKope-AI/ProKope-7B (7.62B parameters, author: Alan Canto / @AlanCantoFTW) is now live and indexed on the official Hugging Face Dataset Leaderboard APIs queried by scripts/fetch_api_only.py:

  • MMLU-Pro (https://huggingface.co/api/datasets/TIGER-Lab/MMLU-Pro/leaderboard): 44.03% (Global Default Rank #93, Discussion #33)
  • GPQA Diamond (https://huggingface.co/api/datasets/Idavidrein/gpqa/leaderboard): 36.87% (Global Default Rank #108, Discussion #59)
  • Composite Aggregate Score: 40.45%

Could you trigger a run of scripts/fetch_api_only.py so OpenEvals/leaderboard-data and the OpenEvals/every-leaderboards Space pick up ProKope-AI/ProKope-7B in the composite table?

Thank you!

Sign up or log in to comment