Jonna Marie Matthiesen
Add accuracy tables, RTX 3500 Ada latency, and fix 270M variant grouping
7671b7c Download data/acc-Gemma-3.csv from embedl/Edge-Inference-Benchmarks: direct link, hf CLI and curl.
- Browser
- Download file 145 Bytes
-
https://huggingface.co/spaces/embedl/Edge-Inference-Benchmarks/resolve/c665bdcb92d0fa886ac38fde43ac79c2d6b1f407/data/acc-Gemma-3.csv
- Command line
-
hf download hf://spaces/embedl/Edge-Inference-Benchmarks@c665bdcb92d0fa886ac38fde43ac79c2d6b1f407/data/acc-Gemma-3.csv
-
curl -L -o acc-Gemma-3.csv https://huggingface.co/spaces/embedl/Edge-Inference-Benchmarks/resolve/c665bdcb92d0fa886ac38fde43ac79c2d6b1f407/data/acc-Gemma-3.csv
145 Bytes
| Model,MMLU-Pro,IFEval,BBH,TruthfulQA,GSM8K | |
| google/gemma-3-1b-it,0.15,0.55,0.38,0.31,0.42 | |
| embedl/gemma-3-1b-it-FlashHead,0.15,0.49,0.38,0.31,0.39 | |