Jonna Marie Matthiesen
Add accuracy tables, RTX 3500 Ada latency, and fix 270M variant grouping
7671b7c Download data/acc-Llama-3.2.csv from embedl/Edge-Inference-Benchmarks: direct link, hf CLI and curl.
- Browser
- Download file 327 Bytes
-
https://huggingface.co/spaces/embedl/Edge-Inference-Benchmarks/resolve/c665bdcb92d0fa886ac38fde43ac79c2d6b1f407/data/acc-Llama-3.2.csv
- Command line
-
hf download hf://spaces/embedl/Edge-Inference-Benchmarks@c665bdcb92d0fa886ac38fde43ac79c2d6b1f407/data/acc-Llama-3.2.csv
-
curl -L -o acc-Llama-3.2.csv https://huggingface.co/spaces/embedl/Edge-Inference-Benchmarks/resolve/c665bdcb92d0fa886ac38fde43ac79c2d6b1f407/data/acc-Llama-3.2.csv
327 Bytes
| Model,MMLU-Pro,HellaSwag,IFEval,BoolQ,BBH,TruthfulQA,GSM8K | |
| meta-llama/Llama-3.2-1B-Instruct,0.18,0.59,0.45,0.69,0.38,0.36,0.46 | |
| embedl/Llama-3.2-1B-Instruct-FlashHead,0.18,0.59,0.45,0.69,0.38,0.36,0.46 | |
| meta-llama/Llama-3.2-3B-Instruct,0.31,,0.57,,0.57,0.57,0.77 | |
| embedl/Llama-3.2-3B-Instruct-FlashHead,0.31,,0.56,,0.57,0.58,0.77 | |