Add eval results for LocalLLaMA/typed-decisions (specialist)

#1
.eval_results/rahulkumar0612__lazydecider-0.8b.yaml ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: LocalLLaMA/typed-decisions
3
+ task_id: accuracy
4
+ value: 0.77
5
+ date: "2026-10-23"
6
+ source:
7
+ url: https://huggingface.co/datasets/LocalLLaMA/typed-decisions
8
+ name: "Typed Decisions benchmark run on HF Jobs"
9
+ notes: "Model was fitted/fine-tuned on this benchmark's train split; not comparable with zero-shot rows."
10
+ - dataset:
11
+ id: LocalLLaMA/typed-decisions
12
+ task_id: kl_from_gold
13
+ value: 0.0938
14
+ date: "2026-10-23"
15
+ source:
16
+ url: https://huggingface.co/datasets/LocalLLaMA/typed-decisions
17
+ name: "Typed Decisions benchmark run on HF Jobs"
18
+ notes: "Model was fitted/fine-tuned on this benchmark's train split; not comparable with zero-shot rows."
19
+ - dataset:
20
+ id: LocalLLaMA/typed-decisions
21
+ task_id: brier
22
+ value: 0.051
23
+ date: "2026-10-23"
24
+ source:
25
+ url: https://huggingface.co/datasets/LocalLLaMA/typed-decisions
26
+ name: "Typed Decisions benchmark run on HF Jobs"
27
+ notes: "Model was fitted/fine-tuned on this benchmark's train split; not comparable with zero-shot rows."
28
+ - dataset:
29
+ id: LocalLLaMA/typed-decisions
30
+ task_id: ece
31
+ value: 0.1454
32
+ date: "2026-10-23"
33
+ source:
34
+ url: https://huggingface.co/datasets/LocalLLaMA/typed-decisions
35
+ name: "Typed Decisions benchmark run on HF Jobs"
36
+ notes: "Model was fitted/fine-tuned on this benchmark's train split; not comparable with zero-shot rows."