Open Jev research: a month of chasing coverage at 5% error
From 23 September to 12 October I tried to match TypeSafe's Jev with open models. Every 4B to 9B model I scored lands at 0.550 to 0.557 coverage at 5% error on the same 1,046 questions, and nothing I built under 1B got past Kev-0.8B's 0.276.
Oct 12, 20267 min read0 reactions0 comments