Typed Decisions (agreement with teacher) Leaderboard
decision-synthetic10 models · Updated October 2026
On the Typed Decisions (agreement with teacher) benchmark, meraGPT Decider 1 ranks #1 with a score of 0.8. The full ranking, with cost per million tokens, is below.
| # | Model | Score | ECE | p50 latency | Input / 1M |
|---|---|---|---|---|---|
| 1 | meraGPT Decider 1meraGPT (Okyasoft) | 0.8 | 0.180 | — | $0.03 |
| 2 | Liquid d1 (hosted)Liquid AI | 0.7 | 0.124 | — | — |
| 3 | JevTypeSafe AI | 0.7 | 0.144 | — | $0.04 |
| 4 | SimpleJev Qwen3.6-35B-A3B (Featherless)Featherless AI | 0.7 | — | — | $0.00 |
| 5 | Bekko System One v0 400Mhotchpotch | 0.7 | 0.143 | — | — |
| 6 | Jeff-Gemma4-E2Bjeff-legacy | 0.6 | 0.188 | — | — |
| 7 | Bekko System One v0 68Mhotchpotch | 0.5 | 0.116 | — | — |
| 8 | Jeff-Qwen3.5-2Bjeff-legacy | 0.5 | 0.203 | — | — |
| 9 | Bekko System One v0 17Mhotchpotch | 0.5 | 0.136 | — | — |
| 10 | Jeff-Qwen3.5-0.8Bjeff-legacy | 0.5 | 0.251 | — | — |
Frequently asked questions
What is the Typed Decisions (agreement with teacher) benchmark?
Typed Decisions (agreement with teacher) is a decision-synthetic used to evaluate and rank large language models. This page lists 10 models by their Typed Decisions (agreement with teacher) score.
Which model is best on Typed Decisions (agreement with teacher)?
meraGPT Decider 1 (meraGPT (Okyasoft)) currently leads the Typed Decisions (agreement with teacher) leaderboard with a score of 0.8.
What is the best value model on Typed Decisions (agreement with teacher)?
Pricing data is being matched to these models.
Pricing is indicative — confirm with the provider before production use. Updated October 2026.