AJev lora7 (Gemma 4 12B) vs Cloudflare clef-flash
AJev lora7 (Gemma 4 12B) is more accurate on the Jev Decision Index, Cloudflare clef-flash is better calibrated. Choose on whichever of accuracy, calibration and cost matters most for your decisions.
| Spec | AJev lora7 (Gemma 4 12B) | Cloudflare clef-flash |
|---|---|---|
| Provider | andyzhang232 | Cloudflare |
| Decision Index score | 50.7 | 47.6 |
| Calibration error (ECE) | 0.082 | 0.025 |
| Median latency (p50) | 69 ms | 53 ms |
| Cost per 1,000 decisions | — | — |
| Parameters | 12B | 10B |
| Open weights | Yes | Yes |
| Question types | Choice (one of N options), Score (ordered rubric), Yes / no | Choice (one of N options), Score (ordered rubric), Yes / no |
| Mechanism | Decoder LM with a decision readout | Decoder LM with a decision readout |
| License | apache-2.0 | apache-2.0 |
FAQ
Is AJev lora7 (Gemma 4 12B) or Cloudflare clef-flash more accurate?
AJev lora7 (Gemma 4 12B) scores higher on the Jev Decision Index (50.7 vs 47.6).
Which is better calibrated, AJev lora7 (Gemma 4 12B) or Cloudflare clef-flash?
Cloudflare clef-flash has the lower expected calibration error (0.025 vs 0.082), so its stated confidence is closer to how often it is right.
Is AJev lora7 (Gemma 4 12B) or Cloudflare clef-flash cheaper per 1,000 decisions?
A hosted price is not recorded for both models; open-weight models cost the compute you run them on.
Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.