Skip to content

Bespoke Nimble 9B v3 vs amos-1-large

Bespoke Nimble 9B v3 and amos-1-large have no measured difference in accuracy, calibration or cost in our data yet.

SpecBespoke Nimble 9B v3amos-1-large
ProviderBespoke LabsScira (mukaddamzaid)
Decision Index score54.7—
Calibration error (ECE)0.123—
Median latency (p50)74 ms—
Cost per 1,000 decisions——
Parameters10B—
Open weightsYesYes
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismDecoder LM with a decision readoutDecoder LM with a decision readout
Licensecc-by-nc-4.0apache-2.0

FAQ

Is Bespoke Nimble 9B v3 or amos-1-large more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, Bespoke Nimble 9B v3 or amos-1-large?

No calibration difference between Bespoke Nimble 9B v3 and amos-1-large is recorded yet.

Is Bespoke Nimble 9B v3 or amos-1-large cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.