vLLM-SR d3-lite (0.8B)
vLLM-SR d3-lite (0.8B) by vLLM Semantic Router is a decision model: it answers typed questions with a probability for each allowed answer instead of generating text. It scores 32.3 on the Jev Decision Index (rank 101).
Pricing
No hosted price is listed. The weights are open: the cost is your own compute.
Specifications
- Provider
- vLLM Semantic Router
- Parameters
- 853M
- Released
- Oct 2026
- Open weights
- Yes
- Question types
- Choice (one of N options), Score (ordered rubric), Yes / no
- Mechanism
- Decoder LM with a decision readout
- Backbone
- Qwen/Qwen3.5-0.8B
- Jev-compatible request
- Yes
- Runs on CPU
- Yes
- License
- apache-2.0
- Hugging Face
- vllm-sr/d3-lite
Benchmarks
- Jev Decision IndexECE 0.094
- 32.3
- Jev Decision Index — VisionECE 0.077
- 42.1
Jev Decision Index: public 36.9, ECE 0.094, Brier 0.508. Lower ECE means its probabilities can be taken at face value.
Speed & latency
Compare vLLM-SR d3-lite (0.8B) with…
FAQ
How much does vLLM-SR d3-lite (0.8B) cost?
vLLM-SR d3-lite (0.8B) has no hosted price listed; its weights are open, so the cost is the compute you run it on.
What questions can vLLM-SR d3-lite (0.8B) answer?
vLLM-SR d3-lite (0.8B) answers choice (one of n options), score (ordered rubric), yes / no questions, returning a probability for each allowed answer.
Is vLLM-SR d3-lite (0.8B) well calibrated?
On the Jev Decision Index its expected calibration error (ECE) is 0.094; below about 0.05, a stated 80% confidence is right roughly 80% of the time.
Is vLLM-SR d3-lite (0.8B) open weight, and can it run on a CPU?
Yes, vLLM-SR d3-lite (0.8B) has open weights. It is small enough to run on a CPU.
Data as of 2026-10-14. Source: Metatext decision-model catalogue, 2026-10-14 (Jev Decision Index, Hugging Face). Pricing is per 1M tokens (USD); confirm with the provider before production use.