Skip to content

Cloudflare clef vs vLLM-SR Decision 2.0 Sol 2B

Cloudflare clef is more accurate on the Jev Decision Index, vLLM-SR Decision 2.0 Sol 2B is better calibrated. Choose on whichever of accuracy, calibration and cost matters most for your decisions.

SpecCloudflare clefvLLM-SR Decision 2.0 Sol 2B
ProviderCloudflarevLLM Semantic Router
Decision Index score53.127.1
Calibration error (ECE)0.0400.037
Median latency (p50)102 ms26 ms
Cost per 1,000 decisions——
Parameters28B2B
Open weightsYesYes
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismDecoder LM with a decision readoutDecoder LM with a decision readout
Licenseapache-2.0apache-2.0

FAQ

Is Cloudflare clef or vLLM-SR Decision 2.0 Sol 2B more accurate?

Cloudflare clef scores higher on the Jev Decision Index (53.1 vs 27.1).

Which is better calibrated, Cloudflare clef or vLLM-SR Decision 2.0 Sol 2B?

vLLM-SR Decision 2.0 Sol 2B has the lower expected calibration error (0.037 vs 0.040), so its stated confidence is closer to how often it is right.

Is Cloudflare clef or vLLM-SR Decision 2.0 Sol 2B cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.