Skip to content

amos-1-medium vs mmastrac diffusiongemma (vLLM PR 57250)

amos-1-medium and mmastrac diffusiongemma (vLLM PR 57250) have no measured difference in accuracy, calibration or cost in our data yet.

Specamos-1-mediummmastrac diffusiongemma (vLLM PR 57250)
ProviderScira (mukaddamzaid)mmastrac
Decision Index score—36.3
Calibration error (ECE)—0.202
Median latency (p50)—127 ms
Cost per 1,000 decisions——
Parameters—26B
Open weightsYesYes
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismDecoder LM with a decision readoutDiffusion LM
Licenseapache-2.0—

FAQ

Is amos-1-medium or mmastrac diffusiongemma (vLLM PR 57250) more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, amos-1-medium or mmastrac diffusiongemma (vLLM PR 57250)?

No calibration difference between amos-1-medium and mmastrac diffusiongemma (vLLM PR 57250) is recorded yet.

Is amos-1-medium or mmastrac diffusiongemma (vLLM PR 57250) cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.