Skip to content

ScaleDown Classify-1 vs Saina Helm 2.0

ScaleDown Classify-1 and Saina Helm 2.0 have no measured difference in accuracy, calibration or cost in our data yet.

SpecScaleDown Classify-1Saina Helm 2.0
ProviderScaleDownSaina
Decision Index score—20.8
Calibration error (ECE)—0.247
Median latency (p50)—39 ms
Cost per 1,000 decisions$0.0080—
Parameters—853M
Open weightsNoYes
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismEncoder classifierDecoder LM with a decision readout
Licenseproprietaryapache-2.0

FAQ

Is ScaleDown Classify-1 or Saina Helm 2.0 more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, ScaleDown Classify-1 or Saina Helm 2.0?

No calibration difference between ScaleDown Classify-1 and Saina Helm 2.0 is recorded yet.

Is ScaleDown Classify-1 or Saina Helm 2.0 cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.