GLiClass instruct base v1.0
KnowledgatorOpen weights
The base-size instruction-tuned GLiClass.
- typed-decisions
- —
- Metatext suite
- 0.559
- ECE untuned
- 0.390
- p50 per case
- 323 ms
not run
3/7 over baseline
four CPU cores
Specifications
- Checkpoint
- knowledgator/gliclass-instruct-base-v1.0
- Publisher
- Knowledgator
- Mechanism
- Label-relevance classifier
- Backbone
- DeBERTa-v3-base, instruction-tuned
- Parameters
- ~190M
- License
- Apache 2.0
- Runs as
- open weights, self-hosted
- Library
- gliclass
- Primitives
- Choice, Noul
- Pricing
- none — your compute
Metatext decisionsrank 10 of 21
Full leaderboard →| Configuration | Mode | Decisions | Beats baseline | ECE |
|---|---|---|---|---|
| criteria + single-hypothesis Noul (correct payload)headline | serial | 0.559 | 3/7 | 0.390 |
| default payload | serial | 0.395 | 2/7 | 0.510 |
| criteria folded into labels | serial | 0.368 | 2/7 | 0.583 |
Per-question accuracy — criteria + single-hypothesis Noul (correct payload), serial mode, 120 judgments
| Task | Question | Type | Accuracy | Baseline | Beats? |
|---|---|---|---|---|---|
| agent_traces | outcome | choice | 0.429 | 0.357 | ✅ |
| agent_traces | needs_human | noul | 0.786 | 0.714 | ✅ |
| customer_service | department | choice | 0.800 | 0.400 | ✅ |
| customer_service | refund_requested | noul | 0.700 | 0.700 | ❌ |
| customer_service | frustration | score | 0.300 | 0.500 | ❌ |
| security_incidents | severity | choice | 0.250 | 0.312 | ❌ |
| security_incidents | actively_exploited | noul | 0.688 | 0.688 | ❌ |
Frequently asked questions
How does GLiClass instruct base v1.0 compare to Jev?
On the Metatext suite GLiClass instruct base v1.0 scores 0.559 against Jev's 0.863.
Is GLiClass instruct base v1.0 open source?
Yes. knowledgator/gliclass-instruct-base-v1.0 is released under Apache 2.0 and runs on your own hardware with the gliclass library.
Can GLiClass instruct base v1.0 extract entities?
No. GLiClass instruct base v1.0 answers questions about text and never returns spans; use a GLiNER-family model for extraction.