Jev: A Fast, Cheap Text Classifier

TypeSafe’s Jev is a zero-shot classifier that returns a distribution over a label set sent with the request, so ordinary code can act on neural judgements. TypeSafe reports it 193.6× faster and 444.6× cheaper than frontier LLMs; its quality still trails them.
LLMs
Machine Learning
Author

Ravi Kalia

Published

September 29, 2026

Jev: A Fast, Cheap Text Classifier

Many LLM calls ask for a label, not prose: spam or not, which team, how urgent. TypeSafe’s Jev is a zero-shot classifier for these. The request carries text and a label set; Jev returns a distribution over the labels without generating tokens.

Three answer types:

Typed answers let symbolic AI sit on top of neural AI. The network reads the text; ordinary code (rules, thresholds, expected-utility decisions) acts on its probabilities.

TypeSafe reports:

Quality still trails frontier LLMs; by TypeSafe’s notes, Jev counts unreliably. TypeSafe’s quality claim scores Jev against the average answer of two frontier LLMs: agreement, not accuracy. Its calibration claim, “higher confidence means higher accuracy”, describes monotonicity, which is weaker than calibration.

Typed. Probabilities. Feed. Code. Fast. Cheap. Not. Yet. Frontier.

References