Jev AI tool · Benchmarks & research
jevmlx
jevmlx is a Jev AI ecosystem project that helps with running Jev-style constrained decisions locally on Apple Silicon without shipping every call to a hosted API. Schema-driven parallel constrained decisions for any MLX model on Apple Silicon — typed, schema-valid JSON from one forward pass.
What jevmlx does
jevmlx brings the Jev pattern — finite fields, logits scoring, JSON assembled in code — to local MLX models on M-series Macs. You declare a schema of booleans, enums, and multi-selects (Pydantic models work well), pass a context string, and receive a validated object plus per-field probabilities from a single batched prefill. There is no free-text generation step for the decision itself: each field’s allowed options are scored from logits and the winners become the payload. The CLI ships presets such as support triage, a local HTTP server, and model aliases (quality / fast / test) that resolve to mlx-community Qwen instruct checkpoints. Design guidance in the project stresses mutually exclusive options, escape hatches when the list may be incomplete, ordered enums for severity scales, and abstention thresholds fitted on labeled data. Choose jevmlx when Apple Silicon is your runtime and you want offline or low-latency typed decisions without depending on the TypeSafe hosted endpoint.
Where it fits in the Jev stack
- Local support-ticket triage on a MacBook without cloud round-trips
- Batch classification jobs over files already on disk
- Prototyping Choice / Score / Noul-style schemas before wiring a hosted key
Browse more in Benchmarks & research, or return to the Jev AI tools directory.
Install & try
Apple Silicon (M1+) and Python 3.12+. First model download is a few GB.
pip install git+https://github.com/bnsd55/jevmlxSource repository
Full docs, issues, and release history live on GitHub. This directory page is an independent overview for discovery inside the Jev AI tools catalog.
github.com/bnsd55/jevmlxThis site is an independent third-party directory of Jev AI tools and is not affiliated with, endorsed by, or operated by TypeSafe AI.