Click any tag below to further narrow down your results
Links
Fast, general-purpose classifiers like Jev can be used as temporary solutions for specific tasks, then replaced with cheaper, faster custom classifiers trained on the input-output data the Jev instance generated. This creates a practical path for engineering teams without ML expertise to eventually build optimized task-specific models.
- System One models solve the immediate problem of deploying classifiers without ML expertise or large datasets — you just prompt them like an LLM
- Once a System One model proves a feature works, you can collect its decisions as training data to build a specialized classifier that's faster and cheaper to run
- This pattern lets teams validate whether a feature is worth building before investing in custom ML development, reducing risk and upfront cost
Jev is a new AI model that only outputs structured data instead of human language, making it dramatically faster (70-500ms vs seconds) and enabling real-time applications like playing Doom. The author argues this speed advantage could become a new computational primitive for AI, though he suspects competitors can replicate it using simpler inference tricks on existing models.
- Jev generates all structured output in a single forward pass instead of token-by-token, achieving 70-500ms response times compared to seconds for standard LLMs, fast enough to play real-time video games.
- The speed advantage likely doesn't require novel model architecture—you can achieve similar results by prefilling responses and generating only one constrained token with existing LLMs, suggesting Jev lacks a substantial technical moat.
- Structured output could unlock entirely new use cases beyond chatbots by injecting "100ms worth of dirt-cheap intelligence" at decision points throughout applications, though Jev won't match frontier LLMs in raw capability.