Another brilliant launch for developers: and its 20-200x faster than LLMs because it skips token-by-token gene
원본 및 링크
@DeRonin_
4 things to do when you get access to Jev: 1. don't replace your model, put Jev in front of it Jev makes the small choice first, and your expensive model only runs when it's really needed one email tool swapped 2 AI calls per email for 1 Jev call, and kept all their normal safety checks on a 120 ticket test: 42 seconds with Jev in front → 22 minutes without it cost: $0.0003 → $0.059 the person who ran that test said his slow version was slowed down even more by retry errors, so the real gap is smaller how to do it: - look through your code for AI calls that only choose something and never write text - write the list of possible answers in your own code, don't let the model invent them - send that list to Jev, and keep your old call as a backup - put it behind an on/off switch so you can undo it in one line - run both for a week and compare them before you delete the old one you're not rebuilding your product, you're replacing one call 2. ask 5 small questions instead of 1 big one someone tested Jev on 2,000 phishing emails ask it one big question and it gets 89.4% a simple 2 line text rule gets 91.8% Claude Haiku 4.5 asked the same question gets 94.2% so when it has to give the final answer alone, Jev loses even to a text rule then he asked 5 small questions instead, and added the answers up in his own code 95.0%, the best score in the whole test SAME MODEL, SAME EMAILS how to do it: - take the big question you were about to ask - write down the 5 things a pe
@aigclink
前OpenAI研究员Diogo Almeida发布了一款新型模型:Jev,一种“放弃生成文字只输出类型化概率决策”的模型 称速度快40–200倍,输入成本便宜5–238倍,输出接近免费 就是说把大模型从会聊天会写长文的生成器,改成软件可以直接调用的概率决策函数 用并行概率决策替代逐token字符串生成,主打结构化、可校准、低延迟、低成本 创始人Diogo Almeida称曾在OpenAI参与指令跟随/对话方法相关研究,他的问题是:模型聊天能力早已超过人,但真正可嵌入代码的自动化仍缺关键一环 Jev背后是一套全新栈:新架构、并行采样器以及新训练方法RLCD 像前沿智能函数调用,输入非结构化状态/程序状态,输出预先定义好的类型化概率决策。放弃自由字符串生成,换来无类型错误、schema内不生成非法/幻觉式输出,并自带置信度 它抢的应该是海量的微决策场景,每一次请求背后几十上百个小判断的基础设施层 可塞进业务系统里做判断器,作为分类、路由、打分、抽取,实时应用里的快速判断,工作流里的“智能if”等 如果真能把每次判断压到毫秒级、接近零输出成本、附带置信度,那这个还是有价值的 #Jev #新型模型
인용 게시물
After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x https://t.co/JSybNG2BKJ
원문 보기