OpenAI's new endpoint picks from a fixed list in 150 milliseconds.
OpenAI put its Decisions API into public beta on Tuesday for app developers. It costs ten cents a million input tokens, and the answers are free. Only the gpt-6-luna model runs on it, and general release comes in weeks.
Why it mattersMost AI work is sorting and routing, not writing long answers. Cheap, fast sorting is what makes an assistant feel instant.