Blog

AllResearchEngineering
Newest first
Valley of Ten Thousand Smokes, Alaska. Photo: National Park Service (public domain)Valley of Ten Thousand Smokes, Alaska. Photo: National Park Service (public domain)

We Built Our Own Post-Training Stack to Measure What Our Tasks Are Worth

post-training-stack
Oct 29, 2026Engineering
Zhe Li, Evan Jolley, Bartosz Mielczarek, Yoshinari Fujinuma, Abdelrahman Madkour, Tobi Akomolede
Lower Falls of the Yellowstone, Wyoming. Photo: NPS, Yellowstone National Park (public domain)Lower Falls of the Yellowstone, Wyoming. Photo: NPS, Yellowstone National Park (public domain)

Introducing SpeedrunBench: A Challenging Benchmark for Frontier Agents

introducing-speedrunbench-a-challenging-benchmark-for-frontier-agents
Sep 3, 2026Research
Yoshinari Fujinuma, Varun Prashant Gangal, Martyna Markiewicz, Shivani Jain, Abdelrahman Madkour, Rebecca Qian, Anand Kannappan
Corona Arch, Moab, Utah. Photo: Vulturesong (CC0)Corona Arch, Moab, Utah. Photo: Vulturesong (CC0)

Introducing FigmaTrace: A Comprehensive Training Dataset for Figma Design Workflows

figmatrace-a-comprehensive-training-dataset-for-figma-design-workflows
Aug 20, 2026Research
Darshan Deshpande, Yoshinari Fujinuma, Martyna Markiewicz, Devanshu Bansal, Shivani Jain, Nicholas Saban, Chirag Maheshwari, Anand Kannappan
Supercell over Vrana Lake, Croatia. Photo: Šime Barešić (CC0)Supercell over Vrana Lake, Croatia. Photo: Šime Barešić (CC0)

Getting GLM-5.2 NVFP4 Post-Training Off the Ground

getting-glm-5-2-nvfp4-post-training-off-the-ground
Jul 8, 2026Engineering
Yoshinari Fujinuma, Varun Prashant Gangal, Zhe Li
Alabama Hills and the Sierra Nevada, California. Photo: Bureau of Land Management, California (public domain)Alabama Hills and the Sierra Nevada, California. Photo: Bureau of Land Management, California (public domain)

Introducing Generative Simulators: Autonomously Scaling Environments for Agents

introducing-generative-simulators
Dec 17, 2025Research
Rebecca Qian, Darshan Deshpande, Varun Prashant Gangal, Li Siyan
Ice cave, Mendenhall Glacier, Alaska. Photo: Forest Service Alaska Region, USDA (public domain)Ice cave, Mendenhall Glacier, Alaska. Photo: Forest Service Alaska Region, USDA (public domain)

Introducing MEMTRACK: A Benchmark for Agent Memory

memtrack
Oct 14, 2025Research
Darshan Deshpande, Varun Prashant Gangal, Hersh Mehta
Kelso Dunes, Mojave, California. Photo: NPS, Joshua Tree National Park (public domain)Kelso Dunes, Mojave, California. Photo: NPS, Joshua Tree National Park (public domain)

Introducing TRAIL: A Benchmark for Agentic Evaluation

introducing-trail-a-benchmark-for-agentic-evaluation
Jun 5, 2025Research
Chinmayee Kulkarni, Darshan Deshpande
Bald cypress swamp. Photo: Ryan Hagerty, USFWS (public domain)Bald cypress swamp. Photo: Ryan Hagerty, USFWS (public domain)

Introducing BLUR: A Benchmark for Tip-of-the-Tongue Search and Reasoning

the-blur-benchmark-browsing-lost-unformed-recollections
Apr 2, 2025Research
Anand Kannappan, Sky CH-Wang