Agents at Scale: Inside MiniMax’s Model and the Infrastructure Behind It — Olive Song

Agents at Scale: Inside MiniMax’s Model and the Infrastructure Behind It — Olive Song

More

Descriptions:

In this conversation, Olive Song, who leads reinforcement learning at MiniMax, opens up the stack behind the company’s open weight models and the infrastructure that serves them. Her starting point is a belief in open source: put the weights out, let builders optimize on them, and share the capability widely. From there she walks through what it takes for a model to land well, from agentic coding that also understands and builds games, to computer use problems trained with RL against environments like OS World.

Much of the discussion is the unglamorous engineering that makes a launch real. When a model ships, the team wants the inference stack ready on day zero, which means writing and tuning GPU kernels, working through benchmarks like a parallel kernel bench, and threading optimization into everything from KV cache handling to routing. Song also talks through multimodality and the training pitfalls that come with it, such as text and vision collapsing after training unless you train both modalities together, and reflects on longer horizon tasks like replicating a twelve hour run. She closes optimistic that open models are closing the gap faster than a year ago would have suggested.

Speaker info:
– https://x.com/olive_jy_song

Timestamps:
0:00 – Introducing the RL lead at MiniMax
1:17 – Why open source and open weights
3:45 – What builders are doing with the model
4:11 – A model that builds games
5:12 – Computer use and OS World
5:49 – Writing GPU kernels
6:25 – Parallel kernel bench
7:28 – A day zero inference stack
9:34 – Optimization across the stack
10:47 – Multimodality and training collapse
14:10 – Replicating a twelve hour run
17:22 – Where open models go next

1 Item

Channels

1 Item

Companies