A stage-by-stage comparison of how modern open models are actually made, built from families that publish enough to be diffed: weights, data, training code, checkpoints, and the reasoning in their tech reports. Every part takes one stage of the pipeline and lines the families up at that stage: who did what, what the alternative was, what it cost, what it bought, and what the published numbers say the difference was worth.
Two anchor families carry the spine: NVIDIA Nemotron, the industrial anchor, and IFM K2-Horizon, the transparency anchor (not Moonshot's Kimi K2; the study corrects that on day one). Kimi K2 is the contrast case, and OLMo, SmolLM, Apertus, Marin, LLM360, and Granite form the fully open supporting cast. Every part ends with the cyber read: what the stage means for building cyber models. Engineer voice throughout; every load-bearing term is in the glossary.
The comparison spine: matched sizes
A dense model has one size. A Mixture-of-Experts model has two: total parameters (what you store and load) and active parameters (what computes each token, and what your speed and cost feel like). Every comparison in this study states both. Full treatment in Piece 0.
| Band | The fight | Why it matters |
|---|---|---|
| Sub-1B to 2B | SmolLM2, OLMo 2 1B, K2-Horizon 0.9B | The fully open world owns this band. Cheap enough to retrain, so every claim is rerunnable. |
| 3B compute band | SmolLM3 and Granite 4.0 Micro (dense) vs Nemotron 3 Nano and Moonlight (3B active, MoE) | Same compute per token, four different answers to where the parameters should live. |
| 7B to 9B dense | OLMo 2 and 3, Marin 8B, Apertus 8B, DCLM 7B, Granite 4.1 8B, K2-Horizon 7B, Nemotron Nano 9B v2 | The most crowded and best documented band, with controlled experiment sets inside the Nemotron line. |
| 22B to 32B shelf band | OLMo 32B, K2-Horizon 32B and 36B MoVA, Nemotron 3 Nano 30B-A3B, 3.5 Lightning; Kimi K2 computes here at 32B active | The masterclass sweet spot: same shelf size, wildly different recipes. |
| 65B to 70B | Apertus 70B vs LLM360 K2-65B | Same size, same openness grade, different eras. NVIDIA has no from-scratch entry here, which is itself a finding. |
| 100B to 120B | Nemotron 3 Super 120B-A12B, alone | A genuine gap: no fully open family publishes a complete pipeline at this size. |
| 340B and up | Nemotron-4 340B vs Nemotron 3 Ultra 550B-A55B, K2-Horizon 375B between them, Kimi K2 at 1T | Old flagship recipe against modern recipe, where the openness gap is widest. |
Start with Piece 0, or open any part. Search loads a plain-text index of all parts, glossary entries, and rosters on first use.