Jul 14, 2026
Nemotron Kernels From Inference To Backpropagation
A visual, source-linked derivation of Nemotron inference, training forward, backpropagation, and quantization across Mamba2, attention, ReLU2, and routed experts.
Read post →Tagged With
3 posts connected to this tag.
Jul 14, 2026
A visual, source-linked derivation of Nemotron inference, training forward, backpropagation, and quantization across Mamba2, attention, ReLU2, and routed experts.
Read post →
Jul 13, 2026
How Nemotron mixes recurrent state, attention, dense MLP, and routed experts, and why exact routing becomes a CPU memory and scheduling problem.
Read post →Jul 3, 2026
C-Kernel-Engine architecture note Nemotron-style hybrid models are interesting to C-Kernel-Engine because they stop looking like a simple stack of attention plus MLP blocks. A runtime has to...
Read post →I write about the maths, the kernels, and what happens when I try to make them work. Join me for the investigations, including the bits that go wrong.
Get the illustrated field guide by email, followed by engineering notes as I write them.