Jul 6, 2026
How the Jacobian Matrix Works
.jacobian-matrix-post .math-block { display: block; max-width: 100%; overflow-x: auto; overflow-y: hidden; -webkit-overflow-scrolling: touch; margin: 1rem 0; padding: 0.85rem 1rem; border: 1...
Read post →Tagged With
10 posts connected to this tag.
Jul 6, 2026
.jacobian-matrix-post .math-block { display: block; max-width: 100%; overflow-x: auto; overflow-y: hidden; -webkit-overflow-scrolling: touch; margin: 1rem 0; padding: 0.85rem 1rem; border: 1...
Read post →Jul 4, 2026
C-Kernel-Engine architecture note DeltaNet and SSM/Mamba are two ways to reduce the amount of unbounded attention history a model has to carry by introducing fixed-size learned state. They a...
Read post →Jul 3, 2026
C-Kernel-Engine architecture note Nemotron-style hybrid models are interesting to C-Kernel-Engine because they stop looking like a simple stack of attention plus MLP blocks. A runtime has to...
Read post →
Jul 2, 2026
ML systems · Quantization internals This ShivasNotes deep dive is the granular companion to the broader Quantization Deep Dive in this series. The earlier post explained why quantization ma...
Read post →Jul 1, 2026
C-Kernel-Engine runtime comparison This post is a follow-up to the earlier thread-pool deep dive. The previous post built the pthread idea from first principles. This one asks the systems qu...
Read post →
Jun 26, 2026
Systems note A fast kernel is not just a loop. A fast kernel is a loop, a memory layout, a thread placement policy, a page-fault policy, and a measurement discipline running inside a real Li...
Read post →
Jun 23, 2026
AI kernel learning map This post is a bridge between the earlier ShivasNotes fundamentals series and the next long-form video: what AI kernels should you actually know if you want to underst...
Read post →
Jun 22, 2026
CPU performance engineering · C-Kernel-Engine This ShivasNotes deep dive is written for CPU silicon teams and systems engineers who need to understand not just whether an AI framework is fa...
Read post →
Jun 20, 2026
Quantization deep dive · ML fundamentals This ShivasNotes deep dive is written for CPU silicon teams evaluating whether C-Kernel-Engine really owns its quantized inference path. The answer ...
Read post →
Jun 19, 2026
ARM NEON · C-Kernel-Engine CKE has already run Qwen2 and Qwen3 on ARM Cortex-A72 hardware (TI TDA4VM). This is not a roadmap post. This is a “what we already ship” post. For ARM silicon...
Read post →I write about the maths, the kernels, and what happens when I try to make them work. Join me for the investigations, including the bits that go wrong.
Get the illustrated field guide by email, followed by engineering notes as I write them.