Jul 6, 2026
How the Jacobian Matrix Works
.jacobian-matrix-post .math-block { display: block; max-width: 100%; overflow-x: auto; overflow-y: hidden; -webkit-overflow-scrolling: touch; margin: 1rem 0; padding: 0.85rem 1rem; border: 1...
Read post →Tagged With
10 posts connected to this tag.
Jul 6, 2026
.jacobian-matrix-post .math-block { display: block; max-width: 100%; overflow-x: auto; overflow-y: hidden; -webkit-overflow-scrolling: touch; margin: 1rem 0; padding: 0.85rem 1rem; border: 1...
Read post →Jul 4, 2026
C-Kernel-Engine architecture note DeltaNet and SSM/Mamba are two ways to reduce the amount of unbounded attention history a model has to carry by introducing fixed-size learned state. They a...
Read post →Jul 3, 2026
C-Kernel-Engine architecture note Nemotron-style hybrid models are interesting to C-Kernel-Engine because they stop looking like a simple stack of attention plus MLP blocks. A runtime has to...
Read post →
Jul 2, 2026
ML systems · Quantization internals This ShivasNotes deep dive is the granular companion to the broader Quantization Deep Dive in this series. The earlier post explained why quantization ma...
Read post →Jul 1, 2026
C-Kernel-Engine runtime comparison This post is a follow-up to the earlier thread-pool deep dive. The previous post built the pthread idea from first principles. This one asks the systems qu...
Read post →Jun 29, 2026
Systems note This post moves from model math into the machine that actually runs the kernels: cores, caches, NUMA domains, MPI ranks, RDMA-capable fabrics, and the memory-layout discipline n...
Read post →
Jun 26, 2026
Systems note A fast kernel is not just a loop. A fast kernel is a loop, a memory layout, a thread placement policy, a page-fault policy, and a measurement discipline running inside a real Li...
Read post →
Jun 14, 2026
AI Kernel Engineer Beginner Guide: Math, Linear Algebra, C/Linux Part 1: Beginner roadmap A viewer asked a useful question: “I know some C, some linear algebra, and some calculus. What are...
Read post →
May 26, 2026
Abstract / Executive Summary C Kernel Engine is an AI LLM inference and training engine optimized for CPUs. It takes model weights, model configuration, and computational graph templates, th...
Read post →May 20, 2026
Qwen3 is not just a model name inside C Kernel Engine. It is a concrete runtime target: a GGUF file, a model configuration, a set of tensor shapes, a generated C runtime, a packed weight blo...
Read post →I write about the maths, the kernels, and what happens when I try to make them work. Join me for the investigations, including the bits that go wrong.
Get the illustrated field guide by email, followed by engineering notes as I write them.