Jul 31, 2026
How CKE Made Qwen3.6 Prefill 2.6x Faster
How CKE used exact head parallelism and packed quantized kernels to accelerate Qwen3.6-27B Q4_K_M prefill 2.6x on one 5th Gen Xeon node, while remaining about 1.85x behind llama.cpp.
Read post →Tagged With
5 posts connected to this tag.
Jul 31, 2026
How CKE used exact head parallelism and packed quantized kernels to accelerate Qwen3.6-27B Q4_K_M prefill 2.6x on one 5th Gen Xeon node, while remaining about 1.85x behind llama.cpp.
Read post →Jul 20, 2026
Trace Qwen3.5's hybrid circuit, see how CKE X-ray finds numerical divergence, and separate exact runtime parity from the observed quality of a 0.8B model.
Read post →Jul 4, 2026
C-Kernel-Engine architecture note DeltaNet and SSM/Mamba are two ways to reduce the amount of unbounded attention history a model has to carry by introducing fixed-size learned state. They a...
Read post →
Jun 18, 2026
ML fundamentals · SIMD deep dive This ShivasNotes deep dive is written for CPU silicon teams evaluating kernel-level software competence. The subject is not “can the model run?” but “...
Read post →
Jun 16, 2026
Lab note This ShivasNotes lab note studies the alternative used by the Qwen3.5 / qwen3next recurrent path in C-Kernel-Engine: Gated DeltaNet, where the model stops trying to store every toke...
Read post →I write about the maths, the kernels, and what happens when I try to make them work. Join me for the investigations, including the bits that go wrong.
Get the illustrated field guide by email, followed by engineering notes as I write them.