New Action 3

Jun 9, 2026

Tokenization: The First Decision That Shapes Everything

Lab note Companion post to the Tokenization carousel. Previously: Positional Encoding: Teaching Transformers Where To Look. Tokenization is the first place where text stops being human langu...

Read post →

Jun 8, 2026

Positional Encoding: Teaching Transformers Where To Look

Lab note Companion post to the Positional Encoding carousel. Previously: LayerNorm And RMSNorm: Stabilizing The Signal. Transformers are brilliant at reading an entire sequence in parallel, ...

Read post →

Jun 7, 2026

LayerNorm And RMSNorm: Stabilizing The Signal

Lab note Companion post to the LayerNorm & RMSNorm carousel. Watch the companion video: Why LayerNorm and RMSNorm Matter in a C LLM Runtime. Previously: Activation Functions: The Nonlinearit...

Read post →

Jun 6, 2026

Activation Functions: The Nonlinearity Inside Neural Networks

Lab note Companion post to the Activation Functions carousel. Previously: Softmax: The Probability Engine. The previous Softmax post ended with a strange contrast. Softmax was beautifully sm...

Read post →

Jun 5, 2026

Softmax: The Probability Engine

Lab note Companion post to the Softmax carousel. Previously: Matrix Wx+b: From Scalars To Transformers. The previous post was about the moment a scalar weighted sum grew into a matrix multip...

Read post →

Jun 4, 2026

Matrix Wx+b: From Scalars To Transformers

A step-by-step explanation of how scalar wx+b becomes matrix Wx+b, how shape rules govern transformer layers, and why GEMM is the physical kernel underneath modern models.

Read post →

Jun 3, 2026

Backpropagation From wx+b: The Smallest Training Loop

Lab note This is the companion post to today's backprop-wxplusb carousel. I wanted a version with more room for the pictures, the algebra, and the engineering intuition. Previous post in thi...

Read post →

May 31, 2026

Why I Build Things From Scratch

Why I keep building systems from scratch: Antsand, C Kernel Engine, and my flight-controller stack all come from the same instinct to understand primitives, remove bloat, think like a compil...

Read post →

May 31, 2026

Training SVGs With C Kernel Engine: A Research Report

A research-style report on training small C Kernel Engine models to emit SVG-oriented DSLs, showing why lower loss is not enough, how tokenizer and compiler contracts shaped the work, and wh...

Read post →

May 29, 2026

Hardening My Linux Engineering Workflow

I am slowly moving more of my engineering life back into Linux. Not as a slogan. As a workflow. This is part two of my hardening series. Part one was Hardening Long Projects in the Age of A...

Read post →

May 26, 2026

What Is the C Kernel Engine?

Abstract / Executive Summary C Kernel Engine is an AI LLM inference and training engine optimized for CPUs. It takes model weights, model configuration, and computational graph templates, th...

Read post →

May 24, 2026

Is the Future of My Work Writing, Typing, Drawing, and Orchestrating?

For the last few months, I have been noticing a strange shift in my work. I am still building software. I am still thinking about AI runtimes, Linux, C Kernel Engine, Antsand, content system...

Read post →

May 20, 2026

Qwen3 From a C Runtime Perspective

Qwen3 is not just a model name inside C Kernel Engine. It is a concrete runtime target: a GGUF file, a model configuration, a set of tensor shapes, a generated C runtime, a packed weight blo...

Read post →

May 15, 2026

Hardening Long Projects in the Age of AI

Images generated by chatGPTI have been thinking a lot about hardening lately, especially with Antsand. Not hardening in the dramatic cybersecurity movie sense. I mean the boring kind of hard...

Read post →

Apr 21, 2026

Why I Stopped Getting High on the Newer AI Models (And Why My Strategic Bet Is Still Consistent: CPUs, Smaller Models, and Less Compute Will Win)

Last week, Claude Opus 4.7 "got released." And the Anthropic team is doing what Americans are genius at: marketing, marketing, marketing. The whole Claude, OpenAI, Gemini saga is the same pl...

Read post →

C-Kernel-Engine

Tokenization: The First Decision That Shapes Everything

Positional Encoding: Teaching Transformers Where To Look

LayerNorm And RMSNorm: Stabilizing The Signal

Activation Functions: The Nonlinearity Inside Neural Networks

Softmax: The Probability Engine

Matrix Wx+b: From Scalars To Transformers

Backpropagation From wx+b: The Smallest Training Loop

Why I Build Things From Scratch

Training SVGs With C Kernel Engine: A Research Report

Hardening My Linux Engineering Workflow

What Is the C Kernel Engine?

Is the Future of My Work Writing, Typing, Drawing, and Orchestrating?

Qwen3 From a C Runtime Perspective

Hardening Long Projects in the Age of AI

Why I Stopped Getting High on the Newer AI Models (And Why My Strategic Bet Is Still Consistent: CPUs, Smaller Models, and Less Compute Will Win)

ShivasNotes

Explore

Connect

Subscribe

Subscribe to emails from Anthony

ShivasNotes

Explore

Connect