← All posts

Tagged With

attention

1 post connected to this tag.

Jun 5, 2026

Softmax: The Probability Engine

Lab note Companion post to the Softmax carousel. Previously: Matrix Wx+b: From Scalars To Transformers. The previous post was about the moment a scalar weighted sum grew into a matrix multip...

Read post →

Subscribe

Get my rants delivered to your inbox

I will send new posts as and when I write. No fixed cadence, just engineering notes, rants, and things I am thinking through.

ShivasNotes

Engineering notes, A.I. workflow, drones, systems programming, and the messy process of building in public.

Explore

Connect