performance

3 posts connected to this tag.

Aug 20, 2026

The Qwen3-VL CPU Gap vs llama.cpp: A Build Log That Keeps Getting Measured

CKE moved a Qwen3-VL OCR path from ~281s to ~76.7s against a llama.cpp baseline of ~55.8s — not a victory lap, a map. Revisited after the harness era: corpus certification, X-Ray parity, a...

Read post →

Aug 2, 2026

How CKE Made Whisper Faster In Two Days — And The Evidence That Makes It Believable

The two days after the July books closed The July recap closed its Whisper chapter at a 2.7x gap to whisper.cpp: 1.53–1.58 seconds on the controlled Base fixture against 0.567 seconds for ...

Read post →

Jul 31, 2026

How CKE Made Qwen3.6 Prefill 2.6x Faster

How CKE used exact head parallelism and packed quantized kernels to accelerate Qwen3.6-27B Q4_K_M prefill 2.6x on one 5th Gen Xeon node, while remaining about 1.85x behind llama.cpp.

Read post →

Get my rants delivered to your inbox

I will send new posts as and when I write. No fixed cadence, just engineering notes, rants, and things I am thinking through.

Need an intelligent system to work on real hardware?

Embedded systems · Robotics · Constrained AI · CPU and HPC · Accelerators · Distributed systems

Work With Us / Antshiv Robotics

See engineering services

ShivasNotes

Independent notes on software, systems, AI workflows, robotics, and building Antsand in public.

The Qwen3-VL CPU Gap vs llama.cpp: A Build Log That Keeps Getting Measured

How CKE Made Whisper Faster In Two Days — And The Evidence That Makes It Believable

How CKE Made Qwen3.6 Prefill 2.6x Faster

Subscribe

Subscribe to emails from Anthony

Need an intelligent system to work on real hardware?

Embedded systems · Robotics · Constrained AI · CPU and HPC · Accelerators · Distributed systems

ShivasNotes

Read

Support