Start a project

Insights

Notes from the engine room.

Practical writing on AI engineering, memory safety, cyber security and performance — what works, what doesn’t, and why.

AI compilers

Why your inference bill is a compiler problem

LLM inference is usually limited by memory bandwidth, not raw compute. That makes fusion, quantisation and kernel work the biggest levers on cost and latency.