Karthik Balasubramanian

Inference Engineering · GPU Kernels (Triton / CUDA) · LLM Serving (vLLM, SGLang) · Kubernetes (CKA)

ML Inference & GPU Systems Engineer: making LLMs fast, observable, and reliable in production.

I'm Karthik Balasubramanian, a Software Engineer at Adobe with a background in site reliability, tools and infrastructure. I'm now working down the stack, where LLM cost and latency are decided: GPU kernels and inference engines. I write up what I learn about kernels, attention, KV-cache management and serving with vLLM and SGLang, and I measure it the way an SRE would.

Latest writing