Testimonials

Services

Video meeting . 60 mins
5

1:1 Career Mentorship

How to find your dream role in GenAI
$50$75
Popular

About me

I'm Abi Aryan - an AI Infrastructure Engineer, founder, researcher, author, and educator working at the intersection of AI inference, GPU systems, and distributed computing. I help engineers, technical leaders, founders, and aspiring AI infrastructure professionals understand how modern AI systems actually work, from GPU kernels and inference runtimes to distributed serving, networking, power efficiency, and data-center architecture. I've spent over a decade building production ML systems, researching advanced computing architectures, and teaching the engineering behind them. I founded Joule, an inference power economics engine connecting physical GPU energy consumption to token throughput and SLO goodput. I work across the inference stack, including TensorRT-LLM, TorchDynamo, SGLang, and vLLM, with a focus on building efficient, high-concurrency inference systems at scale.