Durable Agents with LangGraph and LangSmith
Part 6: State that survives crashes, approvals that expire, evaluations that gate releases, and an authenticated streaming API.
· Avi Chawla
Multi-agent orchestration with LangGraph
Part 5: Parallel specialist workers, shared state, and a reviewer that reconciles their findings.
· Avi Chawla
Planning and Verification Loops with LangGraph and Jev
Part 4: Plans, independent verification, stuck detection, budgets, and loops that stop when the task is done.
· Avi Chawla
Agent Harness with LangChain Middleware and Jev
Part 3: Retries, fallbacks, routing, guardrails, permissions, and the first human-in-the-loop interrupt.
· Avi Chawla
Middleware-Driven Context Engineering in LangChain
Part 2: Dynamic prompts, memory, compression, and isolation with middleware
· Avi Chawla
First Steps Towards a Production-Ready Agent with LangChain
Part 1: Tools, structured output, runtime context, and tracing, in one small agent.
· Avi Chawla
Preloading Knowledge Into a Model Instead of Retrieving It (Part C)
Part 15: Block-Attention, Cartridges, and what running preloading in production actually involves, with implementations
· Avi Chawla
Preloading Knowledge Into a Model Instead of Retrieving It (Part B)
Part 14: Shrinking a preloaded cache and the problems with those approaches, covered with implementations
· Avi Chawla
Preloading Knowledge Into a Model Instead of Retrieving It (Part A)
Part 13: Reading the corpus once before any query arrives, and the two limitations that decide whether it works in production, with implementations
· Avi Chawla
Why RAG Latency Is a Prefill Problem, Not a Retrieval Problem
Part 12: Why prefill dominates RAG latency, and how to reuse KV caches that share no prefix, with implementations
· Avi Chawla
How do AI teams use RL in production?
RL Part 13: An exploration of real-world RL case studies.
· Avi Chawla
Agentic RL: Environments, Trajectories, and the Training
RL Part 12: From a single judged group to a full multi-step training loop with ART and RULER.
· Avi Chawla
The Reward Signal Problem for Agents
RL Part 11: From verifiable rewards to LLM-as-a-judge.
· Avi Chawla
Verifiable Rewards and GRPO
RL Part 10: Dropping two models from the four-model pipeline, and building rewards you can trust.
· Avi Chawla
RLHF: Aligning Language Models with Human Feedback
Part 9: From human preferences to a trained reward signal, and the four-model PPO pipeline.
· Avi Chawla
Proximal Policy Optimization
RL Part 8: Trust regions, the clipped surrogate, and the workhorse of modern RL.
· Avi Chawla
Policy Gradients: REINFORCE and Actor-Critic
RL Part 7: Learning the policy directly, from REINFORCE to actor-critic.
· Avi Chawla
Introduction to Deep RL and DQN
RL Part 6: From linear features to neural networks, and the engineering choices that makes deep value-based RL possible.
· Avi Chawla
Function Approximation
RL Part 5: From tables to parameterized value functions.
· Avi Chawla
Model-Free Learning
RL Part 4: Learning value functions and policies without a model. Monte Carlo methods, TD(0), SARSA, Q-learning, and the bias-variance bridge between them.
· Avi Chawla
Bellman Equations and Dynamic Programming
RL Part 3: Bellman expectation and optimality equations, policy iteration, value iteration, and why dynamic programming needs a model.
· Avi Chawla
Markov Decision Processes and Value Functions
RL Part 2: Markov decision processes, returns, policies, and value functions.
· Avi Chawla
Foundations of Reinforcement Learning
RL Part 1: Agents, environments, rewards, and why RL is different from supervised learning.
· Akshay Pachaar
Diffusion LLMs from the Ground Up: Training, Inference, and Practical Engineering
Diffusion LLMs Part 2: How dLLMs scale to 100B parameters, the inference stack that makes them fast, hands-on code, and when to actually use them.
· Avi Chawla
Diffusion LLMs from the Ground Up: Theory, Math, and Why They Work
Diffusion LLMs Part 1: Understanding how diffusion language models work from first principles, the math behind masked diffusion, and why they represent a fundamentally different approach to text generation.
· Avi Chawla
MLOps and LLMOps: Case Studies
An exploration of real-world MLOps and LLMOps case studies, examining the importance of reliable ML and AI engineering and their significance for business outcomes.
· Avi Chawla
Concepts of LLM Serving
LLMOps Part 14: An overview of the fundamentals of LLM serving, including API-based access, inference with vLLM, and practical decisions.
· Avi Chawla
LLM Inference and Optimization: Fundamentals, Bottlenecks, and Techniques
LLMOps Part 13: Exploring the mechanics of LLM inference, from prefill and decode phases to KV caching, batching, and optimization techniques that improve latency and throughput.
· Avi Chawla
LLM Fine-tuning: Techniques for Adapting Language Models
LLMOps Part 12: Understanding LLM fine-tuning, parameter-efficient methods like LoRA and QLoRA, and alignment techniques such as RLHF, DPO, and GRPO.
· Avi Chawla
Evaluation: Multi-turn Conversations, Tool Use, Tracing, and Red Teaming
LLMOps Part 11: Understanding evaluation of conversational LLM systems, tool evaluations, tracing with Langfuse, and automated red teaming.
· Avi Chawla