Reinforcement Learning Course
Agentic RL: Environments, Trajectories, and the Training
RL Part 12: From a single judged group to a full multi-step training loop with ART and RULER.
Avi Chawla
407 posts published
Agents
Build Your Own 100% Local AI Second Brain
How the best builders in tech are all converging on AI second brains.
Agents
How to Reduce LLM Costs by 50-60% Using Model Routing
...explained with code.
Reinforcement Learning Course
The Reward Signal Problem for Agents
RL Part 11: From verifiable rewards to LLM-as-a-judge.
Reinforcement Learning Course
Verifiable Rewards and GRPO
RL Part 10: Dropping two models from the four-model pipeline, and building rewards you can trust.
Agents
Loop Engineering, Clearly Explained!
Used by top products, including Anthropic, Google, etc.
Reinforcement Learning Course
RLHF: Aligning Language Models with Human Feedback
Part 9: From human preferences to a trained reward signal, and the four-model PPO pipeline.
Reinforcement Learning Course
Proximal Policy Optimization
RL Part 8: Trust regions, the clipped surrogate, and the workhorse of modern RL.
Reinforcement Learning Course
Policy Gradients: REINFORCE and Actor-Critic
RL Part 7: Learning the policy directly, from REINFORCE to actor-critic.
Reinforcement Learning Course
Introduction to Deep RL and DQN
RL Part 6: From linear features to neural networks, and the engineering choices that makes deep value-based RL possible.
Reinforcement Learning Course
Function Approximation
RL Part 5: From tables to parameterized value functions.
Memory
[Hands-on] Agent memory is only as good as its schema
A deep dive on building production-grade memory for Agents.
![[Hands-on] Agent memory is only as good as its schema](https://storage.ghost.io/c/3f/df/3fdf6ed2-17ac-4b12-a693-8078bd13e748/content/images/size/w400/2026/06/990fe7c9-7c72-49c9-8fb4-ea0b9cc8e01b.jpg)
Reinforcement Learning Course
Model-Free Learning
RL Part 4: Learning value functions and policies without a model. Monte Carlo methods, TD(0), SARSA, Q-learning, and the bias-variance bridge between them.
Agents
Hermes Agent Masterclass
Everything you need to understand and customize Hermes Agent.
LLMs
Speculative Decoding in LLMs
...explained with code and tradeoffs.
Reinforcement Learning Course
Bellman Equations and Dynamic Programming
RL Part 3: Bellman expectation and optimality equations, policy iteration, value iteration, and why dynamic programming needs a model.
Reinforcement Learning Course
Markov Decision Processes and Value Functions
RL Part 2: Markov decision processes, returns, policies, and value functions.
Reinforcement Learning
How to Beat GRPO Without Touching Model Weights
Berkeley beat GRPO by 10 points with 35× fewer rollouts and no GPU training,
Reinforcement Learning
How Top AI Labs Are Building RL Agents in 2026
The era of not writing custom reward functions.
Reinforcement Learning Course
Foundations of Reinforcement Learning
RL Part 1: Agents, environments, rewards, and why RL is different from supervised learning.
Claude
How We Cut Our Claude Code Token Usage 2.8x!
...using Karpathy's context engineering principles!
Classical ML and Deep Learning
Diffusion LLMs from the Ground Up: Training, Inference, and Practical Engineering
Diffusion LLMs Part 2: How dLLMs scale to 100B parameters, the inference stack that makes them fast, hands-on code, and when to actually use them.
LLMOps
72 Techniques to Optimize LLMs in Production
...explained with usage.
Claude
10 Must-use Slash Commands in Claude Code
...explained with exact prompts and usage!
Agents
Build Agents That Never Forget
A first-principles walk through agent memory (open-source).
Classical ML and Deep Learning
Diffusion LLMs from the Ground Up: Theory, Math, and Why They Work
Diffusion LLMs Part 1: Understanding how diffusion language models work from first principles, the math behind masked diffusion, and why they represent a fundamentally different approach to text generation.
Agents
Advisor Strategy in Agents
Reduce token costs and improve performance...and how to use it with Claude!
Claude
The Anatomy of an Agent Harness
A deep dive into what Anthropic, OpenAI, Perplexity and LangChain are actually building.
MLOps/LLMOps Course
MLOps and LLMOps: Case Studies
An exploration of real-world MLOps and LLMOps case studies, examining the importance of reliable ML and AI engineering and their significance for business outcomes.
