Grok Bot Masterclass
Everything you need to understand, set up, and get real work out of Grok Bot.
419 posts published
Everything you need to understand, set up, and get real work out of Grok Bot.
The intuition an LLM engineer needs, without the hardware manual. By the end, techniques like quantization, speculative decoding, and continuous batching should stop looking like a list of tricks to memorize.
...explained visually.
Building a pattern recognition layer for memory in production.
Part 12: Why prefill dominates RAG latency, and how to reuse KV caches that share no prefix, with implementations
...explained visually.
...step-by-step, from scratch, using an open-source stack.
RL Part 13: An exploration of real-world RL case studies.
How the best builders in tech are all converging on AI second brains.
A complete guide to build production-grade SLM pipelines.
...explained step-by-step with code.
RL Part 12: From a single judged group to a full multi-step training loop with ART and RULER.
A practitioner's guide to KV cache management in production.
...explained with code.
RL Part 11: From verifiable rewards to LLM-as-a-judge.
100% local setup with open-source stack.
RL Part 10: Dropping two models from the four-model pipeline, and building rewards you can trust.
Used by top products, including Anthropic, Google, etc.
Part 9: From human preferences to a trained reward signal, and the four-model PPO pipeline.
RL Part 8: Trust regions, the clipped surrogate, and the workhorse of modern RL.
RL Part 7: Learning the policy directly, from REINFORCE to actor-critic.
RL Part 6: From linear features to neural networks, and the engineering choices that makes deep value-based RL possible.
RL Part 5: From tables to parameterized value functions.
A deep dive on building production-grade memory for Agents.
RL Part 4: Learning value functions and policies without a model. Monte Carlo methods, TD(0), SARSA, Q-learning, and the bias-variance bridge between them.
Everything you need to understand and customize Hermes Agent.
...explained with code and tradeoffs.
RL Part 3: Bellman expectation and optimality equations, policy iteration, value iteration, and why dynamic programming needs a model.
RL Part 2: Markov decision processes, returns, policies, and value functions.
Berkeley beat GRPO by 10 points with 35× fewer rollouts and no GPU training,