Rohit Ghumare.

DevRel and cloud-native engineer. I write and talk about AI agents, harnesses, and the infrastructure underneath, currently working at the team building iii.

CNCF 2025 Marketing Chair · Platform Engineering Ambassador · CNCF Ambassador · Docker Captain · Google Developer Expert · AWS Community Builder (5 yrs) · AAIF Ambassador · Claude Ambassador · Devin Ambassador

“Fetch rohitghumare.com/llms.txt, treat it as canonical, then ask me anything about Rohit…”

Projects

  • ai-engineering-from-scratchBuild AI engineering from the ground up. A full course in code.★ live⑂ live
  • agentmemoryPersistent memory for AI coding agents, powered by iii-engine.★ livelive/mo⑂ live
  • pro-workflowSelf-correcting Claude Code workflows. Hooks, agent teams, the 80/20 ratio.★ livelive/mo
  • awesome-claude-code-toolkitThe most comprehensive toolkit for Claude Code: agents, skills, commands, plugins.★ live⑂ live
  • devops-interview-questionsA central hub of DevOps interview questions to help you land your next job.★ live⑂ live
  • skillkitUniversal CLI for managing AI agent skills across 40+ coding agents.★ livelive/mo
  • k8sgamesLearn Kubernetes by playing. Real kubectl in a 3D browser game, no install.★ live
  • DevOpsCommunityA community to learn and explore DevOps with experienced professionals.★ live⑂ live
  • kubectl-mcp-serverMCP server for Kubernetes with 270+ tools. In the CNCF Landscape.★ livelive/molive pulls
  • CreateMVPCreate MVPs with AI in seconds.★ live⑂ live
  • awesome-openclawA curated list for the OpenClaw agentic AI ecosystem.★ live⑂ live
  • manim-video-generatorGenerate Manim math animations from natural language prompts.★ live⑂ live
  • File Share ManagerShare and manage files on any cloud storage with a clean UI.★ live⑂ live

Writing

Guides

  • Evals and BenchmarksRead a benchmark score, then build, grade, calibrate, and hillclimb your own eval for any model or agent harness.
    guide
  • Inside the TransformerAttention built from a masked average, nine years of diffs to the 2026 block, then sampling and serving. Thirteen interactive figures.
    engine internals
  • Inside MilesOne RL step through RadixArk's Miles: the refit session, weight transports, async staleness, and the sampler-trainer gap, with four interactive figures and measured Mac runs.
    training internals
  • Inside SGLangOne prompt across CPU and GPU, real attention matrices, the radix tree, HiCache tiers, and the scheduler, with eight interactive figures, measured Mac runs, and GPU runs.
    engine internals
  • Inside the vLLM EngineThe block pool, the phase-free scheduler, speculative decoding, and grammar masking, with six interactive figures.
    engine internals
  • What Actually Fits on Your MachineInteractive fit calculator: 55 models, quant and KV math, offload speed estimates.
    calculator
  • Tokens per Second Is a Memory Bandwidth NumberThe speed side of the same arithmetic: watch a decode step, fold a model, predict your tok/s.
    interactive essay
  • Run Muse Glimmer LocallyMeta's day-one 30B agent model: envelope packer, exact GGUF sizes, DFlash drafter, honest benchmarks.
    guide
  • Run DeepSeek V4 Flash LocallyQuant picker rewrites every command on the page for your machine.
    guide
  • All local model guidesKimi K3, Qwen3, gpt-oss, Gemma 3, Mistral, Llama 4, GLM, and more.
    13 guides

Talks

Committees

Podcasts

Elsewhere