The AI Compute Cycle — H100, H200, B100, B200 Economics
Per-GPU cost, training run economics, hyperscaler capex, and whether the AI compute buildout is supply-constrained or demand-constrained
The 2023-2025 AI compute cycle is the largest hardware capex buildout in technology history measured in absolute dollars. Hyperscaler capex — Microsoft, Alphabet, Meta, Amazon Web Services, and Oracle, plus the next tier of OpenAI / Anthropic-aligned compute and the sovereign AI programs — aggregated to approximately $200-260 billion in calendar 2024 (industry analyst estimates triangulated from public hyperscaler disclosures). A substantial fraction was allocated to Nvidia GPUs and the surrounding compute infrastructure.
The unit economics of the cycle are determined by a small number of products: the Nvidia H100, the H200, and the B100 / B200. Each generation of these accelerators sits at the intersection of the constraints covered in earlier lessons: HBM supply (sc1_l5), advanced packaging (sc1_l12), TSMC leading-edge capacity (sc1_l4), and the export control regime that governs which customers can buy them (sc1_l8). This lesson is the unit economics framework: per-GPU cost, training run economics, hyperscaler capex flow, and the central question — is the buildout demand-constrained or supply-constrained, and what does each scenario imply for the cycle's durability.
That is the opening. Finishing a lesson is where it stops being interesting and starts being useful: the full lesson runs to 7 sections and ends with 6 practice questions. A free account is what opens the rest, and the other 255 lessons in the Academy with it. No card.
What this lesson covers
- 1Training-run economics — what a frontier LLM actually costs to compute
- 2Supply versus demand — the central question for the cycle's durability
- 3Nvidia AI accelerator generations — process, memory, pricing, and lifecycle
- 4Hyperscaler capex flow — where the AI compute dollars come from
- 5Calendar 2024 — $200-260B hyperscaler capex, ~$130B Nvidia revenue, ~75% gross margin, sustained supply constraint
- 6Where to see this on the platform
- 7Summary