AWS CEO highlights shift in AI demand from training to inference, and crypto miners should pay attention

At AWS re:Invent 2025, AWS CEO Matt Garman laid out a simple but consequential data point: AI inference now accounts for roughly two-thirds of all AI compute demand. That’s up from about one-third in 2023. In English: training is teaching a model to think. Inference is actually making it think. The industry spent billions teaching these models, and now the spending is shifting toward putting them to work. Garman, who took over as AWS CEO in June 2024 after succeeding Adam Selipsky, described inference as “a new Lego” in computing. He’s saying inference is becoming a basic building block that enterprises will snap together to automate tasks, run AI agents, and fundamentally change how businesses operate. He went further, predicting that 80-90% of enterprise AI value will eventually come from inference-powered agents. Not chatbots summarizing your emails, but autonomous systems actually completing tasks. AWS is putting hardware behind this bet too. The company showcased its Trainium3 chips at re:Invent, purpose-built for inference workloads rather than the training-optimized GPUs that have dominated headlines and Nvidia’s earnings reports. This shift matters enormously for the crypto...