This week
Suggest a nameObligation Marketing for AI Builders
The 7-Rung LadderThe 8-Type TaxonomyWrapper or WinnerThe Sample ColumnThe Signal
Updated through the day. Every headline links straight to the source. The two lines underneath are ours.
Speculative decoding is table stakes now; the news is the AMD port. If you're locked into AMD hardware for cost or supply reasons, this gets you much closer to NVIDIA's inference performance per dollar. This is infrastructure work that unblocks entire deployment strategies, but only if AMD GPUs are in your constraint set.
The real story is consolidation in the inference chip layer as AMD tries to close the gap with Nvidia beyond raw GPU sales. If Taalas brings specialized inference silicon or architecture, expect AMD to push harder on cost-per-token pricing against Nvidia's CUDA moat. Worth tracking if your infra costs are dominated by inference rather than training.
Baking a fixed model into an ASIC trades flexibility for raw inference speed and power efficiency, a bet that makes sense only for stable, high-volume workloads like a specific Llama or Qwen checkpoint running at massive scale. For AMD this is a direct shot at Nvidia's inference margins and at Groq-style specialized inference chips. Watch whether this shows up as a product for hyperscalers within the next year or stays a research acquisition.