In short: Uber has expanded its AWS contract to run real-time ride-matching infrastructure on Amazon’s Graviton4 processor and is piloting AI model training on Trainium3, joining Anthropic, OpenAI, and Apple on a customer list that is becoming the clearest evidence yet that Amazon’s custom silicon strategy is working. Uber’s infrastructure runs on milliseconds. Every time a […]<br /> [...]
AMD is buying Canadian startup Taalas, which hard-codes model weights directly into inference chips. That makes them extremely fast but locks each chip to a single model. A demo chip hit over 16,000 tokens per second per user running Llama 3.1-8B. Google is reportedly working on a similar approach for Gemini.<br /> The article AMD acquires Taalas, a startup that bakes AI models directly into [...]