AMD Acquires AI Chip Startup Taalas to Boost Inference Performance
AMD has acquired AI chip company Taalas to enhance inference performance by etching models into silicon. The deal, announced on Thursday, aims to make high-performance AI services faster and cheaper to run. Founded in 2023, Taalas' approach is different from conventional GPUs and dataflow architectures. The acquisition may challenge Nvidia's dominance in AI hardware.
Key points
- AMD has acquired AI chip company Taalas, a Toronto-based startup founded in 2023.
- Taalas' chips etch model weights directly into silicon, boosting inference performance by an order of magnitude or more.
- The deal aims to make high-performance AI services faster and cheaper to run, potentially challenging Nvidia's dominance.
- Taalas' technology has been demonstrated with a 48x faster performance than Nvidia's GPUs and 8.5x faster than Cerebras' accelerators.
- The terms of the deal were not disclosed, but it is considered an actual acquisition rather than an acquihire.
AMD Acquires AI Chip Startup Taalas to Boost Inference Performance
AMD has made a significant move in the AI hardware market by acquiring AI chip company Taalas. The deal, announced on Thursday, aims to enhance inference performance by etching models directly into silicon.
A New Approach to Inference
Taalas' approach to inference is radically different from conventional GPUs and dataflow architectures. The company's chips don't rely on HBM to store model weights but rather etch them directly into the silicon. This results in a model-specific integrated circuit (MSIC) that boosts inference performance by an order of magnitude or more.
Challenging Nvidia's Dominance
The acquisition may challenge Nvidia's dominance in AI hardware. Nvidia's $20 billion licensing deal with Groq last December aimed to make high-performance inference services faster and cheaper to run. AMD's acquisition of Taalas may be seen as a response to this move.
Demonstrated Performance
Taalas' technology has been demonstrated with a 48x faster performance than Nvidia's GPUs and 8.5x faster than Cerebras' accelerators. The company's first test chip, the HC1, was fabbed on TSMC's 6nm process tech and achieved a blistering 16,960 tokens per second when running Meta's Llama 3.1 8B model.
What's Next
The terms of the deal were not disclosed, but it is considered an actual acquisition rather than an acquihire. AMD's acquisition of Taalas may be seen as a strategic move to enhance its presence in the AI hardware market.
Sources
The WireByte editorial team synthesises technology news from multiple primary sources, verifies the facts, and links every source. Articles are produced with AI assistance and reviewed under our editorial policy.