Two weeks ago, there was a flurry of excitement around a tweet from Sharon Zhou, cofounder and CEO of Lamini, a startup that helps AI developers create customized large language models. Zhou revealed in the tweet that, for the past year, she’s been using more than 100 chips from chipmaker Advanced Micro Devices to power her AI startup’s products.
In the midst of the ongoing compute crunch, AI founders and investors rallied around the news, seeing it as an indicator that AMD could cash in on the intense demand for AI chips, possibly even taking market share from the main supplier of those chips, Nvidia. AMD stock has jumped 13% since then.
Indeed, the AMD chip in question, the Instinct MI300A, has often been touted by founders and analysts as a strong alternative to Nvidia’s industry-leading H100. It’s due for release later this year. But before AI startups get too excited, they should pay attention to all the details of Zhou’s experience with the AMD chips. The short version: it’s not as easy as it looks to use those chips.
0 Commentaires