Baseten CEO explains inference challenges

generalist.com12 min read

Tuhin Srivastava, co-founder and CEO of Baseten, discusses the challenges of AI inference in production and why he considers inference to be AI's ultimate market. In the interview, Srivastava details Baseten's pivot toward specialized serving infrastructure, the ongoing compute crunch, and the extreme difficulty of forecasting demand in an exponential market. Open article →