MLPerf Results Highlight Growing Importance of Generative AI and Storage (5 minute read)
MLPerf has released results from two benchmark suites: MLPerf Inference v3.1, which showcases record participation and performance gains, and MLPerf Storage v0.5, which assesses storage system performance for ML training workloads. The Inference benchmark suite introduced a large language model and updated recommender tests, reflecting emerging AI trends.
๐ง
Research & Innovation
Align a language model without training (25 minute read)
Alignment helps make language models more helpful and harmless. It can sometimes hurt performance, but in general is a positive. Alignment is expensive and requires substantial alignment data. However, if you allow the model to rewind during generation after evaluating its own output, it can improve alignment performance on the frozen model by up to 81%.
Pushing mixture of experts to the limit with parameter efficiency (28 minute read)
Mixture of experts (MoEs) is a cool way to increase the capacity of a model without increasing per token runtime. However, they're still tricky to run quickly and fine-tune. Researchers find that if you modify dense model parameters efficiently fine tuning to work with MoEs you can dramatically reduce tuning costs without hurting performance too much.
Making Better Recommendations (18 minute read)
Researchers have developed a new model called HAMUR to improve how models make suggestions or "recommendations" across multiple subjects or domains, like music, books, or movies. Unlike older methods that mix up information between these domains, HAMUR uses a special technique to keep data separate and more flexible.
AI Life Coach (Product)
Summit is an AI life coach that helps users achieve personal and professional goals. Summit helps to break down big goals into bite-sized actions, holds users accountable for achieving them, and supports users with personalized coaching along the way.