M* (M-star): A Modular, Extensible, Serving System for Multimodal Models

mstar.stanford.edu14 min read

Researchers have introduced M*, a modular and extensible serving system designed to handle complex multimodal models from a single runtime. By using a declarative graph abstraction called the Walk Graph, M* enables flexible component wiring, first-class loops, parallel execution, and streaming without bespoke per-model glue code. Benchmarks across five models demonstrate that M* matches or outperforms specialized serving stacks, delivering significant speedups in speech, image serving, and world-model rollouts. Open article →

More on this topic