Apple evaluates fm CLI for on-device LLMs

The author evaluates Apple's native fm CLI tool for running on-device foundation models locally on Apple Silicon during AI prototyping. The evaluation demonstrates that while the tool enables free, private local inference and JSON extraction via Python subprocesses or an OpenAI-compatible local server, its compact size introduces factual hallucinations and classification errors that necessitate grounding and validation. Open article →