VB Notes runs 350M embedding on iPhone
The author built VB Notes, a cross-platform markdown notes application that runs a 350-million-parameter embedding model locally on devices like iPhones to enable privacy-first semantic search. The implementation relies on custom chunking with repeated titles, int8 SQLite vector storage, and reciprocal rank fusion to combine keyword and meaning-based search results. Open article →