TLDR AI 2023-11-21
OpenAI employees threaten to quit 👋, Amazon’s free generative AI course 📚, Video LLaVa 📹
Video LLaVa (22 minute read)
LLaVa is a recipe for training a multi-modal model from a text model. It can now work with video. The resulting model (based on Vicuna) is extremely powerful and easily achieves state-of-the-art performance in video summarization and captioning.
Teaching small language models to reason (12 minute read)
The Orca models are a set of small models from Microsoft that excel at reasoning tasks. There has been concern about validity because much of the information was kept closed. Orca 2 has now been released and the model is available on HuggingFace. It demonstrates good performance for its size, outperforming several larger models on reasoning benchmarks.
Popular public models likely didn't train on the test set (18 minute read)
An in-depth way to study what data was used to train language models. The results of which suggest that many closed-source models likely didn't train on popular benchmarks.
👨💻
Engineering & Research
AI Exploits (GitHub Repo)
A list of exploits that have been found and responsibly disclosed in AI applications.
tldraw Make it Real starter (GitHub Repo)
tldraw made a viral app recently that allows users to design software quickly with its paint-like interface and then use GPT-V to generate code for a web version of the design. It works surprisingly well and generates robust and working code. It also takes natural language instructions.
Better Item Representation for Recommender Systems (GitHub Repo)
The newly introduced CoWPiRec approach improves recommender systems by blending collaborative filtering information with text-based item representations. This innovative method, which utilizies word graphs for item interactions, has shown superior performance in various recommendation scenarios, including addressing the cold-start problem.
OpenAI’s Misalignment And Microsoft’s Gain (12 minute read)
Microsoft has dramatically altered the AI landscape by acquiring key personnel and IP from OpenAI, including co-founders Sam Altman and Greg Brockman, following Altman's firing and Brockman's resignation from OpenAI, which was struggling with its non-profit model and internal conflicts.
Bain Capital Ventures Launches BCV Lab (1 minute read)
Bain Capital Ventures has created a new AI incubator and technical community called BCV Labs, offering office space, events, a fellowship program, GPU credits, and recruiting support, along with funding.
AGI’s Impact On Tech, SaaS Valuations (5 minute read)
The rapid advancement of AI, particularly AGI, could significantly impact the valuation of SaaS and tech companies by increasing competition, compressing margins, and reducing the demand for traditional project management and CRUD apps, while also challenging incumbents with new AI-native startups and self-serve app creation, ultimately leading to a shift in the software value chain.
Get the most interesting AI stories and breakthroughs delivered in a free daily email.
Join 920,000 readers for
one daily email