TLDR AI 2024-05-20
Unitree's humanoid robot π¦Ύ LoRA forgets less π Model explorer π
What Happened To OpenAI's Long-Term AI Risk Team? (4 minute read)
OpenAI dissolved its superalignment team after the departures of co-leads Ilya Sutskever and Jan Leike and several other researchers. This team, created to address long-term AI risks, will have its work absorbed by other research efforts.
$16k G1 humanoid rises up to smash nuts, twist, and twirl (4 minute read)
Unitree has released the first few details on its G1 Humanoid Agent, a $16,000 robotic helper. The robot is equipped with 3D LiDAR sensors, a depth camera, three-fingered grippers, and a 9,000-mAh battery pack. It can recover from brutal kicks and punches, as seen in the short demo video in the article. At around 35 kg, the robot can fold itself down to 690x450x300-mm proportions for compact carry.
Open Release of Grok-1 (1 minute read)
xAI has released the weights and architecture for Grok-1. Grok-1 is a Mixture-of-Experts model with 314 billion parameters. The released model is a raw base model checkpoint from the Grok-1 pretraining phase, which means that it is not fine-tuned for any specific application. It was trained from scratch by xAI using a custom training stack.
π§
Research & Innovation
LoRA Learns Less and Forgets Less (25 minute read)
LoRA is a popular way to fine-tune models to inject style or knowledge. This paper explores the trade off between power and forgetting when using LoRAs. The research finds that LoRAs are able to learn less than full fine tuning, but maintain more of the original βout of distributionβ performance.
Chameleon Early Fusion Multi-Modal (16 minute read)
Meta has announced a natively multi-modal model called Chameleon that operates on images and text simultaneously like GPT-4o. It outperforms many alternative models. The Meta team has since far surpassed this work on internal models.
Gemini 1.5 Technical Report (153 page PDF)
Google's most recent family of models has an updated technical report. There is little information about the models or the data used, but there is significant information about the evaluation and safety measures taken, which is an interesting window into large-scale alignment.
π¨βπ»
Engineering & Research
Run PaliGemma in Real Time (GitHub Repo)
Using GPT-Fast, you can run the most recent Google VLM in real time. This opens up a number of powerful downstream tasks as the model is extremely easy to fine-tune for specific tasks.
Experts (GitHub Repo)
Experts is the easiest way to create and deploy OpenAI's Assistants and link them together as Tools to create a Panel of Experts system with expanded memory and attention to detail.
Model Explorer (GitHub Repo)
Google has released a model explorer that makes it easy to inspect the computation graph of your models. It can be useful for debugging and performance engineering.
AI agent builds garple.com (3 minute read)
Garple is a website that sells short, easy-to-say .com domains that would make good startup names. All the code was written by an AI coding agent.
Gamma raises $12M Series A (5 minute read)
Gamma raised $12M from Accel to reimagine presentations using AI. So far, 60M+ Gammas (AI-generated slides) have been created across 18M+ users.
Google I/O 2024: Everything you need to know (14 minute read)
Google kicked off its I/O developer conference with a two-hour presentation containing a rapid-fire stream of announcements. This article summarizes these announcements into an easy-to-read list. The announcements include Firebase Genkit, an addition to the Firebase platform aimed at making it easier for developers to build AI-powered applications in JavaScript/TypeScript; LearnLM, a family of generative AI models fine-tuned for learning; AI-generated quizzes on YouTube; a new discovery feature for apps in Google Play; scam call detection; Ask Photos, a feature that lets users search across their Google Photos collection using natural language queries; and much more.
Get the most interesting AI stories and breakthroughs delivered in a free daily email.
Join 920,000 readers for
one daily email