TLDR AI 2024-05-29
OpenAI Safety Board π¦Ί, Jan Leike Joins Anthropic π, Reproducing GPT-2 by Andrej Karpathy π»
OpenAI Safety Board (2 minute read)
OpenAI formed a Safety and Security Committee after announcing the training of its new foundation model. This committee will be tasked with issuing recommendations to the board about actions to take as model capabilities continue to improve.
Jan Leike Joins Anthropic (1 minute read)
Jan Leike, a former OpenAI researcher who resigned over AI safety concerns, has joined Anthropic to lead a new "superalignment" team focusing on AI safety and security. Leike's team will address scalable oversight, weak-to-strong generalization, and automated alignment research.
New agent capabilities in Microsoft Copilot unlock business value (3 minute read)
Microsoft unveiled new features for Copilot at Build 2024, including Team Copilot for team collaboration, custom AI Agents to automate workflows, and Copilot Extensions and Connectors for easy customization. These enhancements aim to improve productivity and business process efficiency. The updates are currently in limited private preview, with broader availability expected later in 2024.
π§
Research & Innovation
gzip Predicts Data-dependent Scaling Laws (16 minute read)
Scaling laws are a way to predict how well models will perform at certain sizes with a certain amount of data. They are expensive to obtain. This paper explores using gzip compression ratio as a strong signal to predict a data-dependent scaling law.
Transformers Learn to Solve Complex Arithmetic with New Embeddings (18 minute read)
Researchers have improved transformer performance on arithmetic tasks by adding embeddings that encode each digit's position relative to the start of the number.
Schedule Free Optimizer (23 minute read)
A few weeks ago, a new optimizer from Meta made the rounds as a promising alternative to Adam. This paper outlines the method in more detail, including the online updates portion of the method. In general, it seems like a promising result, especially when the total number of desired training steps is unknown at the beginning of training.
Driving World Model (1 minute read)
Vista is a driving world model designed to improve prediction accuracy and action controllability for autonomous driving.
βI lost trustβ: Why the OpenAI team in charge of safeguarding humanity imploded (9 minute read)
Key members of OpenAI's safety team, including leaders of the superalignment team tasked with ensuring AI alignment, have departed partly due to lost faith in CEO Sam Altman. These departures follow internal conflicts and concerns about OpenAI's safety priorities and the company's direction under Altman's leadership. OpenAI is updating its offboarding documents after criticisms regarding potential equity cancellations for those who refuse to sign non-disparagement agreements.
What GPT-4o illustrates about AI Regulation (4 minute read)
This article discusses different approaches to AI regulation, contrasting model-level, use-level, and conduct-level frameworks. It argues that conduct-level regulation, which applies existing laws to new technology without excessive specificity, is preferable to use-level regulation, which could result in impractical restrictions and unnecessary complications for AI deployment. The recent EU AI Act's restrictions on AI's ability to infer emotions is cited as an example of the pitfalls of a use-level approach.
Get the most interesting AI stories and breakthroughs delivered in a free daily email.
Join 920,000 readers for
one daily email