TLDR AI 2024-02-20

Google is introducing "Gemini Business" and "Gemini Enterprise" plans for Workspace customers, offering access to its advanced AI model, Gemini 1.0 Ultra, with enterprise-grade data protection. It will not use employee conversations for model training.

OpenAI has reportedly reached a valuation of over $80 billion following a deal with VC firm Thrive Capital. This valuation marks a nearly 3x increase in less than 10 months, making OpenAI the 3rd highest-valued tech startup in the world. The deal involves a share sale under a "tender offer," allowing employees to cash out their shares in the company.

Magic is building an AI software engineer and has raised more to help with this process.

SpLiCE is a new method that makes CLIP's complex visual data easier to understand.

Quantizing the KV cache, which is a technical detail of the Transformer architecture, allows it to use less memory at inference time. Quantization is the shrinking of the floating point precision with minimal loss in quality.

ZeroSwot is a new method for Speech Translation (ST) that overcomes the lack of data and differences between speech and text. It uses unique techniques to train a speech encoder with only speech recognition data, allowing it to work with a multilingual translation model.

The 3D Diffuser Actor combines diffusion policies and 3D scene representations to improve robot manipulation. This AI-driven approach allows robots to understand and interact with their environment more effectively.

ControlVectors are a way to cheaply steer semantic generation output. They are cheaper to train than LoRA but can still be quite effective. This library makes it easier.

This is a Ray-based implementation of RLHF for Llama-style models, which includes Mistral. It contains a number of PPO stabilization tricks to improve performance.

When you started building a product, you didn’t dream of endless admin and organization tasks. You wanted to make something people would love.

Meet Height, an AI project tool to manage the work for you, invisibly, automatically, and autonomously.

Be the first to access Height 2.0

AdamW is commonly used to decouple learning rate and weight decay. However, the common implementation in Pytorch doesn’t explicitly do this. This post discusses how to tune these parameters.

A new Temporal Dilated Video Transformer (TDViT) has been developed to improve the analysis of dense video tasks, such as frame-by-frame video object detection.

Ever wondered how OpenAI is able to innovate and build at such a fast pace? In this podcast, Logan Kilpatrick, OpenAI's head of developer relations, discusses OpenAI's unique culture, the importance of high agency and urgency, and the company's decision-making framework for launching products.

Ensure your emails land in the inbox, not spam.

A list of full clusters that are available for rent by the hour.

OpenLLMetry-JS is a set of extensions built on top of OpenTelemetry that gives you complete observability over your LLM application.