TLDR AI 2024-03-29

Mamba is a style of model that is supposed to beat Transformers in efficiency while matching performance. Jamba is a novel variant that includes MoE layers. It can run at 1.6k tokens per second with a context length of 128k tokens. It achieves 67% on the MMLU benchmark. The weights are available.

Hume has released the Empathic Voice Interface (EVI), the first conversational AI with emotional intelligence.

Google is piloting AI-generated overviews in search results for complex queries with a subset of U.S. users without requiring opt-in to its Search Generative Experience. This feedback-driven test aims to enhance user experience and may impact site traffic dynamics due to changes in ad placements and organic search visibility.

1 Bit language models are exciting. This work shows how to quantize the Linear layers of a language model without sacrificing performance. This can result in a 70B model running on consumer GPUs.

You can use language models to generate factual information. Google has released a dataset and benchmarks to show how well each model performs. This report gives insight into how to improve a model’s factuality and shows language models winning against human annotators in a majority of cases.

CoDA is a new approach to Unsupervised Domain Adaptation (UDA). It helps AI models better adapt to unlabeled, challenging environments by learning from differences at both the scene and image levels.

CT-RATE is a dataset that marries 3D medical imaging with textual reports. CT-CLIP is a versatile AI framework optimized for these images.

This approach pinpoints the exact content that triggers user questions online, from lectures to news articles. This method, known as backtracing, aims to help content creators refine their work by identifying and understanding the causes of confusion, curiosity, or emotional reactions.

Researchers have developed a new method, Mixture-of-Resolution Adaptation (MRA), which improves AI's ability to recognize details in images.

AI Futurist Ray Kurzweil invented the law of accelerating returns, which states that the rate of progress is increasing at an exponential rate over time. In a recent discussion, Kurzweil explored various topics including prospects that are only getting better, the direction in which the AI economy is headed, human relationships with AIs, longevity escape velocity, and much more.

AI experts are exploring automating human tasks, leading to concerns about job loss and wage declines. However, the view that AI advancement will inevitably result in human job obsolescence may not be correct. Humans may retain employment in an AI-dominated future due to constraints like computing power and opportunity costs, although this scenario is not guaranteed.

Coframe’s generative A/B testing tool allows you to optimize images on your website in minutes with generative AI.

Meta is introducing AI features to its Ray-Ban smart glasses, including translation, and the identification of objects, animals, and monuments, with activation through voice commands.

The Pixel 8 will receive Gemini Nano in a developer preview to enhance features like Summarize in Recorder and Gboard Smart Reply.