TLDR AI 2023-09-12

Meta’s GPT-4 competitor 🥷, Project Gutenberg releases AI audiobooks 📚, self-driving cars & language prompts 🚗

Humans suck at project management (Sponsor)

We’ve all tried every project management tool under the sun…

And we’ve all given up on most of them at one point or another.

You know that yet-another Kanban board isn’t the solution. But what is?

Enter Height, the first and only AI project manager. Height offloads the drudgery of project management — so you can get back to bringing ideas to life. In Height, AI is woven right into the tasks and projects you’re working on — keeping your workflows and projects organized on autopilot.

Standups? Drafting release notes? Height automates your repetitive weekly time drains with cutting-edge AI and dynamic workflows.

Save time in every area of work. Enter a new era of project management

🚀
Headlines & Launches

Project Gutenberg releases thousands of AI audiobooks (22 minute read)

In collaboration with Microsoft, thousands of open-domain books have been transcribed with state-of-the-art text-to-speech. They're available on most streaming platforms. Information about the process is included in the link.

Meta Is Working On A GPT-4 Competitor (1 minute read)

Meta has been snapping up AI training chips and building out data centers in order to create a more powerful new chatbot it hopes will be as sophisticated as OpenAI’s GPT-4.
🧠
Research & Innovation

Making Self-Driving Cars Smarter with Language Prompts (15 minute read)

This project introduces NuPrompt, a new set of instructions in everyday language that helps self-driving cars understand and track objects around them better. It works really well!

A Better Understanding and Reasoning About Pictures (22 minute read)

The authors of this study have created a way to test how well vision-language models can also think logically about what they see.

Speed up speculative decoding without a draft model (8 minute read)

Language model inference is generally slow because these models are heavily memory-bound. So people have introduced speculative decoding using a smaller draft model to “run ahead” and offer suggestions to the large model. This works well, but it’s complicated to implement, and finding a good draft model is tough. Instead, you can create a Medusa model that acts as its own draft by splitting off activations from various internal stages. This speeds up Llama 2x without compromising performance.
👨‍💻
Engineering & Resources

RestGPT (GitHub Repo)

RestGPT aims to construct a large language model-based autonomous agent to control real-world applications, such as movie databases and music players.

Teaching Language Models to Understand 3D Shapes (GitHub Repo)

PointLLM is a tool that helps language models understand 3D objects, not just text and 2D images.
🎁
Miscellaneous

Another group of writers is suing OpenAI over copyright claims (2 minute read)

OpenAI faces a lawsuit from writers alleging illegal use of their copyrighted works to train ChatGPT. They argue that ChatGPT's capabilities to summarize and analyze their content indicate direct training on their works, constituting copyright infringement. This follows similar suits from other authors against OpenAI.

Can LLMs Reason? (10 minute read)

The debate surrounding large language models concerns whether they possess human-like reasoning abilities or rely on memorization and pattern-matching, with studies showing mixed results. Evaluating LLMs for true abstract reasoning is challenging due to their tendency to excel in tasks related to their training data, necessitating further research for clarification.

Patterns for Building LLM-based Systems & Products (66 minute read)

This article shares seven practical patterns for integrating large language models into systems: measuring performance, adding recent knowledge, fine-tuning for tasks, caching to save time/cost, ensuring quality output, managing errors, and harnessing user feedback.
⚡️
Quick Links

OpenAI Confirms That AI Writing Detectors Don’t Work (1 minute read)

OpenAI has confirmed that AI writing detectors are ineffective.

AudioNotes (Product)

Convert your random voice notes and unstructured text notes into structured text summaries using AI.

HelpKit AI (Product)

HelpKit AI turns your Notion knowledge base into a smart, 24/7 AI assistant that provides precise and instant answers to your users.
TLDR is a daily newsletter with links and TLDRs of the most interesting stories in startups 🚀, tech 📱, and programming 💻!
Join 500,000 readers for one daily email