TLDR AI 2025-02-11
OpenAI Intelligence Age 🤖, France’s $112B AI Investment 🇫🇷, Ilya Sutskever’s SSI valued at $20B 💰
Building Bridges between Regression, Clustering, and Classification (23 minute read)
This paper introduces a novel method for improving neural network training in regression tasks that involves framing them as classification problems using a learned target encoder-decoder pair. The approach outperforms traditional regression methods by leveraging the benefits of distributional target representation and smooth interpolation between different objectives.
Better GNN Generalization (19 minute read)
While maximizing spectral gap has been used to address over-squashing in GNNs, this paper shows that minimizing it can also improve generalization. The authors propose three new rewiring strategies to enhance label-community alignment, homophily, and computational efficiency.
Scaling up Test-Time Compute with Latent Reasoning (34 minute read)
3.5B model trained to do latent reasoning which also shows dramatic improvement on math problems. The model itself is a recurrent architecture.
👨💻
Engineering & Research
QuEST: Stable Training of LLMs with 1-Bit Weights and Activations (GitHub Repo)
QuEST allows stable training with 1-bit weights and activations. QuEST achieves this by improving two key aspects of QAT methods: accurate and fast quantization of the (continuous) distributions of weights and activations via Hadamard normalization and MSE-optimal fitting, and a new trust gradient estimator based on the idea of explicitly minimizing the error between the noisy gradient computed over quantized states and the "true" (but unknown) full-precision gradient.
Diagen (GitHub Repo)
Agentic workflow for generating diagrams with language models.
Better Programming Assistance (GitHub Repo)
This work introduces a new conversational framework for programming assistance that integrates coding history, current code, and user instructions.
Get the most interesting AI stories and breakthroughs delivered in a free daily email.
Join 920,000 readers for
one daily email