TLDR Data 2026-07-20
Inside Spark 4.2 β¨, Data Modeling Still Matters π, Faster Spark With Rust π¦
Data Modeling isn't Dead, You Just Stopped Doing It with Joe Reis (65 minute video)
Data modeling is still essential, especially in the AI era, because clear structures, standards, and context help teams avoid bad data, wasted work, and constant firefighting. Modern data professionals need a flexible βmixed modelβ approach that uses the right modeling style for the problem rather than forcing everything into one method.
Agents think in milliseconds, legacy infrastructure doesn't. LinkedIn, Walmart, and Zendesk shared how they closed the gap at VB Transform 2026 (4 minute read)
Enterprise agents are constrained more by legacy infrastructure than model quality. LinkedIn pre-provisioned containers and shifted 80% of orchestration to deterministic code, Walmart governed duplicate internal agents, and Zendesk strengthened data pipelines for its 20B conversations. The lesson is to invest in evals, own the agent harness, and keep workloads portable across models.
AI Agents Need Data Product Context Not More RAG (11 minute read)
Enterprise AI agents need governed context, not just vector search: retrieval can find relevant passages, but it does not preserve source boundaries, business meaning, ownership, or usage restrictions. The proposed approach compiles one governed data-product model into multiple representations: graph, Markdown wiki, portable OKF bundle, and compact sidecars such as TOON/GCF. AI readiness depends on connected, trusted context and repeatable operations rather than catalog presence alone.
π₯ CEO waiting for data? Cube agents deliver so your team can focus on thinking (Sponsor)
Asking a data question is still a ticket, a queue, and a week of bogged down data teams.
Cube hands that workflow to AI agents who model, explore, and build reports - working from one governed set of definitions and single source of truth. Brex, Wix, and Patagonia run on Cube.
Get started for freeIntroducing Apache Spark 4.2 (6 minute read)
Apache Spark 4.2 adds metric views for defining business metrics, SQL vector similarity search, native geospatial types, and change data capture queries through a new CHANGES clause. Spark Connect and default Arrow optimized Python execution make the engine easier to reach. The release bundles over 1,900 commits from more than 260 contributors.
Ontology Playground (GitHub Repo)
Microsoft's Ontology Playground is a free, open-source tool for visually exploring, building, importing and sharing ontologies for Microsoft Fabric IQ.
Postgres 19 Compression: from pglz to LZ4 (8 minute read)
Postgres 19 plans to switch default TOAST compression from pglz to LZ4, while keeping the same unified compression framework across heap storage, TOAST, and B-tree indexes. Variable-length types like TEXT, VARCHAR, BYTEA, and JSONB are compressed automatically via varlena metadata, with rows targeting ~2 KB before spilling out-of-line to TOAST. LZ4 is much faster than pglz in tests, often compresses better, and still fails fast on incompressible data.
Experience Graphs: The Data Foundation for Self-Improving Agents (28 minute read)
Trellis stores agent artifacts, rewards, search data, and causal history as persistent experience graphs accessible through SQL, graph, vector, and temporal queries. Meta found that reusing past experience matched performance about 10x faster and reduced successful-solution token costs by 52%, though excessive memory reuse reduced exploration.
In-House LLM Serving at Netflix (7 minute read)
Netflix runs LLM serving end-to-end in-house, using a unified JVM-based platform with gRPC plus an OpenAI-compatible HTTP API, rather than relying on hosted APIs. The stack standardizes deployment through Triton-backed Model Scoring Service, using vLLM as the paved-path engine after re-benchmarking. It also adds custom packaging, zero-downtime rollouts, and patched guided decoding to prevent malformed JSON output.
From Weeks to a Day: How We Made LLM Evaluation Fast Enough to Iterate on (10 minute read)
Airbnb cut LLM evaluation cycles from weeks to under a day by caching generated references and judge scores, since over half of model outputs across candidates were identical strings and judge drift of about 1% per run. Small LoRA adapters with rank under 50 train in under an hour on a single GPU for same day fixes, and a final validation stage runs sampled traffic to catch failures.
Curated deep dives, tools and trends in big data, data science and data engineering π
Join 570,000 readers for
one daily email