More on the topic...
Generating detailed summary...
Failed to generate summary. Please try again.
At Spotify, teams struggled to get reliable data because there are over 70,000 datasets across petabytes of storage and no single expert knows it all. Traditional dashboards couldn’t keep up, and Slacking a data guru introduced long waits. Simply dumping warehouse schemas into an LLM failed: context windows top out, and raw table definitions don’t capture quirks like legacy test data or nuanced business terms. Spotify solved this with Vedder, a data assistant that routes questions to the right “cluster” of domain-owned context, generates SQL, runs it, and returns results plus the query and sources.
Each cluster groups relevant tables (with schema, column cardinality, sample values), hand-picked question-and-SQL examples, and written docs on terminology and gotchas. Domain experts curate these three components. They rejected 87.5% of auto-generated example pairs drawn from historical queries, because most past queries are one-offs or teach bad patterns. By keeping only vetted examples, clusters encode true business knowledge. When a question arrives, Vedder uses a ReAct loop—reasoning, acting, checking tool outputs—to build and refine its SQL before returning a final answer.
Clusters earn a health score based on signals like schema drift, validity of curated pairs after changes, reproducibility of generated queries, and coverage of actual user questions. If a column is renamed or a table deprecated, that cluster’s score drops and suggests specific maintenance tasks on its dashboard. Every user interaction—questions, SQL, feedback—feeds back to cluster owners, helping them spot gaps and update examples or docs. That feedback loop scales each expert’s reach, shifting their work from answering ad-hoc requests to stewarding a shared context layer for thousands of users.
Questions about this article
No questions yet.