Towards Scalable Visual Data Wrangling via Direct Manipulation
Abstract
Data wrangling—the process of cleaning, transforming, and preparing data for analysis—is a well-known bottleneck in data science workflows. Existing tools either rely on manual scripting, which is error-prone and hard to debug, or automate cleaning through opaque black-box pipelines that offer limited control. We present Buckaroo, a scalable visual data wrangling system that restructures data preparation as a direct manipulation task over visualizations. Buckaroo enables users to explore and repair data anomalies—such as missing values, outliers, and type mismatches— by interacting directly with coordinated data visualizations. The system extensibly supports user-defined error detectors and wranglers, tracks provenance for undo/redo, and generates reproducible scripts for downstream automation. Buckaroo maintains efficient indexing structures and differential storage to localize anomaly detection and minimize recomputation. To demonstrate the applicability of our model, Buckaroo is integrated with the Hopara pan-and-zoom engine, which enables multi-layered navigation over large datasets without sacrificing interactivity. Through computational experiments and an expert review, we show that Buckaroo makes visual data wrangling scalable—bridging the gap between visual inspection and programmable repairs.