DC Agencies Race to Purge Duplicate Records as Cities From London to Seoul Wrestle With the Same Digital Mess

Washington DC's Office of the Chief Technology Officer has been quietly working through a backlog of duplicate digital images embedded in city agency databases — a problem that has ballooned as the District digitized decades of paper records during the pandemic years and has only grown more urgent as federal funding uncertainty forces the Bowser administration to find savings wherever it can.

The issue is unglamorous but expensive. Municipal governments store enormous volumes of scanned documents, permit photos, property inspection images, and ID records. Without automated deduplication protocols, identical files get saved multiple times across different departments, inflating cloud storage costs and slowing retrieval systems used by workers at agencies ranging from DC Health to the Department of Consumer and Regulatory Affairs on K Street NW.

A Problem Made Worse by DOGE-Era Budget Pressure

The Trump administration's restructuring of the federal workforce, driven in part by the Department of Government Efficiency, has rippled directly into the District's finances. Federal grants and shared-service agreements that once subsidized parts of DC's IT infrastructure are under review, making every line item on the city's own technology budget more visible to council members. At a DC Council oversight hearing in March 2026, technology spending came under scrutiny, with members pressing the OCTO on whether storage costs could be reduced without cutting front-line services.

DC is not alone in facing this reckoning. London's Government Digital Service began a formal duplicate-asset reduction programme in 2023 across borough councils, targeting an estimated 30 percent redundancy rate in scanned planning documents. Seoul's Smart City division reported in late 2024 that automated hashing tools — software that assigns a unique fingerprint to every image file — had reduced their municipal image library by roughly 18 percent within 12 months of deployment, according to a report published by the Korea Institute of Public Administration. Amsterdam's city archive, which manages records for a metropolitan area of about 1.1 million residents, completed a similar deduplication sweep in early 2025 and publicly cited storage cost reductions as a key outcome.

DC's population of roughly 689,000 puts it closer in scale to Amsterdam than to London or Seoul, but the city's role as a federal capital means its agencies handle records volumes that dwarf those of comparable-sized municipalities. The District's Department of Buildings, which consolidated several permitting functions under a 2022 reorganisation, holds tens of thousands of property inspection photographs, many of which advocates for digital efficiency say are stored in multiple locations within the agency's content management system.

What DC Is Doing — and What It Hasn't Done Yet

The OCTO has piloted a deduplication tool in the Anacostia-based Department of Public Works satellite office, according to procurement records posted on the DC eProcurement portal in January 2026. The pilot covers vehicle fleet inspection images and road-condition photographs taken along corridors including Martin Luther King Jr. Avenue SE and Good Hope Road SE — areas that have seen increased infrastructure scrutiny alongside the broader gentrification pressures reshaping the neighborhood.

A separate initiative through the NoMa Business Improvement District, which manages some shared data infrastructure for commercial property compliance in the Northeast corridor, began its own internal image audit in February 2026 after a storage invoice from a cloud vendor showed a 22 percent year-over-year increase in costs that administrators traced partly to file duplication.

The gap between DC and its global peers comes down to timing and mandate. London and Seoul acted with explicit government directives and allocated ring-fenced budgets for the work. DC's efforts remain pilot-scale and depend on discretionary allocations that compete with higher-profile priorities like Metro funding and affordable housing programs.

For residents and businesses dealing with city agencies, the practical consequence is slower database searches, occasional delays in permit-status updates, and a city IT budget under pressure it did not need. The OCTO is expected to present a full deduplication roadmap to the DC Council's Committee on Technology and the Environment before the end of the third quarter of 2026. Whether that roadmap arrives with committed funding attached will determine how quickly Washington closes the gap on cities that moved earlier and faster.