London's Battle Against Duplicate Street Images: How the Capital Stacks Up Against New York, Tokyo and Berlin

London's network of 33 borough councils is sitting on a backlog of hundreds of thousands of duplicate images clogging public-facing planning portals, housing registers and heritage databases — and a coordinated effort to fix it is already running two years behind comparable initiatives in Tokyo and Berlin. The problem, mundane as it sounds, has real consequences: planning officers waste time cross-referencing the same site photographs filed under multiple reference numbers, housing applicants encounter stale or mismatched property images, and Freedom of Information requests pile up when records cannot be reliably matched to a single address.

The urgency has sharpened because Mayor Sadiq Khan's City Hall is midway through pushing boroughs onto a unified digital planning platform as part of the wider PropTech programme tied to the government's Planning and Infrastructure Bill. Duplicate imagery undermines the whole exercise. If two photographs of the same property in Southwark are tagged to different application numbers, automated tools that scan visual records to flag unauthorised development simply cannot function reliably. The Greater London Authority's Digital Planning team, based at City Hall on the South Bank, flagged the issue formally in a technical working paper circulated to borough planning leads in early 2026.

What London Is Actually Doing

Hackney Council and the London Borough of Lambeth are the furthest along. Hackney introduced a deduplication pipeline in January 2026 using open-source image-hashing software integrated with its back-end planning system, Idox. The process automatically identifies near-identical images — same file, slightly different compression or filename — and flags them for human review before archiving. Lambeth followed in March with a similar setup, concentrating first on its Brixton town centre regeneration zone, where several hundred planning applications submitted between 2019 and 2024 contained overlapping site photographs.

The cost is not trivial. Procurement documents published by Hackney put the initial contract for deduplication tooling and data cleansing at just under £180,000, covering an 18-month project through mid-2027. Other boroughs watching that figure have been slower to commit. Westminster City Council, which administers one of the densest concentrations of listed buildings in the country, has not yet published a comparable tender.

Transport for London faces its own version of the problem. Its asset management database — covering roughly 6,300 kilometres of road and 400-plus bridges — contains duplicate photographic surveys from different contractors working the same stretches of the A4 in Chiswick and the A13 corridor through Barking. TfL's Asset Information team acknowledged the overlap in its 2025-26 annual asset management report but has not set a public deadline for resolution.

How Other Cities Compare

The contrast with Tokyo is instructive. The Tokyo Metropolitan Government completed a city-wide deduplication exercise for its housing and urban planning image archive in March 2025, covering approximately 2.4 million records held across 23 special wards. The project ran through the Digital Agency's local government interoperability framework and took 14 months. Critically, Tokyo mandated a single image ingestion standard across all wards before the exercise began, which London has not done — boroughs still use at least four different document management systems.

Berlin's Senate Department for Urban Development wrapped a similar project in late 2024, focusing on images linked to the FIS-Broker spatial data platform. Berlin benefited from having already consolidated borough planning systems onto a single state-managed infrastructure after German federal digitisation legislation passed in 2021. London's fragmented structure, with each borough acting as its own local planning authority, makes that kind of top-down standardisation politically and legally difficult.

New York City's Department of City Planning has taken a different approach: rather than deduplicate existing archives, it imposed strict upload rules on its ZoLa planning portal from 2023 onwards, preventing duplicates at the point of submission. London could theoretically adopt the same approach for new applications immediately, regardless of what happens to legacy records.

For Londoners trying to navigate the planning system now, the practical advice is specific: when submitting applications through the Planning Portal, use unique, sequentially numbered filenames and avoid resubmitting the same photograph under multiple document categories. Borough planning officers say mislabelled or repeated images are among the leading causes of validation delays, adding days to what should be straightforward acknowledgements. The GLA's Digital Planning team has indicated it will publish updated submission guidance before the end of the third quarter of 2026.