How London's Planning System Got Buried in Duplicate Images — and Why It's Finally Being Fixed

Thousands of planning applications lodged with London boroughs contain duplicate images — the same photograph, site drawing, or technical diagram submitted multiple times under different file names — clogging digital archives and, in some cases, obscuring the actual evidence base on which decisions get made. The problem is not new. It has been building since councils began accepting digital submissions in earnest around 2010, and it has taken until 2025 and 2026 for the combination of stretched IT budgets and Keir Starmer's planning reform push to force the issue into the open.

The timing matters. The government's Planning and Infrastructure Bill, currently making its way through Parliament, places new obligations on local planning authorities to maintain searchable, auditable digital records. For boroughs like Tower Hamlets and Southwark — both processing hundreds of major applications a year along the Thames corridor — the state of their existing document stores is now directly relevant to whether they can comply with incoming statutory requirements.

How the Backlog Built Up

The root cause is straightforward. Before standardised upload portals, applicants emailed documents directly to case officers. A single planning file for a medium-sized residential scheme on, say, Old Kent Road might contain a flood-risk assessment submitted as three near-identical PDFs because the applicant revised the cover page twice and resubmitted each time without withdrawing earlier versions. Case officers, already managing caseloads that borough audits have repeatedly flagged as unsustainable, had neither the time nor the tools to deduplicate on receipt.

The Greater London Authority's own research unit estimated in a 2024 review of planning data quality across 12 inner London boroughs that duplicate or redundant documents accounted for between 18 and 24 percent of total stored files in legacy systems — a figure that translates directly into storage costs and search failures. Camden's planning portal, which serves one of the capital's busiest development zones around King's Cross and Euston, was specifically cited in that review as carrying a backlog of unresolved duplicate entries stretching back to 2012.

The Planning Portal, the national online gateway managed by TerraQuest Solutions on behalf of local authorities, introduced automated duplicate-detection flags in late 2023. But the tool applies only to new submissions. Everything lodged before that date remains in whatever condition councils left it — and in London, where major regeneration schemes in places like Elephant and Castle and the Royal Docks generated enormous document volumes throughout the 2010s, that legacy pile is substantial.

What Reform Looks Like Now

Sadiq Khan's office has linked digital record quality directly to the Mayor's London Plan commitments on housing delivery transparency. The London Legacy Development Corporation, which oversees the Queen Elizabeth Olympic Park area in Stratford, began a systematic deduplication exercise in January 2026 using software that cross-references file hashes rather than file names — a more reliable method that catches documents renamed to evade simple filters. The LLDC's project is being watched by several boroughs considering similar programmes.

Southwark Council launched its own records-cleaning tender in March 2026, covering approximately 40,000 application files generated between 2008 and 2020. The contract value has not been disclosed publicly, but comparable exercises in other English cities have run to several hundred thousand pounds for archives of that size.

For developers and their agents, the practical implication is straightforward: applications that go in now will be subject to far stricter document-management requirements at submission stage. The National Planning Policy Framework update expected later in 2026 is set to make document metadata standards a condition of valid application rather than best practice guidance. Applicants working on schemes anywhere from the Old Street roundabout to the Nine Elms riverside zone should expect pre-application meetings to include explicit discussion of how their digital submission package will be structured and validated before it reaches a case officer's desk. Agents who have not updated their internal document protocols since the email-submission era are running out of time to do so.