London's Duplicate Image Problem: The Numbers Councils Can't Ignore

Tens of thousands of duplicate images are clogging the digital planning and property databases of London's 32 boroughs, according to Freedom of Information requests filed by researchers at University College London's Bartlett School of Planning earlier this year. The Bartlett team estimated that across the Greater London Authority's linked data systems, somewhere between 12 and 18 per cent of all images held in active planning files are either exact duplicates or near-identical copies uploaded at separate stages of an application — wasting storage, slowing case officers and, in several documented instances, causing the wrong photograph to be attached to a listed building consent decision.

Why does this matter right now? The Starmer government's Planning and Infrastructure Bill, currently moving through the House of Commons, proposes mandatory digital-first planning submissions for all major applications from January 2027. That deadline is concentrating minds. If boroughs import their existing image libraries into the new national portal without first cleaning the data, errors embedded today will be locked into a system designed to last decades. The Department for Housing, Communities and Local Government has acknowledged the migration risk in its technical consultation documents, though it has not published a specific remediation budget.

Where the Backlog Is Worst

Tower Hamlets and Southwark are among the boroughs where the duplication problem is most visible to practitioners. At Tower Hamlets, planners processing applications around the Whitechapel Road regeneration zone have reported — in internal bulletins seen by The Daily London — that heritage photograph sets submitted for the Altab Ali Park conservation area review contained multiple identical images of the same Victorian facade uploaded under different file names. Southwark's planning portal, which handles high volumes of submissions related to the Elephant and Castle and Old Kent Road opportunity areas, logged over 4,200 image uploads in the first quarter of 2026 alone; a spot-check by the borough's digital team found roughly one in five was a duplicate or near-duplicate of a file already in the system.

Historic England, which maintains the National Heritage List for England and advises London boroughs on listed building casework, flagged the image integrity issue in its March 2026 guidance note on digital records management. The organisation noted that mis-labelled or repeated images in listed building consent files create legal ambiguity when conditions require photographic evidence of existing fabric before demolition or alteration begins.

The Cost in Time and Money

The financial arithmetic is straightforward, even if the political will to act on it has been slow. A 2025 audit commissioned by the London Borough of Lambeth — covering its planning and highways image archive on the Brixton-based server cluster — found that removing confirmed duplicates freed 1.4 terabytes of managed storage. At the contracted rate Lambeth was paying its cloud storage provider at the time, that represented a saving of approximately £6,200 annually. Multiply that across 32 boroughs with larger and older archives, and the potential saving runs well into six figures each year across the capital.

Beyond storage costs, case officer time is the real currency. The Bartlett researchers estimated that a senior planning officer loses an average of 23 minutes per week manually reconciling image discrepancies in complex applications — a figure that compounds quickly across a borough with 40 or 50 case officers. At median Greater London Council-grade salaries, that translates to lost productivity worth roughly £180,000 per borough per year. Across all 32 boroughs, the number approaches £5.8 million annually.

Automated deduplication tools already exist and are in use by commercial property platforms including Rightmove and Zoopla, which process millions of listing images daily. Several councils, including Camden and Islington, have begun trialling open-source image-hashing tools adapted from the software sector — Camden's pilot, run out of its Euston Road office since February 2026, reportedly cleared 8,000 duplicates from its pre-2020 archive in a single weekend processing run.

Boroughs that have not yet begun deduplication audits should treat the January 2027 national portal deadline as a hard backstop. The GLA's Digital Planning programme team has said it will publish data migration standards for image files by September 2026. That leaves a narrow window — roughly six months — for boroughs to audit, clean and reformat their archives before mandatory digital submission rules come into force and any existing mess becomes everyone's permanent problem.