Tag Archives: AI urbanism

AI governance in the real-world ‘city brain’ project: possible pitfalls

An April 16, 2025 Trinity College Dublin press release illustrates the pervasiveness of generative artificial intelligence (Generative AI, GenAI, or GAI) in the management of cities,

The work underscores what can go wrong when an AI that manages city transport, safety, health and environmental monitoring predicts the future and intervenes in the present, significantly influencing urban governance and public policy development.

Generative Artificial Intelligence (AI) is boosting anticipatory forms of governance around the world, helping state actors to predict the future and focus their efforts in the present where the AI predicts they can have the greatest positive impact.

This phenomenon is particularly evident in China, but similar forms of governance mediated by generative AI are also becoming increasingly popular in Europe and the seeds of this trend are already visible in Ireland.

In this context, “city brains” represent an emerging type of generative AI currently employed in urban governance and public policy in a growing number of cities. City brains are large-scale AIs residing in vast digital urban platforms, which use Large Language Models (LLMs) to generate visions of urban futures: visions that are in turn used by policymakers to generate new urban policies. In China alone, there are over 500 cities developing city brains.

However, one of the main foreseeable dangers is the formation of a policy process that, under the influence of unintelligible LLMs, risks losing transparency and thus accountability, with another being the marginalisation of human stakeholders (citizens, in particular) as the role of AI in the management of cities keeps growing and governance begins to turn posthuman.

And by focusing on a real-world city brain project operating in the Haidian district of Beijing (China), which has a population of around 3,000,000 people and gathers data from over 14,000 CCTV cameras and over 20,000 environmental sensors, the researchers have been able to show these dangers are not just theoretical.

A person stands looking at an interactive dashboard of an existing City Brain system in China, at an interactive exhibition centre for the public. The dashboard of an existing City Brain system in China. Image credit: Dr Ying Xu.

Dr Federico Cugurullo, Associate Professor in Trinity’s School of Natural Sciences, is a leading expert in AI urbanism and the first author of the research, which has been published in the journal Policy and Society.

He said: “We can think of the Haidian city brain project as a gigantic panopticon that constantly observes what is happening it the city. It is operated by AI and focuses on three main areas of governance that are shaped by its predictions: environmental risk management, traffic management and public security.”

“For example, in the case of an impending natural disaster, policies are rapidly implemented to build new infrastructure meant to reinforce riverbanks and increase the efficiency of the city’s drainage systems. Outcomes also include direct interventions when, for example, police officers are dispatched to prevent illegal activities in an area where, according to the city brain, crimes are likely to take place in the near future.”

“However, the predictions of the Haidian city brain are far from being infallible. Our research reveals that the accuracy rate of what the city brain predicts varies from 60% to 90%, which leaves a significant margin of error around such important decisions, for which there is no understanding as to why they have been implemented. This is particularly dangerous when it comes to predictive policing, since any error made by AI means that an innocent person will be targeted by the police for hypothetical crimes that never took place.”

This research forms part of the ORACLE project led by Professor Cugurullo, which was funded by Research Ireland (formerly the Irish Research Council).

Here’s a link to and a citation for the paper,

When AIs become oracles: generative artificial intelligence, anticipatory urban governance, and the future of cities by Federico Cugurullo, Ying Xu. Policy and Society, Volume 44, Issue 1, January 2025, Pages 98–115, DOI: https://doi.org/10.1093/polsoc/puae025 Published online: 01 August 2024

This paper is open access.

For anyone unfamiliar with the ‘panopticon’, there’s an entry in Wikipedia, Note: Links have been removed,

The panopticon is a design of institutional building with an inbuilt system of control, originated by the English philosopher and social theorist Jeremy Bentham in the 18th century. The concept is to allow all prisoners of an institution to be observed by a single corrections officer, without the inmates knowing whether or not they are being watched.

Although it is physically impossible for the single guard to observe all the inmates’ cells at once, the fact that the inmates cannot know when they are being watched motivates them to act as though they are all being watched at all times. They are effectively compelled to self-regulation. The architecture consists of a rotunda with an inspection house at its centre. From the centre, the manager or staff are able to watch the inmates. Bentham conceived the basic plan as being equally applicable to hospitals, schools, sanatoriums, and asylums. …

I have not been able to find a website for Cugurullo’s ORACLE project but I did find Cugurullo’s January 3, 2025 essay “AI could make cities autonomous, but that doesn’t mean we should let it happen,” which discusses a new field “AI urbanism” and includes the example of an enormous Saudi Arabian project, Neom and its linear city, The Line.