Single ChatGPT Query Uses Enough Electricity to Burn Light Bulb for 20 Minutes

Dr Anna Bosman is a Senior Lecturer in the Faculty of Engineering, Built Environment and Information Technology at the University of Pretoria. As an academic within the department, she plays a key role in teaching, research, and advancing knowledge in her field.

A single query to ChatGPT uses as much electricity as burning a light bulb for about 20 minutes. Multiply that by the millions of requests that this artificial intelligence (AI) chatbot receives each day, and the environmental impact is ominous.

The Computational Intelligence Research Group (CIRG), led by Dr Anna Bosman of the University of Pretoria’s (UP) Department of Computer Science, is searching for ways to reduce the energy consumption of artificial neural networks without sacrificing their performance.

“If we want AI to be sustainable, we must make it compressible,” she said.

Automatically extract patterns

Artificial neural networks (ANNs) can automatically extract patterns from data through a process called training or machine learning (ML). While ‘artificial’, ANNs were inspired by the human brain’s ability to process information.

ML allowed computers to perform tasks such as image recognition, natural language processing and decision-making without being explicitly programmed. However, the size and complexity of the ANNs have grown exponentially over the past decade, and that’s not always good news.

“State-of-the-art ANNs often have billions of parameters, demanding massive computational power for training and deployment,” Dr Bosman explained.

“This rapid increase in model size has raised significant concerns about their accessibility and environmental impact. The data centres built in Ireland, which are crucial for the modern ML infrastructure, are projected to consume 27% of the country’s electricity by 2029.

An average data centre is estimated to use as much water as three average-sized hospitals. Using large ANNs is costly and has a significant environmental footprint.”

AI remains inaccessible

Another downside of large ANNs is that they cannot be deployed in resource-constrained environments. Not everybody has access to a Google data centre. As such, impressive progress in AI remains inaccessible to those who may need it most: doctors in rural areas, small-scale farmers and nature conservationists.

“Energy efficiency can be achieved in two ways: by compressing large models to reduce their size or by designing more expressive ANN architectures requiring fewer parameters to achieve comparable results to standard ANNs,” Dr Bosman said.

A promising avenue for green ML is knowledge distillation (KD), a method of transferring knowledge from a large ‘teacher’ ANN to a smaller ‘student’ ANN to preserve performance in a more compact form; this is done by mimicking the information representation of the teacher.

Using this technique, Dr Anna Bosman and collaborators achieved a tenfold reduction in the size of a pest detection model for a farming project in Rwanda. Another research project is underway where KD methods are applied directly to the ANN parameters rather than the outputs they produce.

Next generation of AI

Heinrich van Deventer, a PhD student at CIRG and recipient of a Google PhD Fellowship, is using his background in theoretical physics to develop radically new compact ANN architectures (or neural operators) from the ground up. The trick is to treat inputs as continuous functions similar to analogue computing, rather than discrete or independent variables.

“Such compact ANN models may become the building blocks for the next generation of AI that is accessible to all, and mindful of the world,” he said.

3 More stories about AI technology

• Speaking exclusively to Briefly News, Priaash Ramadeen said he and a group of SA innovators created AI software to combat poaching effectively.
• Less than 3% of female students in higher education choose to pursue ICT (Information and Communication Technology) courses.
• Marvel Shibambu, named one of Briefly News' 2025 Young Money Makers, is a self-taught coder who co-created the NOVAR app.

Disclaimer: The views and opinions expressed here are those of the author and do not necessarily reflect the official policy or position of Briefly News.

Source: Briefly News