The Register: AI’s thirst for water is alarming, but may solve itself

Source URL: https://www.theregister.com/2024/09/05/ai_water_energy/
Source: The Register
Title: AI’s thirst for water is alarming, but may solve itself

Feedly Summary: Its energy addiction, on the other hand, only seems to get worse
Comment Once an abstract subject of science fiction and academic research, the concept of artificial intelligence has become the topic of dinner table conversations over the past two years.…

AI Summary and Description: Yes

**Summary:** The text provides an in-depth analysis of the environmental impacts of artificial intelligence, particularly concerning water consumption in datacenters that support AI models. It outlines the operational choices that datacenter operators face regarding cooling methods and their implications on energy and water use, emphasizing a shift toward more sustainable practices through liquid cooling technologies.

**Detailed Description:**
The discussion focuses on the growing prominence of artificial intelligence and its environmental ramifications, particularly in relation to datacenter operations. Key points include:

– **Increased Awareness of Environmental Impact:** The rise of AI technology has shifted public attention to its environmental consequences, particularly the significant resources required for training AI models.

– **Water Consumption Trends:**
– A report indicates a 66% increase in water consumption in Northern Virginia datacenters over five years due to AI model training, with substantial water usage attributed to cooling technologies.
– The example of ChatGPT is cited, demonstrating its substantial water needs for operational models (500 ml for a conversation).

– **Scale of AI Models:**
– The text contrasts the parameter size of older models like GPT-3 (175 billion) with newer ones like GPT-4 (1.7 to 1.8 trillion), suggesting that as AI models grow, so do their infrastructure demands.

– **Cooling Technology and Water Use:**
– Datacenters utilize various cooling methods, notably evaporative cooling, which can heavily affect local water resources—an environmental concern as it extracts water from local ecosystems.
– Alternatives like dry coolers and refrigerant-based systems are highlighted, particularly their application in various climates affecting operational choices.

– **Economic Considerations in Cooling Decisions:**
– The decision to use water-intensive cooling systems often hinges on cost-effectiveness and operational efficiency, with datacenter operators facing trade-offs between power and water costs.

– **Emerging Technologies:**
– The increasing density of chips, such as Nvidia’s Grace Blackwell Superchips rated at 2,700W, drives a move toward liquid cooling methodologies that provide better energy efficiency but require significant infrastructure adjustments.
– Potential benefits of liquid cooling include reduced water consumption, enabling dry cooling systems, and recycling heat for secondary uses, such as district heating.

– **Future Implications:**
– Until liquid cooling technologies see widespread deployment, the issue of water usage in datacenters will likely continue to receive attention, necessitating more sustainable practices and possible regulatory scrutiny.

This analysis is valuable for security, privacy, and compliance professionals to understand the evolving nexus between AI technology, datacenter operations, and environmental sustainability, considering the broader regulatory and compliance implications of increased resource consumption in a climate-sensitive world.