Tag Archives: NASA’s Jet Propulsion Laboratory

The cost of building ChatGPT

After seeing the description for Laura U. Marks’s recent work ‘Streaming Carbon Footprint’ (in my October 13, 2023 posting about upcoming ArtSci Salon events in Toronto), where she focuses on the environmental impact of streaming media and digital art, I was reminded of some September 2023 news.

A September 9, 2023 news item (an Associated Press article by Matt O’Brien and Hannah Fingerhut) on phys.org and also published September 12, 2023 on the Iowa Public Radio website, describe an unexpected cost for building ChatGPT and other AI agents, Note: Links have been removed,

The cost of building an artificial intelligence product like ChatGPT can be hard to measure.

But one thing Microsoft-backed OpenAI needed for its technology was plenty of water [emphases mine], pulled from the watershed of the Raccoon and Des Moines rivers in central Iowa to cool a powerful supercomputer as it helped teach its AI systems how to mimic human writing.

As they race to capitalize on a craze for generative AI, leading tech developers including Microsoft, OpenAI and Google have acknowledged that growing demand for their AI tools carries hefty costs, from expensive semiconductors to an increase in water consumption.

But they’re often secretive about the specifics. Few people in Iowa knew about its status as a birthplace of OpenAI’s most advanced large language model, GPT-4, before a top Microsoft executive said in a speech it “was literally made next to cornfields west of Des Moines.”

In its latest environmental report, Microsoft disclosed that its global water consumption spiked 34% from 2021 to 2022 (to nearly 1.7 billion gallons , or more than 2,500 Olympic-sized swimming pools), a sharp increase compared to previous years that outside researchers tie to its AI research. [emphases mine]

“It’s fair to say the majority of the growth is due to AI,” including “its heavy investment in generative AI and partnership with OpenAI,” said Shaolei Ren, [emphasis mine] a researcher at the University of California, Riverside who has been trying to calculate the environmental impact of generative AI products such as ChatGPT.

If you have the time, do read the O’Brien and Fingerhut article in it entirety. (Later in this post, I have a citation for and a link to a paper by Ren.)

Jason Clayworth’s September 18, 2023 article for AXIOS describes the issue from the Iowan perspective, Note: Links have been removed,

Future data center projects in West Des Moines will only be considered if Microsoft can implement technology that can “significantly reduce peak water usage,” the Associated Press reports.

Why it matters: Microsoft’s five WDM data centers — the “epicenter for advancing AI” — represent more than $5 billion in investments in the last 15 years.

Yes, but: They consumed as much as 11.5 million gallons of water a month for cooling, or about 6% of WDM’s total usage during peak summer usage during the last two years, according to information from West Des Moines Water Works.

This information becomes more intriguing (and disturbing) after reading a February 10, 2023 article for the World Economic Forum titled ‘This is why we can’t dismiss water scarcity in the US‘ by James Rees and/or an August 11, 2020 article ‘Why is America running out of water?‘ by Jon Heggie published by the National Geographic, which is a piece of paid content. Note: Despite the fact that it’s sponsored by Finish Dish Detergent, the research in Heggie’s article looks solid.

From Heggie’s article, Note: Links have been removed,

In March 2019, storm clouds rolled across Oklahoma; rain swept down the gutters of New York; hail pummeled northern Florida; floodwaters forced evacuations in Missouri; and a blizzard brought travel to a stop in South Dakota. Across much of America, it can be easy to assume that we have more than enough water. But that same a month, as storms battered the country, a government-backed report issued a stark warning: America is running out of water.

As the U.S. water supply decreases, demand is set to increase. On average, each American uses 80 to 100 gallons of water every day, with the nation’s estimated total daily usage topping 345 billion gallons—enough to sink the state of Rhode Island under a foot of water. By 2100 the U.S. population will have increased by nearly 200 million, with a total population of some 514 million people. Given that we use water for everything, the simple math is that more people mean more water stress across the country.

And we are already tapping into our reserves. Aquifers, porous rocks and sediment that store vast volumes of water underground, are being drained. Nearly 165 million Americans rely on groundwater for drinking water, farmers use it for irrigation―37 percent of our total water usage is for agriculture—and industry needs it for manufacturing. Groundwater is being pumped faster than it can be naturally replenished. The Central Valley Aquifer in California underlies one of the nation’s most agriculturally productive regions, but it is in drastic decline and has lost about ten cubic miles of water in just four years.

Decreasing supply and increasing demand are creating a perfect water storm, the effects of which are already being felt. The Colorado River carved its way 1,450 miles from the Rockies to the Gulf of California for millions of years, but now no longer reaches the sea. In 2018, parts of the Rio Grande recorded their lowest water levels ever; Arizona essentially lives under permanent drought conditions; and in South Florida’s freshwater aquifers are increasingly susceptible to salt water intrusion due to over-extraction.

The focus is on individual use of water and Heggie ends his article by suggesting we use less,

… And every American can save more water at home in multiple ways, from taking shorter showers to not rinsing dishes under a running faucet before loading them into a dishwasher, a practice that wastes around 20 gallons of water for each load. …

As an advertising pitch goes, this is fairly subtle as there’s no branding in the article itself and it is almost wholly informational.

Attempts to stave off water shortages as noted in Heggie’s and other articles include groundwater pumping both for individual use and industrial use. This practice has had an unexpected impact according to a June 16, 2023 article by Warren Cornwall for Science (magazine),

While spinning on its axis, Earth wobbles like an off-kilter top. Sloshing molten iron in Earth’s core, melting ice, ocean currents, and even hurricanes can all cause the poles to wander. Now, scientists have found that a significant amount of the polar drift results from human activity: pumping groundwater for drinking and irrigation.

“The very way the planet wobbles is impacted by our activities,” says Surendra Adhikari, a geophysicist at NASA’s Jet Propulsion Laboratory and an expert on Earth’s rotation who was not involved in the study. “It is, in a way, mind boggling.”

Clark R. Wilson, a geophysicist at the University of Texas at Austin, and his colleagues thought the removal of tens of gigatons of groundwater each year might affect the drift. But they knew it could not be the only factor. “There’s a lot of pieces that go into the final budget for causing polar drift,” Wilson says.

The scientists built a model of the polar wander, accounting for factors such as reservoirs filling because of new dams and ice sheets melting, to see how well they explained the polar movements observed between 1993 and 2010. During that time, satellite measurements were precise enough to detect a shift in the poles as small as a few millimeters.

Dams and ice changes were not enough to match the observed polar motion. But when the researchers also put in 2150 gigatons of groundwater that hydrologic models estimate were pumped between 1993 and 2010, the predicted polar motion aligned much more closely with observations. Wilson and his colleagues conclude that the redistribution of that water weight to the world’s oceans has caused Earth’s poles to shift nearly 80 centimeters during that time. In fact, groundwater removal appears to have played a bigger role in that period than the release of meltwater from ice in either Greenland or Antarctica, the scientists reported Thursday [June 15, 2023] in Geophysical Research Letters.

The new paper helps confirm that groundwater depletion added approximately 6 millimeters to global sea level rise between 1993 and 2010. “I was very happy” that this new method matched other estimates, Seo [Ki-Weon Seo geophysicist at Seoul National University and the study’s lead author] says. Because detailed astronomical measurements of the polar axis location go back to the end of the 19th century, polar drift could enable Seo to trace the human impact on the planet’s water over the past century.

Two papers: environmental impact from AI and groundwater pumping wobbles poles

I have two links and citations for Ren’s paper on AI and its environmental impact,

Towards Environmentally Equitable AI via Geographical Load Balancing by Pengfei Li, Jianyi Yang, Adam Wierman, Shaolei Ren. Subjects: Artificial Intelligence (cs.AI); Computers and Society (cs.CY) Cite as: arXiv:2307.05494 [cs.AI] (or arXiv:2307.05494v1 [cs.AI] for this version) DOI: https://doi.org/10.48550/arXiv.2307.05494 Submitted June 20, 2023

Towards Environmentally Equitable AI via Geographical Load Balancing by Li, Pengfei; Yang, Jianyi; Wierman, Adam; Ren, Shaolei. UC Riverside. Retrieved from https://escholarship.org/uc/item/79c880vf Publication date: 2023-06-27

Both links offer open access to the paper. Should you be interested in more, you can find Shaolei Ren’s website here.

Now for the wobbling poles,

Drift of Earth’s Pole Confirms Groundwater Depletion as a Significant Contributor to Global Sea Level Rise 1993–2010 by Ki-Weon Seo, Dongryeol Ryu, Jooyoung Eom, Taewhan Jeon, Jae-Seung Kim, Kookhyoun Youm, Jianli Chen, Clark R. Wilson. Geophysical Research Letters Volume 50, Issue 12, 28 June 2023 e2023GL103509 DOI: https://doi.org/10.1029/2023GL103509 First published online: 15 June 2023

This paper too is open access.

Virtual Reality (VR) becomes educational (at Case Western Reserve University and Miami Children’s Hospital)

I have two virtual reality news bits the most recent concerning Case Western Reserve University (CWRU; located in Cleveland, Ohio) and Microsoft’s HoloLens in an April 29, 2015 CWRU press release (also on EurekAlert), Note: Some of this academic press release reads like marketing collateral,

Case Western Reserve University Radiology Professor Mark Griswold knew his world had changed the moment he first used a prototype of Microsoft’s HoloLens headset. Two months later, one of the university’s medical students illustrated exactly why.

“There’s the aortic valve,” Satyam Ghodasara exclaimed as he used Microsoft’s device to examine a holographic heart. “Now I understand.”

Today, Griswold told tens of thousands of people how HoloLens can transform learning across countless subjects, including those as complex as the human body. Speaking to an in-person and online audience at Microsoft’s annual Build conference, he highlighted disciplines as disparate as art history and engineering–but started with a holographic heart. In traditional anatomy, after all, students like Ghodasara cut into cadavers to understand the body’s intricacies.

With HoloLens, Griswold explained, “you see it truly in 3D. You can take parts in and out. You can turn it around. You can see the blood pumping–the entire system.”

In other words, technology not only can match existing educational methods–it can actually improve upon them. Which, in many ways, is why Cleveland Clinic CEO Toby Cosgrove contacted then-Microsoft executive Craig Mundie in 2013, after the hospital and university first agreed to partner on a new education building.

“We launched this collaboration to prepare students for a health care future that is still being imagined,” Cleveland Clinic CEO Delos “Toby” Cosgrove said of what has become a 485,000-square-foot Health Education Campus project. “By combining a state-of-the-art structure, pioneering technology, and cutting-edge teaching techniques, we will provide them the innovative education required to lead in this new era.”

As Cosgrove, Case Western Reserve President Barbara R. Snyder and other academic leaders engaged more extensively with Microsoft, the more potential everyone saw.

“For more than a century, our medical school has been renowned for inventing and reinventing approaches to teaching and learning that take root nationwide,” President Snyder said. “When we match that expertise with the interdisciplinary knowledge of our faculty, we create a rich environment to explore the educational potential of Microsoft’s extraordinary technology.”

After a small group including Griswold, engineering professor Marc Buchner and Cleveland Clinic education technology leader Neil Mehta first experienced HoloLens in December, the faculty returned to Cleveland to create a core team dedicated to exploring the technology’s academic potential. In February, 10 members of the team–including Ghodasara–returned to Microsoft for a HoloLens programming deep dive.

Ghodasara already had taken the traditional anatomy class at Case Western Reserve, but it wasn’t until he used the HoloLens headset that he first visualized the aortic valve in its entirety–unobstructed by other elements of the cardiac system and undamaged by earlier dissection efforts. Members of the Microsoft team were in the room when Ghodasara had his “aha” moment; a few weeks later, the heart demonstration became part of the Build conference agenda.

Case Western Reserve is the only university represented during the three-day event, a distinction Griswold attributes in part to the core team’s breadth of expertise and collegial approach.

“Without all of those people coming together,” Griswold said, “this would not have happened.”

When Griswold took the stage as part of Microsoft’s opening keynote at the Build conference, Ghodasara, Buchner and Chief Information Officer Sue Workman also were in the audience. Back in Cleveland, three of Professor Buchner’s undergraduates–John Billingsley, Henry Eastman and Tim Sesler–demonstrated some of the potential of the HoloLens technology live in the Tinkham Veale University Center.

Buchner, whose specialties include simulation and game design, believes Microsoft’s innovation “has the capability to transform engineering education.”

Because the technology is relatively easy to use, students will be able to build, operate and analyze all manner of devices and systems. “[It will] encourage experimentation,” Buchner said, “leading to deeper understanding and improved product design.”

In truth, HoloLens ultimately could have applications for dozens of Case Western Reserve’s academic programs. NASA’s Jet Propulsion Laboratory already has worked with Microsoft to develop software that will allow Earth-based scientists to work on Mars with a specially designed rover vehicle. A similar collaboration could enable students here to take part in archeological digs around the world. Or astronomy students could stand in the midst of colliding galaxies, securing front-row view of the unfolding chaos. Art history professors could present masterpieces in their original settings–a centuries-old castle, or even the Sistine Chapel.

“The whole campus has the potential to use this,” Griswold said. “Our ability to use this for education is almost limitless.”

For now, however, the top priority is creating a full digital anatomy curriculum, a process launched with the advent of the Health Education Campus, and now experiencing even greater momentum. Among the key collaborators are a team of medical students and anatomy and radiology faculty who are already investigating the use of these kinds of technology. This team, led by Amy Wilson­Delfosse, the medical school’s associate dean for curriculum, and Suzanne Wish-Baratz, an assistant professor who is one of the primary leaders of anatomy education, fully expects to have a digital curriculum ready for the new Health Education Campus.

Also essential, Griswold said, has been the advice and assistance of Microsoft’s HoloLens team and executives.

“It’s been a joy to work with them. They have been so friendly, so collaborative, so willing to work with us on this,” Griswold said. “We’re going to do incredible things together.”

Ohio is not the only state where virtual reality is being incorporated into medical education.

Florida

From an April 30, 2015 Next Galaxy Corp. news release,

Incorporating eye gaze control, gestures, and voice commands while “walking around” inside an emergency medical experience, Next Galaxy’s Virtual Reality Model educates participants far beyond today’s methodology of passively watching video and taking written tests.

Next Galaxy Corp (OTC: NXGA) recently announced the signing of an agreement with Miami Children’s Hospital to use the Company’s VR Model to develop immersive Virtual Reality medical instructional content for patient and medical professional education. Per the multi-year agreement, Next Galaxy and Miami Children’s Hospital are jointly developing VR Instructionals on cardiopulmonary resuscitation (CPR) and other lifesaving procedures, which will be released as an application for smartphones.

Assessments are incorporated directly into the medical VR models, creating situations where participants are required to make the appropriate decisions about proper techniques. The Virtual CPR instructional will measure metrics and provide real-time feedback ensuring participants accurately perform CPR techniques. Further, the instructional will explain any mistake and prompt users to try again when errors are made. Supportive messages are delivered upon success.

The medical VR models will be viewable through smartphones and desktops as 3D, and via VR devices such as Google Cardboard, VRONE and Oculus Rift.

About Next Galaxy Corporation

Next Galaxy Corporation is a leading developer of innovative content solutions and fully Immersive Consumer Virtual Reality technology. The Company’s flagship consumer product in development is CEEK, a next-generation fully immersive entertainment and educational social virtual reality platform featuring a combination of live action and 3D experiences. Next Galaxy’s CEEK simulates the communal experience of attending events, such as concerts, sporting events, movies or conferences through Virtual Reality. Next Galaxy is developing entertainment and educational experiences for VR Cinema, VR Concerts, VR Sports, VR Business, VR Tourism and more. In short, Next Galaxy is building the meeting places of the future. For further information, visit www.nextgalaxycorp.com

This seems to be the second time this information has been distributed (March 11, 2015 news release on PRNewswire), a widely adopted practice. Consequently and thankfully, there’s a March 11, 2015 article by Celia Ampel for the South Florida Business Journal which provides more details about the technology and explaining how a smartphone fits into virtual reality,

The best way to learn CPR is an immersive experience, Miami Children’s Hospital leaders believe — not a video.

“If I’m watching a video, I can pause and count, but there’s no way to tell if I counted to six or seven,” Next Galaxy President Mary Spio said. “Because [the virtual reality application] is voice-activated, they’re going to be able to count out loud and self-assess whether they’re doing it correctly.”

Next Galaxy (Pink Sheets: NXGA)’s virtual reality technology uses a smartphone app. Users can put their smartphone into a virtual reality headset for an immersive experience, or see 3D content through the phone.

The application will be available to the public in the next few months, Spio said.

This deal and another with Miami-Dade Country Public Schools are transforming Next Galaxy Corp according to Ampel’s article,

The five-person company will be hiring about 20 full-time employees in the next six months, focusing on developers with 3D modeling and gaming experience, she said.

Quadrupling the size of your company in six months can be quite a challenge. I wish them good luck with their expansion and their virtual reality course materials.

As to what all this mixed-reality/virtual reality might look like, there’s this image from Case Western Reserve University,

Courtesy: Case Western Reserve University

Courtesy: Case Western Reserve University