Session

DescriptionFoundation models represent a new class of artificial intelligence models designed to encapsulate information from large amounts of data. The most prominent example are large language models, which have achieved significant breakthroughs in various applications, including natural language processing (NLP), text generation, and machine translation. Some prominent examples of foundation models include GPT models, BERT, PalmX and their derivatives. This workshop will explore the untapped potential of foundation models in Earth system science, bringing together three different perspectives. First, we will introduce AtmoRep, a foundation model for the atmosphere released by a multidisciplinary collaboration between Magdeburg University, CERN and JSC. After that, we will move the discussion to the industry perspective, with Dr. Johannes Jakubik from IBM. In particular, Dr. Jakubik will present the Prithvi model for Earth Observations data, developed in collaboration with NASA. After that, Troy Arcomano from Argonne National Laboratory will present two different models: ClimaX, released in collaboration with Microsoft, and Stromer. The last part of the workshop will be an interactive discussion with the audience on the role of foundation models in fundamental science. It will be the occasion for the community to brainstorm around the future and the potential of these new technologies.