IBM Corp. and the European Space Agency are collaborating on an AI system called TerraMind to monitor climate change using space-based data.
TerraMind is a multimodal AI model based on a transformer encoder-decoder architecture, trained on TerraMesh geospatial data.
It integrates pixel-based, token-based, and sequence-based inputs for Earth observation tasks like predicting water scarcity risks.
TerraMind outperformed 12 other models, as per ESA evaluations, by over 8% on tasks like land cover classification and change detection.
The model leverages nine core modalities, including ESA satellite data, to provide a comprehensive understanding of Earth systems.
IBM's TerraMind utilizes the 'Thinking-in-Modalties' tuning technique to enhance performance by generating synthetic data from various modalities.
This AI model has applications in disaster management, agriculture, infrastructure monitoring, and environmental studies.
AI expert Holger Mueller views TerraMind as a significant advancement in Earth observation, offering a holistic view of the planet.
TerraMind has been made open source on platforms like Hugging Face, with plans to release specialized versions for disaster response.
The collaboration between IBM, ESA, and experts highlights the synergy of earth observation, machine learning, and data science for impactful applications.