Using ML to monitor coral reef bleaching
Coral Reefs & Bleaching Events
Coral reefs form home for an estimated 25% of all marine life incorporating more than four thousand species of fish and over a million other aquatic species that live, breed, and are dependent on coral reef ecosystems during their lifetime . This number is significantly important if we consider that coral reefs form just under 0.1% of the oceans’ surface area. In addition, almost half a million people are dependent on coral reef ecosystems as they provide protection for coastal infrastructure and prevention from storms, tsunamis, and floods; they are sources for medicine, fishing, and tourism activities.
Great Barrier Reef located in the Coral Sea, off the coast of Queensland, Australia, is the world’s largest coral reef system identified to be one of the seven natural wonders on Earth. Unfortunately, the reef has already lost over half of the reef’s coral cover between 1995 and 2017, especially with the effects of widespread bleaching outbreak events that took place in 2016, 2017, and with the latest bleaching event taking place in the summer of 2020.
What is coral bleaching?
Corals are animals with a polymorphic structure. They have a calcium carbonate skeleton that lives in a symbiotic relationship with a type of algae called “zooxanthellae” in their tissues which provides the essential nutrients to corals.
Coral bleaching is occurring when corals expel the algae (zooxanthellae) living in their tissues causing the coral to turn completely white due to a coral bleaching event such as extreme weather and water conditions like a tornado or a cyclone, causing a water temperature change. Coral reefs are very sensitive to temperature change therefore water temperature changes stress them out. Although corals may survive a bleaching event, however, if the stress continues and the algae loss is prolonged, the coral will eventually die due to a lack of nutrients .
Coral Bleaching Stages 
Human activities have caused average global temperature to rise about 1°C above pre-industrial levels, causing marine heatwaves and triggering more frequent and more severe mass bleaching events. In February 2020, the Great Barrier Reef was subjected to the hottest sea surface temperatures since records began in 1900, leading to one of the most widespread bleaching events.
Monitoring bleaching events
Monitoring coral reefs at scale is costly, time-consuming, and complex. Current technology practices for monitoring coral reefs’ health and for inspecting coral bleaching events use various sources for data and image collection including satellites, airborne and ship-based mediums such as sonars, and performance of visually inspected underwater surveys. While satellite-based remote sensors have been quite popular for large scale coral reef monitoring they are limited by weather conditions (e.g., cloud, snow, fog), aerial pollution, and camera resolution not being able to provide finer granularity detail of the coral reef ecosystems and their benthic conditions at greater water depth. For example, in Australia, due to the scale of the Great Barrier’s Reef ecosystem, the resolution of images from satellites is not always satisfactory in order to analyse the coral bleaching events and monitor their state. On the other hand, divers required for underwater surveys have limited capacity in covering ground and study the reef ecosystem at its full scale. In fact, only 0.3 % of the Great Barrier Reef has been surveyed by divers.
An Innovative Approach based on UASs & Machine Learning
Researchers at the Queensland University of Technology (QUT) have been exploring the use of unmanned aerial systems (UASs) as a cost-efficient monitoring medium for coral bleaching inspection and surveillance of the Great Barrier Reef in Australia.
The researchers combine in-water spectral observations and automated classification techniques to determine levels of benthic cover and coral growth in shallow water reef regions . In practice Felipe Gonzalez’s research team use AI and ML techniques to interpret images captured by hyper-spectral cameras mounted on drones, to monitor and collect information about the health of the reef. Their methodology covers three different phases as depicted in the workflow diagram below:
Predictive detection model workflow 
- Data collection: In the first phase, airborne and hyperspectral images are collected while in parallel coral specimens are assessed as part of in-water surveys practiced by coral reef conservation experts. Underwater surveys have been able to provide images and data forming the ground truth and a starting point for the training data used in the ML bleaching detection models. In particular, survey test sites were used where experts identified various genera of coral at varying levels of bleaching across a segment of reef, as a reference for approximation of optical variances due to water and algae. These were then classified based on genus, location (longitude and latitude), depth, and bleaching level.
- Image Processing: In the second phase, the images that have been collected are being processed in order to identify their coral type, classify the bleaching event, and further determine orthomosaics of the reef. Orthomosaics are helpful in identifying regions of the coral reef that may be at greater risk and under-water survey data points, providing therefore an approximation of what coral types are located in those regions. Hyperspectral scans are then orthorectified using multiple datacubes to produce a georeferenced hyperspectral snapshot of the reef. These orthorectified datacubes are processed to obtain radiance and reflectance, which are used in combination with expert visual coral type and bleaching assessment for signature extraction and calculation of indices of coral types and bleaching levels . Corrections need to be applied to the data due to the light absorption varying based on water depth, location corrections, issues with marine pollution, etc. There are therefore both atmospheric and location corrections.
- Bleaching Detection Model: The last phase integrates different data sources under Azure data platform for correlation analysis among georeferenced data and the spectral signatures to generate a correlation between coral type and the bleaching level. The output of the correlation analysis is used as a basis for developing a coral bleaching detection model. The model is then being evaluated and assessed for accuracy to derive the final coral reef bleaching detection model. It’s interesting to note that a generic detection bleaching model is impossible to be created and applied to different coral reef locations. The ML coral reef bleaching detection model needs to be fine-tuned based on the coral type and where the corals grow as coral reefs are not the same throughout the different regions, for example, comparing reefs across the Hawaiian Islands and the Philippines.
Data processing has taken place using Microsoft Azure cloud services as part of the Microsoft grant scheme providing the resources for scaling up the data and machine learning processing. The majority of the data collected has been hosted in the cloud where ML techniques are being applied to the gathered datasets focusing mostly currently on classic SVM (support vector machine) algorithms for image recognition and classification using both supervised and unsupervised methods. In addition, with Microsoft Azure grant the QUT Research group was able to scale the data processing and bleaching detection analysis of up to four coral reefs. QUD is currently under the completion of the data processing analysis this year and we are looking forward to investigating into further ML model analysis techniques such as reinforcement learning based on a combination of new in-water survey data points.
United States Environmental Protected Agency (EPA), “Basic Information about Coral Reefs”, Online Source: https://www.epa.gov/coral-reefs/basic-information-about-coral-reefs.
 Wikipedia, “Coral Reef Bleaching”, Online Source: https://en.wikipedia.org/wiki/Coral_bleaching
 National Ocean Service (NOOA), “What is Coral Bleaching”, Online Source: https://oceanservice.noaa.gov/facts/coral_bleach.html
 Modest Fish, “Coral Bleaching Stages”, Online Source: https://modestfish.com/
 Parsons, Mark, Dmitry Bratanov, Kevin J. Gaston, and Felipe Gonzalez. 2018. “UAVs, Hyperspectral Remote Sensing, and Machine Learning Revolutionizing Reef Monitoring” Sensors 18, no. 7: 2026. https://doi.org/10.3390/s18072026