{"id":1058,"date":"2021-10-18T08:00:25","date_gmt":"2021-10-18T07:00:25","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/sustainable-software\/?p=1058"},"modified":"2021-10-18T10:47:52","modified_gmt":"2021-10-18T09:47:52","slug":"using-ml-to-monitor-coral-reef-bleaching","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/sustainable-software\/using-ml-to-monitor-coral-reef-bleaching\/","title":{"rendered":"Using ML to monitor coral reef bleaching"},"content":{"rendered":"<h4><\/h4>\n<h4><a href=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/123837.jpeg\"><img decoding=\"async\" class=\"alignnone size-full wp-image-987\" src=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/123837.jpeg\" alt=\"Image 123837\" width=\"2200\" height=\"1468\" srcset=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/123837.jpeg 2200w, https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/123837-300x200.jpeg 300w, https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/123837-1024x683.jpeg 1024w, https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/123837-768x512.jpeg 768w, https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/123837-1536x1025.jpeg 1536w, https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/123837-2048x1367.jpeg 2048w\" sizes=\"(max-width: 2200px) 100vw, 2200px\" \/><\/a><\/h4>\n<p><span style=\"font-size: 18pt; font-family: arial, helvetica, sans-serif;\"><b style=\"color: #ff6600;\">Coral Reefs &amp; B<\/b><span style=\"color: #ff6600; font-family: arial, helvetica, sans-serif;\"><b>leaching<\/b><\/span><b style=\"color: #ff6600;\"> Events<\/b><\/span><\/p>\n<p><span style=\"color: #003300;\">Coral reefs form home for an estimated 25% of all marine life incorporating more than four thousand species of fish and over a million other aquatic species that live, breed, and are dependent on coral reef ecosystems during their lifetime [1]. This number is significantly important if we consider that coral reefs form just under 0.1% of the oceans&#8217; surface area. In addition, almost half a million people are dependent on coral reef ecosystems as they provide protection for coastal infrastructure and prevention from storms, tsunamis, and floods; they are sources for medicine, fishing, and tourism activities.<\/span><\/p>\n<p><span style=\"color: #003300;\"><strong>Great Barrier Reef<\/strong> located in the Coral Sea, off the coast of Queensland, Australia, is the world\u2019s largest coral reef system identified to be one of the seven natural wonders on Earth. Unfortunately, the reef has already lost over half of the reef&#8217;s coral cover between 1995 and 2017, especially with the effects of widespread bleaching outbreak events that took place in 2016, 2017, and with the latest bleaching event taking place in the summer of 2020.<\/span><\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/file-20200406-74220-1axw6r6.png\"><img decoding=\"async\" class=\"alignnone size-full wp-image-990\" src=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/file-20200406-74220-1axw6r6.png\" alt=\"Image file 20200406 74220 1axw6r6\" width=\"1000\" height=\"731\" srcset=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/file-20200406-74220-1axw6r6.png 1000w, https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/file-20200406-74220-1axw6r6-300x219.png 300w, https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/file-20200406-74220-1axw6r6-768x561.png 768w\" sizes=\"(max-width: 1000px) 100vw, 1000px\" \/><\/a><\/p>\n<p><span style=\"color: #ff6600; font-family: arial, helvetica, sans-serif;\"><strong><span style=\"font-size: 18pt;\">What is coral bleaching?<\/span><\/strong><\/span><\/p>\n<p class=\"\"><span style=\"color: #333300;\">Corals are animals with a polymorphic structure. They have a calcium carbonate skeleton that lives in a symbiotic relationship with a type of algae called &#8220;zooxanthellae&#8221;\u00a0 in their tissues which provides the essential nutrients to corals.<\/span><\/p>\n<p class=\"\"><span style=\"color: #333300;\">Coral bleaching is occurring when corals expel the algae (zooxanthellae) living in their tissues causing the coral to turn completely white due to a coral bleaching event such as extreme weather and water conditions like a tornado or a cyclone, causing a water temperature change. Coral reefs are very sensitive to temperature change therefore water temperature changes stress them out. Although corals may survive a bleaching event, however, if the stress continues and the algae loss is prolonged, the coral will eventually die due to a lack of nutrients [2].<\/span><\/p>\n<div class=\"mceTemp\">\n<p><img decoding=\"async\" class=\"wp-image-982 size-full aligncenter\" src=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/Coral-Bleaching-Graphic.jpeg\" alt=\"Image Coral Bleaching Graphic\" width=\"800\" height=\"540\" srcset=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/Coral-Bleaching-Graphic.jpeg 800w, https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/Coral-Bleaching-Graphic-300x203.jpeg 300w, https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/Coral-Bleaching-Graphic-768x518.jpeg 768w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/><\/p>\n<p><strong><span style=\"font-size: 14pt; font-family: arial, helvetica, sans-serif;\">\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 Coral Bleaching Stages [4]<\/span><\/strong><\/p>\n<p class=\"\"><span style=\"color: #333300;\">Human activities have caused average global temperature to rise about 1\u00b0C above pre-industrial levels, causing marine heatwaves and triggering more frequent and more severe mass bleaching events. In February 2020, the Great Barrier Reef was subjected to the hottest sea surface temperatures since records began in 1900, leading to one of the most widespread bleaching events.<\/span><\/p>\n<p><figure id=\"attachment_983\" aria-labelledby=\"figcaption_attachment_983\" class=\"wp-caption aligncenter\" ><a href=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/image007.jpeg\"><img decoding=\"async\" class=\"wp-image-983 size-full\" src=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/image007.jpeg\" alt=\"Image coral infographic\" width=\"763\" height=\"679\" srcset=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/image007.jpeg 763w, https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/07\/image007-300x267.jpeg 300w\" sizes=\"(max-width: 763px) 100vw, 763px\" \/><\/a><figcaption id=\"figcaption_attachment_983\" class=\"wp-caption-text\"><span style=\"font-size: 12pt;\">\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0<span style=\"font-family: arial, helvetica, sans-serif; font-size: 14pt;\"> <strong>How corals become bleached [3]<\/strong><\/span><\/span><\/figcaption><\/figure><\/p>\n<h4><\/h4>\n<div class=\"html-p\"><\/div>\n<\/div>\n<p><span style=\"color: #ff6600; font-family: arial, helvetica, sans-serif;\"><strong><span style=\"font-size: 18pt;\">Monitoring bleaching events<\/span><\/strong><\/span><\/p>\n<p>Monitoring coral reefs at scale is costly, time-consuming, and complex. Current technology practices for monitoring coral reefs\u2019 health and for inspecting coral bleaching events use various sources for data and image collection including satellites, airborne and ship-based mediums such as sonars, and performance of visually inspected underwater surveys. While satellite-based remote sensors have been quite popular for large scale coral reef monitoring they are limited by weather conditions (e.g., cloud, snow, fog), aerial pollution, and camera resolution not being able to provide finer granularity detail of the coral reef ecosystems and their benthic conditions at greater water depth. For example, in Australia, due to the scale of the Great Barrier\u2019s Reef ecosystem, the resolution of images from satellites is not always satisfactory in order to analyse the coral bleaching events and monitor their state. On the other hand, divers required for underwater surveys have limited capacity in covering ground and study the reef ecosystem at its full scale. In fact, only 0.3 % of the Great Barrier Reef has been surveyed by divers.<\/p>\n<h4 id=\"an-innovative-approach-based-on-uass-machine-learning\" class=\"\"><span style=\"color: #ff6600; font-family: arial, helvetica, sans-serif; font-size: 18pt;\"><b>An Innovative Approach based on UASs &amp; Machine Learning<\/b><\/span><\/h4>\n<p>Researchers at the Queensland University of Technology (QUT) have been exploring the use of unmanned aerial systems (UASs) as a cost-efficient monitoring medium for coral bleaching inspection and surveillance of the Great Barrier Reef in Australia.<\/p>\n<p><iframe src=\"\/\/www.youtube.com\/embed\/9Z2JHLU0H2w\" width=\"560\" height=\"314\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>The researchers combine in-water spectral observations and automated classification techniques to determine levels of benthic cover and coral growth in shallow water reef regions [5]. In practice Felipe Gonzalez\u2019s research team use AI and ML techniques to interpret images captured by hyper-spectral cameras mounted on drones, to monitor and collect information about the health of the reef. Their methodology covers three different phases as depicted in the workflow diagram below:<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/10\/Screenshot-2021-10-03-at-8.17.45-PM.png\"><img decoding=\"async\" class=\"aligncenter wp-image-1036 size-large\" src=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/10\/Screenshot-2021-10-03-at-8.17.45-PM-899x1024.png\" alt=\"Image Screenshot 2021 10 03 at 8 17 45 PM\" width=\"640\" height=\"729\" srcset=\"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/10\/Screenshot-2021-10-03-at-8.17.45-PM-899x1024.png 899w, https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/10\/Screenshot-2021-10-03-at-8.17.45-PM-263x300.png 263w, https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/10\/Screenshot-2021-10-03-at-8.17.45-PM-768x874.png 768w, https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-content\/uploads\/sites\/60\/2021\/10\/Screenshot-2021-10-03-at-8.17.45-PM.png 1284w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a>\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 <span style=\"font-family: arial, helvetica, sans-serif;\">\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 <span style=\"font-size: 14pt;\"><strong class=\"\">Predictive detection model workflow [5]<\/strong><\/span><\/span><\/p>\n<ul>\n<li><strong class=\"\">Data collection:<\/strong>\u00a0In the first phase, airborne and hyperspectral images are collected while in parallel coral specimens are assessed as part of in-water surveys practiced by coral reef conservation experts. Underwater surveys have been able to provide images and data forming the ground truth and a starting point for the training data used in the ML bleaching detection models. In particular, survey test sites were used where experts identified various genera of coral at varying levels of bleaching across a segment of reef, as a reference for approximation of optical variances due to water and algae. These were then classified based on genus, location (longitude and latitude), depth, and bleaching level.<\/li>\n<li><strong>Image Processing:\u00a0<\/strong>In the second phase, the images that have been collected are being processed in order to identify their coral type, classify the bleaching event, and further determine orthomosaics of the reef. Orthomosaics are helpful in identifying regions of the coral reef that may be at greater risk and under-water survey data points, providing therefore an approximation of what coral types are located in those regions. Hyperspectral scans are then orthorectified using multiple datacubes to produce a georeferenced hyperspectral snapshot of the reef. These orthorectified datacubes are processed to obtain radiance and reflectance, which are used in combination with expert visual coral type and bleaching assessment for signature extraction and calculation of indices of coral types and bleaching levels [5]. Corrections need to be applied to the data due to the light absorption varying based on water depth, location corrections, issues with marine pollution, etc. There are therefore both atmospheric and location corrections.<\/li>\n<li><strong>Bleaching Detection Model:\u00a0<\/strong>The last phase integrates different data sources under Azure data platform for correlation analysis among georeferenced data and the spectral signatures to generate a correlation between coral type and the bleaching level. The output of the correlation analysis is used as a basis for developing a coral bleaching detection model. The model is then being evaluated and assessed for accuracy to derive the final coral reef bleaching detection model. It\u2019s interesting to note that a generic detection bleaching model is impossible to be created and applied to different coral reef locations. The ML coral reef bleaching detection model needs to be fine-tuned based on the coral type and where the corals grow as coral reefs are not the same throughout the different regions, for example, comparing reefs across the Hawaiian Islands and the Philippines.<\/li>\n<\/ul>\n<p>Data processing has taken place using Microsoft Azure cloud services as part of the Microsoft grant scheme providing the resources for scaling up the data and machine learning processing. The majority of the data collected has been hosted in the cloud where ML techniques are being applied to the gathered datasets focusing mostly currently on classic SVM (support vector machine) algorithms for image recognition and classification using both supervised and unsupervised methods. In addition, with Microsoft Azure grant the QUT Research group was able to scale the data processing and bleaching detection analysis of up to four coral reefs. QUD is currently under the completion of the data processing analysis this year and we are looking forward to investigating into further ML model analysis techniques such as reinforcement learning based on a combination of new in-water survey data points.<\/p>\n<h4><strong><span style=\"color: #ff6600;\">References<\/span><\/strong><\/h4>\n<p id=\"references\"><span style=\"font-size: 12pt;\">[1]United States Environmental Protected Agency (EPA), \u201cBasic Information about Coral Reefs\u201d, Online Source: https:\/\/www.epa.gov\/coral-reefs\/basic-information-about-coral-reefs.<\/span><\/p>\n<p><span style=\"font-size: 12pt;\">[2] Wikipedia, \u201cCoral Reef Bleaching\u201d, Online Source: https:\/\/en.wikipedia.org\/wiki\/Coral_bleaching<\/span><\/p>\n<p><span style=\"font-size: 12pt;\">[3] National Ocean Service (NOOA), \u201cWhat is Coral Bleaching\u201d, Online Source: https:\/\/oceanservice.noaa.gov\/facts\/coral_bleach.html<\/span><\/p>\n<p><span style=\"font-size: 12pt;\">[4] Modest Fish, \u201cCoral Bleaching Stages\u201d, Online Source: https:\/\/modestfish.com\/<\/span><\/p>\n<p><span style=\"font-size: 12pt;\">[5] Parsons, Mark, Dmitry Bratanov, Kevin J. Gaston, and Felipe Gonzalez. 2018. \u201cUAVs, Hyperspectral Remote Sensing, and Machine Learning Revolutionizing Reef Monitoring\u201d\u00a0Sensors\u00a018, no. 7: 2026. https:\/\/doi.org\/10.3390\/s18072026<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Coral Reefs &amp; Bleaching Events Coral reefs form home for an estimated 25% of all marine life incorporating more than four thousand species of fish and over a million other aquatic species that live, breed, and are dependent on coral reef ecosystems during their lifetime [1]. This number is significantly important if we consider that [&hellip;]<\/p>\n","protected":false},"author":52212,"featured_media":987,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[22],"tags":[147,148,116,62],"class_list":["post-1058","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sustainable-software-engineering","tag-ai-for-ocean","tag-coral-reefs-bleaching","tag-marine-conservation","tag-sustainability"],"acf":[],"blog_post_summary":"<p>Coral Reefs &amp; Bleaching Events Coral reefs form home for an estimated 25% of all marine life incorporating more than four thousand species of fish and over a million other aquatic species that live, breed, and are dependent on coral reef ecosystems during their lifetime [1]. This number is significantly important if we consider that [&hellip;]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-json\/wp\/v2\/posts\/1058","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-json\/wp\/v2\/users\/52212"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-json\/wp\/v2\/comments?post=1058"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-json\/wp\/v2\/posts\/1058\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-json\/wp\/v2\/media\/987"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-json\/wp\/v2\/media?parent=1058"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-json\/wp\/v2\/categories?post=1058"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/sustainable-software\/wp-json\/wp\/v2\/tags?post=1058"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}