CSE Developer Blog

Deploying a Batch AI Cluster for Distributed Deep Learning Model Training

Microsoft and Land O'Lakes partnered to develop an automated solution to identify sustainable farming practices given thousands of satellite images of Iowan farms. Our primary goal was to reduce the reliance on manual interviewing of farmers and make it more profitable for farmers to follow sustainable farming practices. To tackle this issue our team deployed a highly scalable Batch AI cluster on Azure and then performed distributed deep learning model training with Horovod.

Using Otsu’s method to generate data for training of deep learning image segmentation models

In this article, we introduce a technique to rapidly pre-label training data for image segmentation models such that annotators no longer have to painstakingly hand-annotate every pixel of interest in an image. The approach is implemented in Python and OpenCV and extensible to any image segmentation task that aims to identify a subset of visually distinct pixels in an image.

Sequence Intent Classification Using Hierarchical Attention Networks

We analyze how Hierarchical Attention Neural Networks could be helpful with malware detection and classification scenarios, demonstrating the usefulness of this approach for generic sequence intent analysis. The novelty of our approach is in applying techniques that are used to discover structure in a narrative text to data that describes the behavior of executables.

Classifying Leaks Using Cognitive Toolkit

We use Deep Learning to turn a painful and time-consuming leak-detection task for water and oil pipelines into a fast, painless process. Using Python and Fast Fourier Transforms, we turn audio sensor data into images, then use Convolutional Neural Networks to detect and classify pipeline anomalies.