ISE Developer Blog

How to Build A K8S Http API For Helm, and Serve Micro-services Using A Single IP

The Commercial Software Engineering team (CSE) partnered with Axonize to automate the process of deploying apps to Kubernetes, and expose these apps to the internet via a single IP. This post is about enabling applications in your Kubernetes cluster to programmatically install helm charts and expose them through a single public facing IP.

Attaching and Detaching an Edge Node From a HDInsight Spark Cluster when running Dataiku Data Science Studio (DSS)

Earlier this year, Dataiku and Microsoft joined forces to add extra flexibility to DSS on HDInsight, and also to allow Dataiku customers to attach a persistent edge node on an HDInsight cluster – something which was previously not a feature supported by the most recent edition of Azure HDInsight.  

Infrastructure as Code – On demand GPU clusters with Terraform & Jenkins

Developing robust algorithms for self-driving cars requires sourcing event data from over 10 billion hours of recorded driving time. CSE worked with Cognata, a startup developing simulation platforms for autonomous vehicles, to build a Jenkins pipeline and Terraform solution that enabled our partner to dynamically scale GPU resources for their simulations.

Deploying a Batch AI Cluster for Distributed Deep Learning Model Training

Microsoft and Land O'Lakes partnered to develop an automated solution to identify sustainable farming practices given thousands of satellite images of Iowan farms. Our primary goal was to reduce the reliance on manual interviewing of farmers and make it more profitable for farmers to follow sustainable farming practices. To tackle this issue our team deployed a highly scalable Batch AI cluster on Azure and then performed distributed deep learning model training with Horovod.

Building a Private Ethereum Consortium

Over the past two years, Microsoft and Webjet have collaborated to build a blockchain-based solution, Rezchain, to help travel companies reduce payment disputes. In this code story, we’ll share the lessons learned in creating the Rezchain consortium. In particular, we'll focus on how we solved the challenges involved with enabling Ethereum nodes to peer across virtual networks.

Using Otsu’s method to generate data for training of deep learning image segmentation models

In this article, we introduce a technique to rapidly pre-label training data for image segmentation models such that annotators no longer have to painstakingly hand-annotate every pixel of interest in an image. The approach is implemented in Python and OpenCV and extensible to any image segmentation task that aims to identify a subset of visually distinct pixels in an image.