Posts by this author

Jan 18, 2019
0
0

Running Parallel Apache Spark Notebook Workloads On Azure Databricks

This article walks through the development of a technique for running Spark jobs in parallel on Azure Databricks. The technique enabled us to reduce the processing times for JetBlue's reporting threefold while keeping the business logic implementation straight forward. The technique can be re-used for any notebooks-based Spark workload on Azure Dat...

Big Data
May 17, 2018
0
0

Using Otsu’s method to generate data for training of deep learning image segmentation models

In this article, we introduce a technique to rapidly pre-label training data for image segmentation models such that annotators no longer have to painstakingly hand-annotate every pixel of interest in an image. The approach is implemented in Python and OpenCV and extensible to any image segmentation task that aims to identify a subset of visually d...

Machine Learning
Nov 20, 2017
0
0

Permissively-Licensed Named Entity Recognition on the JVM

The ability to correctly identify entities, such as places, people, and organizations, adds a powerful level of natural language understanding to applications. This post introduces a MIT-licensed one-click deployment to Azure for web services that lets developers get started with a wide range of natural language tasks in 5 minutes or less, by consu...

Machine LearningAzure App Services
Nov 1, 2017
0
1

Building a Custom Spark Connector for Near Real-Time Speech-to-Text Transcription

This post describes in detail the Azure Cognitive Services speech-to-text WebSocket protocol and shows how to implement the protocol in Java. This enables us to transcribe audio to text in near real-time. We then show how to feed the transcribed radio into a pipeline based on Spark Streaming for further analysis, augmentation, and aggregation. The ...

Machine LearningCognitive Services