ISE Developer Blog

Detecting “Action” and “Cut” in Archival Footage Using a Multi-model Computer Vision and Audio Approach with Azure Cognitive Services

September 27, 2021 Sep 27, 2021 09/27/21

Nile Wilson

Movies and TV shows require multiple takes per scene and may have a substantial amount of archival footage as a result. Here, we use Azure Cognitive Services and custom code to develop a multi-model Machine Learning (ML) solution to automatically detect discardable footage to save media companies manual archiving hours and storage space.

Building an Action Detection Scoring Pipeline for Digital Dailies

September 20, 2021 Sep 20, 2021 09/20/21

Samuel Mendenhall

Media companies capture footage filmed for the entire day in what's known as ‘digital dailies’. When talking about terabytes and petabytes of content, storage costs can be a factor. Lets explore Machine Learning approaches to identify which content can be archived or discarded which will save on those storage costs.

Giving meaningful context to social media influence with Microsoft Cognitive Services

December 7, 2017 Dec 7, 2017 12/7/17

Rachel Weil

When it comes to identifying and understanding influential voices in social media, context is key. See how we used topic detection, sentiment analysis, and Azure Functions to automate context-aware social media insights.

Comparing Image-Classification Systems: Custom Vision Service vs. Inception

December 5, 2017 Dec 5, 2017 12/5/17

Clemens Wolff

This story covers how to get started with transfer-learning and build image classification models in Python with the Custom Vision Service. We compare the results with the popular Tensorflow-based models Inception and MobileNet.

Developing a Custom Search Engine for an Expert Chat System

August 7, 2017 Aug 7, 2017 08/7/17

Mona Soliman Habib

We address the challenge of creating a custom search experience for a specific domain area. We also provide a guide for creating your own custom search experience by leveraging Azure Search and Cognitive Services and sharing custom code for iterative testing, measurement and indexer redeployment.

Automating Receipt Processing

July 5, 2017 Jul 5, 2017 07/5/17

CY Yam

Claiming expenses is usually a manual process. This project aims to improve the efficiency of receipt processing by looking into ways to automate this process. This code story describes how we created a skeletal framework to achieve the following: We found a few challenges in addressing these goals. For instance, the ...

Building an Image Classification Pipeline Using Serverless Architecture

July 1, 2017 Jul 1, 2017 07/1/17

Jason Fox

We collaborated on an image classification pipeline to perform automatic face detection and matching using machine learning via Microsoft Cognitive Services Face API. Our project was built with Azure Functions to process images using message queues.

Food Classification with Custom Vision Service

May 12, 2017 May 12, 2017 05/12/17

Olga Liakhovich

How we created an app to identify foods and their nutritional content by using the new Custom Vision Service to leverage domain-specific image recognition powered by DNNs.

Building LUIS Models for Unsupported Languages with Machine Translation

January 14, 2017 Jan 14, 2017 01/14/17

Ari Bornstein

A wrapper for the Microsoft LUIS Cognitive Service that provides universal language support (after training) using the Cognitive Service Translation API.