Cognitive Services

Detecting “Action” and “Cut” in Archival Footage Using a Multi-model Computer Vision and Audio Approach with Azure Cognitive Services

Nile Wilson September 27, 2021 Sep 27, 2021 09/27/21

Movies and TV shows require multiple takes per scene and may have a substantial amount of archival footage as a result. Here, we use Azure Cognitive Services and custom code to develop a multi-model Machine Learning (ML) solution to automatically detect discardable footage to save media companies manual archiving hours and storage space.

Building an Action Detection Scoring Pipeline for Digital Dailies

Samuel Mendenhall September 20, 2021 Sep 20, 2021 09/20/21

Media companies capture footage filmed for the entire day in what's known as ‘digital dailies’. When talking about terabytes and petabytes of content, storage costs can be a factor. Lets explore Machine Learning approaches to identify which content can be archived or discarded which will save on those storage costs.

Entity Disambiguation Using Search Engine

Maysam Mokarian June 14, 2021 Jun 14, 2021 06/14/21

This blog post proposes a methodology to disambiguate misspelled entities by comparing the search retrieval performance with different custom search analyzers in a search engine.

Using Azure Cognitive Services to Analyse Evidence in Public Safety and Justice

Sonal Patil June 7, 2021 Jun 7, 2021 06/7/21

A scenario commonly encountered in public safety and justice is the need to collect and index digital data recovered from devices, so that investigating officers can perform evidence-based analysis. We recently built an advanced evidence analysis platform that uses Azure AI services for automated labelling of media and documents.

Social Stream Pipeline on Databricks with auto-scaling and CI/CD using Travis

Mor Shemesh December 12, 2018 Dec 12, 2018 12/12/18

Background For the tech companies designing tomorrow’s smart cities, making local authorities able to collect and analyze large quantities of data from many different sources and mediums is critical. Data can come from different sources – from posts on social media and data automatically collected from IoT devices, to information ...

Semantic Segmentation of Small Data using Keras on an Azure Deep Learning Virtual Machine

Margaret Meehan July 18, 2018 Jul 18, 2018 07/18/18

Introduction As previously featured on the Developer Blog, golf performance tracking startup Arccos joined forces with Commercial Software Engineering (CSE) developers in March in hopes of unveiling new improvements to their "virtual caddie" this summer. Powered by Microsoft Azure, Arccos' virtual caddie app uses artificial ...

Making sense of Handwritten Sections in Scanned Documents using the Azure ML Package for Computer Vision and Azure Cognitive Services

Tingting Zhao May 7, 2018 May 7, 2018 05/7/18

Business Problem For businesses of all sorts, one of the great advantages of the shift from physical to digital documents is the fast and effective search and knowledge extraction methods now available. Gone are the days of reviewing documents line-by-line to find particular information. However, things get more complicated when the ...

Giving meaningful context to social media influence with Microsoft Cognitive Services

Rachel Weil December 7, 2017 Dec 7, 2017 12/7/17

Background In understanding social media, context is key. Current social-media analytics can tell us what topics are trending, but they don't provide insight into the tenor of the conversation or who are engaged in it. We recently joined with social marketing startup m-oracle, based in Atlanta, for a two-day hackfest to develop a solution ...

Comparing Image-Classification Systems: Custom Vision Service vs. Inception

Clemens Wolff December 5, 2017 Dec 5, 2017 12/5/17

We recently worked with Reverb, an online marketplace for music gear. Musicians and music retailers use Reverb's platform to buy and sell items such as guitars, keyboards, effects pedals, etc. A key element that aids discovery of items listed on the Reverb site is accurate metadata. For example, the manufacturer's official name for the finish ...

Building a Custom Spark Connector for Near Real-Time Speech-to-Text Transcription

Clemens Wolff November 1, 2017 Nov 1, 2017 11/1/17

The Fortis project is a social data ingestion, analysis, and visualization platform. Originally developed in collaboration with the United Nations Office for the Coordination of Humanitarian Affairs (UN OCHA), Fortis provides planners and scientists with tools to gain insight from social media, public websites and custom data sources. UN ...

CSE Developer Blog

Cognitive Services - CSE Developer Blog