ISE Developer Blog
Solving global tech challenges, sharing insights, and empowering developers
Latest posts
Propagating SharePoint Document Permissions to AI Search and RAG Pipelines
A security-first architecture that propagates SharePoint document permissions into downstream AI systems, using Microsoft Entra ID object IDs (GUIDs) for safe, query-time filtering in Azure AI Search, RAG pipelines, and Copilot extensions.
Lessons Learned from Building a Well-Matching Intelligence Layer
Key insights from the EDA and Ground Truth journey for solving well identity resolution in the Energy industry—challenges that extend to any entity matching problem across distributed systems.
Discoverable – Observable MCP Server
How to build an observable MCP Server with discoverable tools and agents.
Building Search-Enabled Agents with Azure AI Foundry and Semantic Kernel and A2A
A step-by-step guide to enable search in the semantic kernel agents using bing grounding in Azure Foundry AI Agent using A2A.
From Azure IoT Operations Data Processor Pipelines to Dataflows
In this post we explore the evolution from Azure IoT Operations Data Processor Pipelines to Dataflows, why we adopted a hybrid strategy with custom Rust pods, and the architectural lessons we learned building event detection systems at the edge.
Using Agents to Setup Experiments
When setting up an experiment is complex, agents can automate the process to make it faster and more reliable.
Building a Secure MCP Server with OAuth 2.1 and Azure AD: Lessons from the Field
How we built a production-ready MCP server with OAuth 2.1 authentication and On-Behalf-Of flow for Microsoft Graph, navigating a rapidly evolving specification.
Using Codes to Increase Adherence to Prompts
Agentic systems have some discretion in the parameters they sent to tooling, but there are cases, such as experimentation, when you need 100% adherence to a set of parameters.
Minimal GitOps for Edge Applications with Azure IoT Operations and Azure DevOps
How we built a minimal, scalable GitOps workflow for edge applications using Azure IoT Operations, Azure DevOps, and a multi-repo strategy. Includes pipeline templates and scripts for real-world deployments.
Bridging Local Development and Cloud Evaluation: Using Microsoft Devtunnels with Azure Machine Learning
Learn how to streamline AI development by using Microsoft Devtunnels to connect local services with Azure Machine Learning evaluation pipelines, eliminating deployment delays while maintaining comprehensive cloud-based validation.
Evaluate Small Language Model Function Calling using the Azure AI Evaluation SDK
This blog details how the Azure AI Evaluation SDK can be used to assess the performance of a small language model for function calling, such as Phi-4-mini-instruct, and view the results in Microsoft Foundry.
Introducing the Copilot Studio + Azure AI Search Solution
Introduction to a scaleable and secure turnkey architecture for deploying Copilots connected to Azure AI Search.
Agent Onboarding Process for Agentic Systems: Maintain accuracy at scale
A robust agent onboarding process is the backbone of scalable, reliable multi-agent AI systems—enforcing uniqueness, rigorous evaluation, and responsible AI practices at every step.
Accelerating AI Development with GitHub Copilot: Real-World Use-Cases
This blog post shares real-world experiences from Microsoft's ISE team using GitHub Copilot to accelerate AI development workflows, demonstrating how AI tools can significantly speed up tasks like creating documentation, class diagrams, data visualizations, and demo scripts when used by experienced developers.
Ensuring Seamless User Experience in Modernization Projects with AI‑Generated Stagehand and Playwright UI Tests
Using AI‑generated tools like Stagehand with Microsoft's Playwright helps ensure a smooth user experience during modernization efforts such as Hyper Velocity Engineering and monolith-to-microservices migrations.
Patterns for Building a Scalable Multi-Agent System
Practical patterns for designing scalable, high-performing multi-agent systems—grounded in real implementation experience.
Tuning and Optimization of Speech-to-Text (STT), Text-to-Speech (TTS), and Custom Keyword Recognition in Azure Speech Services
This blog outlines best practices for optimizing Speech-to-Text (STT), Text-to-Speech (TTS), and Custom Keyword Recognition in Azure Speech Services, helping developers build more accurate and responsive voice-enabled applications.
Integration Testing with Testcontainers
How to leverage Testcontainers for integration testing
Managing secrets on Azure KeyVault with a Tagging strategy to perform automations
Cloud and Infrastructure teams can manage secrets on Azure KeyVault with a Tagging strategy to perform automations.
Working with Git Submodules: Managing Dependencies Across Repositories
Working with Git Submodules and creating actions.
Leveraging Fabric Eventhouse to Store Great Expectations Validation Results
A step-by-step guide to storing data validation results into the Eventhouse & visualize data using queries and dashboard.
Taming Complexity: Intuitive Evaluation Framework for Agentic Chatbots in Business-Critical Environments
This blog post introduces a comprehensive evaluation framework for enterprise chatbots powered by large language models (LLMs), specifically addressing the challenges of assessing Line of Business (LOB) agents in business-critical environments. The authors tackle the fundamental problem that traditional chatbot evaluation metrics fail to capture the nuanced, non-deterministic performance of modern LLM-based systems, proposing a solution that combines realistic chat simulation using an LLM-powered User Agent, automated ground truth generation at scale, and comprehensive metrics including function call precision, r...
Unlocking Vector Search with OneLake Indexer and OpenAI Integration in Microsoft Fabric
Exploring how Microsoft Fabric OneLake indexer integrates with OpenAI
Ground Truth Curation Process for AI Systems
Steps to Produce High Quality Ground Truth Pairs for AI Systems
Customizable and Extensible Evaluation of a GenAI Application
Suggestions on how to evaluate a generative AI application in an adaptable and extensible manner.
Learnings from External Data Handling
This blog post discusses the challenges and solutions encountered by the ISE team at Microsoft while making a distributed system production-ready. It focuses on issues including slow processing speeds and out-of-memory exceptions, and provides insights into the methods used to address these problems.
Enhancing Analytical Queries with Semantic Kernel and In-Memory SQL Processing
Integrating Semantic Kernel with an ephemeral in-memory SQL plugin, enabling secure and efficient analytical queries over structured data.
AI Model Promotion with dstoolkit-mlops-v2
Evaluates various repository structures and designs for maximizing the efficiency of Data Scientists and Software Engineers developing, promoting and deploying AI models on the same project.
Use Agent to Update Dataverse Table Content
Create an agent using Copilot Studio to update the content of a Dataverse table.
Fleet Configuration Management
This post explains the challenge of fleet configuration management, the role of an automated fleet configuration management system, and describes key considerations for building such a system.
PACT Contract Testing – Because Not Everything Needs Full Integration Tests
PACT is a contract testing tool that allows you to define a contract between two applications, enabling
Dockerizing UV
How to Dockerize Python Package Management Tool UV
Hierarchical Waterfall Evaluation of Query Classification, Retrieval & Generation in Multi-Agent LLM Systems
This post presents a hierarchical waterfall framework for evaluating query classification, retrieval, and generation in multi-agent LLM systems.
Efficient Ground Truth Generation for Search Evaluation
This article discusses the challenges and methodologies for creating a reliable groundtruth dataset for search evaluation. It highlights the use of TREC Pooling and GPT-4o assisted ranking to overcome the labor-intensive process of manual labeling, ensuring high-quality search evaluations even with limited data.
Durable Functions for Indexing in RAG: A Practical Python Approach
Azure Durable Functions streamline RAG indexing by combining push flexibility with pull reliability for scalable,
Cloud infrastructure provisioning: best practices for IaC
Infrastructure-as-Code (IaC) is a common DevOps practice that enterprises use to provision and deploy IT infrastructure. Enterprises applying IaC and continuous integration/continuous delivery (CI/CD) pipelines can maintain high availability and manage risk for their cloud environments at scale. However, multi-environment challenges, manual processes, and fragmented guidance still lead to configuration drift, errors, and inconsistencies. These issues are likely to result in downtime, security vulnerabilities, and inefficient resource utilization.
Integration testing with Dapr and Testcontainers
This blog post discusses setting up a Pytest integration test framework for a system using Dapr and Testcontainers. This framework was initially setup for a customer to suit their needs and it has been extracted into a sample project to provide a starting point.
Running RAG with ONNX Runtime GenAI for On-Prem Windows
Exploring how to efficiently run a RAG pipeline with structured language models (SLMs) and guardrails on Windows, achieving inference under 5 seconds with ONNX Runtime GenAI.
Data Validations with Great Expectations in MS Fabric
In this blog post, we will explore how to integrate GX within the Microsoft Fabric environment and use it to validate data programmatically.
Using OpenTelemetry for flexible observability
OpenTelemetry offers flexible observability in distributed systems, this post looks at how to integrate multiple data sources when connected and disconnected from the internet.
The Hidden Risks of Docker Build Time Arguments and How to Secure Your Secrets
This post discusses the security risks of using Docker build-time arguments to pass secrets, and suggests alternative methods for handling secrets securely.
Flexible Tool Selection for ML Model Production
data science and software engineering teams can choose the best tools for their respective roles in delivering machine learning models to production.
Multi Root Workspaces in Visual Studio Code
How to manage multiple independent python projects, with different dependencies, inside Visual Studio Code.
Multi-Provider Strategy for App Configuration in Python
This post discusses a strategy for creating a custom extensible configuration module in python projects.
Instrumenting Apache Spark Structured Streaming jobs using OpenTelemetry
Apache spark monitoring using OpenTelemetry
Unlock Generative AI for Enterprise Scalability
Reusable templates, pipelines, and tools to streamline the setup of GenAI projects, saving time and effort, and ensuring consistency and reliability across projects.
Azure Functions vs. Indexers: AI Data Ingestion
This article compares Azure Functions with pre-built indexers for data ingestion in Azure AI Search, with a focus on using Azure Functions for a flexible, scalable approach. It explores key steps like data migration, index creation, and deployment automation.
Using Managed Identity on Logic App consumption
Deploy Azure Logic App Consumption with Managed Identity using Terraform by leveraging azapi_resource and ARM templates. This setup enables secure authentication without manual credential management.
Revolutionising Customer Feedback: Harnessing Large Language Models for Retail Insights and Intelligence
In this article, we delve into techniques for extracting valuable insights from customer feedback using Large Language Models (LLMs). By identifying themes, sentiment, and competitor comparisons from feedback, businesses can gain a competitive edge.
LLMOps in restricted networks and addressing continuous evaluation long run constraints
In this blog post, we'll explore the challenges we faced in establishing LLMOps and continuous evaluation within a pipeline using Azure Machine Learning, particularly when dealing with long runs and a restricted Bring-Your-Own (BYO) network.
Transforming Language into Code: Building and Evaluating a Robotic Code Generation Copilot
This blog post explores the development and evaluation of an AI assistant that converts natural language into robotic code.
Implementing Evaluation platform on Azure Machine Learning
Azure Machine Learning is known for training and deploying models, but can also be used for running experiments. This blog post will show us how we have implemented our Evaluation platform on Azure Machine Learning.
Semantic Kernel Learnings
A synopsis of our key learnings and findings from using Semantic Kernel.
Building AI Search for Production in Corporate Environments: Key Lessons
In the dynamic world of AI and data science developing production-level solutions for corporate environments comes with its own set of challenges and lessons. As a data science team working within Microsoft, we recently completed an engagement for a large company where we leveraged cutting-edge technologies, including OpenAI tools, GPT-4o for generating syntactic datasets, embedding models like text_embedding_3, and Azure AI Search for implementing both text and hybrid search solutions. Here are 10 key lessons we learned along the way.
Accessing Private Resources in Azure
A practical guide for developers on connecting to Azure resources with private endpoints through a VPN.
Three Ways to Simplify CI/CD Pipelines on GitHub Actions
This post focuses on three ways to simplify CI/CD pipelines deploying to Azure with GitHub Actions.
Building a Multi-tenant GenAI gateway using APIM
This blog shares insights on developing a GenAI gateway with multi-tenancy and quota management capabilities implemented using Azure APIM where customers can access the GenAI resources across different service tiers like Freemium, Basic, and Premium with each tier having it's own quota and rate limits. The solution used the concept of "Products" to group APIs related to specific entitlements and using Product Policies, simplifying the overall design and ensuring scalability.
Multimodal RAG with Vision: From Experimentation to Implementation
This blog post delves into the experimentation journey of fine-tuning a multimodal RAG pipeline to best answer user queries that require both textual and image context. We ran our experiments by systematically testing various approaches, adjusting one configuration setting at a time and using clearly defined evaluation metrics to validate the performance of each component of the RAG pipeline in isolation, as well as the end-to-end inference flow.
Streamlining Error Handling in Power Automate for Better Workflow Performance
This post explores effective error handling strategies in Power Automate to enhance workflow reliability and maintainability through practical techniques and integrations.
PromptFlow Serve – Benchmark Result Analysis
In this post we discuss how to test the throughput of PromptFlow pf-serve module and key learnings doing so. We explore the impact on throughput and performance the different WSGI and ASGI hosting methods have and the importance of engineering your Python nodes with the async await pattern for I/O.
Earning Agentic (and LangChain) Complexity
This post examines the challenges of adopting complex technologies like LangChain and agentic solutions in production environments, emphasizing the importance of understanding the necessity of such complexity. It provides insights on how to evaluate these technologies carefully, manage dependencies, and adhere to best practices for secure and stable AI applications.
Semantic Router using Azure AI Search
Potential semantic routing solution using Azure AI Search for scalable query handling.
Measuring Differentials of Product Images in AI-generated Ads
Various methodologies of measuring differentials between a product image and an AI-generated ad for the purpose of product representation integrity in serving AI-generated ads.
Converting multiple sources to FHIR using Liquid
A brief summary of how Microsoft ISE teams creation a solution to integrate patients data from multiple fragmented sources into a standard FHIR data model
Profiling Docker Compose services through Visual Studio
A brief summary of how Crew Clark were able to profile performance using Visual Studio and within a Docker Compose environment.
LLM Prompt Injection Considerations With Tool Use
This post discusses a pattern to prevent a class of prompt injection attacks in LLM-based solutions. It emphasizes the importance of building strong foundational patterns to mitigate risks and avoid potential pitfalls. By implementing this pattern, teams can enhance the security of their tool-based solutions.
Document Summarization Solution Patterns using Azure Open AI & Langchain
This post lists the various solution patterns that can be applied for document summarization. Document summarization comes with its challenges related to token limitation and chunk sizes. This blog post discusses about the solutions to tackle those challenges.
Azure IoT Operations Data Processor Pipelines: Unlocking Efficiency in the Industrial Metaverse
In this post we explore the implementation of Azure IoT Operations Data Processor pipelines in a manufacturing context, focusing on data processing at the edge.
Learnings around developing with Microsoft Graph Toolkit
Learnings of Microsoft Graph Toolkit from our recent project, including data leaking and privacy concerns that can help developers get a jumpstart with Microsoft Graph Toolkit.
Empowering Collaboration with a Tech Savvy Customer
Empowering Collaboration with a Tech Savvy Customer
Next-Level Boilerplate: An Inside Look Into Our .Net Clean Architecture Repo
In this article, we will take an inner look at the clean architecture boilerplate and how it helps kickstart our projects rapidly.
7 Essential Tips: Accelerate Prompt Flow Development
This post focusses on tips and tricks to accelerate from flow development through use of dev container & shell scripts.
Start Simple, Scale Fast: Azure Storage for Distributed Computing
Azure Storage Accounts are one of the simplest resources on Azure, but simultaneously one of the most useful and reused building blocks across the Microsoft Cloud ecosystem. Blobs, leases, and queues are fundamental components that enable powerful patterns. Let's dig into why Storage Accounts should be in your Azure toolkit.
Simplified Connection State Management
This post advocates for a simplifying a complex network of states into simple states that correlate with user expectations.
Synchronizing multiple remote Git Repositories
summary of the post
Making an Application More Robust With Data Mapping
How to use data mapping to make your application more robust against unexpected third-party data schema changes.
Development Containers Simplified
This post talks about the concept of development containers and how it can help us to solve the challenges we face when setting up our development environment or onboarding a new team member.
Testing VSCode Extensions with TypeScript
Due to the nature of VS Code, testing extensions can be quite complex. In this blog post, we explore various ways to write unit tests for VS Code extensions, as well as strategies for writing more sufficient integration tests.
Develop Microsoft Teams multi-tenants application that enables access to a legacy software running on-premises
In this article, we describe how we built a multi-tenants Microsoft Teams application that is able to connect to a legacy software running on-premises at different customers', in a scalable, secure and reliable way.
Image manipulation experiments for Mobile Read Hero Images(MRHI) compatibility
Introduction The Consumer Packaged Goods (CPGs) industry relies on multiple channels for selling the products and aims to provide a seamless buying experience for the consumer. With the advent of omni-channel retailing, Consumer Packaged Goods (CPGs) and retailers are striving towards providing the best possible experience to the customer alongside working on providing the most available information on the product they are selling on these touch points. On an e-commerce Channel which sells multiple products, the need for a compliant product (SKU) image is key. This is where a Mobile Ready Hero Image (MRHI) becom...
APIs load testing using K6
In this post, We will go through the load testing concepts and how to use the K6 framework to perform load testing for API endpoints.
Plugins in Dataverse
This post focusses on different technology options available for exporting data out of Dataverse based on an event-driven architecture. It also provides guidance on how to achieve it.
Crafting an Opinionated Logging and Error Handling Framework for Enhanced Observability in PowerShell
Logging with PowerShell and share insights gained during our development journey, resulting in the development of a highly opinionated set of code to manage logging effectively.
Consuming Azure OpenAI resources in AKS with Workload Identities
This post will showcase the use of Azure OpenAI from AKS without the need for sharing secrets.
Streamlining Development through Monorepo with Independent Release Cycles
Streamlining Development through Monorepo with Independent Release Cycles
Engineering Document (P&ID) Digitization
Journey on how to solve engineering document digitization problem through a proposed method and the end-to-end solution.
APIs testing using HTTP files and Rest Client
This post focuses on providing a comprehensive practical way to perform end-to-end testing of the API endpoints, using HTTP files and Rest Client
Validating Data in Synapse Using Data Flows and Pipelines
How to use Synapse data flows and pipelines to validate data quality in a data warehouse solution.
Jest Mocking Best Practices
Best practices and common mocking scenarios for using Jest to unit test TypeScript applications.
Automate the capturing of test results from Application Insights
This post provides instructions on how to automate querying application insights test results using a script. It explains how to format the datetime, install the application insights extension, set the offset, and handle the query results. The script can be adapted to other scripting languages. The result is a reusable script that can output results in any format and reduce manual filtering errors.
Debugging Java Dapr-enabled Apps in GitHub Codespaces
To simplify the development and debugging of complex Java Dapr-enabled microservices we recommend leveraging Docker Compose to define all services including the Java Apps, each with its own Dapr sidecar, plus infrastructure/dependent services all these running in individual containers. Using a VS Code devcontainer with Docker-in-Docker support, enabling Java extensions, and installing Maven and OpenJDK. Creating a new GitHub Codespaces instance and finally employing VS Code to attach to a remote Java process for debugging purposes.
Centralizing Data with Delta Lake and Azure Databricks
In this post, we delve into a real-world case study on centralizing data with the power of Azure Databricks. Learn about the challenges, solutions, and decision-making processes that shaped this data centralization project.
Serving Swagger UI from a Golang Azure Function Custom Handler
Our team used Swaggo, a Golang Swagger tool, to expose an OpenAPI spec for a Azure Function hosted Golang API. This post describes what lead to the decision along with guidance on how to expose an OpenAPI spec for an Azure Function hosted Golang API.
Patterns for optimizing data retrieval from Cosmos DB
In this blog post, we share how our team improved the performance of read operations on documents stored in Cosmos DB.
ACI for jobs
This post shows using Azure Container Instances for job processing such as data generation and ingestion.
Saving CO2 using location and time shifting in Azure
Saving CO2 using location and time shifting in Azure
4 Key Tips: Production-Ready Spring Boot REST API with PostgreSQL
4 key tips when developing production ready Spring Boot REST API
Multi-Cluster Application Deployments to Kubernetes at Scale at Edge
An innovative solution has been developed to address challenges in deploying applications in distributed environments with multiple clusters. These challenges encompass scenarios like edge deployments across regions and distributing components across numerous co-located clusters. While Kubernetes is commonly used for orchestrating deployments through YAML descriptors, GitOps tools such as Flux, ArgoCD, and Jenkins X automate deployment management. However, as cluster numbers increase, issues arise regarding organization, configuration, and scalability. To tackle these challenges, a Control Plane-based deployment ...
Build a robust transaction processing solutions to improve payment experience of retail end customers
In this post, we will describe how to build a data ingestion framework that receives payment transaction events from internal or external payment service providers and process the events in real-time. The ingested payment data can be used to provide the real time view of the payment transactions to merchants to improve the payment experience of the retail end customers.
Authoring an RBAC API for your application
Guidance when writing your own RBAC API for your application.
Coding with Customer: A Story of Building a Federated Data Catalog with Microsoft Purview
How we coded with customer team to build a first version of their federated data catalog, with Microsoft Purview.
Lessons Learned In The Field For DevOps And Azure Container Apps
This post will highlight some of the challenges teams can experience while CI/CD-ing with Azure Container Apps.
Leveraging Azure Load Testing for Optimal Performance and Scalability
In a recent customer engagement, our team leveraged load testing to evaluate system performance. In this post, we will share our experience of utilizing the Azure Load Testing service and highlight the service's most impressive features.
Using Postman to Create Acceptance Tests for Customer Engagements
An Easy and Effective Approach to Acceptance Testing for Customer Engagements
Developing with Multiple Repositories inside a Single Solution for .NET
A strategy for working with interdependent .NET repositories locally and remotely.
Using Azure Cosmos DB with Integrated Cache
Industry use case for Cosmos DB with Integrated Cache
Best Practices for Performance Testing: A Guide for Developers
This post underscores the importance of performance testing in software development, based on insights from a project involving a high-throughput containerized workload. It highlights the necessity of establishing clear performance goals, early identification and collaboration with a Performance Engineer, effective use of Application Performance Monitoring (APM) tools, and maintaining a dedicated performance environment. It also advocates for frequent, early, and local testing to expedite issue detection and resolution. Additionally, the article emphasizes best practices such as automation, clear log segregation,...
Maintaining API Clients With NSwag Model Generation
Our team used NSwag, an OpenAPI .NET toolchain, to generate C# models in code and improve the maintainability of a .NET Core API client for a project. This post describes what lead to the decision along with guidance on how to use Nswag to generate C# models in code.
Temporal Mutual Transport Layer Security(mTLS) and single-sign-on(SSO) using Azure
This guide explores Temporal platform security features and how it can be integrated with Azure Key Vault and Azure Active Directory.
Use Cases for Event Hub
This post will discuss multiple use-cases for Azure Event Hub that hopefully help you think about how to get creative in your own solutions.
Large Language Model Prompt Engineering for Complex Summarization
Learn how to use GPT / LLMs to create complex summaries such as for medical text
Solving store inventory allocation problem of CPG
Solution of store inventory allocation problem of CPG
Coding with AI
Our team used AI tools to write code, documentation, indexes, etc. extensively during our last engagement. This post will talk about what we used and how we used it.
Building a custom workflow engine on top of Durable Task Framework DTFx
In this post we write about how we implemented a custom workflow engine that supports DSL, workflow cancellation and closure on top of Durable Task Framework (DTFx), explaining the why behind our choices and discussing the challenges we faced.
Guidelines for Organizing and Testing Your Terraform Configuration
Guidelines on how to structure a Terraform infrastructure configuration together with testing and documentation.
Getting to Know TypeScript Generics
A guide to using TypeScript Generics as a way to create reusable logic that will work for a multitude of types.
Launching Litmus Chaos Scenarios Programmatically
Guidance for how to kick off a Litmus Chaos Scenarios programmatically and in an Azure DevOps Pipeline.
A Technical Journey into API Design-First: Best Practices and Lessons Learned
A Practical Guide to API Design-First Development with TypeSpec and OpenAPI
Hitchhikers Guide to Workflow Engines
This guide explores workflow engines, their essential features, and types, while offering insights and evaluation criteria to help you choose the right solution for your specific use case.
Data preparation at scale on Azure ML using Dask
In this post we will describe how we were able to run our Dask-based data preparation at scale on Azure ML Compute Clusters, using Dask-MPI and the native Azure ML MPI support.
Transforming Financial Planning with Power Platform: A Journey through Data Modeling on Dataverse
Data modeling on Dataverse with real-world customer scenarios
How to Deploy a Production-Ready Node.js Application in Azure
Step-by-step guide on how to deploy node.js application in production using docker and Azure pipeline
In-App User Experience with Flutter Embedded Web View and Azure Active Directory B2C User Flows
Guidance on how we can integrate Azure AD B2C's user login workflow within mobile app development using Flutter.
Effortless Pair Programming with GitHub Codespaces and VSCode LiveShare
Revolutionize your collaboration game, experience effortless pair programming with GitHub Codespaces and VSCode.
A Hypothesis-Driven Approach to Building and Testing Resilience in .NET Azure Functions
An overview of how to use the Polly and Simmy libraries for a hypothesis-driven resilience engineering and chaos testing approach to .NET Azure Functions.
Large-scale Data Operations Platform for Autonomous Vehicles
Implementing a large-scale data operations platform for autonomous vehicles using Azure Data Factory (ADF) and Azure Batch.
Common Pitfalls of using Self-Hosted Build Agents
Avoid the common pitfalls of moving from vendor-hosted CI/CD agents to self-hosted ones.
Observability on IoT Edge leveraging a push model approach
Solution to continuously push logs from IoT Edge devices to a Log Analytics Workspace on Azure.
Maintenance window strategy for database migrations
Maintenance window implementation for database migrations using Flask.
Hosting a Capture-the-Flag event on Azure
Guidance for setting up a self-hosted, scalable, secured, and easy to maintain CTFd environment, using nothing Azure Platform as a Service components.
X++ And Git: A Basic Setup
Overview In this post we outline the basics of setting up an X++ repository in Git as well as a YAML-based build pipeline which executes against this repository. Background Git is an increasingly popular version control system which sees broad use within the Commercial Software Engineering (CSE) organization at Microsoft. Dynamics 365 for Finance and Operations (D365 F&O) projects have deployed with Team Foundation Version Control (TFVC) as the default repository technology for several years, and TFVC remains the default version control option for F&O development projects to this day. Given the growing...
An Approach to Unit Testing ADX Functions
Overview Our application contains many functions that return data stored in Azure Data Explorer (ADX). We wrote these functions in Kusto Query Language (KQL) and each function returns a set of data based on the arguments passed. Although developers tested these functions as they wrote them, we needed a way to validate that the functions continued to work as the code and the data changed. Automated Unit testing is an essential part of any application development life cycle. It validates that code works properly and minimizes the risk that future code changes will break existing functionality. In this article, I w...
A Search Solution For Video Archive
Background Azure Video Analyzer enables developers to quickly build an AI-powered video analytics solution to extract actionable insights from videos, whether stored or streaming. It can be used to enhance workplace safety, in-store experiences, digital asset management, media archives, and more by assisting in understanding audio and visual video content without video or machine learning expertise [1]. In this solution we use Azure Video Analyzer and Azure Search to be able to retrieve desired moments in our video archive. Challenges and Objectives Our customers needed to be able to search th...
Configuring Edge Devices At Scale
While many agent- and SSH-based server management solutions exist, the seamless integration with IoT Hub gives OSConfig a decisive edge for IoT scenarios that have strict requirements in terms of scalability, security and offline resiliency.
Configuring Authentication and Authorization for REST APIs using Azure AD B2C ID Tokens
This article describes how were able to automate Azure Active Directory B2C token retrieval and authentication for our partner, allowing them to run End-to-End tests without user interaction.
E2E Tests for LoRaWAN Starter Kit with Real Hardware
This article focuses on the different aspects of end-to-end testing of the LoRaWAN Starter Kit project. Due to the specifics of the LoRaWAN protocol and the Starter Kit, the end-to-end testing of the solution needs to be performed with real hardware which includes LoRa leaf devices, LoRa concentrators and Edge gateways.
Observability Journey
As an Engineering team on Microsoft’s Commercial Software Engineering (CSE), we strive to empower customers to build and maintain their software-based solutions. A key factor in being successful in our goal is to educate and develop the solution by applying certain Engineering Fundamentals. In this article, we will cover Observability.
Entity Framework Journey
As an Engineering team on Microsoft’s Commercial Software Engineering (CSE), we strive to empower customers to build and maintain their software-based solutions. In this article, we will cover an aspect of our Engineering Fundamentals, DB change management using Entity Framework.
Continuous Integration and Deployment Journey
As an Engineering team on Microsoft’s Commercial Software Engineering (CSE), we strive to empower customers to build and maintain their software-based solutions. A key factor in being successful in our goal is to educate and develop the solution by applying certain Engineering Fundamentals. In this article, we will cover Continuous Integration
Privacy in Medical Systems using FHIR
This post describes how we leveraged the FHIR specification to define a model of ownership for resources and delegation of access to FHIR resources by their owners.
Re-Simulation in Automated Driving
Autonomous Driving is a competitive market with complex security and processing challenges. This article highlights how we met concerns and constraints when developing a cloud-based Autonomous Driving re-simulation solution.
Working with a Monorepo
In this blog post, we want to share a Microsoft manufacturing customer’s journey that started off by setting up with them the core piece for their software development: a monolithic repository — or monorepo for short.
Building an Azure based Industrial Internet of Things Solution for Factory Automation
Microsoft CSE was involved in the process of a smart factory transformation in the automotive space, leveraging Microsoft technology, building an Industrial Internet of Things solution for factory automation.
Azure Service Operators – A Kubernetes native way of Deploying Azure Resources
The promise of being able to standardize on Kubernetes as a platform is attractive as it offers unique solutions to many of the challenges companies face. This post talks about the Azure Service Operator open source project that helps customers deploy Azure Resources using Kubernetes definitions
Detecting “Action” and “Cut” in Archival Footage Using a Multi-model Computer Vision and Audio Approach with Azure Cognitive Services
Movies and TV shows require multiple takes per scene and may have a substantial amount of archival footage as a result. Here, we use Azure Cognitive Services and custom code to develop a multi-model Machine Learning (ML) solution to automatically detect discardable footage to save media companies manual archiving hours and storage space.
Building an Action Detection Scoring Pipeline for Digital Dailies
Media companies capture footage filmed for the entire day in what's known as ‘digital dailies’. When talking about terabytes and petabytes of content, storage costs can be a factor. Lets explore Machine Learning approaches to identify which content can be archived or discarded which will save on those storage costs.
Enabling COVID-19 Exposure Notifications Across the United States on Azure
During pandemics, the ability to let people know if they have been exposed to a contagious disease is essential for public health practitioners. This is known as contact tracing and the COVID-19 pandemic is no exception. In this post, I describe the journey of our Microsoft team to deploy an exposure notification server on Azure.
Entity Disambiguation Using Search Engine
This blog post proposes a methodology to disambiguate misspelled entities by comparing the search retrieval performance with different custom search analyzers in a search engine.
Using Azure Cognitive Services to Analyse Evidence in Public Safety and Justice
A scenario commonly encountered in public safety and justice is the need to collect and index digital data recovered from devices, so that investigating officers can perform evidence-based analysis. We recently built an advanced evidence analysis platform that uses Azure AI services for automated labelling of media and documents.
Observability for Event Stream Processing with Azure Functions, Event Hubs, and Application Insights
With distributed tracing handled by Azure Functions, Azure Event Hubs, and Azure Application Insights behind the scenes, Azure Application Insights provides useful monitoring visualizations of the system that helped us easily understand system performances and troubleshoot failures.
Unit Testing Azure DevOps UI Extensions
Mocking cloud service dependencies in modern applications is essential for independent unit testing. We show how to mock all relevant parts of the Azure DevOps Extension SDK, Azure DevOps Extension API as well as other external APIs to create meaningful unit tests for Azure DevOps UI Extensions and reach full code coverage.
Developing and Deploying a Recommender Model for Continuous Systematic Literature Reviews
This blog post is about using the Microsoft Academic Graph and NLP to build a personalized recommender system to suggest new scientific publications to researchers maintaining Systematic Literature Reviews.
Evaluation Framework for Information Extraction
In this blog post we cover the process, requirements, and the design of an evaluation framework for NLP and Information Extraction. We cover the reasoning behind such a framework, and discuss its implementation with examples from a Named Entity Recognition evaluation point of view.
Building A Clinical Data Drift Monitoring System With Azure DevOps, Azure Databricks, And MLflow
Hospitals around the world regularly work towards improving the health of their patients as well as ensuring there are enough resources available for patients awaiting care. During these unprecedented times with the COVID-19 pandemic, Intensive Care Units are having to make difficult decisions at a greater frequency to optimize patient health outcomes. The continuous collection of biometric and clinical data throughout a patient’s stay enables medical professionals to take a data-informed, holistic approach to clinical decision making. In some cases, a Machine Learning model may be used to provide insig...
Using Blockchain To Securely Transfer And Verify Files
MOOG came to CSE in hopes of building a technology solution that would prove the provenance and transfer of digital assets securely between parties. Working together, Microsoft and MOOG set out to develop a demo of this solution that leverages Azure and blockchain technology.
Preventing Rhino Poaching With Microsoft Azure
In the last eight years, poaching in Africa has been happening at an alarming rate. Currently, the continent loses three rhinos a day. As part of our team’s mission to find new ways that technology can positively impact our world, we’ve been collaborating with the Combating Wildlife Crime team Peace Parks Foundation (PPF), in partnership with
Using uPort For Authentication On Blockchain To Improve Standards On The Food Logistics Chain
Food ingredients travel thousands of miles along logistics chains. One bad batch of produce can ruin a restaurant’s reputation, but it’s hard to identify who’s at fault. CSE has worked with Hitachi to build a sample infrastructure leveraging blockchain – thus achieving a new level of accountability for those producing, storing and serving food.
Real-time Streaming Of 3D Enterprise Applications From The Cloud To Low-powered Devices
Microsoft recently partnered with AVEVA, an engineering, design and management software provider to the Power, Oil & Gas and Marine industries. AVEVA’s challenge is one that is becoming more and more common in the construction visualization space: ever increasing complexity of 3D data that needs to be highly interactive to a customer base that operates on mobile platforms (smartphones, tablets, and untethered headsets like HoloLens). AVEVA believes that remote rendering and live asset streaming is the way forward for their business. As a result of our collaboration, we built 3D Streaming Toolkit, an open-s...
Assessing the Severity of Acne via Cell Phone Selfie Images Using A Deep Learning Model
Nestlé Skin Health partnered with Microsoft to develop a deep learning model powered mobile app able to assess acne severity using only uploaded selfie images as a source.
Running Parallel Apache Spark Notebook Workloads On Azure Databricks
This article walks through the development of a technique for running Spark jobs in parallel on Azure Databricks. The technique enabled us to reduce the processing times for JetBlue's reporting threefold while keeping the business logic implementation straight forward. The technique can be re-used for any notebooks-based Spark workload on Azure Databricks.
Developing and Deploying a Churn Prediction Model with Azure Machine Learning Services
Deep learning algorithms capable of learning and predicting customer behavior are allowing businesses to intervene with the right retention offers at the right time. CSE recently partnered with Majid Al Futtaim Ventures (MAF) to design and deploy a machine learning solution to predict attrition.
Real-Time Time Series Analysis at Scale for Trending Topics Detection
This code story describes a collaboration with ZenCity around detecting trending topics at scale. We discuss the datasets, data preparation, models used and the deployment story for this scenario.
Improving Safety and Efficiency in BMW Manufacturing Plants with an Open Source Platform for Managing Inventory Delivery
Over the course of twelve months Microsoft and BMW partnered three different times to help BMW with its vision for technical transformation. An open-source package called ROS-Industrial was used to help provide the building blocks for the robotics work.
Social Stream Pipeline on Databricks with auto-scaling and CI/CD using Travis
This code story describes CSE's work with ZenCity to create a data pipeline on Azure Databricks supported by a CI/CD pipeline on TravisCI. The aim of the collaboration was to create a pipeline capable of processing a stream of social posts, analyzing them, and identifying trends.
Active Learning for Object Detection in Partnership with Conservation Metrics
CSE teamed up with Conservation Metrics to use Active Learning to allow for more efficient data labeling for object detection projects.
How to Build A K8S Http API For Helm, and Serve Micro-services Using A Single IP
The Commercial Software Engineering team (CSE) partnered with Axonize to automate the process of deploying apps to Kubernetes, and expose these apps to the internet via a single IP. This post is about enabling applications in your Kubernetes cluster to programmatically install helm charts and expose them through a single public facing IP.
Attaching and Detaching an Edge Node From a HDInsight Spark Cluster when running Dataiku Data Science Studio (DSS)
Earlier this year, Dataiku and Microsoft joined forces to add extra flexibility to DSS on HDInsight, and also to allow Dataiku customers to attach a persistent edge node on an HDInsight cluster – something which was previously not a feature supported by the most recent edition of Azure HDInsight.
Infrastructure as Code – On demand GPU clusters with Terraform & Jenkins
Developing robust algorithms for self-driving cars requires sourcing event data from over 10 billion hours of recorded driving time. CSE worked with Cognata, a startup developing simulation platforms for autonomous vehicles, to build a Jenkins pipeline and Terraform solution that enabled our partner to dynamically scale GPU resources for their simulations.
Unsupervised driver safety estimation at scale, a collaboration with Pointer Telocation
A scalable unsupervised approach for driver safety estimation on Pointer Telocation's dataset
Semantic Segmentation of Small Data using Keras on an Azure Deep Learning Virtual Machine
Golf performance tracking startup Arccos joined forces with Commercial Software Engineering (CSE) developers in hopes of unveiling new improvements to their "virtual caddie" this summer.
Deploying a Batch AI Cluster for Distributed Deep Learning Model Training
Microsoft and Land O'Lakes partnered to develop an automated solution to identify sustainable farming practices given thousands of satellite images of Iowan farms. Our primary goal was to reduce the reliance on manual interviewing of farmers and make it more profitable for farmers to follow sustainable farming practices. To tackle this issue our team deployed a highly scalable Batch AI cluster on Azure and then performed distributed deep learning model training with Horovod.
Satellite Images Segmentation and Sustainable Farming
Can Machine Learning help with detecting sustainable farming practices? In this blog post inspired by our collaboration with Land O'Lakes we share the lessons we learned in the image segmentation space.
Building a Private Ethereum Consortium
Over the past two years, Microsoft and Webjet have collaborated to build a blockchain-based solution, Rezchain, to help travel companies reduce payment disputes. In this code story, we’ll share the lessons learned in creating the Rezchain consortium. In particular, we'll focus on how we solved the challenges involved with enabling Ethereum nodes to peer across virtual networks.
Using Otsu’s method to generate data for training of deep learning image segmentation models
In this article, we introduce a technique to rapidly pre-label training data for image segmentation models such that annotators no longer have to painstakingly hand-annotate every pixel of interest in an image. The approach is implemented in Python and OpenCV and extensible to any image segmentation task that aims to identify a subset of visually distinct pixels in an image.
Fashion Retail Inventory Management With Deep Learning Content-based Image Retrieval
In early 2018, Microsoft partnered with a successful international online fashion retailer to develop an efficient system for logging newly arrived apparel items and quickly determining whether the item is already in stock
Making sense of Handwritten Sections in Scanned Documents using the Azure ML Package for Computer Vision and Azure Cognitive Services
Extracting general concepts, rather than specific phrases, from documents and contracts is challenging. It's even more complicated when applied to scanned documents containing handwritten annotations. We describe using object detection and OCR with Azure ML Package for Computer Vision and Cognitive Services API.
Runtime Configuration of Spark Streaming Jobs
We achieved zero-downtime reconfiguration and management of the Spark Streaming job used in Project Fortis with Azure Service Bus.
OAuth 2.0 for Mixed Reality applications
We worked with Aveva to build 3DToolkit, a toolkit for creating cloud-based 3D experiences that securely stream to low-powered devices using WebRTC.
Deep Learning Image Segmentation for Ecommerce Catalogue Visual Search
We explored possible techniques to identify duplicate catalogue entries in fashion retail through image similarity with deep learning and computer vision.
Packaging an Electron app for managed distribution across devices
We developed an Electron-based app using Microsoft Intune cloud service for management and distribution across a broad range of devices.
App-to-app communication with React Native on Android
The ixo Foundation is building a decentralized impact evaluation protocol using blockchain and W3C decentralized identifier specification. We worked with them to develop a sample client in React Native, including a native Android plugin for app-to-app communication.
Voronoi Selection for Cancer Drug Network Visualization in Mixed Reality
We developed a Voronoi selection feature to improve the node selection experience in a HoloLens app that enables physicians to visualize cancer drug networks in 3D.
Sequence Intent Classification Using Hierarchical Attention Networks
We analyze how Hierarchical Attention Neural Networks could be helpful with malware detection and classification scenarios, demonstrating the usefulness of this approach for generic sequence intent analysis. The novelty of our approach is in applying techniques that are used to discover structure in a narrative text to data that describes the behavior of executables.
Using a Private Ethereum Consortium Network to Store and Validate Documents
Food retailers in Germany are required to prove that their food is below thresholds for regulated substances, such as pesticides. Currently, producers must send their probes for these substances to laboratories and only receive their results days later. In the meantime, they must wait to find out whether they s
Copy Custom VM Images on Azure
We created an azure-cli extension to simplify the process of distributing VM images globally.
Using Helm to Deploy Blockchain to Kubernetes
We recently worked with Webjet to migrate their deployment from IaaS to Kubernetes and used Helm to deploy a private Ethereum network to Kubernetes.
Analysing Bot to Human Hand-off Interactions
A common use case in the bot-verse is the ability to hand over a customer conversation from a bot to a human, and the vital need for a feedback loop for this kind of scenario. From this, we developed a Hand-off Dashboard Template that can be used within the Ibex dashboard to provide users with important information about how their bot and agents are working with customers.
Orchestrating TURN Servers for Cloud Deployment
We worked with Aveva to build 3DToolkit, a toolkit for creating powerful cloud-based 3D experiences that stream on low-powered devices with WebRTC.
Azure Event Hub Ingestion at Scale with Python and Kubernetes
We created a solution to ingest Azure Event Hubs events at scale using Python and Kubernetes.
Continuous Delivery for Service Fabric via Github, Travis CI and Docker Compose
This article describes how to use GitHub, Travis CI and Docker Compose to build a simple continuous delivery pipeline to deploy Linux Docker containers to a Service Fabric cluster of Linux hosts.
Deploying a Linux Python web application to Service Fabric via Docker Compose
This article covers how to take a standard Python web service consisting of an application tier, a WSGI server, and a Nginx reverse proxy and deploy it via Linux containers to a Linux cluster managed by Azure Service Fabric using only simple tooling like Docker Compose.
Giving meaningful context to social media influence with Microsoft Cognitive Services
When it comes to identifying and understanding influential voices in social media, context is key. See how we used topic detection, sentiment analysis, and Azure Functions to automate context-aware social media insights.
Comparing Image-Classification Systems: Custom Vision Service vs. Inception
This story covers how to get started with transfer-learning and build image classification models in Python with the Custom Vision Service. We compare the results with the popular Tensorflow-based models Inception and MobileNet.
Stock Market Predictions with Natural Language Deep Learning
We developed a deep learning model using a one-dimensional convolutional neural network to predict future stock market performance of companies using Azure Machine Learning Workbench and Keras.
Autoscaling Deep Learning Training with Kubernetes
We explore how we worked with a customer to add autoscaling capability to a Kubernetes cluster to meet bursty demands for deep learning training in a cost-efficient manner.
Permissively-Licensed Named Entity Recognition on the JVM
The ability to correctly identify entities, such as places, people, and organizations, adds a powerful level of natural language understanding to applications. This post introduces a MIT-licensed one-click deployment to Azure for web services that lets developers get started with a wide range of natural language tasks in 5 minutes or less, by consuming simple HTTP services for language identification, tokenization, part-of-speech-tagging and named entity recognition.
Building a Custom Spark Connector for Near Real-Time Speech-to-Text Transcription
This post describes in detail the Azure Cognitive Services speech-to-text WebSocket protocol and shows how to implement the protocol in Java. This enables us to transcribe audio to text in near real-time. We then show how to feed the transcribed radio into a pipeline based on Spark Streaming for further analysis, augmentation, and aggregation. The Java client is reusable across a wide range of text-to-speech scenarios that require time-efficient speech-to-text transcription in more than 10 languages including English, French, Spanish, German and Chinese.
Bird Detection with Azure ML Workbench
We demonstrate how to train Object Detection models using CNTK and Tensoflow DNN frameworks. Azure ML Workbench is used as the main training and model hosting infrastructure.
Moving High Scale Data and Compute from AWS to Azure for The Emedgene Genetics Intelligence Platform
We demonstrate how we migrated the compute resources of a genomics intelligence platform to Azure, transferring more than 100 TB of blob storage and handling application secrets without embedding the Azure SDK.
Creating a Data Visualization GraphQL Server with a Loosely Coupled Schema
We share how we built a flexible data visualization dashboard by leveraging the GraphQL stack.
Custom Analytics Dashboard for Application Insights
We created an easy-to-use tool for visualizing data from Microsoft Azure Application Insights with a dashboard framework. Our solution can be applied to different bot scenarios as well as other scenarios involving the service.
Using Microsoft Bot Framework as a Proxy to Publish your Bot Stack
With our solution, users can publish bot dialogs from any backend directly to MIcrosoft Bot Framework channels, with custom Navigator logic if needed.
Developing a Custom Search Engine for an Expert Chat System
We address the challenge of creating a custom search experience for a specific domain area. We also provide a guide for creating your own custom search experience by leveraging Azure Search and Cognitive Services and sharing custom code for iterative testing, measurement and indexer redeployment.
Using Object Detection for Complex Image Classification Scenarios
An overview of different image classification approaches including Microsoft Azure Custom Vision Service and CNTK for various levels of classification complexity.
Facilitating Growth Capital Funding in Africa with Bots
We built a bot with Microsoft Bot Framework (MBF) to tap into a multitude of channels, including a client's existing Android app, and implemented localization features, to connect with potential customers on their preferred online platforms.
Automating Receipt Processing
Claiming expenses is usually a manual process. This project aims to improve the efficiency of receipt processing by looking into ways to automate this process. This code story describes how we created a skeletal framework to achieve the following: We found a few challenges in addressing these goals. For instance, the quality of an Optical Character Recognizer (OCR) is crucial to tasks like accurately extracting the information of interest and modeling text-based classifiers (e.g., the expense category classifier). In addition, we discovered some retailers use logos instead of text for their n...
Building an Image Classification Pipeline Using Serverless Architecture
We collaborated on an image classification pipeline to perform automatic face detection and matching using machine learning via Microsoft Cognitive Services Face API. Our project was built with Azure Functions to process images using message queues.
Bot to Human Handoff in Node.js
When considering bots, it’s often important for organizations to have the ability to “hand off” a customer from a bot to a human agent seamlessly. We implemented an unopinionated e-2-e solution called Handoff for bot authors to implement a variety of scenarios, using the Microsoft Bot Framework Node.js SDK.
IoT Sports Sensor Machine Learning Helps Amateurs Up Their Game
We use IoT sensors to collect positional and motion data from professional and amateur skiers to classify expertise and skill level through machine learning.
Youth Homelessness Survey App with Xamarin.Forms and HockeyApp
We partnered with the Connecticut Coalition to End Homelessness to develop a Xamarin application, WeCount, for volunteers to use to collect survey data for the 2017 Point-In-Time Count.
Scaling UDP Workloads with Kubernetes
Situm, a company that offers high precision indoor navigation, looked to Kubernetes on Azure to provide high availability and scalability for their services. As of Kubernetes v1.6.5, Kubernetes on Azure supports both UDP and TCP workloads, and respects the Kubernetes Service spec's sessionAffinity.
Revisiting InterOp with Unity, UWP and DirectX
As Unity applications become more complex, the need arises to extend Unity to provide additional capabilities. In our work with Aveva, we used Unity's plugin architecture to utilize the workstation and server GPU, while still leveraging the Unity runtime for input and display.
Hacking React Native Unbundles into UWP
We recently worked on developing "unbundle" support for react-native-windows to reduce launch times and memory usage for React Native Windows apps.
Building Facebook.Yoga for UWP and WPF
We recently worked to bring greater parity to react-native-windows by building cross-platform layout library Facebook.Yoga for UWP and WPF as the React Native framework for iOS and Android switched to use Yoga.
Learning Image to Image Translation with Generative Adversarial Networks
Microsoft has partnered with Getty Images to explore how Neural Nets could be used to transform the stock photo industry.
Geocoding Social Conversations with NLP and JavaScript
Using Azure Functions and the open-source JavaScript library Compromise for inferring location in social media posts.
Deploying bots using the Serverless framework
Microsoft partnered with MaaS Global to build a bot using the Microsoft Bot Framework Node.js SDK that can be deployed with the Serverless framework.
Digital badge building with reusable Web Components
Designing and developing the badge builder for the Duke of York's iDEA programme with responsive web design, web components and Azure.
A Production Deis Workflow Deployment on Azure
We will cover the steps necessary to get Deis Workflow up and running on Azure, and address the production deployment steps in depth.
Food Classification with Custom Vision Service
How we created an app to identify foods and their nutritional content by using the new Custom Vision Service to leverage domain-specific image recognition powered by DNNs.
Project Fortis: Accelerating UN Humanitarian Aid Planning with GraphQL
Using GraphQL and Azure to create a data processing pipeline for identifying trends and providing insights about global humanitarian crises.
Classifying Leaks Using Cognitive Toolkit
We use Deep Learning to turn a painful and time-consuming leak-detection task for water and oil pipelines into a fast, painless process. Using Python and Fast Fourier Transforms, we turn audio sensor data into images, then use Convolutional Neural Networks to detect and classify pipeline anomalies.
Provision and Configure your Infrastructure on Azure using SaltStack
SaltStack delivers infrastructure as code and configuration management with an abstraction of the cloud provider selected. We will illustrate the end-to-end process of how we provisioned and configured the deployment of an ElasticSearch cluster on Azure using SaltStack.
Using a Layer 7 Proxy for Ethereum Blockchain Client’s JSON-RPC Endpoint
This walk-through shows how to use a Layer 7 proxy on Azure to protect an Ethereum Blockchain client's JSON-RPC endpoint and provide additional capabilities, such as secure channels, tracking, and even analytics.
Continuous Delivery to Multi-Cloud Marketplaces
This code story describes how we collaborated with a partner to create a continuous delivery solution that runs on multiple cloud platforms using Jenkins.