{"id":1023,"date":"2025-07-08T05:57:41","date_gmt":"2025-07-08T05:57:41","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/all-things-azure\/?p=1023"},"modified":"2025-07-08T18:59:53","modified_gmt":"2025-07-08T18:59:53","slug":"build-biosensing-ai-native-apps-on-azure-with-bci-ai-foundry-and-agents","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/all-things-azure\/build-biosensing-ai-native-apps-on-azure-with-bci-ai-foundry-and-agents\/","title":{"rendered":"Build Biosensing AI-Native Apps on Azure with BCI, AI Foundry, and Agents Service"},"content":{"rendered":"<p><!-- Title: Emotionally Intelligent Solutions on Azure with fNIRS\u202fBCI Wearables\nSlug: emotionally\u2011intelligent\u2011solutions\u2011azure\u2011fnirs\u2011bci\nCategories: AI, Azure OpenAI, IoT, Cognitive Services\nTags: BCI, fNIRS, TypeAgent, Brain\u2011Computer\u2011Interface, Agents\u00a0SDK --><\/p>\n<p><strong>Co\u2011Author:<\/strong> <a href=\"https:\/\/www.linkedin.com\/in\/jdchibuk\">JD\u202fChibuk<\/a>, Founder\u00a0<a href=\"http:\/\/blueberryx.com\">Blueberry\u202fX<\/a><!-- upload to the Media Library and replace this placeholder URL --><\/p>\n<p>We obsessively track our steps, heart rate, and sleep &#8211; but what about our mental state? \ud83e\udde0 Most of us navigate life blind to how stress, focus, and cognitive overload show up in our physiology. Tools to help capture cognitive indicators can help us change how we think, feel and act in high stress situations for the better.<\/p>\n<p><iframe src=\"\/\/www.youtube.com\/embed\/Why0vIiYuO0\" width=\"560\" height=\"314\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<h2><strong>\ud83e\udd16 Meet Your Cognitive Copilot<\/strong><\/h2>\n<p>Imagine an AI agent that quietly observes your indicators relating to cognitive activity, learns your patterns, and supports you in real-time. With breakthrough technologies like fNIRS (functional near-infrared spectroscopy), this isn&#8217;t science fiction &#8211; it&#8217;s happening now. The market has shifted to the new frontier especially those looking for an edge!<\/p>\n<p>These agents don&#8217;t replace human judgment; <strong>they supercharge it.<\/strong> \ud83d\udcaa<\/p>\n<h2><strong>\ud83c\udfaf Game-Changing Applications<\/strong><\/h2>\n<p><strong>\ud83c\udfc6 Sports &amp; Performance:<\/strong><\/p>\n<ul>\n<li>\u26f3 Golfers receive real-time emotional regulation insights for shot accuracy<br \/><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250614_golfer_003-min.png\"><img decoding=\"async\" class=\"alignnone size-medium wp-image-1160\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250614_golfer_003-min-300x201.png\" alt=\"Golfer\" width=\"300\" height=\"201\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250614_golfer_003-min-300x201.png 300w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250614_golfer_003-min-1024x685.png 1024w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250614_golfer_003-min-768x514.png 768w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250614_golfer_003-min-1536x1028.png 1536w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250614_golfer_003-min-2048x1371.png 2048w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/li>\n<li>\ud83c\udfc8 High impact sports to understand impact and relative blood flow response<br \/><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_football_example.png\"><img decoding=\"async\" class=\"alignnone size-medium wp-image-1161\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_football_example-300x153.png\" alt=\"Football\" width=\"300\" height=\"153\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_football_example-300x153.png 300w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_football_example-1024x522.png 1024w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_football_example-768x392.png 768w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_football_example.png 1432w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/li>\n<li>\ud83c\udfce\ufe0f Formula 1 &amp; motorsport drivers get cognitive load monitoring for optimal race communications, feedback during training, and cues for when to take a deep breathe<br \/><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250605_motorsports_SF_003.mov\">20250605_motorsports_SF_003<\/a><br \/><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_motorsports_INX0896-min-scaled.jpg\"><img decoding=\"async\" class=\"alignnone size-medium wp-image-1163\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_motorsports_INX0896-min-300x200.jpg\" alt=\"20250526 motorsports INX0896 min image\" width=\"300\" height=\"200\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_motorsports_INX0896-min-300x200.jpg 300w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_motorsports_INX0896-min-1024x683.jpg 1024w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_motorsports_INX0896-min-768x512.jpg 768w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_motorsports_INX0896-min-1536x1024.jpg 1536w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_motorsports_INX0896-min-2048x1365.jpg 2048w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><br \/><em>Credit: @<a href=\"https:\/\/www.linkedin.com\/in\/ivan-novotny-5a82461\/\">Ivan Novotny<\/a>, @<a href=\"https:\/\/www.linkedin.com\/in\/sam-fellows-b84b42232\/\">Sam Fellows<\/a>,\u00a0 @<a href=\"https:\/\/www.linkedin.com\/in\/jimbowielinked\/\">Jim Bowie<\/a>\/Motovitesse<\/em><\/li>\n<\/ul>\n<p><div class=\"alert alert-primary\"><p class=\"alert-divider\"><i class=\"fabric-icon fabric-icon--Info\"><\/i><strong>See it in action<\/strong><\/p>Visit <a href=\"https:\/\/motorsports.blueberryx.com\">motorsports.blueberryx.com<\/a> to see this in action (hosted on azure)<\/div><\/p>\n<p><strong>\u2695\ufe0f High-Stakes Professions:<\/strong><\/p>\n<ul>\n<li>\u2708\ufe0f Pilots optimizing communication timing and focus cues<\/li>\n<li>\ud83d\udd2c Surgeons get stress alerts before fine motor control deteriorates<\/li>\n<li>\u26cf\ufe0f Mining operators prevent accidents through cognitive overload detection\n<p><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250527_pilot_001-min.png\"><img decoding=\"async\" class=\"alignnone size-medium wp-image-1164\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250527_pilot_001-min-300x199.png\" alt=\"20250527 pilot 001 min image\" width=\"300\" height=\"199\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250527_pilot_001-min-300x199.png 300w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250527_pilot_001-min-1024x680.png 1024w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250527_pilot_001-min-768x510.png 768w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250527_pilot_001-min-1536x1020.png 1536w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250527_pilot_001-min-2048x1359.png 2048w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/li>\n<\/ul>\n<p><strong>\ud83d\udcbc Workplace Innovation:<\/strong><\/p>\n<ul>\n<li>\ud83d\udc69\u200d\u2695\ufe0f Doctors managing emotional regulation during traumatic cases<\/li>\n<li>\ud83d\udcbb Developers tracking mental fatigue to boost productivity<\/li>\n<li>\ud83d\udc65 Leaders understanding how cognitive load impacts their teams<\/li>\n<li>\ud83d\udcc8 Stockbrokers receive fatigue warnings before poor decision patterns emerge<\/li>\n<\/ul>\n<h2><strong>Beyond Basic Wearables<\/strong><\/h2>\n<p>Unlike simple fitness trackers, these agents use contextualized intelligence. \ud83e\udde0 Azure&#8217;s TypeAgent BCI Sample combines: \u2022 \ud83c\udf0a Cognitive indicator data \u2022 \ud83d\udc41\ufe0f Audio and visual inputs \u2022 \ud83d\udccd Location and calendar context \u2022 \u2764\ufe0f Biometric signals<\/p>\n<p>The result? Personalized, situationally aware assistants that understand how your cognitive state shifts across different environments, tasks, and social contexts. \ud83c\udfaf<\/p>\n<p>Bio-sensing technology such as fNIRS is modular and small. <br \/>This means it can fit into a variety of form factors such as eyeglass, hats, headphones and headbands.<\/p>\n<p>The adaptability of this technology while providing indicators including \u2764\ufe0f pulse rate, \ud83d\ude0a muscle movements (face and eye) and \ud83e\ude78 deep tissue blood flow response. fNIRS bio-sensing is a great tool for any wearable that needs to include indicators for cognition.<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-blueberry-eyeglass-min-scaled.png\"><img decoding=\"async\" class=\"alignnone size-medium wp-image-1165\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-blueberry-eyeglass-min-300x125.png\" alt=\"202505 blueberry eyeglass min image\" width=\"300\" height=\"125\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-blueberry-eyeglass-min-300x125.png 300w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-blueberry-eyeglass-min-1024x427.png 1024w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-blueberry-eyeglass-min-768x320.png 768w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-blueberry-eyeglass-min-1536x641.png 1536w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-blueberry-eyeglass-min-2048x854.png 2048w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><br \/><em>Credit: Blueberry X\u2019s bio-sensor fNIRS module with an eyeglass<br \/><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-sales-deck-icons.png\"><img decoding=\"async\" class=\"alignnone size-medium wp-image-1167\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-sales-deck-icons-300x131.png\" alt=\"202505 sales deck icons image\" width=\"300\" height=\"131\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-sales-deck-icons-300x131.png 300w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-sales-deck-icons-1024x448.png 1024w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-sales-deck-icons-768x336.png 768w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-sales-deck-icons-1536x671.png 1536w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/202505-sales-deck-icons-2048x895.png 2048w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><br \/><\/em><\/p>\n<h2><strong>\ud83e\ude9eYour Digital Cognitive Mirror<\/strong><\/h2>\n<p>Over time, these agents create a living model of your mental patterns &#8211; a cognitive heuristic that gets smarter with every interaction. Think of it as a mirror that reflects not just how you look, but how you think, feel, and perform.\u00a0<\/p>\n<p>This becomes your ultimate tool for: \u2022 \ud83d\udd0d Self-awareness \u2022 \ud83d\ude80 Performance optimization \u2022 \ud83c\udfaf Strategic decision-making<br \/><em><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_dashboard_snapshot.png\"><img decoding=\"async\" class=\"alignnone size-medium wp-image-1166\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_dashboard_snapshot-300x187.png\" alt=\"20250526 dashboard snapshot image\" width=\"300\" height=\"187\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_dashboard_snapshot-300x187.png 300w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_dashboard_snapshot-1024x638.png 1024w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_dashboard_snapshot-768x478.png 768w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_dashboard_snapshot-1536x957.png 1536w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2025\/06\/20250526_dashboard_snapshot-2048x1276.png 2048w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/em><\/p>\n<h2><strong>\ud83d\udee0\ufe0f The Builder&#8217;s Opportunity<\/strong><\/h2>\n<p>For developers, product managers, and innovation teams, this represents a massive market opportunity &#8211; the foundation for adaptive, insight-driven workplace tools that are deeply personal.<\/p>\n<p><strong>\ud83d\udd25 Critical applications include:<\/strong> \u2022 \ud83d\udea8 Emergency responders maintaining clarity under pressure \u2022 \ud83d\udcca Financial analysts optimizing decision-making during market volatility \u2022 \ud83c\udfed Factory operators ensuring safety through cognitive monitoring \u2022 \ud83c\udfe2 Corporate teams maximizing performance and well-being<\/p>\n<h2 class=\"wp-block-heading\"><strong>\ud83d\udd27 How it could work <\/strong><\/h2>\n<p><img decoding=\"async\" src=\"https:\/\/github.com\/Azure-Samples\/typeagent-bci-sample\/blob\/main\/public\/blog_architecture.png?raw=true\" alt=\"End-to-end architecture for the TypeAgent BCI sample\" width=\"100%\" \/><\/p>\n<p><strong>Input streams.<\/strong> Neuro-signals from the BlueberryX headset (fNIRS) plus heart-rate, Teams messages, email, voice, and other sensor data is fused into <em>Event Grid<\/em> or <em>Event Hubs<\/em>. This normalizes everything into a single, time-stamped event feed.<\/p>\n<p><strong>Meta agent orchestration.<\/strong> A <em>Meta Agent<\/em> (built with <em>TypeAgent <\/em>or other orchestrators) sits in Azure Container Apps and delegates tasks to specialized sub agents &#8211; email replies, guided meditation, deep-breath prompts, design generation, and even golf-stroke analysis.<\/p>\n<p><strong>Reasoning &amp; content generation.<\/strong> Each agent taps <em>Azure AI Foundry<\/em> models (gpt-4o, o3, dall-e etc.) through the new <em>AI Agents Service<\/em>, gaining tools for Bing search, function calls, and knowledge retrieval.<\/p>\n<p><strong>State &amp; search.<\/strong> Long-term context and time-series data land in <em>Cosmos DB<\/em>, while text and multi-modal embeddings are indexed with <em>Azure AI Search<\/em> for fast RAG-style look-ups.\u00a0<\/p>\n<p><strong>Actionable outputs.<\/strong> The agent swarm produces real-time dashboards, research reports, adaptive meditation scripts, and even AI-generated diagrams &#8211; each tailored to the user\u2019s current cognitive state.\u00a0<\/p>\n<h2><strong>\u23f0 The Time is Now<\/strong><\/h2>\n<p>If you&#8217;re building solutions that make humans more aware, capable, and in control of their inner state, <strong>we want to connect with you.<\/strong> \ud83e\udd1d<\/p>\n<p><strong>\ud83d\ude80 Ready to explore?<\/strong> <br \/>\u2022 \ud83d\udd2c Dive into the <a href=\"https:\/\/github.com\/Azure-Samples\/typeagent-bci-sample\">Azure\u2019s TypeAgent BCI Sample<\/a> <br \/>\u2022 \ud83c\udf1f Join our community of builders and pioneers <br \/>\u2022 \ud83d\udc99 Discover fNIRS bio-sensing at <a href=\"https:\/\/www.blueberryx.com\/\">blueberryx.com<\/a><\/p>\n<p>The future of emotionally intelligent tools starts with you. Let&#8217;s build it together. \ud83c\udf1f<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Co\u2011Author: JD\u202fChibuk, Founder\u00a0Blueberry\u202fX<\/p>\n","protected":false},"author":172657,"featured_media":1167,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1023","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-azure"],"acf":[],"blog_post_summary":"<p>Co\u2011Author: JD\u202fChibuk, Founder\u00a0Blueberry\u202fX<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/posts\/1023","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/users\/172657"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/comments?post=1023"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/posts\/1023\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/media\/1167"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/media?parent=1023"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/categories?post=1023"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/tags?post=1023"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}