{"id":400,"date":"2024-12-04T19:41:06","date_gmt":"2024-12-04T19:41:06","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/all-things-azure\/?p=400"},"modified":"2025-01-23T17:16:02","modified_gmt":"2025-01-23T17:16:02","slug":"how-to-develop-ai-apps-and-agents-in-azure-a-visual-guide","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/all-things-azure\/how-to-develop-ai-apps-and-agents-in-azure-a-visual-guide\/","title":{"rendered":"How to develop AI Apps and Agents in Azure &#8211; A Visual Guide"},"content":{"rendered":"<p><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">As organizations explore new AI-powered experiences and automated workflows, there&#8217;s a growing need to move beyond experiments and proofs-of-concept to production-ready applications. This guide walks you through the essential steps and decisions for building robust AI applications in Azure, focusing on reliability, security, and enterprise-grade quality.<\/span><\/p>\n<h3><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Why Choose Azure&#8217;s Managed Services?<\/strong><\/span><\/h3>\n<p><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">It&#8217;s easy to experiment with generative AI models and create proof-of-concept demos, but building production-ready applications that can scale reliably is a different challenge entirely. When deploying AI-powered applications for real business use, you need infrastructure that provides consistent performance, robust security, and reliable operations. Did you know that OpenAI&#8217;s ChatGPT, GitHub Copilot, and Microsoft&#8217;s Copilots, are all deployed on Azure&#8217;s managed services? Managed services reduce uncertainty when deploying AI agents with specific goals and guardrails, making them accessible to organizations of all sizes.<\/span><\/p>\n<p><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">In this article I am going to provide you with a visual map to help you decide which Azure AI service is best for your use case. Let&#8217;s get started:<\/span><\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_decision-tree.png\"><img decoding=\"async\" class=\"alignnone size-large wp-image-436\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_decision-tree-1024x749.png\" alt=\"Image MS AzureBlog DecisionTree 12 03 24 decision tree\" width=\"1024\" height=\"749\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_decision-tree-1024x749.png 1024w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_decision-tree-300x219.png 300w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_decision-tree-768x562.png 768w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_decision-tree-1536x1123.png 1536w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_decision-tree-2048x1498.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/p>\n<h2><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Need a Quick Start?<\/strong><\/span><\/h2>\n<p><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">The quickest way to get started is by going to Azure AI Foundry at <a href=\"https:\/\/aka.ms\/AAtn81f\">https:\/\/ai.azure.com<\/a>, which serves as your central hub for AI development, offering:<\/span><\/p>\n<p><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/ai-foundry.png\"><img decoding=\"async\" class=\"size-medium wp-image-407 aligncenter\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/ai-foundry-80x300.png\" alt=\"Image ai foundry\" width=\"80\" height=\"300\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/ai-foundry-80x300.png 80w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/ai-foundry-272x1024.png 272w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/ai-foundry.png 281w\" sizes=\"(max-width: 80px) 100vw, 80px\" \/><\/a><\/strong><\/span><\/p>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Playgrounds: <\/strong>Add your data and ground models to your content through managed RAG (Retrieval Augmented Generation) with just a few clicks. Deploy production-ready chat experiences quickly without complex setup<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Prompt Flow: <\/strong>Enables you to do evaluation-driven development, tune prompts, integrate with tools, and provides built-in observability and troubleshooting<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Agent Service<\/strong>: Enable secure, scalable single-purpose agents with managed RAG, managed function calling, and bring-your-own customization options. Seamlessly integrate with enterprise systems<\/span><\/li>\n<\/ul>\n<p><div class=\"alert alert-success\"><p class=\"alert-divider\"><i class=\"fabric-icon fabric-icon--Lightbulb\"><\/i><strong>Pro Tip: Start Your AI Journey with Azure AI Foundry<\/strong><\/p>Azure AI Foundry provides everything you need to kickstart your AI application development journey. It offers an intuitive platform with built-in development tools, essential AI capabilities, and ready-to-use models (1800+!). As your needs grow, you can seamlessly integrate additional Azure managed services to enhance your AI solutions further. This makes it the ideal starting point for both beginners and experienced developers.<\/div><\/p>\n<p><div  class=\"d-flex justify-content-left\"><a class=\"cta_button_link btn-primary mb-24\" href=\"https:\/\/aka.ms\/AAtn81f\" target=\"_blank\">Azure AI Foundry<\/a><\/div><\/p>\n<h2><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Need More Control? Let&#8217;s Build Your Stack<\/strong><\/span><\/h2>\n<h3><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>What Kind of Model Do You Need?<\/strong><\/span><\/h3>\n<p>Selecting the right AI model is a critical decision that impacts your application&#8217;s capabilities, performance, and cost-effectiveness. Azure offers a comprehensive range of models to address different requirements, from multimodal reasoning to specialized tasks. Here&#8217;s a guide to help you choose the most suitable model for your specific needs:<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-4.png\"><img decoding=\"async\" class=\"aligncenter wp-image-451 size-medium\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-4-300x265.png\" alt=\"Image MS AzureBlog DecisionTree 12 03 24 section 4\" width=\"300\" height=\"265\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-4-300x265.png 300w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-4-1024x905.png 1024w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-4-768x679.png 768w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-4.png 1080w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<table style=\"width: 100.828%; height: 917px;\" width=\"683\">\n<tbody>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Requirement<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Options<\/strong><\/span><\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Multimodal reasoning<\/strong> (text + images)<\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Azure OpenAI GPT-4o: Latest multimodal model for understanding both text and images<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Llama models: Open-source multi-modal foundation model, designed for various natural language processing tasks, offering flexibility and customization for developers<\/span><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Sensitive to latency and cost<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Smaller LLMs like 4o-mini: optimized for lower latency and cost, making them suitable for applications where quick responses and resource efficiency are critical.<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Choose from 1800+ models in Azure AI Model Catalog: Specialized models for specific tasks<\/span><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Embeddings for search or classification<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Azure OpenAI&#8217;s text-embedding-3 family: provides embeddings that capture semantic meanings of text (vector representations), enabling effective search, classification, and clustering tasks.<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Cohere embeddings: Alternative text embedding models with strong multilingual support<\/span><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Working with images<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Azure OpenAI&#8217;s CLIP model + AI Search: enables vector-based image search by understanding and associating images with textual descriptions, enhancing image retrieval capabilities.<\/span><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Advanced reasoning<\/strong> (System-2)<\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">o1-preview: designed for complex problem-solving with built-in reflection mechanisms, enabling advanced reasoning and decision-making processes.<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">o1-mini: offers efficient reasoning capabilities, providing a balance between performance and resource utilization for applications requiring streamlined decision-making.<\/span><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><span style=\"font-size: 12pt; font-family: tahoma, arial, helvetica, sans-serif;\"><div class=\"alert alert-success\"><p class=\"alert-divider\"><i class=\"fabric-icon fabric-icon--Lightbulb\"><\/i><strong>Pro Tip: Choosing the Right Model<\/strong><\/p>Start with Azure AI Foundry&#8217;s model catalog to explore and experiment with different models. For most enterprise applications, consider using GPT-4o for complex multimodal tasks, while leveraging specialized models like 4o-mini for latency-sensitive operations. When building RAG applications, pair embedding models with your LLM &#8211; Azure OpenAI&#8217;s text-embedding-3 family works seamlessly with GPT models. Remember that you can always switch or combine models as your needs evolve, so focus on finding the right balance between capability and efficiency for your specific use case.<\/div><\/span><\/p>\n<h3><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>How Will Your Agent Remember Things?<\/strong><\/span><\/h3>\n<p><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">When building AI applications, choosing the right storage solution is crucial for managing different types of data effectively. Here&#8217;s a guide to help you select the appropriate memory solution for your needs:<\/span><\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-2.png\"><img decoding=\"async\" class=\"aligncenter wp-image-452 size-medium\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-2-150x300.png\" alt=\"Image MS AzureBlog DecisionTree 12 03 24 section 2\" width=\"150\" height=\"300\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-2-150x300.png 150w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-2-512x1024.png 512w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-2.png 538w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/><\/a><\/p>\n<table style=\"width: 100.828%; height: 886px;\" width=\"683\">\n<tbody>\n<tr style=\"height: 35px;\">\n<td style=\"width: 21.0036%; height: 35px;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Requirement<\/strong><\/span><\/td>\n<td style=\"width: 119.563%; height: 35px;\" width=\"468\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Options<\/strong><\/span><\/td>\n<\/tr>\n<tr style=\"height: 271px;\">\n<td style=\"width: 21.0036%; height: 271px;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Search Capabilities<\/strong><\/span><\/td>\n<td style=\"width: 119.563%; height: 271px;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnfqo\">Azure AI Search<\/a>: Enterprise-grade search service with built-in AI capabilities including:<\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Multi-modal semantic search<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">OCR and image analysis<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Translation services<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Rich integrations with Azure AI services<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr style=\"height: 182px;\">\n<td style=\"width: 21.0036%; height: 182px;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Frequently Accessed Knowledge<\/strong><\/span><\/td>\n<td style=\"width: 119.563%; height: 182px;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtn829\">Cosmos DB<\/a>: Globally distributed database with multi-model support<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnfqq\">Azure Redis Cache<\/a>: In-memory data store for high-performance scenarios requiring low latency, which is also integrated with APIM&#8217;s Gen-AI Gateway for semantic caching<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnfqo\">Azure AI Search<\/a>: Combines search capabilities with knowledge storage<\/span><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr style=\"height: 182px;\">\n<td style=\"width: 21.0036%; height: 182px;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Episodic Memory<\/strong> (interaction history) and Knowledge Graphs<\/span><\/td>\n<td style=\"width: 119.563%; height: 182px;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Cosmos DB: Native graph database support for complex relationship modeling via <a href=\"https:\/\/aka.ms\/AAtnfqr\">Gremlin API<\/a>, or using <a href=\"https:\/\/aka.ms\/AAtnnip\">GraphRAG solution accelerator<\/a><\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtn82d\">Azure Database for PostgreSQL<\/a>: Uses Apache Graph Extension for graph capabilities in a relational database &#8211; see Azure PostgreSQL&#8217;s <a href=\"https:\/\/aka.ms\/AAtnfqs\">GraphRaG implementation<\/a><\/span><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr style=\"height: 216px;\">\n<td style=\"width: 21.0036%; height: 216px;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Operational Data with Semantic Retrieval<\/strong><\/span><\/td>\n<td style=\"width: 119.563%; height: 216px;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">NoSQL preference \u2192 Cosmos DB with DiskANN: Ideal for applications needing global distribution and vector search<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">SQL preference \u2192 PostgreSQL with pgvector: Best for applications requiring both traditional SQL capabilities and vector operations<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">MongoDB preference \u2192 MongoDB vCore: Fully managed MongoDB service with vector search capabilities<\/span><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><div class=\"alert alert-success\"><p class=\"alert-divider\"><i class=\"fabric-icon fabric-icon--Lightbulb\"><\/i><strong>Pro Tip: Choosing the Right Memory Solution<\/strong><\/p>\n<span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Start by evaluating your search needs &#8211; Azure AI Search provides comprehensive multi-modal search capabilities with built-in AI services integration. For frequent data access, consider combining Azure Redis Cache for performance-critical operations with a persistent storage solution like Cosmos DB. When building knowledge graphs, leverage the GraphRAG solution accelerators available for both Cosmos DB and PostgreSQL to simplify implementation.<\/span>\n<\/div><\/p>\n<h3 class=\"font-600 text-lg font-bold\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Where Will You Run Your Application?<\/span><\/h3>\n<p class=\"whitespace-pre-wrap break-words\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Choosing the right runtime environment and frontend infrastructure is crucial for your AI application&#8217;s performance, scalability, and maintainability. Azure offers various options to match your specific deployment needs, from simple web apps to complex containerized solutions. Here&#8217;s a guide to help you select the most appropriate runtime configuration:<\/span><\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-1.png\"><img decoding=\"async\" class=\"aligncenter wp-image-453 size-medium\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-1-176x300.png\" alt=\"Image MS AzureBlog DecisionTree 12 03 24 section 1\" width=\"176\" height=\"300\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-1-176x300.png 176w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-1.png 569w\" sizes=\"(max-width: 176px) 100vw, 176px\" \/><\/a><\/p>\n<table style=\"width: 100.828%; height: 917px;\" width=\"683\">\n<tbody>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Requirement<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Options<\/strong><\/span><\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Web Applications<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnnis\">Azure App Service<\/a>: Fully managed platform for building, deploying, and scaling web apps<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Built-in CI\/CD integration<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Automatic scaling and load balancing<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Enterprise-grade security and compliance<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Serverless and Event-Driven<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnniu\">Azure Container Apps<\/a>: Fully managed serverless container service for AI workloads<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Serverless GPUs with scale-to-zero<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Dynamic Sessions for secure code interpretation with Hyper-V isolation<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Built-in data governance (data never leaves container boundaries)<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Enterprise features like private endpoints and planned maintenance<\/span><\/li>\n<\/ul>\n<\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnv3j\">Azure Functions<\/a>: Serverless compute with Azure OpenAI integration<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">OpenAI triggers and bindings for chat assistants and RAG patterns<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Pay-per-execution pricing with Flex consumption<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Support for vector stores (AI Search, Cosmos DB MongoDB, ADX)<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Managed identity support for secure service access<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Container Orchestration<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnv3l\">Azure Kubernetes Service (AKS)<\/a>: Managed Kubernetes service for complex container orchestration<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Full container orchestration control<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Multi-container deployments<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Enterprise-grade security features<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Advanced networking and scaling options<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Communication Features<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtoam0\">Azure Communication Services<\/a>: Comprehensive platform for adding communication capabilities<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Voice and video calling<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">SMS and chat functionality<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Easy integration with existing applications<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><div class=\"alert alert-success\"><p class=\"alert-divider\"><i class=\"fabric-icon fabric-icon--Lightbulb\"><\/i><strong>Pro Tip: Choosing the Right Runtime Environment<\/strong><\/p><\/span>\n<span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Consider starting with Azure App Service for straightforward web applications. For event-driven workloads, both Azure Container Apps and Functions offer serverless capabilities with automatic scaling &#8211; choose Container Apps when you need container flexibility or GPU support, and Functions for lightweight compute with AI bindings. If you need full container orchestration control, AKS provides enterprise-grade Kubernetes management.<\/span>\n<span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><\/div><\/span><\/p>\n<h3><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">How Will Your AI Agent Take Action?<\/span><\/h3>\n<p><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">When building AI applications that need to interact with the real world, you&#8217;ll need tools that enable your agents to take actions, process information, and integrate with enterprise systems. Azure provides a comprehensive set of tools that let your AI agents create real-world impact while maintaining security and control. With the AI Agent Service in Azure AI Foundry, integrating these tools has become even more streamlined. Here&#8217;s a guide to help you choose the right tools for your AI application:<\/span><\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-3.png\"><img decoding=\"async\" class=\"aligncenter wp-image-454 size-medium\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-3-196x300.png\" alt=\"Image MS AzureBlog DecisionTree 12 03 24 section 3\" width=\"196\" height=\"300\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-3-196x300.png 196w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-3.png 538w\" sizes=\"(max-width: 196px) 100vw, 196px\" \/><\/a><\/p>\n<table style=\"width: 100.828%; height: 917px;\" width=\"683\">\n<tbody>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Requirement<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Options<\/strong><\/span><\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Plugins and Workflows<\/strong> (Function Calling)<\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAto2tx\">Logic Apps<\/a>: The primary tool for enabling AI agents to take actions<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Native integration with AI Agent Service for seamless function calling<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Support for On-Behalf-Of (OBO) flows<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">200+ pre-built connectors for enterprise systems<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Visual workflow designer for complex orchestrations<\/span><\/li>\n<\/ul>\n<\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnv3j\">Azure Functions<\/a>: Serverless compute for custom tool implementations<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Custom function calling implementations<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Integration with AI services via bindings<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>AI Services<\/strong> (via APIs)<\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtoam7\">Content Understanding<\/a>: Process and structure any content type<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Unified processing of documents, images, videos, and audio<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Field extraction with configurable schema<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Built-in confidence scoring and source grounding<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Ideal for automation, RAG, and analytics workflows<\/span><\/li>\n<\/ul>\n<\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtoam8\">Document Intelligence<\/a>: Extract and analyze information from documents<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnv3o\">Vision<\/a>: Process and analyze images and videos<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtn82n\">Language<\/a>: Natural language processing and understanding<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnnj4\">Speech<\/a> &amp; <a href=\"https:\/\/aka.ms\/AAtnnj6\">Avatar<\/a>: Voice interaction and digital human experiences<\/span><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Code Interpreter<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnnj8\">Azure Container Apps Dynamic Sessions<\/a>: Secure environment for running AI-generated code<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Isolated execution environment<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Support for multiple programming languages<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Integration with AI Agent Service<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><div class=\"alert alert-success\"><p class=\"alert-divider\"><i class=\"fabric-icon fabric-icon--Lightbulb\"><\/i><strong>Pro Tip: Leveraging AI Agent Service for Tool Integration<\/strong><\/p><\/span>\n<span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">The AI Agent Service in Azure AI Foundry significantly simplifies tool integration for your AI applications. It provides managed function calling capabilities and seamless integration with Logic Apps, making it easier to implement complex workflows and system interactions. When building AI agents that need to take actions, start with Logic Apps for orchestration and leverage the AI Agent Service&#8217;s built-in support for OBO flows and enterprise system integration.<\/span>\n<span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><\/div><\/span><\/p>\n<h3><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">How Will You Ensure Quality and Safety?<\/span><\/h3>\n<p><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Enterprise AI applications require comprehensive quality controls across safety, evaluation, security, and reliability dimensions. Azure provides integrated services to help you build AI applications that meet the highest quality standards. Here&#8217;s a guide to help you implement the right quality attributes:<\/span><\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-5.png\"><img decoding=\"async\" class=\"aligncenter wp-image-455 size-medium\" src=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-5-176x300.png\" alt=\"Image MS AzureBlog DecisionTree 12 03 24 section 5\" width=\"176\" height=\"300\" srcset=\"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-5-176x300.png 176w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-5-601x1024.png 601w, https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-content\/uploads\/sites\/83\/2024\/12\/MS_AzureBlog-DecisionTree_12.03.24_section-5.png 669w\" sizes=\"(max-width: 176px) 100vw, 176px\" \/><\/a><\/p>\n<table style=\"width: 100.828%; height: 917px;\" width=\"683\">\n<tbody>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Requirement<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Options<\/strong><\/span><\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Quality Attributes &amp; Reliability<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnv3a\">API Management with GenAI Gateway<\/a>: Enterprise-grade API management<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Token limit management and monitoring<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Semantic caching for optimized responses<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Load balancing across multiple endpoints<\/span><\/li>\n<\/ul>\n<\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAto2tl\">Event Hubs<\/a>: Reliable flow control<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnv39\">Service Bus<\/a>: Reliable messaging<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtoalr\">Azure Monitor<\/a>: Comprehensive observability<\/span><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>AI Safety<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAto2ti\">Azure AI Content Safety<\/a>: Comprehensive content safety service<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Detect harmful content in text and images<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Built-in Prompt Shields for LLM attack protection<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Support for custom safety categories<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Integration with Microsoft Defender for Cloud for threat protection<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Evaluation &amp; LLMOps<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnfql\">Azure AI Foundry Evaluations<\/a>: Integrated evaluation platform<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Built-in metrics for quality, safety, and performance<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">AI-assisted and NLP-based evaluation methods<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Support for custom evaluation flows<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Comprehensive evaluation metrics library<\/span><\/li>\n<\/ul>\n<\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtn81z\">Prompt Flow (integrated with AI Foundry)<\/a>: Evaluation-driven development<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Flow-based evaluation orchestration<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Built-in observability and troubleshooting<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 21.0036%;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Security<\/strong><\/span><\/td>\n<td style=\"width: 119.563%;\" width=\"468\">\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtn81x\">Microsoft Entra Managed Identity<\/a>: Secure identity management<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtnfqf\">Microsoft Defender for Cloud<\/a>: AI-specific threat protection<\/span><\/span>\n<ul>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Real-time threat detection for AI workloads<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Integration with Defender XDR<\/span><\/li>\n<li><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Protection against data leakage and poisoning<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><div class=\"alert alert-success\"><p class=\"alert-divider\"><i class=\"fabric-icon fabric-icon--Lightbulb\"><\/i><strong>Pro Tip: Building Enterprise-Grade AI Applications<\/strong><\/p><\/span>\n<span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Start with Azure AI Foundry&#8217;s evaluation capabilities to assess your application&#8217;s quality and safety. Use Content Safety service to protect against harmful content and integrate with API Management&#8217;s GenAI Gateway for production-grade reliability. Implement Microsoft Defender for Cloud to ensure comprehensive security coverage for your AI workloads. This layered approach helps create AI applications that meet enterprise requirements for quality, safety, and reliability.<\/span>\n<span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><\/div><\/span><\/p>\n<h3><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Need Additional Development Support?<\/span><\/h3>\n<p><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">When building AI applications, you can accelerate your development by leveraging battle-tested frameworks that provide abstracted design patterns and pre-built integrations with the above managed services:<\/span><\/p>\n<table style=\"width: 100.828%; height: 220px;\" width=\"683\">\n<tbody>\n<tr style=\"height: 24px;\">\n<td style=\"width: 21.0036%; height: 24px;\" width=\"215\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Framework<\/strong><\/span><\/td>\n<td style=\"width: 119.563%; height: 24px;\" width=\"468\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Capabilities<\/strong><\/span><\/td>\n<\/tr>\n<tr style=\"height: 49px;\">\n<td style=\"width: 21.0036%; height: 49px;\"><a href=\"https:\/\/aka.ms\/AAtnv2s\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Semantic Kernel<\/span><\/a><\/td>\n<td style=\"width: 119.563%; height: 49px;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Microsoft&#8217;s open-source SDK that integrates LLMs with conventional programming languages (C#, Python, Java). Ideal for enterprise applications requiring tight integration with existing code.<\/span><\/td>\n<\/tr>\n<tr style=\"height: 49px;\">\n<td style=\"width: 21.0036%; height: 49px;\"><a href=\"https:\/\/aka.ms\/AAtn81m\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">AutoGen<\/span><\/a><\/td>\n<td style=\"width: 119.563%; height: 49px;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Framework for building multi-agent applications, enabling sophisticated agent-to-agent interactions and complex task completion.<\/span><\/td>\n<\/tr>\n<tr style=\"height: 49px;\">\n<td style=\"width: 21.0036%; height: 49px;\"><a href=\"https:\/\/python.langchain.com\/docs\/integrations\/providers\/microsoft\/\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Langchain<\/span><\/a><\/td>\n<td style=\"width: 119.563%; height: 49px;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Popular framework for building LLM applications with ready-to-use components for common patterns like RAG, agents, and chains.<\/span><\/td>\n<\/tr>\n<tr style=\"height: 49px;\">\n<td style=\"width: 21.0036%; height: 49px;\"><a href=\"https:\/\/aka.ms\/AAtnni3\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">LlamaIndex<\/span><\/a><\/td>\n<td style=\"width: 119.563%; height: 49px;\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Data framework specialized in connecting custom data with LLMs, offering advanced RAG capabilities and data connectors.<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h3><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Ready to Start Building?<\/span><\/h3>\n<p class=\"whitespace-pre-wrap break-words\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Choose your path based on your needs:<\/span><\/p>\n<ol class=\"-mt-1 [li&gt;&amp;]:mt-2 list-decimal space-y-2 pl-8\">\n<li class=\"whitespace-normal break-words\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Want the quickest start?<\/strong> Head to <a href=\"https:\/\/aka.ms\/AAtn81f\">Azure AI Foundry<\/a> for a guided experience with built-in best practices and patterns.<\/span><\/li>\n<li class=\"whitespace-normal break-words\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Need more control?<\/strong> Start with <a href=\"https:\/\/aka.ms\/AAtn81r\">AI App templates<\/a> for common patterns, or build your stack from scratch by selecting your models, memory solutions, and deployment options from the choices above.<\/span><\/li>\n<li class=\"whitespace-normal break-words\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><strong>Looking for development frameworks?<\/strong> Use battle-tested frameworks like Semantic Kernel, AutoGen, or LangChain that provide abstracted design patterns and pre-built integrations for rapid development.<\/span><\/li>\n<\/ol>\n<p class=\"whitespace-pre-wrap break-words\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Remember: Major players like ChatGPT, GitHub Copilot, and Microsoft&#8217;s Copilots all run on these same services &#8211; you&#8217;re building on proven infrastructure. To accelerate your development:<\/span><\/p>\n<ul class=\"-mt-1 [li&gt;&amp;]:mt-2 list-disc space-y-2 pl-8\">\n<li class=\"whitespace-normal break-words\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/learn.microsoft.com\/en-us\/azure\/cloud-adoption-framework\/scenarios\/ai\/platform\/architectures\"><strong>Landing Zone Reference Architectures<\/strong><\/a>: Ready-to-deploy infrastructure templates that follow best practices for security, scaling, and governance<\/span><\/li>\n<li class=\"whitespace-normal break-words\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><a href=\"https:\/\/aka.ms\/AAtn81r\"><strong>AI App Templates<\/strong><\/a>: Quickly customize existing AI applications for your specific business needs using production-tested patterns<\/span><\/li>\n<\/ul>\n<p><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\"><div  class=\"d-flex justify-content-left\"><a class=\"cta_button_link btn-primary mb-24\" href=\"https:\/\/aka.ms\/AAtn81r\" target=\"_blank\">AI App Templates<\/a><\/div><\/span><\/p>\n<h4 class=\"font-600 text-lg font-bold\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Prerequisites to Get Started<\/span><\/h4>\n<p class=\"whitespace-pre-wrap break-words\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Before you begin, ensure you have:<\/span><\/p>\n<ul class=\"-mt-1 [li&gt;&amp;]:mt-2 list-disc space-y-2 pl-8\">\n<li class=\"whitespace-normal break-words\"><a href=\"https:\/\/aka.ms\/AAtoal8\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">An Azure subscription<\/span><\/a><\/li>\n<li class=\"whitespace-normal break-words\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">User role with Azure AI Developer permissions<\/span><\/li>\n<li class=\"whitespace-normal break-words\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">Azure AI Inference Deployment Operator permissions (if models aren&#8217;t already deployed)<\/span><\/li>\n<\/ul>\n<p class=\"whitespace-pre-wrap break-words\"><span style=\"font-family: tahoma, arial, helvetica, sans-serif;\">This guide will continue to evolve as Azure&#8217;s AI capabilities expand. Start building today and transform your AI experiments into production-ready applications!<\/span><\/p>\n<p><iframe title=\"Build AI Agents &amp; Apps FAST with Azure AI Foundry!\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/mnfNZmKtZ-4?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n","protected":false},"excerpt":{"rendered":"<p>As organizations explore new AI-powered experiences and automated workflows, there&#8217;s a growing need to move beyond experiments and proofs-of-concept to production-ready applications. This guide walks you through the essential steps and decisions for building robust AI applications in Azure, focusing on reliability, security, and enterprise-grade quality. Why Choose Azure&#8217;s Managed Services? It&#8217;s easy to experiment [&hellip;]<\/p>\n","protected":false},"author":172657,"featured_media":401,"comment_status":"open","ping_status":"open","sticky":true,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[35,36,37,1,38,39],"tags":[30,40,45,43,42,41,2,44],"class_list":["post-400","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-agents","category-ai-apps","category-ai-foundry","category-azure","category-app-development","category-decision-tree","tag-ai","tag-ai-apps","tag-ai-foundry","tag-app-development","tag-appdev","tag-apps","tag-azure","tag-llm"],"acf":[],"blog_post_summary":"<p>As organizations explore new AI-powered experiences and automated workflows, there&#8217;s a growing need to move beyond experiments and proofs-of-concept to production-ready applications. This guide walks you through the essential steps and decisions for building robust AI applications in Azure, focusing on reliability, security, and enterprise-grade quality. Why Choose Azure&#8217;s Managed Services? It&#8217;s easy to experiment [&hellip;]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/posts\/400","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/users\/172657"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/comments?post=400"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/posts\/400\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/media\/401"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/media?parent=400"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/categories?post=400"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/all-things-azure\/wp-json\/wp\/v2\/tags?post=400"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}