{"id":7117,"date":"2023-11-15T08:00:39","date_gmt":"2023-11-15T16:00:39","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/cosmosdb\/?p=7117"},"modified":"2023-11-21T04:57:08","modified_gmt":"2023-11-21T12:57:08","slug":"announcing-azure-cosmos-db-mirroring-in-microsoft-fabric-private-preview","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/cosmosdb\/announcing-azure-cosmos-db-mirroring-in-microsoft-fabric-private-preview\/","title":{"rendered":"Announcing Azure Cosmos DB Mirroring in Microsoft Fabric \u2013 Private Preview"},"content":{"rendered":"<p style=\"text-align: justify;\">We are excited to announce private preview availability of mirroring your Azure Cosmos DB databases in <a href=\"https:\/\/www.microsoft.com\/microsoft-fabric\">Microsoft Fabric<\/a>. <span class=\"NormalTextRun SCXW43175091 BCX8\">Mirroring <\/span><span class=\"NormalTextRun SCXW43175091 BCX8\">provides<\/span><span class=\"NormalTextRun SCXW43175091 BCX8\"> a modern way of accessing your Azure Cosmos DB databases in Microsoft Fabric, helping unify your data estate, thereby eliminating data silos.\u00a0<\/span><\/p>\n<p style=\"text-align: justify;\">With just a few clicks, you can now bring your Azure Cosmos DB databases into Microsoft Fabric, for rich business insights using Fabric\u2019s built-in advanced analytics and AI capabilities. Your Cosmos DB operational data is seamlessly and incrementally replicated into Fabric OneLake in near real-time. Data in OneLake is stored in open-source Delta Parquet format and made available to all analytical engines in Fabric without further data movement.<\/p>\n<p style=\"text-align: justify;\">You can use <span class=\"NormalTextRun CommentStart CommentHighlightRest SCXW200994301 BCX8\" data-ccp-charstyle=\"normaltextrun\">T-SQL to run complex aggregate queries <\/span>across Azure Cosmos DB collections or databases and Spark for data exploration. You can seamlessly join this data with all other data in your Fabric workspace and build BI reports using Direct Lake, accessing data directly from OneLake.<\/p>\n<p style=\"text-align: justify;\">In addition to continuous replication for advanced analytics, you can access Azure Cosmos DB Data Explorer directly from your mirrored database in Fabric. This gives you flexibility to access and query your Azure Cosmos DB database, as you would from Azure portal, without leaving Fabric. You can view collections, add\/edit\/delete items, and run simple SQL queries on your collections.<\/p>\n<h2>Key features of mirroring<\/h2>\n<ul>\n<li style=\"text-align: left;\">Inserts\/updates\/deletes on your Azure Cosmos DB data are incrementally replicated into Fabric OneLake, with no-ETL. There is no performance or RU impact on your transactional workload.<\/li>\n<li style=\"text-align: justify;\">You can directly query data in OneLake from SQL analytics endpoint, automatically created in mirrored database.<\/li>\n<li style=\"text-align: justify;\"><strong><em>SQL analytics endpoint experience: <\/em><\/strong>\n<ul>\n<li>Run complex aggregate queries using T-SQL, within or across Azure Cosmos DB collections in the mirrored database, build views and visual queries, cross-join data with other mirrored artifacts or Lakehouses or Warehouses in Fabric.<\/li>\n<li>Use the endpoint directly from SSMS or any other 3<sup>rd<\/sup> party tools to access views and queries.<\/li>\n<\/ul>\n<\/li>\n<li style=\"text-align: justify;\"><strong><em>Azure Cosmos DB Data Explorer \u2013 visual editor experience:<\/em><\/strong>\n<ul>\n<li>Any changes made to the source database, from Azure Cosmos DB Data Explorer in mirrored database, are reflected immediately in Azure portal\/other clients and vice-versa.<\/li>\n<\/ul>\n<\/li>\n<li style=\"text-align: justify;\">You can add mirrored databases as shortcuts in Fabric Lakehouse. Data engineers can create notebooks and use Spark to analyze the data. Mirrored database data can be joined with any other data in Lakehouse, including shortcuts from Azure Data Lake Storage Gen2 (ADLS Gen2), Amazon S3, other OneLake sources etc.<\/li>\n<li style=\"text-align: left;\">Visualize your Azure Cosmos DB data and build quick BI reports using Direct Lake and leverage copilot to build rich content for your dashboards and reports. <a href=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture1a_jpg.jpg\"><img decoding=\"async\" class=\"alignnone size-full wp-image-7148\" src=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture1a_jpg.jpg\" alt=\"Image Picture1a jpg\" width=\"1200\" height=\"535\" srcset=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture1a_jpg.jpg 1200w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture1a_jpg-300x134.jpg 300w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture1a_jpg-1024x457.jpg 1024w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture1a_jpg-768x342.jpg 768w\" sizes=\"(max-width: 1200px) 100vw, 1200px\" \/><\/a><\/li>\n<\/ul>\n<h2>Getting started with mirroring<\/h2>\n<ul>\n<li>Navigate to Fabric-&gt;Data warehouse and click on Mirrored Azure Cosmos DB database. Give your artifact a name.<a href=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture2-2.png\"><img decoding=\"async\" class=\"size-full wp-image-7141 aligncenter\" src=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture2-2.png\" alt=\"Image Picture2\" width=\"1186\" height=\"569\" srcset=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture2-2.png 1186w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture2-2-300x144.png 300w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture2-2-1024x491.png 1024w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture2-2-768x368.png 768w\" sizes=\"(max-width: 1186px) 100vw, 1186px\" \/><\/a><\/li>\n<li>Create or pick a connection to connect to your Azure Cosmos DB account and database.<\/li>\n<li><strong><em>Azure Cosmos DB Data Explorer<\/em><\/strong><strong><em> \u2013 visual editor experience: <\/em><\/strong>\n<ul>\n<li>Access your source database directly using Azure Cosmos DB Data Explorer, integrated into Microsoft Fabric.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p style=\"padding-left: 40px;\"><a href=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture5-1.png\"><img decoding=\"async\" class=\"wp-image-7143 alignleft\" src=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture5-1.png\" alt=\"Image Picture5\" width=\"1338\" height=\"667\" srcset=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture5-1.png 1282w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture5-1-300x150.png 300w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture5-1-1024x510.png 1024w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture5-1-768x383.png 768w\" sizes=\"(max-width: 1338px) 100vw, 1338px\" \/><\/a><\/p>\n<ul>\n<li>Navigate to SQL analytics endpoint to access Azure Cosmos DB data replicated into Fabric OneLake.<a href=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/picture6-scaled.jpg\"><img decoding=\"async\" class=\"alignnone size-full wp-image-7152\" src=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/picture6-scaled.jpg\" alt=\"Image picture6\" width=\"2500\" height=\"1235\" srcset=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/picture6-scaled.jpg 2500w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/picture6-300x148.jpg 300w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/picture6-1024x506.jpg 1024w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/picture6-768x379.jpg 768w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/picture6-1536x759.jpg 1536w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/picture6-2048x1012.jpg 2048w\" sizes=\"(max-width: 2500px) 100vw, 2500px\" \/><\/a><\/li>\n<li><strong><em>SQL analytics endpoint experience<\/em><\/strong><\/li>\n<\/ul>\n<p style=\"padding-left: 80px;\">Automatic continuous replication from Azure Cosmos DB to Fabric OneLake for analytics<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li><em><strong>Run T-SQL queries and views <\/strong><\/em>Here\u2019s an example of a cross-collection query with aggregates. Optional: You can select the query below and click on \u201cSave as view\u201d.<a href=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture8.png\"><img decoding=\"async\" class=\"alignnone size-full wp-image-7153\" src=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture8.png\" alt=\"Image Picture8\" width=\"1235\" height=\"636\" srcset=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture8.png 1235w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture8-300x154.png 300w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture8-1024x527.png 1024w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture8-768x396.png 768w\" sizes=\"(max-width: 1235px) 100vw, 1235px\" \/><\/a><\/li>\n<li><strong style=\"font-size: 1rem; text-align: var(--bs-body-text-align);\">Build visual queries with just a few clicks<a href=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/visualq.png\"><img decoding=\"async\" class=\"alignnone size-full wp-image-7173\" src=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/visualq.png\" alt=\"Image visualq\" width=\"1276\" height=\"639\" srcset=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/visualq.png 1276w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/visualq-300x150.png 300w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/visualq-1024x513.png 1024w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/visualq-768x385.png 768w\" sizes=\"(max-width: 1276px) 100vw, 1276px\" \/><\/a><\/strong><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li><strong>Cross-join Azure Cosmos DB data with other data in OneLake: <\/strong>Below example shows Azure Cosmos DB data queried together with mirrored Azure SQL Database data.<a href=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture10.png\"><img decoding=\"async\" class=\"alignnone size-full wp-image-7156\" src=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture10.png\" alt=\"Image Picture10\" width=\"1229\" height=\"641\" srcset=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture10.png 1229w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture10-300x156.png 300w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture10-1024x534.png 1024w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture10-768x401.png 768w\" sizes=\"(max-width: 1229px) 100vw, 1229px\" \/><\/a><\/li>\n<li><strong>Build BI reports directly from SQL\u00a0<\/strong><b>queries<a href=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture11.png\"><img decoding=\"async\" class=\"alignnone size-full wp-image-7162\" src=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture11.png\" alt=\"Image Picture11\" width=\"1267\" height=\"610\" srcset=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture11.png 1267w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture11-300x144.png 300w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture11-1024x493.png 1024w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture11-768x370.png 768w\" sizes=\"(max-width: 1267px) 100vw, 1267px\" \/><\/a><\/b><\/li>\n<\/ul>\n<\/li>\n<li><strong><em>Data science: Access Cosmos DB data from Lakehouse\/notebooks<\/em><\/strong><\/li>\n<\/ul>\n<p><strong> <a href=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture12.png\"><img decoding=\"async\" class=\" wp-image-7163 aligncenter\" src=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture12.png\" alt=\"Image Picture12\" width=\"1287\" height=\"644\" srcset=\"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture12.png 1275w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture12-300x150.png 300w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture12-1024x512.png 1024w, https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-content\/uploads\/sites\/52\/2023\/11\/Picture12-768x384.png 768w\" sizes=\"(max-width: 1287px) 100vw, 1287px\" \/><\/a><\/strong><\/p>\n<h2>When to use mirroring<\/h2>\n<p>If you are an existing Azure Synapse Link customer or looking for analytics on your operational data in Azure Cosmos DB, you may benefit from below with mirroring:<\/p>\n<ul>\n<li>Ease of bringing data across various sources into Microsoft Fabric OneLake<\/li>\n<li>Open-source Delta Parquet format and delta features such as time-travel<\/li>\n<li>Delta table optimizations with v-order for lightning-fast reads<\/li>\n<li>One-click integration with Power BI with Direct Lake and co-pilot<\/li>\n<li>Rich business insights by joining data across various sources<\/li>\n<li>Richer app integration to access queries and views<\/li>\n<\/ul>\n<p>If you are an existing Fabric user, you may benefit from having Azure Cosmos DB data with rest of your organizational data in OneLake, unifying your data estate.<\/p>\n<h2>How to sign-up for private preview<\/h2>\n<p>If you are interested in trying the product in preview, please fill this <a href=\"https:\/\/aka.ms\/FabricMirroringPreview\">form<\/a>. Mirroring is currently available for NoSQL API only.<\/p>\n<p>For any questions or feedback, please reach out to our team at <a href=\"mailto:fabriccosmosdbmirror@microsoft.com\">fabriccosmosdbmirror@microsoft.com.<\/a><\/p>\n<h2>About Azure Cosmos DB<\/h2>\n<p>Azure Cosmos DB is a fully managed and serverless distributed database for modern app development, with SLA-backed speed and availability, automatic and instant scalability, and support for open-source PostgreSQL, MongoDB, and Apache Cassandra.\u00a0<a href=\"https:\/\/cosmos.azure.com\/try\/\" target=\"_blank\" rel=\"noopener\">Try Azure Cosmos DB for free here.<\/a>\u00a0To stay in the loop on Azure Cosmos DB updates, follow us on\u00a0<a href=\"https:\/\/twitter.com\/AzureCosmosDB\" target=\"_blank\" rel=\"noopener\">Twitter<\/a>,\u00a0<a href=\"https:\/\/www.youtube.com\/AzureCosmosDB\" target=\"_blank\" rel=\"noopener\">YouTube<\/a>, and\u00a0<a href=\"https:\/\/www.linkedin.com\/company\/azure-cosmos-db\/\" target=\"_blank\" rel=\"noopener\">LinkedIn<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We are excited to announce private preview availability of mirroring your Azure Cosmos DB databases in Microsoft Fabric. Mirroring provides a modern way of accessing your Azure Cosmos DB databases in Microsoft Fabric, helping unify your data estate, thereby eliminating data silos.\u00a0 With just a few clicks, you can now bring your Azure Cosmos DB [&hellip;]<\/p>\n","protected":false},"author":115504,"featured_media":7148,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"image","meta":{"_acf_changed":false,"footnotes":""},"categories":[1216,12,14],"tags":[1801,1242,1894],"class_list":["post-7117","post","type-post","status-publish","format-image","has-post-thumbnail","hentry","category-analytics","category-announcements","category-core-sql-api","tag-advanced-analytics","tag-analytics","tag-microsoft-fabric","post_format-post-format-image"],"acf":[],"blog_post_summary":"<p>We are excited to announce private preview availability of mirroring your Azure Cosmos DB databases in Microsoft Fabric. Mirroring provides a modern way of accessing your Azure Cosmos DB databases in Microsoft Fabric, helping unify your data estate, thereby eliminating data silos.\u00a0 With just a few clicks, you can now bring your Azure Cosmos DB [&hellip;]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-json\/wp\/v2\/posts\/7117","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-json\/wp\/v2\/users\/115504"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-json\/wp\/v2\/comments?post=7117"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-json\/wp\/v2\/posts\/7117\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-json\/wp\/v2\/media\/7148"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-json\/wp\/v2\/media?parent=7117"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-json\/wp\/v2\/categories?post=7117"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cosmosdb\/wp-json\/wp\/v2\/tags?post=7117"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}