{"id":9429,"date":"2022-01-31T08:00:58","date_gmt":"2022-01-31T16:00:58","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/?p=9429"},"modified":"2022-05-26T15:01:26","modified_gmt":"2022-05-26T22:01:26","slug":"microsoft-graph-data-connect-deploying-azure-synapse-analytics","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/microsoft-graph-data-connect-deploying-azure-synapse-analytics\/","title":{"rendered":"Microsoft Graph Data Connect: Deploying Azure Synapse Analytics"},"content":{"rendered":"<p>This article covers the process of deploying Azure Synapse Analytics in your tenant. Azure Synapses Analytics is a complete Extract\/Transform\/Load (ETL) toolset that acts as the foundation of big data analytics in the cloud. It provides interfaces to develop data flow pipeline through its Azure Data Factory integration, data transformation logic via Synapse Spark Notebooks and Scripts, and data storage via its SQL or Lake databases. It is the recommended tool to perform analytics on Microsoft 365 data via Microsoft Graph Data Connect (MGDC).<\/p>\n<h2>Azure Resource Manager Template<\/h2>\n<p>Step-by-step instructions to get started and manually deploy your first Azure Synapse workspace for Microsoft Graph Data Connect Analytics are provided below. If you wish to automate the deployment of the workspace, an <a href=\"https:\/\/github.com\/microsoftgraph\/dataconnect-solutions\/tree\/main\/ARMTemplates\/Synapse\">Azure Resource Manager Template<\/a> is provided on our official GitHub repository. This template will automatically deploy all the required components in your Azure environment and can be re-used inside of your solutions to ensure the consistency of deployments.<\/p>\n<h2>Deploying a New Azure Synapse Workspace<\/h2>\n<p>From the Azure portal\u2019s landing page, start by typing Azure Synapse in the top search box. From the result lists, select Azure Synapse Analytics as shown in Figure 1 below.<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-28.png\"><img decoding=\"async\" class=\"aligncenter size-large wp-image-9436\" src=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-28-1024x493.png\" alt=\"Image MGDC Synapse blog image 28\" width=\"640\" height=\"308\" srcset=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-28-1024x493.png 1024w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-28-300x144.png 300w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-28-768x369.png 768w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-28.png 1287w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/p>\n<p style=\"text-align: center;\"><em><span style=\"font-size: 10pt;\">Figure 1 &#8211; Azure Synapse Analytics from the Search Menu<\/span><\/em><\/p>\n<p>You will be brought to the Azure Synapse Analytics instance list. From there, click on the <strong>Create<\/strong> icon as highlighted in Figure 2 below.<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-29.png\"><img decoding=\"async\" class=\"aligncenter size-large wp-image-9435\" src=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-29-1024x305.png\" alt=\"Create a New Azure Synapse Analytics Workspace\" width=\"640\" height=\"191\" srcset=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-29-1024x305.png 1024w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-29-300x89.png 300w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-29-768x229.png 768w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-29.png 1287w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/p>\n<p style=\"text-align: center;\"><em><span style=\"font-size: 10pt;\">Figure 2 &#8211; Create a New Azure Synapse Analytics Workspace<\/span><\/em><\/p>\n<p>This will open the <strong>Create Synapse Workspace<\/strong> blade which will prompt you to provide several pieces on information. Make sure you select the subscription in which you wish to create the workspace in and create a new Resource Group by clicking on the <strong>Create New<\/strong> link below the drop-down list as shown in Figure 3.<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-30.png\"><img decoding=\"async\" class=\"aligncenter size-large wp-image-9434\" src=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-30-1024x455.png\" alt=\"Create a New Resource Group for an Azure Synapse workspace\" width=\"640\" height=\"284\" srcset=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-30-1024x455.png 1024w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-30-300x133.png 300w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-30-768x341.png 768w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-30.png 1248w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/p>\n<p style=\"text-align: center;\"><em><span style=\"font-size: 10pt;\">Figure 3 &#8211; Create a New Resource Group for an Azure Synapse workspace<\/span><\/em><\/p>\n<p>When prompted to provide a name for the Resource Group, enter the name <strong>MGDC Azure Synapse<\/strong> and click Ok. Leave the <strong>Managed resource group<\/strong> box empty. In the Workspace details section, provide the name <strong>MGDC Workspace<\/strong> and select the region you want to create the instance in from the drop down.<\/p>\n<p>Make sure you leave the option to Select Data Lake Storage Gen 2 set to <strong>From subscription<\/strong> and create a new account by providing a name. In our case, the account will be named <strong>mgdcsynapse<\/strong> storage. \u00a0Also create a new file system and provide it a unique name. Figure 4 below summarizes the entries we provided for our scenarios. Note that the storage account names must be unique across Azure and therefore cannot be re-used in your environments.<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-31.png\"><img decoding=\"async\" class=\"aligncenter size-large wp-image-9433\" src=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-31-910x1024.png\" alt=\"Basics information provided for new Azure Synapses Workspace\" width=\"640\" height=\"720\" srcset=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-31-910x1024.png 910w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-31-267x300.png 267w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-31-768x864.png 768w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-31.png 1287w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/p>\n<p style=\"text-align: center;\"><span style=\"font-size: 10pt;\"><em>Figure 4 &#8211; Basics information provided for new Azure Synapses Workspace<\/em><\/span><\/p>\n<p>Click on the <strong>Next: Security &gt;<\/strong> button. On the Security tab, provide an Admin login username and password for the SQL account as seen on Figure 5 below.<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-32.png\"><img decoding=\"async\" class=\"aligncenter size-large wp-image-9432\" src=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-32-1024x510.png\" alt=\"Azure Synapse Workspace SQL Server admin account\" width=\"640\" height=\"319\" srcset=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-32-1024x510.png 1024w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-32-300x149.png 300w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-32-768x383.png 768w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-32.png 1287w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/p>\n<p style=\"text-align: center;\"><em><span style=\"font-size: 10pt;\">Figure 5 &#8211; Azure Synapse Workspace SQL Server admin account<\/span><\/em><\/p>\n<p>Click on the <strong>Review + create<\/strong> button, and then once again on the <strong>Create<\/strong> button. This will initiate the creation process which can take several minutes to complete.<\/p>\n<p>Once the workspace is created, go to the resource. At the top of the Overview screen, click on <strong>New Apache Spark pool<\/strong>. You will be brought to a new screen. Provide an Apache Spark pool name and keep all other default settings (see Figure 6 for an example).<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-33.png\"><img decoding=\"async\" class=\"aligncenter size-full wp-image-9431\" src=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-33.png\" alt=\"Basic Information for a new Apache Spark Pool\" width=\"815\" height=\"927\" srcset=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-33.png 815w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-33-264x300.png 264w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-33-768x874.png 768w\" sizes=\"(max-width: 815px) 100vw, 815px\" \/><\/a><\/p>\n<p style=\"text-align: center;\"><em><span style=\"font-size: 10pt;\">Figure 6 &#8211; Basic information for a new Apache Spark Pool<\/span><\/em><\/p>\n<p>Click on the <strong>Review + create<\/strong> button at the bottom of the screen. This will bring you to the summary screen. From there click on the <strong>Create<\/strong> button at the bottom. After a few minutes, the Spark pool will be created. Navigate back to the new Azure Synapse Analytics workspace you created (search for Azure Synapse Analytics in top bar and select the instance). When you get back to the Overview page, under the Open in Synapse Studio section, click on the <strong>Open<\/strong> link. This will open a new browser tab and navigate into Azure Synapse Studio automatically.<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-34.png\"><img decoding=\"async\" class=\"aligncenter wp-image-9430\" src=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-34.png\" alt=\"Open Synapse Studio\" width=\"800\" height=\"517\" srcset=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-34.png 961w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-34-300x194.png 300w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2022\/01\/MGDC-Synapse-blog_image-34-768x496.png 768w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/><\/a><\/p>\n<p style=\"text-align: center;\"><span style=\"font-size: 10pt;\"><em>Figure 7 &#8211; Open Synapse Studio<\/em><\/span><\/p>\n<p>Synapse Studio is the workbench you will use to execute your ETL operations against Microsoft Graph Data Connect\u2019s data. While this article doesn\u2019t cover the steps to create and automate your ETL processes using Azure Synapse, it acts as the baseline for multiple articles we will be releasing over the next few months. Subsequent articles in our series will always assume you have an Azure Synapse Workspace created that follows the guidance provided in this blog post.<\/p>\n<p>Happy coding!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Learn about the process of deploying Azure Synapse Analytics with step-by-step instructions to get started and manually deploy your first Azure Synapse workspace for Microsoft Graph Data Connect.<\/p>\n","protected":false},"author":72603,"featured_media":9452,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[3],"tags":[61,161,31],"class_list":["post-9429","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-microsoft-graph","tag-azure","tag-azure-synapse","tag-microsoft-graph-data-connect"],"acf":[],"blog_post_summary":"<p>Learn about the process of deploying Azure Synapse Analytics with step-by-step instructions to get started and manually deploy your first Azure Synapse workspace for Microsoft Graph Data Connect.<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/posts\/9429","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/users\/72603"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/comments?post=9429"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/posts\/9429\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/media\/9452"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/media?parent=9429"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/categories?post=9429"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/tags?post=9429"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}