Apache Spark

How to export Azure SQL Managed Instance data into Fabric Lakehouse

July 11, 2023 Jul 11, 2023 07/11/23

Jovan Popovic

If you want to perform advanced analytics on your data and create stunning reports in Power BI, you should consider using Microsoft Fabric. Microsoft Fabric is a solution that combines the best Lakehouse and Warehouse technologies to provide a scalable, secure, and cost-effective platform for data analytics. With Microsoft Fabric, you can ...

Considerations of Data Partitioning on Spark during Data Loading on Clustered Columnstore Index

March 2, 2021 Mar 2, 2021 03/2/21

Sumit

This article showcases how to take advantage of a highly distributed framework provided by spark engine, to load data into a Clustered Columnstore Index of a relational database like SQL Server or Azure SQL Database, by carefully partitioning the data before insertion.

Fast loading data into Azure SQL: a lesson learned.

September 14, 2020 Sep 14, 2020 09/14/20

Davide Mauri

I'm preparing a series of post and samples on how to properly load data into Azure SQL using Azure Databricks / Apache Spark that I will start to publish very soon, but I realized today that there is a pre-requisite that in many cases, especially by developers new to the data space, is overlooked: good table design. Wait! If you're not a...

Azure SQL Devs’ Corner

Apache Spark - Azure SQL Devs’ Corner

How to export Azure SQL Managed Instance data into Fabric Lakehouse

Considerations of Data Partitioning on Spark during Data Loading on Clustered Columnstore Index

Fast loading data into Azure SQL: a lesson learned.