Azure SQL Database

Azure SQL Devs’ Corner

Voices from the Azure SQL PM Team, focusing on development and developers

Considerations of Data Partitioning on Spark during Data Loading on Clustered Columnstore Index

March 2, 2021 Mar 2, 2021 03/2/21

Sumit

This article showcases how to take advantage of a highly distributed framework provided by spark engine, to load data into a Clustered Columnstore Index of a relational database like SQL Server or Azure SQL Database, by carefully partitioning the data before insertion.

Fast loading data into Azure SQL: a lesson learned.

September 14, 2020 Sep 14, 2020 09/14/20

Davide Mauri

I'm preparing a series of post and samples on how to properly load data into Azure SQL using Azure Databricks / Apache Spark that I will start to publish very soon, but I realized today that there is a pre-requisite that in many cases, especially by developers new to the data space, is overlooked: good table design. Wait! If you're not a...

Feedback

Azure SQL Devs’ Corner

Apache Spark - Azure SQL Devs’ Corner