Let\u2019s tackle each one of these questions one by one starting from the very first. In the next blog posts I\u2019ll discuss about the other questions.<\/p>\n
Quickly vectorize existing data<\/h2>\n
This is a straightforward question. While the answer is often “it depends,” in this case, there is a clear and direct solution: to efficiently vectorize data, batching requests is essential. The OpenAI API\u2014and by extension, the Azure OpenAI service\u2014supports receiving an array of strings for vectorization, thereby minimizing REST call overhead:<\/p>\n
https:\/\/platform.openai.com\/docs\/api-reference\/embeddings<\/a><\/p>\n The OpenAI API is rapidly becoming the standard, so it is highly likely that even if you plan to use your own model with an on-premises inference server, batch support for embedding processing is also available. For instance, Ollama already supports this feature:<\/p>\n https:\/\/github.com\/ollama\/ollama\/blob\/main\/docs\/api.md#generate-embeddings<\/a><\/p>\n Having established the optimal strategy, how can it be implemented? Several options exist, ranging from Azure Data Factory to Apache Spark. Essentially, any tool capable of reading from Azure SQL, batching requests, and making REST calls is suitable.<\/p>\n However, turning text into embeddings at scale presents complexities. For instance, if the text to be vectorized is too lengthy, it must be chunked to ensure the generated embeddings accurately represent the underlying concepts. Additionally, embedding models may have inherent limitations, such as restrictions on the amount of text (in terms of tokens) that can be vectorized simultaneously.<\/p>\n To address these limitations and enhance scalability, one option is to scale out by deploying multiple embedding models in parallel. By distributing arrays of text to different models simultaneously, the solution can easily be scaled by adding more instances of the desired embedding model.<\/p>\n At a certain point, I was required to vectorize approximately 10 million rows of text and needed to complete this task as efficiently as possible. Therefore, I developed a sample to facilitate all the necessary processes. To ensure maximum customization and adaptability to various scenarios, I opted to use .NET and implemented everything from scratch utilizing the Parallelize and scale<\/h2>\n
![\"Image](\"https:\/\/devblogs.microsoft.com\/azure-sql\/wp-content\/uploads\/sites\/56\/2025\/02\/vectorized-high-level-architecture.jpg\")
<\/a><\/p>\nA working example<\/h2>\n
ConcurrentQueue<\/code> class, which supports scaling out and parallelism to the greatest extent possible.<\/p>\n
![\"Image](\"https:\/\/devblogs.microsoft.com\/azure-sql\/wp-content\/uploads\/sites\/56\/2025\/02\/sample-screenshot.jpg\")
<\/a><\/p>\n