Our team used AI tools to write code, documentation, indexes, etc. extensively during our last engagement. This post will talk about what we used and how we used it.
In this post we write about how we implemented a custom workflow engine that supports DSL, workflow cancellation and closure on top of Durable Task Framework (DTFx), explaining the why behind our choices and discussing the challenges we faced.
This guide explores workflow engines, their essential features, and types, while offering insights and evaluation criteria to help you choose the right solution for your specific use case.
In this post we will describe how we were able to run our Dask-based data preparation at scale on Azure ML Compute Clusters, using Dask-MPI and the native Azure ML MPI support.