This article walks through the development of a technique for running Spark jobs in parallel on Azure Databricks. The technique enabled us to reduce the processing times for JetBlue's reporting threefold while keeping the business logic implementation straight forward. The technique can be re-used for any notebooks-based Spark workload on Azure Databricks.
Deep learning algorithms capable of learning and predicting customer behavior are allowing businesses to intervene with the right retention offers at the right time. CSE recently partnered with Majid Al Futtaim Ventures (MAF) to design and deploy a machine learning solution to predict attrition.
This code story describes a collaboration with ZenCity around detecting trending topics at scale. We discuss the datasets, data preparation, models used and the deployment story for this scenario.