Mark Kromer

Documentation search now embedded in Azure Data Factory

In the Data Factory team, we are always looking for ways to make the life of the data engineer as easy as possible!  To help with easily and quickly finding answers to your questions in Azure Data Factory (ADF), we’ve incorporated documentation search to our ADF search bar. Without ever leaving your ADF design environment, […]

Documentation search now embedded in Azure Data Factory Continue Reading

Unroll multiple arrays in a single Flatten step in ADF

You can now easily unroll multiple arrays inside a single Flatten transformation in Azure Data Factory and Azure Synapse Analytics using a data pipeline with a Mapping Data Flow. ADF and Synapse data flows gave a Flatten transformation to make it easy to unroll an array as part of your data transformation pipelines. We’ve updated

Unroll multiple arrays in a single Flatten step in ADF Continue Reading

Process your data in seconds with new ADF real-time CDC

In January, we announced that we’ve elevated our Change Data Capture features front-and-center in ADF. In ADF, CDC processes are light-weight always-running (not batch) data processing with a latency option. And up until today, the lowest latency we were allowing for CDC processing was 15 minutes. But today, I am super-excited to announce that we have

Process your data in seconds with new ADF real-time CDC Continue Reading

You can now customize the return value from your pipeline!

When building complex workflows in the cloud with Azure Data Factory and Azure Synapse Pipelines, a very common pattern is to separate different workflow branches into child pipelines. The ADF team is super-excited to announce that we’ve made creating workflows even simpler with this new preview feature! Now you can customize the output of your

You can now customize the return value from your pipeline! Continue Reading