Hi, I'm Murali

In this post, I would like to explore an option for asynchronously executing a data factory pipeline from another pipeline. Scenario: Execute data factory pipeline asynchronously (fire and forget) from another pipeline where both calling pipeline and called pipeline are in the same data factory. [Read More]

Azure databricks workspace users can securely and easily access azure data lake storage (ADLS) by creating a mount point in azure databricks. This article walks through the steps for creating a mount point using service principal and azure key vault-backed secret scope. [Read More]

Securing credentials for the azure resources is a common challenge. Moving away from passwords is the preferred way of securing azure resources. Authenticating azure resources with credentials can be eliminated by using managed identities. [Read More]

In my previous post, I have shown configuring diagnostic settings for azure data factory using azure resource manager(arm) template. Let’s look at enabling alert rule for PipelineFailedRuns data factory metric in this post. PipelineFailedRuns metric provides the total count of failed data factory pipelines within a minute window. My goal... [Read More]

As you may know, azure data factory out of the box monitoring allows to view logs and metrics for 45 days only. It may not be sufficient for some environments where data factory logs needs to be analyzed beyond the default retention days. The out of the box monitoring also... [Read More]