Log Analytics, a tool in the Azure portal that allows you to query and analyze log data by using the Kusto query language (KQL). For more information, see Get started with log queries in Azure Monitor .

Jan 5, 2024 · You can monitor all of your pipeline runs natively in the Azure Data Factory user experience. To open the monitoring experience, select the Monitor & Manage tile in the data factory blade of the Azure portal .

Jan 23, 2025 · Log Analytics dashboards can visualize all of your saved log queries. Visualizations let you find, correlate, and share IT operational data in your organization. This tutorial shows how to create a shared dashboard, based on log query, which can to be accessed by your IT operations support team.

This is focused on operational understanding in a single data factory. If you want to do larger more flexible analysis of your pipelines, or across factories, then using the standard Log Analytics integration is very useful.

Jan 15, 2021 · In this article, we will show how to monitor the different aspects of the Azure Data Factory. Monitor Pipeline in Debug Mode. When executing a pipeline under debug mode, no execution logs will be written to the Azure Data Factory Monitor page.

Oct 7, 2024 · This blog will answer exactly that question. Hint, it does involve an Azure Data Explorer cluster. I will also briefly explain how data ends up in those blobs in the first place. **Note: ADX is often used to indicate “Azure Data Explorer” in this blog post. How to export Log Analytics to Storage Account Blobs . Option One: Workspace Export

Jun 6, 2021 · You can use Azure Log Analytics Workspaces to store and analyze the logs of ADF. Within the Azure Market place you can find some standard dashboards to monitor and manage your Data Factory, but you can also write custom queries with Kusto Query Language (KQL).

May 4, 2021 · You don’t need to create additional activities to identify Azure Data Factory pipelines that have been running for longer than expected. Instead, you can use the built-in logs. Identify long-running Azure Data Factory workloads will help you locate unusual performance in your data movement and minimize costs.

Sep 15, 2021 · Azure Data Factory Analytics gives you a pre-built dashboard for all your data factories. This dashboard gives you detailed information like” Customized Alerts: You can also explore the results on the dashboard, navigate to its Log Analytics query and create customized alerts on those queries.

Oct 6, 2020 · How to enhance the monitoring activities for your Azure Data Factory using Azure Data Factory Analytics. A step by step tutorial.