In this exercise, you'll use Microsoft Purview to track assets and data lineage in an Azure Synapse Analytics workspace. You'll start by using a script to provision these resources in your Azure subscription.

Sep 10, 2024 · A customer of mine recently asked how to automate the column metadata for an Azure SQL database (or more specifically Synapse Dedicated SQL pool). How can we enhance our dataset to allow Purview to automatically ingest this metadata?

Using custom Process types, we can create a custom lineage between any data sources. In Azure Purview, we are able to take advantage of its UI feature called columnMapping which essentially shows the column level lineage!

Feb 3, 2025 · This article outlines the process to register an Azure SQL database source in Microsoft Purview. It includes instructions to authenticate and interact with the SQL database. When you're scanning Azure SQL Database, Microsoft Purview supports extracting technical metadata from these sources:

Feb 18, 2025 · To view data lineage in the Unified Catalog, you need to first search for a data product, then view data asset details. One of the platform features of Microsoft Purview is the ability to show the lineage between datasets created by data processes. Systems like Data Factory, Data Share, and Power BI capture the lineage of data as it moves.

Mar 28, 2023 · Supported capabilities in Microsoft Purview for Azure SQL Database: When you’re scanning Azure SQL Database, Microsoft Purview supports extracting technical metadata from these sources: Server; Database; Schemas; Tables, including columns; Views, including columns; Stored procedures (with lineage extraction enabled)

Apr 26, 2023 · In this post, we will use raw lineage data coming from spline (Details: link) and make detailed lineage for multiple spark processes and create a map.

May 9, 2023 · Showing column-level lineage through Azure Databricks. The accelerator currently supports capturing lineage for the following data sources: Azure SQL; Azure Synapse Analytics (as input)

Feb 21, 2023 · In this article, I would like to show you how to display lineage in Azure SQL using the relatively new ‘Lineage extraction’ feature. The described feature is not a simple static data extraction but a dynamic one. What does this mean?

BULK 'https://storagename.dfs.core.windows.net/synapseroot/moviesoutgoing1/', FORMAT = 'delta') as rows Where YEAR = 2021; All my Samples for 2021. Contribute to balakreshnan/Samples2021 development by creating an account on GitHub.