The problem I’m having
I am following dbt-pv scripts for moving dbt lineage information into Purview. My goal is to achieve these following actions
- Prepare execution (check if everything is ready)
- Trigger dbt Entities generation
- generate dbt docs
- Detect lineage and write into _pv_folder
- Detect products and write into _pv_folder
- Push data from _pv_folder into Purview REST APIs
The context of why I’m trying to do this
The purpose of this is to have the lineage onboarded from the dbt
What I’ve already tried
I created a new App registration in the Azure entra as I am trying to integrate dbt with Microsoft Purview for Data cataloging.
I have created these two files in my dbt project in the target folder
• manifest.json which contains information about my dbt models
• catalog.json which contains information about the physical tables in my database
But I am getting a couple of errors, I am open to suggestions or any new method to try to achieve this integration.