Integrating Data Catalog from Datahub with Spark SQL for SQLMesh and Delta Tables

Original Slack Thread

Hello all. Where would I be able to learn more if the data catalog from Datahub would work with spark sql? I am trying to use sqlmesh with delta tables, and it has to be done through sparksql which requires a catalog.

Hey Amin, I hope this help.

https://datahubproject.io/docs/metadata-integration/java/spark-lineage

let me know if you are looking for something more specific.