Tracking Data Lineage in Postgres and Spark Integration with Spark Integration Jar, Seeking Help from Team Member UV14447EU

Original Slack Thread

Does anyone know if it is possible to track data lineage with postgres and spark? For example, loading a table from postgres, performing a transform, and writing the table back or writing as a new table which will get tracked as lineage? I already have postgres ingestion working just fine, but even with the spark integration jar I get an empty task without much information.

<@UV14447EU> Would love your input here!