Does anyone know if it is possible to track data lineage with postgres and spark? For example, loading a table from postgres, performing a transform, and writing the table back or writing as a new table which will get tracked as lineage? I already have postgres ingestion working just fine, but even with the spark integration jar I get an empty task without much information.
<@UV14447EU> Would love your input here!