Troubleshooting Column-Level Lineage Issue After CLI Upgrade

ingestion
1

Original Slack Thread

<@U06TM7M40RK> After upgrading to the cli for some reason i dont have anymore the column linage between enteties

2

It seems like you are experiencing issues with column-level lineage after upgrading your CLI. Here are a few steps and considerations to help troubleshoot and resolve the issue:

  1. Check CLI Version Compatibility: Ensure that the CLI version you upgraded to supports column-level lineage. According to <Slack Slack discussion>, certain features like fine-grained lineage require a minimum CLI version. Make sure your CLI version is compatible with the features you are trying to use.

  2. Configuration Verification: Double-check your ingestion configuration to ensure that column-level lineage is enabled. For example, if you are using dbt, make sure include_column_lineage is set to true as mentioned in <Slack Slack thread>.

  3. Ingestion Source Support: Verify that the ingestion source you are using supports column-level lineage. As per the <https://datahubproject.io/docs/0.14.0/api/tutorials/lineage#add-column-level-lineage|DataHub Lineage Guide>, not all sources support column-level lineage out of the box. You may need to programmatically create it using the API or Python SDK.

  4. UI Settings: Ensure that the “Show Columns” toggle is enabled in the DataHub UI to view column-level lineage. This is a common oversight as noted in <Slack Slack conversation>.

  5. Known Issues and Bugs: Check for any known issues or bugs related to column-level lineage in the version you are using. For instance, there have been reports of UI not displaying lineage correctly due to caching or other issues, as discussed in <Slack Slack thread>.

Would you like more detailed instructions on any of these steps or need help with a specific part of the process?

Sources:

3

Hi <@U043M1LL15E>, how did my answer work out for you? Need any more assistance? You can also tag <@U07FV3UHE4D> to let your fellow community members know you’re still looking for guidance.

4

Hi :slight_smile: ! Did this interaction resolve your issue or do you still require assistance ?

Please tag @ RunLLM if you still need further assistance !

Or tag @Datahub Community Support if you require a person to take a look :slight_smile:

Hope this helps ! ><