How to Set Custom BrowsePathV2 on Ingestion Using Python SDK in DataHub 0.11.0 and Plans for Transformer Update

ingestion
1

Original Slack Thread

Question about dataset BrowsePathsV2 - we have ingestion set up using the set_dataset_browse_path transformer to set a custom browse path. It looks like that sets the old browse path instead of the V2 one, which the sidebar uses on the UI. How can I set a custom browsepathV2 on ingestion? Is there a plan to update the transformer? Thanks! I have read the https://datahubproject.io/docs/browsev2/browse-paths-v2/#generating-custom-browse-paths.

2

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Are you using UI or CLI for ingestion?
  2. Which DataHub version are you using? (e.g. 0.12.0)
  3. What data source(s) are you integrating with DataHub? (e.g. BigQuery)
3

We are currently using python sdk for ingestion using datahub.ingestion.run.pipeline. We are on DH 0.11.0 but plan to upgrade to 12.x soon. We are integrating s3 and delta lake sources.