Clarifying Information for DataHub Ingestion Queries

ingestion
1

Original Slack Thread

This message was deleted.

2

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Are you using UI or CLI for ingestion?
  2. Which DataHub version are you using? (e.g. 0.12.0)
  3. What data source(s) are you integrating with DataHub? (e.g. BigQuery)

<@U06TM7M40RK> Can you help with the questions in this thread?

:information_source: We’re experimenting with a new AI assistant for questions in the <#CUMUWQU66> channel to help you track down helpful resources more quickly. Keep in mind that responses may not always be spot-on; feel free to ask it follow-up questions and don’t forget to provide its responses a :thumbsup: or :thumbsdown: so other folks in the Community know if you’re still looking for help on the topic!

3

Hi there! :wave: Thanks for providing the context. To help you effectively, could you please provide the following information?

  1. Are you using UI or CLI for ingestion?
  2. Which DataHub version are you using? (e.g., 0.12.0)?
  3. What data source(s) are you integrating with DataHub? (e.g., BigQuery)?

Regarding your question about the URN urn:li:dataPlatform:dbt,dev.blinkit_iceberg_staging.interim.DNU_imd_esto_transfer_loss_diff,PROD, the dev. part typically refers to the environment in which the dataset resides. In this case, dev likely indicates a development environment. This is part of the origin field in the URN, which represents the environment or fabric type where the dataset belongs or was generated.

The environment part of the URN is picked from the ingestion configuration, where you specify the environment (e.g., DEV, PROD). According to <Dataset | DataHub metadata model>, the origin field can have values like DEV, PROD, QA, etc.

Would you like more detailed guidance on how to configure or understand the origin field in your ingestion setup?

Sources:

  • <Dataset | DataHub Metadata Model>
  • <Slack Discussion on Environment vs Platform Instance> :+1: 0 button :-1: 0 button :bulb: Hint: Mention @runllm in the thread for followups.