Resolving Dataset Organization Inconsistencies Between Hive Connector and Airflow Datasets

Original Slack Thread

Hello, I’m trying to track down an inconsistency I’m seeing in dataset organization between datasets ingested via hive connector, and datasets reported by airflow. Both have a similar urn pattern urn:li:dataset:(urn:li:dataPlatform:hive,db.table,DEV) but the hive connector datasets seem to have an additional container in the search tree view. We’d like to remove the extra hive from the hive connector datasets if possible, or add it to the airflow if necessary. either way, make them consistent.

Running 0.12.0

For hive connector datasets:

   DEV
      Hive
         hive
            db```
For airflow datasets:
```Datasets
   DEV
      Hive
         db```

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Which DataHub version are you using? (e.g. 0.12.0)
  2. Please post any relevant error logs on the thread!