Implementing Semantic Documentation and Governance Tags in DataHub via Source Code Schema

Original Slack Thread

Anyone try (or think about) pushing semantic documentation or governance tags from source code data schema into DataHub as an alternative to manual documentation/tagging? Perhaps something like <https://docs.getdbt.com/docs/collaborate/documentation|dbt docs> but for other datastores. If so, what motivated you to do it and did it work as you expected?

This sounds somewhat similar to our dbt meta mappings feature https://datahubproject.io/docs/next/generated/ingestion/sources/dbt/#dbt-meta-automated-mappings

Lets you define metadata in dbt and have it synced into datahub automatically - is this along the lines of what you’re thinking about?

<@U01GZEETMEZ>: very helpful, thanks! Is there only support for dbt right now? Any examples of how this feature is currently used?

There’s a couple examples further down on the page https://datahubproject.io/docs/next/generated/ingestion/sources/dbt/#data-tier---bronze-silver-gold - probably need to reorganize these docs a bit though