Storing Profile Statistics for Data Asset in DataHub

ingestion
1

Original Slack Thread

When profile stats are generated for a data asset, where are those statistics stored? My instance of Datahub is deployed to a k8s clusters using helm. The backend mysql db is pointing to an external mysql db hosted in GCP. The ES config is left as default. I’m trying to query the Mysql db to pull some of these stats but I’m not sure where they are being stored.

  1. UI for ingestion
  2. v0.11.0
  3. Source BigQuery Table
2

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Are you using UI or CLI for ingestion?
  2. Which DataHub version are you using? (e.g. 0.12.0)
  3. What data source(s) are you integrating with DataHub? (e.g. BigQuery)
3

Profile metadata is modelled as a time series and so it is exclusively stored in Elasticsearch