Hi Datahub team, I am Etsy and we’re the customer of Datahub. We use it to manage our BigQuery tables. And I was wondering if Datahub provides any API to surface these BQ column stats:
• null counts and proportions
• distinct counts and proportions
• minimum, maximum, mean, median, standard deviation, some quantile values
• histograms or frequencies of unique values
I believe these would be captured under the profiling stats if it’s enabled in your ingestions. If they’re there you should be able to query the profiling stats with an entity query on GraphQL
https://datahubproject.io/docs/api/graphql/overview
https://datahubproject.io/docs/graphql/objects#datasetprofile