How to troubleshoot missing `datahubIngestionRunSummary` aspect during data ingestion via CLI

ingestion
1

Original Slack Thread

Hello,

Is the DataJob datahubIngestionRunSummary aspect supposed to be emitted every time an Ingestion recipe runs? Or are there only certain cases where it gets created? We are using CLI to ingest data and aren’t seeing that aspect

2

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Are you using UI or CLI for ingestion?
  2. Which DataHub version are you using? (e.g. 0.12.0)
  3. What data source(s) are you integrating with DataHub? (e.g. BigQuery)
3
  1. CLI
  2. https://github.com/optum-eeps/hcdp-mesh-datahub/releases/tag/v0.10.5%2Boptum|v0.10.5
  3. Unity Catalog, Hive
4

any thoughts on this?

5

Hey Tim, this aspect is used in using the Ingestion State Telemetry provider, and per docs is supported for Snowflake and SQL based sources. Do you mind elaborating on the use case you’re going for?

https://datahubproject.io/docs/metadata-ingestion/docs/dev_guides/reporting_telemetry/