Troubleshooting a DataHub Ingestion Failure

ingestion
1

Original Slack Thread

2025-02-03 09:31:20,077 [qtp1089324622-23] INFO i.d.metadata.context.RequestContext:53 - RequestContext{actorUrn=‘urn:li:corpuser:__datahub_system’, sourceIP=‘172.19.0.8’, requestAPI=RESTLI, requestID=‘ingestProposal([dataHubExecutionRequest])’, userAgent=‘python-requests/2.32.3’}
2025-02-03 09:31:20,087 [qtp1089324622-23] INFO c.l.m.r.entity.AspectResource:317 - INGEST PROPOSAL content: urn: urn:li:dataHubExecutionRequest:3cb875c8-ff8b-43c7-8b76-afcdf99405c7, async: false, value: {“status”: “FAILURE”, “report”: "~~~~ Execution Summary - RUN_INGEST \nExecution finished with errors.\n{‘exec_id’: ‘3cb875c8-ff8b-43c7-8b76-afcdf99405c7’,\n ‘infos’: [‘2025-02-03 09:31:09.315993 INFO: Starting execution for task with name=RUN_INGEST’,\n "2025-02-03 09:31:20.069023 INFO: Failed to execute ‘datahub ingest’, exit code 1",\n '2025-02-03 09:31:20.069341 INFO: Caught exception EXECUTING task_id=3cb875c8-ff8b-43c7-8b76-afcdf99405c7, name=RUN_INGEST, '\n 'sta…
2025-02-03 09:31:20,098 [qtp1089324622-23] INFO c.l.m.entity.EntityServiceImpl:983 - Ingesting aspects batch to database: AspectsBatchImpl{items=[ChangeMCP{changeType=UPSERT, urn=urn:li:dataHubExecutionRequest:3cb875c8-ff8b-43c7-8b76-afcdf99405c7, aspectName=‘dataHubExecutionRequestResult’, recordTemplate={report= Execution Summary - RUN_INGEST ~~~~
Execution finished with errors.

2

Hey there! :wave:

<@U06TM7M40RK> Can you help with the questions in this thread?

:information_source: Please continue to tag RunLLM (e.g <@U06TM7M40RK>) to have it continue generating responses!

3

It looks like you’re encountering an error during a DataHub ingestion process, as indicated by the log messages. The error message suggests that the execution of the ‘datahub ingest’ command failed with an exit code 1. This typically indicates that there was an issue during the ingestion process.

To help diagnose and resolve this issue, here are some steps you can take:

  1. Check Logs for Detailed Errors: Look at the detailed logs for more specific error messages. This can provide more context about what might be going wrong. You can access these logs through the DataHub UI by clicking on the ingestion run details or by using docker logs for the relevant container.

  2. Verify Configuration: Ensure that your ingestion recipe and configurations are correct. Sometimes, a misconfiguration can lead to such errors. For example, make sure that the host_port, username, password, and other required fields are correctly set.

  3. Network Connectivity: Make sure that the DataHub instance can reach the data source and that there are no network issues. Verify DNS resolution and network policies that might be blocking the connection.

  4. Container Health: Ensure that all necessary Docker containers are running and healthy. You can verify the health of the containers using docker ps. Specifically, check the datahub-actions container, which is responsible for executing ingestion requests.

  5. Resource Allocation: Ensure that your Docker environment has sufficient resources allocated to the DataHub components.

For more detailed steps on debugging a failed ingestion run, you can refer to the <https://datahubproject.io/docs/0.14.0/ui-ingestion#debugging-a-failed-ingestion-run|DataHub documentation on Debugging Ingestion>.

Would you like more detailed steps or further assistance on any specific part of the process?

Sources:

4

Hi, how did my answer work out for you? Need any more assistance? You can also tag <@U07FV3UHE4D> to let your fellow community members know you’re still looking for guidance.

5

Hi :slight_smile: ! Did this interaction resolve your issue or do you still require assistance ?

Please tag @ RunLLM if you still need further assistance !

Or tag @Datahub Community Support if you require a person to take a look :slight_smile:

Hope this helps ! ><