Hello, we are doing s3 ingestion. While ingesting through DataHub GUI, ingestion is failing frequently due to the following error.
‘errors’: ['2023-09-18 17:18:26.581068 ERROR: The ingestion process was killed, likely because it ran out of memory. You can resolve this issue by ‘allocating more memory to the datahub-actions container.’]
We also increased the memory to 1.5GB in production. Still we are facing this issue frequently. Could you please help us.
Can you try it by increasing memory to 4GB?
Check the below thread for reference https://datahubspace.slack.com/archives/CUMUWQU66/p1681983477041819