Resolving DataHub API Error in Airflow Data Ingestion

Original Slack Thread

<@U06TM7M40RK> we are getting the following error when ingesting data from airflow, do you have any idea why
All action methods (specified via ‘action’ in URI) must be submitted as a POST (was GET)

The error message “All action methods (specified via ‘action’ in URI) must be submitted as a POST (was GET)” indicates that there is an issue with the HTTP method being used for a request to the DataHub API. This error typically occurs when a GET request is mistakenly used instead of a POST request for an action that requires a POST method.

According to the <https://github.com/datahub-project/datahub/issues/2724|GitHub issue>, this error can occur if there is a misconfiguration in the way requests are being made to the DataHub API. Specifically, actions that modify data, such as ingesting metadata, should be performed using POST requests.

Here are some steps to resolve this issue:

  1. Check the Request Method: Ensure that the requests being made to the DataHub API for ingestion are using the POST method. This is crucial for actions that involve data modification.

  2. Review the Configuration: Verify the configuration of your Airflow setup to ensure that the correct HTTP method is being used. This might involve checking the code or scripts that are responsible for making API calls to DataHub.

  3. Update the Endpoint: If you are using a custom script or plugin, make sure that the endpoint being called is correct and that it is configured to use POST for actions that require it.

  4. Network Configuration: As mentioned in the <https://github.com/datahub-project/datahub/issues/8974|GitHub issue>, ensure that there are no network configurations, such as proxies or load balancers, that might be altering the request method from POST to GET.

Would you like more detailed steps on how to verify and update your configuration?

Sources:

Hi <@U08B11U7F6V>, how did my answer work out for you? Need any more assistance? You can also tag <@U07FV3UHE4D> to let your fellow community members know you’re still looking for guidance.

Hi :slight_smile: ! Did this interaction resolve your issue or do you still require assistance ?

Please tag @ RunLLM if you still need further assistance !

Or tag @Datahub Community Support if you require a person to take a look :slight_smile:

Hope this helps ! ><