Troubleshooting AKKA.HTTP Error and Misconfigured SSO Integration in DataHub on AWS ECS Fargate

Original Slack Thread

Hey !subteam^S02G6MS60C9|@acryl-data-team :cat-wave:

I tried setting up DataHub on my AWS ECS Fargate application. Facing some issues while integrating with Google SSO. Can someone help me with what am I missing on this AKKA.HTTP error.

NOTE: I followed https://datahubproject.io/docs/authentication/guides/sso/configure-oidc-react-google/#4-configure-datahub-frontend-to-enable-oidc-authentication|this document by Datahub.


2023-10-16 08:15:04,610 [application-akka.actor.default-dispatcher-26] WARN  akka.actor.ActorSystemImpl - Illegal request, responding with status '501 Not Implemented': Unsupported HTTP method: PRI

2023-10-16 09:23:07,195 [application-akka.actor.default-dispatcher-5] WARN  akka.actor.ActorSystemImpl - Illegal request, responding with status '400 Bad Request': Unsupported HTTP method: HTTP method too long (started with 'MGLNDD_3.101.65.') from 138.68.208.50:43310. Increase `akka.http.server.parsing.max-method-length` to support HTTP methods with more characters.

2023-10-16 14:07:33,245 [application-akka.actor.default-dispatcher-7] WARN  akka.actor.ActorSystemImpl - Illegal request, responding with status '400 Bad Request': Unsupported HTTP method: HTTP method too long (started with 'Pexample') from 185.224.128.17:52636. Increase `akka.http.server.parsing.max-method-length` to support HTTP methods with more characters.

2023-10-16 14:07:33,245 [application-akka.actor.default-dispatcher-86] WARN  akka.actor.ActorSystemImpl - Illegal request, responding with status '400 Bad Request': CONNECT requests are not supported: Rejecting CONNECT request to '<http://example.com:80|example.com:80>'

2023-10-16 14:07:48,089 [application-akka.actor.default-dispatcher-10] WARN  akka.actor.ActorSystemImpl - Illegal request, responding with status '400 Bad Request': Illegal HTTP message start

2023-10-16 18:34:40,676 [application-akka.actor.default-dispatcher-26] WARN  akka.actor.ActorSystemImpl - Illegal request, responding with status '400 Bad Request': Unsupported HTTP method: The HTTP method started with 0x16 rather than any known HTTP method from 147.182.216.100:22364. Perhaps this was an HTTPS request sent to an HTTP endpoint?

2023-10-16 18:34:40,829 [application-akka.actor.default-dispatcher-7] WARN  akka.actor.ActorSystemImpl - Illegal request, responding with status '400 Bad Request': Unsupported HTTP method: The HTTP method started with 0x16 rather than any known HTTP method from 147.182.216.100:22370. Perhaps this was an HTTPS request sent to an HTTP endpoint?

2023-10-16 18:38:20,176 [application-akka.actor.default-dispatcher-7] WARN  o.e.j.j.spi.PropertyFileLoginModule - Exception starting propertyUserStore /etc/datahub/plugins/frontend/auth/user.props

2023-10-16 18:38:22,406 [application-akka.actor.default-dispatcher-86] WARN  o.e.j.j.spi.PropertyFileLoginModule - Exception starting propertyUserStore /etc/datahub/plugins/frontend/auth/user.props

2023-10-16 23:05:27,656 [application-akka.actor.default-dispatcher-10] ERROR controllers.AuthenticationController - Caught exception while attempting to redirect to SSO identity provider! It's likely that SSO integration is mis-configured

2023-10-16 23:05:27,839 [application-akka.actor.default-dispatcher-11] ERROR controllers.AuthenticationController - Caught exception while attempting to redirect to SSO identity provider! It's likely that SSO integration is mis-configured

2023-10-16 23:46:01,693 [application-akka.actor.default-dispatcher-10] WARN  akka.actor.ActorSystemImpl - Illegal request, responding with status '400 Bad Request': Unsupported HTTP method: HTTP method too long (started with 'MGLNDD_3.101.65.') from 162.243.138.62:54176. Increase `akka.http.server.parsing.max-method-length` to support HTTP methods with more characters.```

I’m experiencing the same issue. The error log Caught exception while attempting to redirect to SSO identity provider! It's likely that SSO integration is mis-configured makes it impossible to investigate further. I also tried 2 stable versions: v0.11.0 and v0.10.5, but getting the same problem.

if you don’t mind sharing your values file ( with redactions ) I can try help

Something is definitely misconfigured here note that its trying to make an https connection to an http site, specifically some example hostname.
Rejecting CONNECT request to '<http://example.com:80|example.com:80>'

<@U05U4UUKULD> <@U03MF8MU5P0>
In the container it’s running on port 80 on ECS fargate & we are terminating the SSL on ELB. Let me know what else is required.

Where is this hostname in your configuration? <http://example.com|example.com> ? That may be from configuration in your SSO provider.

<@U061X07NMUL> - The <http://example.com|example.com> reference is probably in your identity provider’s configuration, not in DataHub itself.