Troubleshooting group membership update issues with DataHub SSO integration on Azure Kubernetes

Original Slack Thread

Hi All, I came across a new failure (well new to me). I have DataHub deployed via helm, on Azure Kubernetes (via Rancher). I am using SSO with OKTA, has been working fine for a few weeks. I can authenticate, but now having group membership update issues. Any clue on this one?

Python version: 3.10.13 (main, Aug 24 2023, 22:36:46) [Clang 14.0.3 (clang-1403.0.22.14.1)]```
```2023-09-14 16:12:48,645 [application-akka.actor.default-dispatcher-7] ERROR auth.sso.oidc.OidcCallbackLogic - Failed to perform post authentication steps. Redirecting to error page.
java.lang.RuntimeException: Failed to update group membership for user with urn urn:li:corpuser:some.user@something.com```

<@UV5UEC3LN> might be able to speak to this!

Not sure, is this the full log?

<@UV5UEC3LN>, this was the log from within the pod, not the detailed log. Anyways, I think I found the issue. It seems my datahub-upgrade job was interrupted and mysql was not fully in a state where it was up. After rolling back the update and redeploying it was working. Thanks.