Error deploying DataHub in k8s with Terraform due to missing KafkaClient entry in JAAS configuration

all-things-deployment
1

Original Slack Thread

Hello, I’m trying to deploy DataHub in k8s using Terraform. I created all my services in AWS, and when creating a deployment for GMS I get this error:
Could not find a 'KafkaClient' entry in the JAAS configuration. System property 'java.security.auth.login.config' is not set

I have injected this config in the deployment:

            name  = "KAFKA_PROPERTIES_SASL_KERBEROS_SERVICE_NAME"
            value = "kafka"
          }
          env {
            name  = "KAFKA_PROPERTIES_SECURITY_PROTOCOL"
            value = "SASL_SSL"
          }
          env {
            name  = "KAFKA_PROPERTIES_SASL_JAAS_CONFIG"
            value = "software.amazon.msk.auth.iam.IAMLoginModule required;"
          }
          env {
            name  = "KAFKA_PROPERTIES_SSL_TRUSTSTORE_LOCATION"
            value = "/tmp/kafka.client.truststore.jks"
          }
          env {
            name  = "KAFKA_PROPERTIES_SASL_CLIENT_CALLBACK_HANDLER_CLASS"
            value = "software.amazon.msk.auth.iam.IAMClientCallbackHandler"
          }
          env {
            name  = "KAFKA_PROPERTIES_SASL_MECHANISM"
            value = "AWS_MSK_IAM"
          }
          env {
            name  = "KAFKA_PROPERTIES_SASL_CLIENT_CALLBACK_HANDLER_CLASS"
            value = "software.amazon.msk.auth.iam.IAMClientCallbackHandler"
          }```
Do you have an idea of what I’m missing ?
2

<@U04UKA5L5LK> Would love your input here!

3

You might be missing the ‘SPRING_KAFKA_PROPERTIES_’ prefix in your environment variables. Try changing them to: SPRING_KAFKA_PROPERTIES_SASL_KERBEROS_SERVICE_NAME, SPRING_KAFKA_PROPERTIES_SECURITY_PROTOCOL, SPRING_KAFKA_PROPERTIES_SASL_JAAS_CONFIG, SPRING_KAFKA_PROPERTIES_SSL_TRUSTSTORE_LOCATION, SPRING_KAFKA_PROPERTIES_SASL_CLIENT_CALLBACK_HANDLER_CLASS, and SPRING_KAFKA_PROPERTIES_SASL_MECHANISM.
You can see more information here: https://datahubproject.io/docs/how/kafka-config