Troubleshooting setup issues with datahub deployment on EKS cluster

all-things-deployment
1

Original Slack Thread

Hi, I’m trying to follow the instructions https://datahubproject.io/docs/deploy/kubernetes/|here to install datahub for the first time on an eks cluster. I started with all default settings (just installing within an empty namespace named “datahub-test”), and I hit an issue with the setup job failing with an error not finding the right avro schema. I worked around this by modifying the default values to use kafka as the schema registry https://github.com/acryldata/datahub-helm/blob/master/charts/datahub/values.yaml#L491|here. Now it’s failing at the datahub-nocode-migration-job, and it looks like it’s because the datahub-datahub-gms pod is failing to start. The logs from that pod include these errors:

2023-08-07 20:20:36,364 [pool-16-thread-1] INFO  c.l.m.boot.OnBootApplicationListener:63 - Sleeping for 1 second```
This is what the schemaregistry section of my values.yaml currently looks like, is this correct or should I change something here? This is the only part of values.yaml that I changed from default.
```    schemaregistry:
      # GMS Implementation - `url` configured based on component context
      # type: INTERNAL
      # Confluent Kafka Implementation
      type: KAFKA
      # url: "<http://prerequisites-cp-schema-registry:8081>"

      # Glue Implementation - `url` not applicable
      # type: AWS_GLUE
      # glue:
      #   region: us-east-1
      #   registry: datahub```
2

was facing the same issue initially. what seemed to work for me is:
in prerequisites: enable schema registry

  enabled: true
  # Schema registry is under the community license
  cp-schema-registry:
    enabled: true
    kafka:
      bootstrapServers: "prerequisites-kafka:9092"  # &lt;&lt;release-name&gt;&gt;-kafka:9092
  cp-kafka:
    enabled: false
  cp-zookeeper:
    enabled: false
  cp-kafka-rest:
    enabled: false
  cp-kafka-connect:
    enabled: false
  cp-ksql-server:
    enabled: false
  cp-control-center:
    enabled: false```
and in datahub values.yaml: uncomment url as well
```    schemaregistry:
      # GMS Implementation - `url` configured based on component context
      # type: INTERNAL
      # Confluent Kafka Implementation
      type: KAFKA
      url: "<http://prerequisites-cp-schema-registry:8081>"

      # Glue Implementation - `url` not applicable
      # type: AWS_GLUE
      # glue:
      #   region: us-east-1
      #   registry: datahub```