Setting up datahub's Elasticsearch backend with ECK on Kubernetes and configuring credentials

all-things-deployment
1

Original Slack Thread

I am using ECK(Elastic Cloud on Kubernetes [2.9]) to set up my datahub’s es backend, anyone knows how to adjust the configuration in official datahub helm chart to make them connected. it seems there should be a username/password but the datahub chart doesn’t have. thansk

2

Default username/password is datahub/datahub.
After login by using it, you can invite your team member.

3

sorry for my unclear expression. I mean the datahub is using elastic search as its backend. so the datahub needs a credential of elsatic search server to connect to elastic search and use it as storage.

4

Oh i understood.
So you should set your username & password in existing your Elastic Search Cloud.

See the helm chart link https://github.com/acryldata/datahub-helm/blob/master/charts/datahub/subcharts/datahub-gms/templates/deployment.yaml#L197|here .

 - name: ELASTICSEARCH_USERNAME
   value: {{ .username }}
 - name: ELASTICSEARCH_PASSWORD
   {{- if .password.value }}
      value: {{ .password.value | quote }}
   {{- else }}```
5

thanks for your reply, I know datahub need elastic username to be “datahub/datahub”

6

So you can set values.yaml like

  strict_mode: true
  graph_service_impl: elasticsearch
  datahub_analytics_enabled: true
  datahub_standalone_consumers_enabled: false

  elasticsearch:
    host: "elasticsearch-master"
    port: "9200"
    skipcheck: "false"
    auth:
      username: "your_username"
      password: "your_password" ```
7

thank you, I wonder to know how https/tls works for datahub.

8

ECK by default makes the elastic cluster to be accessed by https. If the ‘skipcheck’ flag needs to be set as true

9

i do not know about skipcheck flag. but if you want to connect elastic search with ssl, you can set useSSL flag as true.

    host: "elasticsearch-master"
    port: "9200"
    skipcheck: "false"
    insecure: "false"
    useSSL: "true"```