user-1
March 4, 2024, 4:59pm
1
Original Slack Thread
Hey all, I’m just getting started with Datahub trying to kick the tires but cant even get it installed. Im using the quick start for AWS EKS. I get to the step to helm install prerequisites and the pods stay pending forever. (https://datahubproject.io/docs/deploy/kubernetes )
kubectl create secret generic neo4j-secrets --from-literal=neo4j-password=placeholder
helm repo add datahub <https://helm.datahubproject.io/>
helm install prerequisites datahub/datahub-prerequisites```
kubectl get pods
Hey there!
Which DataHub version are you using? (e.g. 0.12.0)
Please post any relevant error logs on the thread!
user-1
March 4, 2024, 4:59pm
3
Name: prerequisites-mysql-0
Namespace: default
Priority: 0
Service Account: prerequisites-mysql
Node: <none>
Labels: app.kubernetes.io/component=primary
app.kubernetes.io/instance=prerequisites
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=mysql
controller-revision-hash=prerequisites-mysql-767b8b57b5
helm.sh/chart=mysql-9.1.8
statefulset.kubernetes.io/pod-name=prerequisites-mysql-0
Annotations: checksum/configuration: f4319d4718b248202e23fec5a6be3eedfab5c74178052f0ef5ce1fd05b945270
Status: Pending
IP:
IPs: <none>
Controlled By: StatefulSet/prerequisites-mysql
Containers:
mysql:
Image: docker.io/bitnami/mysql:8.0.29-debian-11-r3
Port: 3306/TCP
Host Port: 0/TCP
Liveness: exec [/bin/bash -ec password_aux="${MYSQL_ROOT_PASSWORD:-}"
if [[ -f "${MYSQL_ROOT_PASSWORD_FILE:-}" ]]; then
password_aux=$(cat "$MYSQL_ROOT_PASSWORD_FILE")
fi
mysqladmin status -uroot -p"${password_aux}"
] delay=5s timeout=1s period=10s #success=1 #failure=3
Readiness: exec [/bin/bash -ec password_aux="${MYSQL_ROOT_PASSWORD:-}"
if [[ -f "${MYSQL_ROOT_PASSWORD_FILE:-}" ]]; then
password_aux=$(cat "$MYSQL_ROOT_PASSWORD_FILE")
fi
mysqladmin status -uroot -p"${password_aux}"
] delay=5s timeout=1s period=10s #success=1 #failure=3
Startup: exec [/bin/bash -ec password_aux="${MYSQL_ROOT_PASSWORD:-}"
if [[ -f "${MYSQL_ROOT_PASSWORD_FILE:-}" ]]; then
password_aux=$(cat "$MYSQL_ROOT_PASSWORD_FILE")
fi
mysqladmin status -uroot -p"${password_aux}"
] delay=15s timeout=1s period=10s #success=1 #failure=10
Environment:
BITNAMI_DEBUG: false
MYSQL_ROOT_PASSWORD: <set to the key 'mysql-root-password' in secret 'mysql-secrets'> Optional: false
MYSQL_DATABASE: my_database
Mounts:
/bitnami/mysql from data (rw)
/opt/bitnami/mysql/conf/my.cnf from config (rw,path="my.cnf")
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-g79gw (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
data:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: data-prerequisites-mysql-0
ReadOnly: false
config:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: prerequisites-mysql
Optional: false
kube-api-access-g79gw:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 6m44s (x111 over 18h) default-scheduler running PreBind plugin "VolumeBinding": binding volumes: timed out waiting for the condition```
user-1
March 4, 2024, 4:59pm
4
I believe theres something going on with the storageclasses/volumeattachment
user-1
March 4, 2024, 4:59pm
5
I figured out the quickstart is missing a lot. It says nothing about enabling ebs,networking drivers and required ebs permissions
user-2
March 4, 2024, 4:59pm
6
<@U06G9PR5Q80> Could you please share us the resolution? MTY
user-1
March 4, 2024, 4:59pm
7
I installed the following add-ons:
CoreDNS Kube-proxy EBS CSI Driver VPC CNI
user-1
March 4, 2024, 4:59pm
8
Im trying to confirm this is all I did, but I’m failing to install it again.
user-1
March 4, 2024, 4:59pm
9
I locked myself out attempting the front-end LB
user-1
March 4, 2024, 4:59pm
10
I got it running by only installing EBS CSI. I had to give the nodegroup role more permissions. I gave it admin but i suspect it only needs EBS permissions.
user-1
March 4, 2024, 4:59pm
11
NAME READY STATUS RESTARTS AGE
datahub-acryl-datahub-actions-759f74b7bf-gwd2q 1/1 Running 0 3m53s
datahub-datahub-frontend-66bcd79b95-dmbpc 1/1 Running 0 3m53s
datahub-datahub-gms-8fdfbc6c6-8456v 1/1 Running 0 3m53s
datahub-datahub-system-update-job-bzfpp 0/1 Completed 0 5m42s
datahub-elasticsearch-setup-job-95658 0/1 Completed 0 8m46s
datahub-kafka-setup-job-v5rgs 0/1 Completed 0 8m40s
datahub-mysql-setup-job-wxtln 0/1 Completed 0 5m48s
datahub-nocode-migration-job-jw7zr 0/1 Error 0 3m53s
datahub-nocode-migration-job-wlzmh 0/1 Completed 0 2m
elasticsearch-master-0 1/1 Running 0 14m
prerequisites-kafka-0 1/1 Running 0 14m
prerequisites-mysql-0 1/1 Running 0 14m
prerequisites-zookeeper-0 1/1 Running 0 14m```
user-1
March 4, 2024, 4:59pm
12
got this warning when upgrading the install for ingress:http://kubernetes.io/ingress.class|kubernetes.io/ingress.class ” is deprecated, please use ‘spec.ingressClassName’ instead
user-1
March 4, 2024, 4:59pm
13
I havent completed the database steps yet, but since adding the front end, the website is blank at login…
user-1
March 4, 2024, 4:59pm
14
the documentation for front end says to use latest. I used an older version
enabled: true
image:
repository: linkedin/datahub-frontend-react
tag: "v0.10.4"```
user-2
March 4, 2024, 4:59pm
16
It works for me too, thank you
Make sure your message includes the following information if relevant, so we can help more effectively!
<@U06G9PR5Q80>