Troubleshooting issues with datahub on Docker and Kafka: Soft data deletion and cluster ID mismatch

troubleshoot
1

Original Slack Thread


i am attaching a screenshot of i am actually facing! here as soon i accessed an entity using the url it popped up on my UI, also i checked my MySQL DB, it has all the data intact in the metadata_aspect_v2 table. ```![attachment](https://files.slack.com/files-pri/TUMKD5EGJ-F05KYLCRB46/screenshot_2023-08-03_at_6.22.10_pm.png?t=xoxe-973659184562-6705490291811-6708051934148-dd1595bd5f63266bc09e6166373c7a3c)
2

<@UV5UEC3LN> Would love you help here!

3

another error in reference to this, i tried rerunning the broker container a couple of times, but now it does not run stating the error
broker | kafka.common.InconsistentClusterIdException: The Cluster ID UDhIE-5oSYOs5ieiEn77vg doesn't match stored clusterId Some(PvzFCTMLRTuswshr7q2gug) in meta.properties. The broker is trying to join the wrong cluster. Configured zookeeper.connect may be wrong.
i found out this file, meta.properties was in the volume files of docker container, and in that particular file, the clusterId is correctly specified as PvzFCTMLRTuswshr7q2gug so it shouldn’t be giving this error as well

if there is a way around this?

4

Did it ever show up in the UI? This seems like an Elastic issue where maybe because Kafka went down all your MCLs died before they could be processed? Try restoring your indices maybe: https://datahubproject.io/docs/how/restore-indices

5

For the other error you may need to delete your Zookeeper volume