Troubleshooting ElasticSearch and MySQL Index Synchronization in Datahub Deployment

Original Slack Thread

Hi everyone, we are about to deploy our datahub to our company’s production environment, but we’ve encountered a problem. In order to add the attribute of platform instance on top of the database layer, we deleted the original ingestion. Following this, we found that ElasticSearch could not rebuild the index. We have verified that the ingestion information in MySQL has been updated, but when querying the index through ElasticSearch API, it appears empty. I would like to confirm how I can ensure that the ElasticSearch and MySQL indexes are synchronized.

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Which DataHub version are you using? (e.g. 0.12.0)
  2. Please post any relevant error logs on the thread!

we are using 0.13.0