Troubleshooting excessive indexing in Datahub causing issues in Elasticsearch

troubleshoot
1

Original Slack Thread

Hello guys,

We are having a problem in our company with datahub but we are quite lost on why it’s happening.
We’ve seen that throughout the time, datahub ends up creating a lot os different indexes. We have so far 810 index on elasticsearch created by Datahub.
Did anyone already have the same problem ?!

Thanks a lot !

2

<@UV5UEC3LN> Would love your help here!

3

We do create a lot of indices, but 810 seems excessive. Do you have a list of them? Please redact any sensitive information in the names, but try to preserve as much as possible