Hello, I’m looking to migrate from the prerequisites chart to us AWS-managed Opensearch/Elasticsearch and Kafka. Are there any existing recommendations on the minimum cluster requirements for those services? Has anyone else had luck with a fairly low-resourced OpenSearch Cluster?
It depends on the size/activity of your workloads (e.g. how much metadata will be ingested), but you can start with the smallest available instance types and upgrade if necessary. For example, I’ve had no issues running some smaller deployments on AWS OpenSearch with 3 t3.medium.search nodes - AWS recommends a minimum of 3 nodes for to avoid data loss issues. Same for Kafka/MSK on kafka.t3.small.
OpenSearch/MSK Serverless could be an option too for lower cost.