Troubleshooting Kafka Bootstrap Connection Issue in DataHub Actions

getting-started
1

Original Slack Thread

Hi team! I’m testing DataHub Actions and was able to complete a custom action I wrote when teh DataHub server and the action are run in the same AWS instance. However, when I try to run them in separate instances, I cannot reach the Kafka Bootsrap Server due to this error:

%3|1705440950.713|FAIL|rdkafka#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: localhost:9092: Connect to ipv4#127.0.0.1:9092 failed: Connection refused (after 0ms in state CONNECT)```
The config for the action looks like this:
```source:
  type: "kafka"
  config:
    connection:
      bootstrap: "private-ip-datahub-instance:9092"
      schema_registry_url: "<http://private-ip-datahub-instance:8081>"```
Why does it try to connect to `localhost` if I'm specifying an IP address? Thank you in advance for your suggestions!
2

that is very very strange - it should not be using localhost if you are providing this in the configuration, i’ve never seen this issue before. The private ip is something like 10.0.1.x right?

3

one possibility is that your action file is not getting correctly picked up - how are you deploying it? using the CLI