Hi Everyone - newbie on Datahub. I’m following the quickstart guide to install it on a fresh virtual environment on Ubuntu but the datahub-broker-1 container errors after creation - could you please help ? Which container is that so that I attach the logs to have a look please ? Thanks!
Hey there! 
Make sure your message includes the following information if relevant, so we can help more effectively!
- Which DataHub version are you using? (e.g. 0.12.0)
- Please post any relevant error logs on the thread!
- DataHub CLI version: 0.13.1.2
Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] 2. TBD
Logs found! - attached![attachment]({‘ID’: ‘F06TSE79SR2’, ‘EDITABLE’: True, ‘IS_EXTERNAL’: False, ‘USER_ID’: ‘U06TJU2FJRK’, ‘CREATED’: ‘2024-04-10 15:58:08+00:00’, ‘PERMALINK’: ‘Slack’, ‘EXTERNAL_TYPE’: ‘’, ‘TIMESTAMPS’: ‘2024-04-10 15:58:08+00:00’, ‘MODE’: ‘snippet’, ‘DISPLAY_AS_BOT’: False, ‘PRETTY_TYPE’: ‘Plain Text’, ‘NAME’: ‘tmpxos4fqoz.log’, ‘IS_PUBLIC’: True, ‘PREVIEW_HIGHLIGHT’: ‘
\n
\n’, ‘MIMETYPE’: ‘text/plain’, ‘PERMALINK_PUBLIC’: ‘https://slack-files.com/TUMKD5EGJ-F06TSE79SR2-a87d9bc2a8’, ‘FILETYPE’: ‘text’, ‘EDIT_LINK’: ‘Slack’, ‘URL_PRIVATE’: ‘Slack’, ‘HAS_RICH_PREVIEW’: False, ‘TITLE’: ‘tmpxos4fqoz.log’, ‘IS_STARRED’: False, ‘PREVIEW_IS_TRUNCATED’: True, ‘URL_PRIVATE_DOWNLOAD’: ‘Slack’, ‘PREVIEW’: ‘time=“2024-04-10T15:56:16Z” level=warning msg=“/home/lumilinks/.datahub/quickstart/docker-compose.yml: \n\n\n\n\n\n
\ntime="2024-04-10T15:56:16Z" level=warning msg="/home/lumilinks/.datahub/quickstart/docker-compose.yml: version is obsolete"broker-1 | ===> User
broker-1 | uid=1000(appuser) gid=1000(appuser) groups=1000(appuser)
broker-1 | ===> Configuring …
broker-1 | Running in Zookeeper mode…
version is obsolete”\nbroker-1 | ===> User\nbroker-1 | uid=1000(appuser) gid=1000(appuser) groups=1000(appuser)\nbroker-1 | ===> Configuring …\nbroker-1 | Running in Zookeeper mode…’, ‘PUBLIC_URL_SHARED’: False, ‘MESSAGE_TS’: ‘1712764703.988149’, ‘PARENT_MESSAGE_TS’: ‘1712764456.432109’, ‘MESSAGE_CHANNEL_ID’: ‘C029A3M079U’, ‘_FIVETRAN_DELETED’: False, ‘LINES_MORE’: 1421, ‘LINES’: 1426, ‘SIZE’: 307631, ‘_FIVETRAN_SYNCED’: ‘2024-04-14 12:55:23.989000+00:00’})
broker-1 | [2024-04-10 15:47:54,259] ERROR Timed out waiting for connection to Zookeeper server [zookeeper:2181]. (io.confluent.admin.utils.ClusterStatus)
The datahub-broker-1 container cannot communicate with the datahub-zookeeper-1 container.
Try stopping it and starting again
Thanks for the reply <@U05SKM6KGGK>! I have stopped and started the datahub-broker-1 container many times but no luck. The logs for it say the below:
INFO Opening socket connection to server zookeeper/172.28.0.3:2181. (org.apache.zookeeper.ClientCnxn)
[2024-04-11 08:34:27,876] INFO SASL config status: Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2024-04-11 08:35:07,863] ERROR Timed out waiting for connection to Zookeeper server [zookeeper:2181]. (io.confluent.admin.utils.ClusterStatus)
[2024-04-11 08:35:07,874] WARN Client session timed out, have not heard from server in 40003ms for session id 0x0 (org.apache.zookeeper.ClientCnxn)
[2024-04-11 08:35:07,875] WARN An exception was thrown while closing send thread for session 0x0. (org.apache.zookeeper.ClientCnxn)
org.apache.zookeeper.ClientCnxn$SessionTimeoutException: Client session timed out, have not heard from server in 40003ms for session id 0x0
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1258)
[2024-04-11 08:35:07,984] INFO Session: 0x0 closed (org.apache.zookeeper.ZooKeeper)
[2024-04-11 08:35:07,984] INFO EventThread shut down for session: 0x0 (org.apache.zookeeper.ClientCnxn)
Using log4j config /etc/kafka/log4j.properties
screenshot:
Would suggest checking logs of the zookeeper container.
Zookeeper logs attached. Binds to port [2024-04-12 15:24:48,399] INFO binding to port 0.0.0.0/0.0.0.0:2181 (org.apache.zookeeper.server.NIOServerCnxnFactory) , broker attempts for 2024-04-12 15:32:59,959] INFO Opening socket connection to server zookeeper/192.168.0.3:2181. (org.apache.zookeeper.ClientCnxn)\n[2024-04-12 15:24:47,661] INFO clientPortAddress is 0.0.0.0:2181 (org.apache.zookeeper.server.quorum.QuorumPeerConfig)\n[2024-04-12 15:24:47,662] INFO secureClientPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)\n[2024-04-12 15:24:47,662] INFO observerMasterPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)\n[2024-04-12 15:24:47,662] INFO metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider (org.apache.zookeeper.server.quorum.QuorumPeerConfig)’, ‘PUBLIC_URL_SHARED’: False, ‘MESSAGE_TS’: ‘1712936017.053169’, ‘PARENT_MESSAGE_TS’: ‘1712764456.432109’, ‘MESSAGE_CHANNEL_ID’: ‘C029A3M079U’, ‘_FIVETRAN_DELETED’: False, ‘LINES_MORE’: 127, ‘LINES’: 132, ‘SIZE’: 23188, ‘_FIVETRAN_SYNCED’: ‘2024-04-14 12:55:24.158000+00:00’})
\n\n\n\n\n\n
\n[2024-04-12 15:24:47,642] INFO Reading configuration from: /etc/kafka/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2024-04-12 15:24:47,661] INFO clientPortAddress is 0.0.0.0:2181 (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2024-04-12 15:24:47,662] INFO secureClientPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2024-04-12 15:24:47,662] INFO observerMasterPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2024-04-12 15:24:47,662] INFO metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
Looks fine, not sure what is going on - probably docker related. Are you connected to a wifi/network on the 192.168.0 range?