Using a Custom Docker Compose File with DataHub

[user-3]

Original Slack Thread

WARN[0000] /Users/kmbl323473/.datahub/quickstart/docker-compose.yml: version is obsolete

how to use my own file

[hyejin.yoon]

Hey there!

<@U06TM7M40RK> Can you help with the questions in this thread?

Please continue to tag RunLLM (e.g <@U06TM7M40RK>) to have it continue generating responses!

[user-1]

To use your own Docker Compose file with DataHub, you can follow these steps:

1. Create or Modify Your Docker Compose File: Ensure your custom Docker Compose file is correctly set up. For example, you might have a file named custom-docker-compose.yml.

2. Use the DataHub CLI to Run the Custom Compose File: You can specify your custom Docker Compose file using the --quickstart-compose-file option with the DataHub CLI.

Here’s an example command:

datahub docker quickstart --quickstart-compose-file /path/to/your/custom-docker-compose.yml

This command tells DataHub to use your custom Docker Compose file instead of the default one.

Example Docker Compose File
If you need an example of what a Docker Compose file might look like, here is a basic structure:

version: '3.8'
services:
  datahub-gms:
    image: linkedin/datahub-gms:latest
    ports:
      - "8080:8080"
    environment:
      - DATAHUB_GMS_HOST=datahub-gms
  datahub-frontend:
    image: linkedin/datahub-frontend:latest
    ports:
      - "9002:9002"
    environment:
      - DATAHUB_GMS_HOST=datahub-gms
    depends_on:
      - datahub-gms

Additional Steps

• Ensure Compatibility: Make sure your Docker Compose file is compatible with the version of Docker and Docker Compose you are using. The warning you received indicates that the version field might be obsolete or incorrectly specified.
• Set Environment Variables: If your custom Docker Compose file relies on environment variables, ensure they are set in your terminal session before running the command.

Troubleshooting
If you encounter issues, you can refer to the <https://datahubproject.io/docs/docker/development|DataHub documentation> for more detailed instructions and troubleshooting tips.

Would you like more detailed guidance on any specific part of this process?

Sources:

• https://datahubproject.io/docs/0.14.0/authentication/changing-default-credentials|https://datahubproject.io/docs/0.14.0/authentication/changing-default-credentials
• https://github.com/datahub-project/datahub/issues/5159|https://github.com/datahub-project/datahub/issues/5159 0 button 0 button Hint: Mention @runllm in the thread for followups.