Installing `acryl-datahub[dbt]` Package for DataHub Ingestion of dbt Cloud Models

ingestion
1

Original Slack Thread

I have setup datahub using docker as described in datahub’s official documentation and I am able to ingest snowflake data but i am unable to ingest dbt cloud models. It fails and gives error that acryl-datahub[dbt cloud] not installed or something like that. How and where to pip install dbt cloud I mean in which cintainer? thank you I am a beginner so may be my question will sound lame to many. Thank you

2

Hey there! :wave:

<@U06TM7M40RK> Can you help with the questions in this thread?

:information_source: Please continue to tag RunLLM (e.g <@U06TM7M40RK>) to have it continue generating responses!

3

To resolve the issue of ingesting dbt cloud models in DataHub, you need to ensure that the acryl-datahub[dbt] package is installed in the environment where the DataHub CLI is running. Here’s a step-by-step guide:

  1. Identify the Environment: If you are using Docker, the DataHub CLI might be running inside a container. You need to install the required package in the same environment where the CLI is executed.

  2. Install the Package: You can install the acryl-datahub[dbt] package using pip. If you are running the CLI inside a Docker container, you will need to access the container and run the pip install command there.

  3. Access the Container: Use the following command to access the running container:

    docker exec -it <container_id_or_name> /bin/bash

    Replace <container_id_or_name> with the actual ID or name of your DataHub container.

  4. Install the Package Inside the Container: Once inside the container, run the following command to install the dbt plugin:

    pip install 'acryl-datahub[dbt]'

  5. Verify the Installation: After installation, you can verify if the plugin is correctly installed by running:

    datahub check plugins --verbose

  6. Run the Ingestion Again: After ensuring the plugin is installed, try running the dbt cloud ingestion again.

If you are not running the CLI inside a container, you can install the package in your local environment where the CLI is executed.

If you need more detailed guidance on any of these steps, feel free to ask!

Sources:

4

Hi, how did my answer work out for you? Need any more assistance? You can also tag <@U07FV3UHE4D> to let your fellow community members know you’re still looking for guidance.

5

Unable to run dbt cloud itvsays dbt cloud is not found when i have pip installed that a million times

6

Hi :slight_smile: ! Did this interaction resolve your issue or do you still require assistance ?

Please tag @ RunLLM if you still need further assistance !

Or tag @Datahub Community Support if you require a person to take a look :slight_smile:

Hope this helps ! ><