Troubleshooting Installation Error for Hive-Metastore Plugin

ingestion
1

Original Slack Thread

<@U06TM7M40RK> Help me with this error while trying to install hive-metastore plugin: WARNING: acryl-datahub 1!0.13.2+docker does not provide the extra ‘hive-metastore’

2

The error message indicates that the acryl-datahub package version 1!0.13.2+docker does not provide the extra hive-metastore. This suggests that the extra you are trying to install is either incorrectly named or not available in the specified version of the package.

To resolve this issue, you should use the correct extra name for the Hive Metastore plugin, which is hive. According to the <https://datahubproject.io/docs/0.13.1/generated/ingestion/sources/hive|DataHub documentation>, the correct command to install the Hive plugin is:

pip install 'acryl-datahub[hive]'

Here’s a step-by-step guide to ensure you install the correct plugin:

  1. Check the Plugin Name: Ensure you are using the correct extra name. For Hive Metastore, it should be hive.

  2. Install the Plugin: Use the following command to install the Hive plugin:

    pip install 'acryl-datahub[hive]'

  3. Verify Installation: After installation, you can verify that the plugin is installed by running:

    datahub check plugins --verbose | grep -i hive

If you are using Helm to deploy DataHub on Kubernetes, you can add the necessary configuration to the values.yaml file to include the required plugin. Here’s an example:

datahub:
  gms:
    extraPipPackages:
      - "acryl-datahub[hive]"

Then, deploy the Helm chart with the modified configuration:

helm upgrade --install datahub datahub/datahub -f values.yaml

Would you like more detailed steps or further assistance with any specific part of this process?

Sources:

3

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Are you using UI or CLI for ingestion?
  2. Which DataHub version are you using? (e.g. 0.12.0)
  3. What data source(s) are you integrating with DataHub? (e.g. BigQuery)

<@U06TM7M40RK> Can you help with the questions in this thread?

:information_source: We’re experimenting with a new AI assistant for questions in the <#CUMUWQU66> channel to help you track down helpful resources more quickly. Keep in mind that responses may not always be spot-on; feel free to ask it follow-up questions and don’t forget to provide its responses a :thumbsup: or :thumbsdown: so other folks in the Community know if you’re still looking for help on the topic!

4

I’m not able to find any data sources to answer your question. Could you provide more details about the exact command you are using and the environment setup? If this doesn’t help, please reach out to the DataHub support team for further assistance. :+1: 0 button :-1: 0 button :bulb: Hint: Mention @runllm in the thread for followups.