We get pydantic version not compatible error when we upgrade pyarrow
Hey there! 
<@U06TM7M40RK> Can you help with the questions in this thread?
Please continue to tag RunLLM (e.g <@U06TM7M40RK>) to have it continue generating responses!
To address the compatibility issue between pydantic
and pyarrow
, we need to understand the specific versions involved and how they interact with your current setup. Here are some steps and considerations to help resolve the issue:
-
Identify the Version Conflict:
- Determine the versions of
pydantic
andpyarrow
that are currently installed. You can do this by running:pip show pydantic pyarrow
- Determine the versions of
-
Check Compatibility:
- Review the compatibility requirements for both
pydantic
andpyarrow
. It’s possible that a recent upgrade ofpyarrow
introduced a dependency that conflicts with the version ofpydantic
you are using.
- Review the compatibility requirements for both
-
Pin Compatible Versions:
- If a specific version of
pydantic
is required, you may need to pin it to a compatible version. For example, ifpydantic
v2 is causing issues, you might need to revert to a v1 version:pip install 'pydantic<2'
- If a specific version of
-
Review DataHub’s Pydantic Usage:
- According to the <https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/setup.py|DataHub’s setup.py>, there are specific constraints on
pydantic
versions due to compatibility issues. Ensure that yourpydantic
version aligns with these constraints.
- According to the <https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/setup.py|DataHub’s setup.py>, there are specific constraints on
-
Use Migration Helpers:
- DataHub provides <https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/configuration/pydantic_migration_helpers.py|pydantic migration helpers> to handle transitions between
pydantic
v1 and v2. These can be useful if you are developing or modifying DataHub components.
- DataHub provides <https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/configuration/pydantic_migration_helpers.py|pydantic migration helpers> to handle transitions between
-
Check for Known Issues:
- Review any known issues or discussions in the DataHub community or on platforms like GitHub and Slack. For example, there are ongoing discussions about <https://github.com/datahub-project/datahub/issues/8829|pydantic v2 compatibility>.
Would you like more detailed steps on any of these troubleshooting points or further assistance on a specific part of the process?
Sources:
- <https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/setup.py|DataHub’s setup.py>
- <https://github.com/datahub-project/datahub/issues/8829|Compatibility of acryl-datahub package with Pydantic v2>
- <https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/configuration/pydantic_migration_helpers.py|pydantic migration helpers>
0 button
0 button
Hint: Mention @runllm in the thread for followups.
Hi, how did my answer work out for you? Need any more assistance? You can also tag <@U07FV3UHE4D> to let your fellow community members know you’re still looking for guidance.
no
Hi ! Did this interaction resolve your issue or do you still require assistance ?
Please tag @ RunLLM if you still need further assistance !
Or tag @Datahub Community Support if you require a person to take a look
Hope this helps ! ><