Troubleshooting Great Expectations DataHub Integration and Dependency Versions

troubleshoot
1

Original Slack Thread

Hi team, I’m trying to send great expectations results to datahub, I’m using the below dependencies, the GX checkpoint with DataHubValidationAction successfully ran, I was able to get the statement at the end: DataHub notification succeeded .
I also verified the dataset urn constructed by GX action matches what I have in datahub, but the validation result just don’t show up in datahub UI.
~Do I miss anything there? I doubt it’s the dependency version issue, but I’m not 100% sure…~

great_expectations, version 0.18.2
sqllineage, version 1.4.8```
2

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Which DataHub version are you using? (e.g. 0.12.0)
  2. Please post any relevant error logs on the thread!
3 
Finding datasets being validated
Datasource redshift is not present in platform_instance_map
Sending metadata to datahub ...
Dataset URN - urn:li:dataset:(urn:li:dataPlatform:redshift,db.table,PROD)
Assertion URN - urn:li:assertion:8f442089eff2505dfb1a887a849b0ed5
Metadata sent to datahub.
datahub_notification_result: DataHub notification succeeded```
4

I figured out it’s because the datahub gms pod ingress didn’t forward the api request properly. now I’m able to view the validation results on datahub UI.
a follow-up question is:
with my current setup (dependencies were installed separately with their newest version), will I miss any functionalities in the datahub and GX integration?

5

Thanks for sharing the update - <@U063WTWMH2L> might be able to speak to this!

6

Hi <@U05KMQ7TXHC>, I’m trying to do the same but getting an error saying metadata not sent to datahub. no datasets found.
Do you mind the share part of your checkpoint code so I compare and see what I’m doing wrong?
Thanks.