BigQuery Ingestion Issue: Error Code 500 on Browsing Tables

troubleshoot
1

Original Slack Thread

Hi Team,
I am facing an issue related to BigQuery ingestion (v0.12.0):

  1. Run BigQuery ingestion to add tables
  2. Rollback ingestion run to soft delete tables
  3. Rerun ingestion to add those tables again
  4. Navigate to any table that got ingested <— The page loads but with an error An unknown error occurred. (code 500)
    In the network tab I see that the api call to getBrowsePaths is causing this issue. And after referring the datahub-gms logs I could see the following error:
    Please refer the :thread:
2

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Which DataHub version are you using? (e.g. 0.12.0)
  2. Please post any relevant error logs on the thread!
3 
	at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:314)
	at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:319)
	at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1702)
	at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.exec(CompletableFuture.java:1692)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.helpAsyncBlocker(ForkJoinPool.java:1144)
	at java.base/java.util.concurrent.ForkJoinPool.helpAsyncBlocker(ForkJoinPool.java:3151)
	at java.base/java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1819)
	at java.base/java.util.concurrent.CompletableFuture.join(CompletableFuture.java:2049)
	at graphql.GraphQL.execute(GraphQL.java:453)
	at com.linkedin.datahub.graphql.GraphQLEngine.execute(GraphQLEngine.java:96)
	at com.datahub.graphql.GraphQLController.lambda$postGraphQL$0(GraphQLController.java:106)
	at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700)
	at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.exec(CompletableFuture.java:1692)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
Caused by: java.lang.RuntimeException: Failed to retrieve browse paths: entity type DATASET, urn urn:li:dataset:(urn:li:dataPlatform:bigquery,wf-gcp-us-ae-lh-prod.curated.tbl_handling_unit_shipment_latest,PROD)
	at com.linkedin.datahub.graphql.resolvers.browse.BrowsePathsResolver.lambda$get$1(BrowsePathsResolver.java:60)
	at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700)
	... 16 common frames omitted
Caused by: java.lang.NullPointerException: null
	at com.linkedin.data.template.StringArray.&lt;init&gt;(StringArray.java:45)
	at com.linkedin.metadata.client.JavaEntityClient.getBrowsePaths(JavaEntityClient.java:549)
	at com.linkedin.datahub.graphql.types.dataset.DatasetType.browsePaths(DatasetType.java:213)
	at com.linkedin.datahub.graphql.resolvers.browse.BrowsePathsResolver.lambda$get$1(BrowsePathsResolver.java:48)
	... 17 common frames omitted"
timestamp: "2024-02-05T16:00:10.199500932Z"```
4

Hi, any help on this one :point_up::skin-tone-3:

5

<@U066NATHPNG> can you help here pl?