Troubleshooting dataPlatform load failure on Datahub GMS

Original Slack Thread

Hello, I am running Datahub v0.11 on Mysql.
I accidentally sent lineage data with the ‘wrong urn’ through Airflow today.
The urn was supposed to be of the form ‘urn:li:dataset:(urn:li:dataPlatform:hive,table_name,PROD)’, but I ended up capitalizing ‘hive’, meaning it was of the form ‘urn:li:dataset:(urn:li:dataPlatform:HIVE,table_name,PROD)’.
After this, the datahub main page is not loading the dataPlatform properly.

This is datagub GMS error log when I go to main page.

	at com.linkedin.datahub.graphql.types.dataplatform.DataPlatformType.batchLoad(
	at com.linkedin.datahub.graphql.GmsGraphQLEngine.lambda$createDataLoader$213(
	... 17 common frames omitted
Caused by: java.lang.IllegalStateException: Duplicate key EntityAspectIdentifier(urn=urn:li:dataPlatform:hive, aspect=dataPlatformInfo, version=0) (attempted merging values com.linkedin.metadata.entity.EntityAspect@b79d8e5d and com.linkedin.metadata.entity.EntityAspect@b79d8e5d)
	at java.base/
	at java.base/$uniqKeysMapAccumulator$1(
	at java.base/$3ReducingSink.accept(
	at java.base/java.util.ArrayList$Itr.forEachRemaining(
	at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(
	at java.base/
	at java.base/
	at java.base/$ReduceOp.evaluateSequential(
	at java.base/
	at java.base/
	at com.linkedin.metadata.entity.ebean.EbeanAspectDao.batchGet(
	at com.linkedin.metadata.entity.EntityServiceImpl.getEnvelopedAspects(
	at com.linkedin.metadata.entity.EntityServiceImpl.getCorrespondingAspects(
	at com.linkedin.metadata.entity.EntityServiceImpl.getLatestEnvelopedAspects(
	at com.linkedin.metadata.entity.EntityServiceImpl.getEntitiesV2(
	at com.linkedin.metadata.client.JavaEntityClient.batchGetV2(
	at com.linkedin.datahub.graphql.types.dataplatform.DataPlatformType.batchLoad(
	... 18 common frames omitted```
After seeing that error message, I suspected that a dataPlatform named 'HIVE' had been created and that this was causing a conflict.. I checked the mysql table and dataplatformindex_v2 in elasticsearch, but 'urn:li:dataPlatform:HIVE' did not exist.
Is there anything else I can do here? Thank you.

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Which DataHub version are you using? (e.g. 0.12.0)
  2. Please post any relevant error logs on the thread!

Please follow this thread to resolve the issue

• <@U0445MUD81W> Problem solved. Thank you!!