Troubleshooting Error: Adding a Subdomain with Java SDK MetadataChangeProposalWrapper

user-1 · August 12, 2024, 12:02am

Hi Team, I’m encountering an error when trying to add a subdomain to an existing domain using the Java SDK MetadataChangeProposalWrapper and RestEmitter. Specifically, when attempting to create a new domain with an existing parent domain URN, the For request 'POST /aspects?action=ingestProposal in a ‘not found’ error. Any insights on how to resolve this?

datahub_team · August 12, 2024, 12:02am

Hey there! Make sure your message includes the following information if relevant, so we can help more effectively!

Are you using UI or CLI for ingestion?
Which DataHub version are you using? (e.g. 0.12.0)
What data source(s) are you integrating with DataHub? (e.g. BigQuery)

<@U06TM7M40RK> Can you help with the questions in this thread?

Please continue to tag RunLLM (e.g <@U06TM7M40RK>) to have it continue generating responses! We’re experimenting with a new AI assistant for questions in the <#CUMUWQU66|> channel to help you track down helpful resources more quickly. Keep in mind that responses may not always be spot-on; feel free to ask it follow-up questions and don’t forget to provide its responses a or so other folks in the Community know if you’re still looking for help on the topic and to help us improve the assistant!

hyejin.yoon · August 12, 2024, 12:02am

To help you more effectively, could you please provide the following details?

Are you using the UI or CLI for ingestion?
Which DataHub version are you using? (e.g., 0.12.0)?
What data source(s) are you integrating with DataHub? (e.g., BigQuery)?

Additionally, based on your description, it seems like you are encountering a 404 Not Found error when trying to add a subdomain using the Java SDK. This could be due to several reasons, such as incorrect URNs or issues with the parent domain not being found.

Here are a few steps to troubleshoot and resolve the issue:

Verify Parent Domain URN: Ensure that the parent domain URN you are using is correct and exists in DataHub. You can verify this by querying the domain using GraphQL or the REST API.
Check Domain Creation Logic: Make sure that the logic for creating a nested domain is correctly implemented. According to the <Domains | DataHub documentation>, you can create a nested domain using the following GraphQL mutation:
```
mutation createDomain {
  createDomain(input: { name: "Verticals", description: "Entities related to the verticals sub-domain.", parentDomain: "urn:li:domain:marketing" })
}
```
Java SDK Implementation: Ensure that your Java SDK implementation follows the correct structure for creating a domain. Here is an example of how to create a nested domain using the Java SDK:

user-3 · August 12, 2024, 12:02am

    import com.linkedin.common.urn.Urn;
    import com.linkedin.datahub.graphql.generated.CreateDomainInput;
    import com.linkedin.datahub.graphql.generated.CreateDomainMutation;
    import com.linkedin.datahub.graphql.generated.Domain;
    import com.linkedin.datahub.graphql.generated.DomainProperties;
    import com.linkedin.datahub.graphql.generated.Mutation;
    import com.linkedin.datahub.graphql.generated.MutationResponse;
    import com.linkedin.datahub.graphql.generated.Query;
    import com.linkedin.datahub.graphql.generated.QueryResponse;
    import com.linkedin.datahub.graphql.generated.UrnInput;
    import com.linkedin.datahub.graphql.generated.UrnType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;

user-3 · August 12, 2024, 12:02am

    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;

user-3 · August 12, 2024, 12:02am

    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;

user-3 · August 12, 2024, 12:03am

    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;

user-3 · August 12, 2024, 12:03am

    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;

user-3 · August 12, 2024, 12:03am

    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputType;
    import com.linkedin.datahub.graphql.generated.UrnTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInputTypeInput;

user-3 · August 12, 2024, 12:03am


Sources:
- [DataHub documentation](<https://datahubproject.io/docs/0.13.1/api/tutorials/domains#creating-a-nested-domain>)``` :+1: 0 button :-1: 0 button :bulb: *Hint:* Mention @runllm in the thread for followups.

user-1 · August 12, 2024, 12:03am

<@U05U4UUKULD> wow it’s actually reproducible…

Topic		Replies	Views
Troubleshooting `404 Not Found` Error When Adding Subdomain using Java SDK ingestion	22	9	August 12, 2024
Troubleshooting Missing Domain Tags in Data Ingestion Recipe ingestion	6	4	October 14, 2024
Resolving Ingestion Configuration Issues in DataHub and Great Expectations Integration troubleshoot	5	50	May 13, 2024
Troubleshooting Metadata Ingestion Error 'Failed to produce MCLs' ingestion	8	76	June 3, 2024
Troubleshooting errors when emitting metadata to DataHub GMS ingestion	1	74	May 13, 2024

Troubleshooting Error: Adding a Subdomain with Java SDK MetadataChangeProposalWrapper

Related Topics