Ingesting Superset BI Metadata Using API Access with Guest Token

Original Slack Thread

how to ingestion superset BI with API acess via guest token

Hey there! :wave:

<@U06TM7M40RK> Can you help with the questions in this thread?

:information_source: Please continue to tag RunLLM (e.g <@U06TM7M40RK>) to have it continue generating responses!

To ingest metadata from Superset using API access via a guest token, you need to consider the following steps and configurations:

  1. Authentication Method: Superset’s ingestion typically uses basic authentication methods like username and password. However, if you are looking to use a guest token, you might need to customize the authentication process since the standard Superset ingestion connector does not explicitly support guest tokens.

  2. Custom Authentication: You may need to implement a custom script or modify the existing ingestion code to handle guest token authentication. This involves setting up the HTTP headers to include the guest token in the Authorization header.

  3. Superset API Endpoints: Ensure that your Superset instance is exposing the necessary API endpoints. The Superset connector extracts datasets by contacting the /api/v1/dataset/ endpoint. You can manually check this endpoint to see if it returns the expected data.

  4. Configuration Example: Here is a basic example of how you might configure the ingestion recipe, assuming you have modified the authentication to use a guest token:

    source:
      type: superset
      config:
        connect_uri: 'https://your-superset-instance/'
        # Custom authentication using guest token
        headers:
          Authorization: 'Bearer your-guest-token'
    sink:
      type: datahub-rest
      config:
        server: 'http://localhost:8080'
        token: 'your-personal-access-token'
    
  5. Debugging and Testing: Run the ingestion with detailed logging to capture more information about the process. This will help you verify that the token is being correctly included in the request headers.

  6. Community and Support: Since using a guest token is not a standard feature, you might want to check the <https://github.com/datahub-project/datahub/issues|DataHub GitHub issues> or the <Slack Slack community> for any similar implementations or discussions.

Would you like more detailed steps or further assistance on any specific part of the process?

Sources:

Hi, how did my answer work out for you? Need any more assistance? You can also tag <@U07FV3UHE4D> to let your fellow community members know you’re still looking for guidance.

Hi :slight_smile: ! Did this interaction resolve your issue or do you still require assistance ?

Please tag @ RunLLM if you still need further assistance !

Or tag @Datahub Community Support if you require a person to take a look :slight_smile:

Hope this helps ! ><