Troubleshooting AWS Athena Connection Error in DataHub Community Version

Original Slack Thread

Hi, am trying to connect to AWS Athena from datahub community version, appreciate if I can get reference to a sample recipe or a document for same from ui. Been getting missing credentials error when I run the ingest job, thanks.

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Are you using UI or CLI for ingestion?
  2. Which DataHub version are you using? (e.g. 0.12.0)
  3. What data source(s) are you integrating with DataHub? (e.g. BigQuery)
  type: athena
    database: test
    aws_region: us-east-1
    aws_role_arn: 'arn:aws:iam::1218689:role/service-role/AWSGlueServiceRole'
    work_group: primary
    query_result_location: '<s3://path>'
    username: aws_access_key
    password: aws_secret_key```

aws_access_key and aws_secret_key is defined in secrets

botocore.exceptions.ClientError: An error occurred (InvalidClientTokenId) when calling the AssumeRole operation: The security token included in the request is invalid.

get this error message


version v0.13.1, UI, AWS Athena

Seems like you’ve got the wrong credentials - this doesn’t look like an issue with the datahub’s athena ingestion

can you please let me know if this is correct way of passing credentials, i have set up aws_access_key and aws_secret_key under secrets, do i need to pass role arn?