Troubleshooting AWS Athena Connection Error in DataHub Community Version

ingestion
1

Original Slack Thread

Hi, am trying to connect to AWS Athena from datahub community version, appreciate if I can get reference to a sample recipe or a document for same from ui. Been getting missing credentials error when I run the ingest job, thanks.

2

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Are you using UI or CLI for ingestion?
  2. Which DataHub version are you using? (e.g. 0.12.0)
  3. What data source(s) are you integrating with DataHub? (e.g. BigQuery)
3 
  type: athena
  config:
    database: test
    aws_region: us-east-1
    aws_role_arn: 'arn:aws:iam::1218689:role/service-role/AWSGlueServiceRole'
    work_group: primary
    query_result_location: '<s3://path>'
    username: aws_access_key
    password: aws_secret_key```
4

aws_access_key and aws_secret_key is defined in secrets

5

botocore.exceptions.ClientError: An error occurred (InvalidClientTokenId) when calling the AssumeRole operation: The security token included in the request is invalid.

6

get this error message

7

recipe

8

version v0.13.1, UI, AWS Athena

9

Seems like you’ve got the wrong credentials - this doesn’t look like an issue with the datahub’s athena ingestion

10

can you please let me know if this is correct way of passing credentials, i have set up aws_access_key and aws_secret_key under secrets, do i need to pass role arn?