Using csv-enricher to Bulk Update Datasets on DataHub with Support for S3 Locations

Original Slack Thread

Hi All, I am hoping to use csv-enricher to bulk update some datasets on DataHub. Are we able to give a s3 location on the recipe and ingest the CSV from there?

currently only local file or http/https url is supported

I have datahub set on aws . does this mean i need to move my file to a container where datahub is hosted and pull it from there?

okay just realized that if http/https url is supported then I can use google sheets


<@UV14447EU> If I use googlesheets it doesn’t work. Is there guidance around it?

google sheets are not supported yet, either you put into a local fs or on a link where it can download the csv file.