Hello everyone. I have datahub 0.12.1 CLI deployed in docker containers. I want to run a metadata ingestion with a custom crontab. I usually import postgresql, mysql and mongo metadata. which container should I modify? what is the procedure to create a new custom crontab and in which path? Thank you very much!
Hey there! Make sure your message includes the following information if relevant, so we can help more effectively!
- Are you using UI or CLI for ingestion?
- Which DataHub version are you using? (e.g. 0.12.0)
- What data source(s) are you integrating with DataHub? (e.g. BigQuery)
Why don’t you use the UI ingestion where you can set the schedule?
https://datahubproject.io/docs/ui-ingestion/
Sorry for the confusion, I use UI version.
The purpose of modify the default scheduler is to add some code lines for connect to a VPN. I don’t know the path of the scheduler and i want to create more for other connections. Thanks!