How to Modify DataHub CLI Docker Container for Custom Crontab Ingestion

Original Slack Thread

Hello everyone. I have datahub 0.12.1 CLI deployed in docker containers. I want to run a metadata ingestion with a custom crontab. I usually import postgresql, mysql and mongo metadata. which container should I modify? what is the procedure to create a new custom crontab and in which path? Thank you very much!

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Are you using UI or CLI for ingestion?
  2. Which DataHub version are you using? (e.g. 0.12.0)
  3. What data source(s) are you integrating with DataHub? (e.g. BigQuery)

Why don’t you use the UI ingestion where you can set the schedule?
https://datahubproject.io/docs/ui-ingestion/

Sorry for the confusion, I use UI version.

The purpose of modify the default scheduler is to add some code lines for connect to a VPN. I don’t know the path of the scheduler and i want to create more for other connections. Thanks!