Creating a venv for ingestion tasks and customizing certificate path for connection requirements

Original Slack Thread

hello every one,
help me please know how you create venv for ingestion tasks, because i added my selfsigned ca certificate into /usr/local/lib/python3.10/site-packages/certifi/cacert.pem and after starting synk process, for my example trino, i see that cretrifi whl installed in venv from zero and i cant add my ca cert in venv automatically

The executor generates venvs from scratch and does a pip install command when creating the venv

If possible, I’d recommend trying to use an environment variable to customize the certificate path instead of overwriting files

If that doesn’t work, I’m afraid the best option would be to run ingestion from the CLI using datahub ingest

are you use requests for connection?

yes, REQUESTS_CA_BUNDLE helps me, ty