Retrieving Metadata Ingestion Yaml Files for DataHub Setup from UI

troubleshoot
1

Original Slack Thread

Hey team, is there a path inside datahub folder to retrieve the metadata ingestion yaml files that were set up using UI, not CLI?

2

Hey there! :wave: Make sure your message includes the following information if relevant, so we can help more effectively!

  1. Which DataHub version are you using? (e.g. 0.12.0)
  2. Please post any relevant error logs on the thread!
3

The recipes are stored as entities in the metadata graph not as yaml files on a file system: https://datahubproject.io/docs/generated/metamodel/entities/datahubingestionsource|https://datahubproject.io/docs/generated/metamodel/entities/datahubingestionsource

In case the other instance is still running you could get the ingestion sources by using the GraphQL API and the listIngestionSources query: https://datahubproject.io/docs/graphql/queries#listingestionsources|https://datahubproject.io/docs/graphql/queries#listingestionsources

4

Thanks <@U03GWPR6FSS> . The other instance is not running anymore. Will check that document. Hope I am able to access graphql and construct all the metadata ingestions back again.

5

If you still have the database of that instance you could also check the table with all the aspects (metadata_aspect_v2) to see if you can find the corresponding dataHubIngestionSourceInfo aspect in it

6

Thanks will do!