Hi all. I’m new to DataHub and currently building a POC… I just want to clarify what will happen… For example we run an ingestion that loads a dataset, and for the next run we update the config to filter out this dataset… but the stateful_ingestion is disabled… What will happen to the said dataset then? Will it be removed from the UI?
it won’t remove previously ingest datasets, the second ingest will updats datasets which matched filter criteria.