Visualizing Lineage from DataHub: Ingesting Data from Elasticsearch and Database Tables

Original Slack Thread

I am working on a proof of concept involving data ingestion from multiple Elasticsearch indices and database tables. Additionally, I want to include the capability to ingest the index templates for those indices. In terms of lineage, my goal is to visualize the lineage from a dataset down to the actual columns in the database tables and the corresponding Elasticsearch indices. Is this possible with our current setup? I am using the UI for the Process and the version I using is 0.13.3.2 and my source is Elasticsearch