Question about <https://datahubproject.io/docs/generated/ingestion/sources/databricks/|Databricks Connectors and Privileges>
I am supporting someone who has successfully connected to Databricks using the Hive recipe and is now trying to switch to the Unity Catalog one.
They have been able to access the Unity Catalog catalogs but they cannot access the old HMS.
They are using a Service Principle for authentication and they’ve given it the privileges mentioned in the doc.
They seem to think that giving the SP Metastore Administration privileges will help, but I really, really think that’d be a bad idea given the damage those privileges can do.
So:
- Should they be able to access the legacy HMS using the UC connector?
- If not, should they continue to use the old one?
- Would granting those extra privileges help?
Thank you!
fyi <@U04J2SE14DV>