Introducing Unity Catalog: Governing Data with Databricks

What is Unity Catalog?

Unity Catalog provides centralized governance to all data assets within the Databricks Lakehouse Platform.

Unity Catalog enables creation of  a universal catalog of datasets which are  accessible through any Unity Catalog enabled Databricks workspace.

Unity Catalog is a significant addition to the capabilities within the Databricks Lakehouse Platform. Up till now Databricks environment only provided access to the local Hive metastore and specific metadata could be accessed only from that workspace. However, with Databricks Unity Catalog users can manage and access metadata centrally which not only allows access across workspaces but also enables central governance of data. Databricks Unity Catalog is not meant to be an organizational level data cataloging solution, but rather Unity catalog enables organizations to have a centralized metastore that catalogs all Delta Tables and enables unified governance and access across the organization.

Tredence has a track record of successful implementations that have seen significant benefits in terms of discoverability and governance of data in the data lake.

Learn All About Unity Catalog

In this series of blogs, Tredence will endeavor to explain its design and implementations aspects including migration to Unity Catalog that we’ve learned from the multitude of practical implementation at our joint client engagements.

We have divided this into 5 sections to help readers get an in-depth understanding of the topic and its best practices:

• What is Unity Catalog and why is it a game changer?
• Setting up Unity Catalog and object organization
• Understanding Databricks Cluster Types in Unity Catalog
• Data governance through Unity Catalog
• Effective Migration to Unity Catalog: A Guide

Stay tuned for the next chapter, where we unveil why Unity Catalog is a game changer.

AUTHOR - FOLLOW
Maulik Divakar Dixit
Director, Data Engineering, Databricks Champion