Jesse Pepple Portfolio

In this project, I implemented Unity Catalog in Databricks  to establish secure, centralized data governance , ensuring controlled access and compliance across all datasets. The solution leveraged Delta Lake and Delta Tables  to provide scalable, reliable, and efficient storage , while the pipeline followed the Medallion Architecture (Bronze → Silver → Gold)  to maintain data quality, reliability, and usability  at every stage. The end-to-end workflow utilized Azure Data Fact

This project implemented Unity Catalog in Databricks to provide secure, centralized data governance, while leveraging Delta Lake and Delta Tables for scalable and efficient data storage. The data pipeline followed the Medallion Architecture (Bronze → Silver → Gold), ensuring data quality, reliability, and usability at every stage. The solution was built using Azure Data Factory, Azure SQL Database, Azure Data Lake Storage, and Azure Databricks, with Python and SQL as the prim