Databricks Architecture

Architectural patterns for organising data on Databricks. Everything here currently sits under the medallion model — raw landing, cleaned, and business-ready layers.

Pages in this Section

• Medallion Architecture — Storing Data in the Bronze Layer Medallion Architecture Best Practices Maintain the data in its original format (e.g., JSON, Parquet, Excel) to…
• Bronze Layer - Medallion Architecture — Raw sources fan in through the ingestion engines and land as append-only Delta tables — never modified after write.
• Gold Layer: Medallion Architecture in Databricks — Gold tables fan out through purpose-built serving surfaces (materialized views, vector search, SQL endpoints, Delta Sharing) to multiple consumer…
• Medallion Architecture with Partitioning — Dataset containing three columns: category , order_id , and sales_amount . The dataset is grouped by the category column, and we perform aggregation…
• Silver Layer: The Conformed Data Foundation — The Silver layer is the cleansed, deduplicated, and conformed data tier of the Medallion Architecture. It sits as a critical bridge between the raw…

‹ Databricks