Popular repositories Loading

1. Azure_first_ADF Azure_first_ADF Public

   This repos store the ETL pipeline created in ADF.

2. Event-Driven-Data-Pipeline-in-dbx Event-Driven-Data-Pipeline-in-dbx Public

   Event-driven data pipeline built in Databricks — ingests multi-domain data (customers, orders, inventory, products, shipping), applies validation, enrichment, and performs final merge operations us…

   Jupyter Notebook

3. Travel_Booking_SCD2_Project Travel_Booking_SCD2_Project Public

   Production-grade parameterized ETL pipeline implementing SCD Type 2 for travel booking data using Databricks, Delta Lake, and ADLS — includes data quality checks, incremental fact table build, Z-Or…

   Jupyter Notebook

4. Healthcare_DLT_Pipeline_Project Healthcare_DLT_Pipeline_Project Public

   Healthcare data pipeline built using Databricks Delta Live Tables (DLT) — processes raw patient and clinical data through Bronze → Silver → Gold layers with automated data quality checks.

   Jupyter Notebook

5. UPI-Transactions-CDC-Data-Processing UPI-Transactions-CDC-Data-Processing Public

   UPI Transactions CDC pipeline simulating INSERT, UPDATE, DELETE operations using a mock script. Processes real-time data with Databricks Structured Streaming from a Delta table and performs merchan…