End-to-end SaaS subscription data platform using AWS, Databricks (Delta Lake), and Snowflake featuring streaming ingestion, CDC/SCD modeling, medallion architecture, and Iceberg-based analytics.

Indian Data Club : Databricks 14-Days Challenge-2 is designed to help beginners build a strong foundation in Databricks through daily learning, hands-on practice, and problem solving.

End-to-End GitHub Streaming Data Pipeline using Databricks, Auto Loader, Delta Lake, Unity Catalog, and Medallion Architecture.

Loading files into delta table warehouse

A LINQ query layer for ParquetSharp that can read entire Parquet datasets — not just single files. Supports Delta Lake tables, Hive partitions, predicate pushdown, and efficient column projection for high-performance .NET data processing.

Real-time IoT Machine Health Analytics pipeline built with Databricks Medallion Architecture (Bronze, Silver, Gold). Includes data ingestion, cleaning, data quality checks, time-series anomaly detection, and dashboarding using PySpark, Delta Lake, and Databricks Workflows.

Unity-Glue-Reverse-Sync is a proof-of-concept Open Lakehouse Data Federation pipeline. It demonstrates how to achieve a "single copy of data" architecture by writing Delta Lake tables into Unity Catalog (OSS) and seamlessly exposing those exact same Parquet data files to the AWS ecosystem (AWS Glue / Athena) as first-class Apache Iceberg tables.

A concise handbook covering Databricks architecture, Delta Lake, Unity Catalog, and data engineering best practices for building scalable and production-ready data pipelines.

Source code for the python package: delta-hybrid-scd