Data Engineer passionate about building scalable data platforms and end-to-end data pipelines.

💡 Data Engineer with 2+ years of experience designing cloud-native data pipelines and scalable data platforms.
👨‍💻 I specialize in building high-performance ETL/ELT workflows using PySpark and SQL within the Azure ecosystem.
🧠 Strong focus on problem-solving (DSA in Python) and system design for scalable systems.

• ⚡ Built scalable ETL pipelines using PySpark & Azure Databricks
• 🔁 Designed incremental data pipelines with schema enforcement
• 🏗️ Implemented Medallion Architecture (Bronze → Silver → Gold)
• 📊 Worked on large-scale distributed data processing and performance optimization
• 🧠 Regularly solving DSA problems on LeetCode using Python

PySpark • SQL • Apache Spark • Delta Lake

Azure Databricks • Azure Data Factory • ADLS / Blob Storage

Medallion Architecture • ETL / ELT Pipelines • Lakehouse

Git & GitHub • Databricks Workflows • Jupyter Notebooks

• 🚀 End-to-End Azure Data Engineering Projects
• 🔄 Real-world ETL pipeline implementations
• ⚡ Databricks + PySpark use cases
• 🏗️ Lakehouse architecture implementations
• 📊 Data modeling & transformation workflows
• 🧠 Data Structure Implementations Daily LeetCode solutions in Python covering DSA patterns

• 🏭 Building production-grade data pipelines
• ⚡ Exploring real-time data processing
• 📊 Improving performance & scalability
• 🏗️ Designing modern lakehouse architectures
• 🧠 Learning System Design (scalability, distributed systems)

• Databricks Certified Data Engineer Associate
• Infosys Certified Databricks Analyst
• Infosys Certified PySpark Professional
• Infosys Certified Cloud Beginner
• Infosys Certified Python Associate

Email: kshagun02@gmail.com
Linkedin: https://www.linkedin.com/in/shagun-khandelwal-96a94620a/
Skype: https://join.skype.com/invite/yfGOtrpFQKyd

📝 You can also find my blogs on:- https://medium.com/@kshagun02