With over 5.7 years of experience in software development and data engineering, coupled with certifications in Databricks Data engineer in Associate and Professional, I bring a strong foundation in building scalable, efficient, and secure data solutions.
In my previous role as a Sr. Software Engineer at THexaware Technologies, I have designed and implemented end-to-end data pipelines using Azure Data Factory, Synapse Analytics, and Data bricks. By leveraging PySpark, I converted semi-structured JSON data into Parquet formats and perform Delta Lake with ACID Properties, built robust logging mechanisms, and implemented data masking to safeguard sensitive information. My efforts in creating modern data warehouses have supported critical decision-making processes and ensured compliance with data security standards.
Beyond my technical expertise, demonstrating my commitment to staying at the forefront of emerging technologies. I am also proficient in tools like Power BI, Tableau, and Python libraries, ensuring my ability to deliver actionable insights through effective data visualisation.
Cloud & Data Platforms: Azure Data Factory, Azure Databricks, Azure Data Lake (ADLS), Azure DevOps, Azure SQL Database, Blob Storage.
Programming & Data Processing: Python, PySpark, SQL, Delta Lake.
Data Engineering & BI: ETL/ELT, Data Transformation, Data Modelling, Data Integration, Data Quality, SCD Type 2, Incremental/Full Loading, Logging Frameworks, Unit Testing.
Best Practices: CI/CD, Data Governance, GDPR Compliance, Agile/Scrum Delivery.
Performance Optimization: Query Tuning, Parallel Processing, Data Partitioning.
Soft Skills: Problem-Solving, Communication, Interpersonal Skills, Independent Work.