Cloud Data Engineer | ETL Pipelines, Databricks, AWS/GCP Solutions
I am a data engineer with 3+ years of experience building scalable, secure, and high-performance data systems across AWS, Google Cloud, Azure, and Databricks. I specialize in designing end-to-end ETL pipelines, implementing data lakes & warehouses, and transforming raw data into clean, analytics-ready datasets for business insights.
Over the years, I have worked on diverse enterprise projects in telecom, retail, and finance, delivering data pipelines that handle 2 TB/day with 99.9% uptime and accuracy. I am highly skilled in Python, PySpark, SQL, Apache Spark, Delta Lake, Hadoop, and modern orchestration tools, including Airflow, Cloud Composer, Step Functions, Dataform, and Databricks Workflows.
My expertise includes:
• Cloud ETL & real-time pipelines (AWS Glue, Kafka, Dataflow, Pub/Sub)
• Databricks development (Delta Lake, ACID transactions, schema enforcement)
• BigQuery, Redshift, Snowflake, and scalable warehousing
• Data governance, quality checks, lineage, and SCD Type 2
• CI/CD automation with GitLab, GitHub, Azure DevOps, Jenkins
• Performance tuning, validation frameworks & monitoring (CloudWatch, Databricks Observability)
I have successfully executed multiple migration projects, including converting legacy Hadoop workloads into optimized Databricks pipelines, migrating enterprise data to GCP, and building financial data lakes on AWS.
Clients appreciate my clear communication, structured approach, documentation quality, and ability to quickly understand business logic. Whether you need a new pipeline, cloud migration, data modelling, validation frameworks, or a fully automated data platform, I can deliver reliable, production-grade solutions with end-to-end ownership.
I am committed to delivering work that is scalable, cost-efficient, and aligned with your business goals — with full support and collaboration throughout the project.
Work Terms
Working Hours:
Available 9 AM – 7 PM IST (flexible for international clients).
Communication:
I provide updates via Freelancer chat, Zoom/Google Meet calls, and daily/weekly status reports depending on project needs.
Project Approach:
• Requirements gathering
• Architecture design
• Development & testing
• Documentation
• Deployment & handover
• Post-delivery support (if needed)
Payment Terms:
• Hourly or fixed-price projects
• Milestone-based payments
• Transparent and honest communication throughout
Delivery Guarantee:
I ensure clean code, optimized pipelines, detailed documentation, and on-time delivery for every project.