I design and build automated data pipelines that extract data from any source, transform it into a clean structured format, and load it into your target system — with minimal manual intervention.
My pipelines run on production-grade tools: Python for processing logic, Apache Airflow for scheduling and orchestration, AWS (Lambda, S3, SNS) for cloud execution, and PostgreSQL for structured storage. I've built and deployed end-to-end pipelines that run on triggers, schedules, and events — with error handling, logging, and alerting built in.
What I deliver:
- Automated ETL pipelines (Python + Airflow + AWS)
- AWS Lambda functions with S3 triggers and SNS alerts
- API integrations and JSON-to-structured-data transformations
- Scheduled data workflows with error handling and monitoring
- Migration of manual scripts to fully automated cloud pipelines
Past work includes migrating local Python scraping scripts to AWS Lambda with S3 event triggers, SNS email notifications, and IAM role configuration — reducing manual effort to zero.
If you have a repetitive data task that needs to run automatically and reliably, I'll build the pipeline that handles it.