Hi there! I am an experienced big data engineer and architect. I have industry knowledge of building large and scalable data pipelines on cloud (preferable on AWS but not limited to).
I may help you with:
- Building robust scalable big data pipelines using spark.
- Building ingestion layer for downstream processes.
- Building data lake from scratch.
- Building delta lake.
- Building data warehouses on cloud.