Banner Image

All Services

Programming & Development Programming & Software

Data Engineer

$10/hr Starting at $30

  • Certified Data Engineer Associate with 4+ years of experience designing scalable data pipelines using Azure Synapse, Data Factory, and Delta Lake. Proven track record in transforming enterprise data from SAP and SharePoint. 
  • Designed and implemented ETL pipelines in synapse (Python, PySpark, Spark SQL) and Azure Data Factory to efficiently ingest and transform data from SAP sources into a Data Lake table, improving data refresh speed by 40%. 
  • Automated data movement from ADLS landing to raw containers using ADF, reducing manual effort by 80%.
  •  Enabled real-time reporting by integrating Delta Lake with Power BI, enhancing decision-making efficiency.  
  • Attending regular stand-up meetings (Planning, daily stand-up, retrospective). working according to Sprint planning. 
  • Monitoring the pipeline using KQL (Kusto Query Language) query.
  • Retail data migration to Azure Synapse from sources like CSV, TXT, Oracle Database, and SQL Database, using a medalean architecture

About

$10/hr Ongoing

Download Resume

  • Certified Data Engineer Associate with 4+ years of experience designing scalable data pipelines using Azure Synapse, Data Factory, and Delta Lake. Proven track record in transforming enterprise data from SAP and SharePoint. 
  • Designed and implemented ETL pipelines in synapse (Python, PySpark, Spark SQL) and Azure Data Factory to efficiently ingest and transform data from SAP sources into a Data Lake table, improving data refresh speed by 40%. 
  • Automated data movement from ADLS landing to raw containers using ADF, reducing manual effort by 80%.
  •  Enabled real-time reporting by integrating Delta Lake with Power BI, enhancing decision-making efficiency.  
  • Attending regular stand-up meetings (Planning, daily stand-up, retrospective). working according to Sprint planning. 
  • Monitoring the pipeline using KQL (Kusto Query Language) query.
  • Retail data migration to Azure Synapse from sources like CSV, TXT, Oracle Database, and SQL Database, using a medalean architecture

Skills & Expertise

Data EngineeringMicrosoft AzurePythonSQLVersion Control

0 Reviews

This Freelancer has not received any feedback.