Experienced Data Engineer/SQL Developer. Data pipelines using tools like SSIS, Python. Databases - Sql Server, MySQL, Postgres, Hadoop, Google Big Query, Spanner, others.
Some projects over the years are:
Project: Import xml data from API. Store in MS Sql Server. Develop Reporting
- Used python to import the xml and store resulting in data MS Sql Server
- Used store procedures to run and email out requested reports
Project: Import data from API into new MySql server. Set up tables/queries for export to ERP system.
- Used java to import and store resulting data in MySql
- Developed several tables and queries to merge data into requested schemas
- Used cron jobs to execute java and mysql queries at certain time intervals
Project: One time transfer of data from MS Sql Server to Google Big Query
- Used python to download and translate data from MS Sql Server and then pushed to Google Big Query.