• More then 5 years of experience in Scala, Spark, Machine learning and Big data eco system •Extensive Experience in designing, configuring, developing, monitoring, debugging and performance tuning of Dataware housing and BigData applications using Hadoop technologies. • Understanding requirement from Business Analyst/Onsite Counterparts and requirement specification documents. • Designing data pipeline and decide technologies to be used to implement business requirement. • Distribute work among team member and mentoring team member. • Have worked on different hadoop technologies like spark, pig, hive, MapReduce, sqoop etc. and distinct hadoop distribution Cloudera and Hortonworks • Strong working knowledge on spark streaming , spark sql and performance running • Very good understanding of Partitioning, Bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance. • Implement and enhance pig latin script. • Export and import data in HDFS using sqoop. • Automate data pipeline using shell script. • Have worked on different Java technologies like Struts, Hibernate and Servlets • Creation and enhancement of Java deliverables for ETL automation, Informatica Mappings, work flows and Sessions based on the analysis from the requirements. • Automated the creation of Informatica mappings Xmls through Java using powermart.dtd and XML parsing. • Have worked on JDBC connectivity • Explain the design to client and teach them how to use system • Educate the freshers to different big-data technology • Have worked from start to finish on development as well as enhancement of various project modules covering the whole life cycle from Initial Impact analysis, development, Unit Testing, pre and post deployment support. • Understanding the process management cycle and being compliant with the organizational policies and logging all the team efforts and defects during various phases of project in the organization portal which is then used for various analysis by the top management. • Excellent communication, interpersonal, analytical skills, and strong ability to perform as a part of team.