I am Big data engineer with 6 years of experience.I worked on the big data technology stack and data pipeline implementation. I worked on the spark , Hadoop ,Hbase ,Hive ,Kafka ,MapR Cloudera. I worked on the projects where it started from the scratch and implemented it.Worked on the different file formats for the data ingestion and the live streaming data. I worked on the data processing engine Apache spark/spark streaming. Business logic implementation on the Data-sets and Data-frames. I have good understanding of the optimization at different level in the spark such as memory optz,query optz. I work on the Hbase as data persistence and handled the live data into it. I am good coder and the good learner. I can work on the Big data project at any level and implement the business analytics on the data part.