My role was a big data developer who mainly deals with a spark, Kafka and Flink, Hive, Hadoop.
I am also working on algorithms for Machine learning with streaming data.
I have more than one year experience as a Big Data Developer in a startup. I worked on Spark for transferring the large and continues dataset into Azure as well as Elasticsearch and kibana for visualization purpose.
For Data injection I have used Apache Nifi.Apache NiFi supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic.
I have connected nifi with different databases(MySQL, Azure Storage), restapi, WebSocket, Email, Azure cloud.i have created Nifi custom processors for transformation.
For Data Messaging I am using Apache Kafka.For each and every tenant I am creating one topic and messaging a stream data.
I used java as well as python in my one year experience.
Area of interest:-
Specialities: Java, Python, C#
Cloud: Azure
Apache tools:- Spark, Kafka, Hive,flink
Data Injection:- Apache nifi
BI tools:- Elasticsearch, KIbana, kibi, MapD
Reactive programming: Rx.Net, RxJava, RxJs
Functional programming : Scala,Java8
Computing Library: Apache Maths
I am enthusiastic about Machine learning and Data Analytics.