Banner Image

Skills

  • Python
  • Web Scraping
  • Amazon EC2
  • Amazon Web Services
  • Apache Hadoop
  • Apache Scala
  • API Development
  • App & Mobile Development
  • Back End Development
  • Django
  • FCM
  • JSON
  • Microsoft SQL Server
  • MySQL
  • PostgreSQL

Sign up or Log in to see more.

Services

  • Web Scraping

    $15/hr Starting at $25 Ongoing

    Dedicated Resource

    We have the experience to scrap or crawl the data over web on categories like: 1 Real estate 2 Retail 3E-commerce 4Hospitality 5Price comparison data 6yellow pages.com 7just dial 8Aviation. Real...

    MySQLPythonScrapy FrameworkSQLWeb Scraping

  • Backend Development

    $25/hr Starting at $100 Ongoing

    Dedicated Resource

    I have 6+ years of experience in writing and developing server side logic along with 3+ years of experience in Developing ETL pipelines using Scala, Spark, PySpark and hadoop. Experience of writing scalable...

    Amazon EC2Amazon Web ServicesApache HadoopApache ScalaAPI Development

About

Backend Developer with ETL and scraping experince

I am a Technical Lead for the Backend Development. and I have a 6+ years of experience in writing and developing server side logic along with 3+ years of experience in Developing ETL pipelines using Scala, Spark, PySpark and hadoop. Experience of writing scalable and robust API's in Python/Django along with ETL loads.

I have en experience to develop and lead teams for different domain products like Media, Food, Healthcare, Sports, Finance.

I have worked on following libraries or tools for my different projects so far.

1 AWS server setup with S3 bucket and email setup and Digital Ocean server setup.
2 NGINX
3 DJANGO CHANNELS FOR SOCKET PROGRAMMING
4 ELASTIC SEARCH
6 CELERY
5 DJANGO-REDIS-CACHE
6 OAUTH2
7 FCM PUSH NOTIFICATIONS
8 SOCIAL MEDIA API'S and 3rd Party API integrations
9 HAVE IMPLEMENTED MANY PAYMENT GATEWAYS LIKE TPAGA, PAYPAL, CC AVENUE
10 POSTGRESQL
11 Versioning Control -GIT,BITBUCKET
12 Media Streaming Services (RTMP and FFMPEG)
13 Spark
14 Hadoop
15 Hive

Work Terms

I can work with any Timing standards
$25/hr

Attachments (Click to Preview)