Banner Image

All Services

Programming & Development web development & design

Crawl Website(Scrapy)

$25/hr Starting at $1K

Hello, How are you?I am a senior Web crawling expert with 5+ years of experience. Most of my works related to the sport.

Let me explain my previous work here

https://dailyfantasynerd.com/

This platform provides you the best sports team lineup, so you can choose the best one according to your condition. This platform bases on crawling data from several sites such as fantasycruncher, awesemo and rotogrinders.

Technical flow to implement is like this

Scrapy -> scrapinghub => cloud mongo -> celery(standardize bot) -> postgresql

We deploy scrapy to scrapinghub and crawled data is saving to cloud mongoAdditionally, 

I have experience crawling data from eCommerce sites such as lazada.

For more detail, discuss over the interview.

Thanks

About

$25/hr Ongoing

Download Resume

Hello, How are you?I am a senior Web crawling expert with 5+ years of experience. Most of my works related to the sport.

Let me explain my previous work here

https://dailyfantasynerd.com/

This platform provides you the best sports team lineup, so you can choose the best one according to your condition. This platform bases on crawling data from several sites such as fantasycruncher, awesemo and rotogrinders.

Technical flow to implement is like this

Scrapy -> scrapinghub => cloud mongo -> celery(standardize bot) -> postgresql

We deploy scrapy to scrapinghub and crawled data is saving to cloud mongoAdditionally, 

I have experience crawling data from eCommerce sites such as lazada.

For more detail, discuss over the interview.

Thanks

Skills & Expertise

Client DevelopmentDatabase DevelopmentFramework DesignInformation TechnologyMongoDBPythonScrapy FrameworkWeb DevelopmentWeb Hosting

Related Work Collections

0 Reviews

This Freelancer has not received any feedback.