Have 6 years experience with Scraping using Python Scrapy Framework, Selenium and BeautifulSoup.
I have developed lots of spiders for extracting the data from the websites and made them output as CSV, JSON and Excel SpreadSheet. And also I have stored in database such as MySQL, PostgreSQL and so on.
Especially, I have crawled the websites such as target, amazon, walmart and etc.
I have implemented daily crawling so when the site is updated then the scraped data is updated automatically.
And I have implemented spider via cron job and managed the job on queueing job.
In addition to, I have good experience with amazon s3 bucket, ec2, route 53.
4 Reviews For This Service