Have 6 years experience with Scraping using Python Scrapy Framework, Selenium and BeautifulSoup. I have developed lots of spiders for extracting the data from the websites and made them output as CSV, JSON and Excel SpreadSheet. And also I have stored in database such as MySQL, PostgreSQL and so on. Especially, I have crawled the websites such as target, amazon, walmart and etc. In addition to, I have solved captcha issue, bot detection, ip blocking, response header proven issue and familiar to javascript response and request. I have implemented daily crawling so when the site is updated then the scraped data is updated automatically. And I have implemented spider via cron job and managed the job on queueing job. In addition to, I have good experience with amazon s3 bucket, ec2, route 53.