ABOUT ME I'm a full-time web scraping expert, since 2008. Websites I scraped include many anti-bot ones like Google, Manta.com, Linkedin, Twitter. Most of the times, I produce correct results at the first place so no revision required, no wasting time. WhAT TOOL DO I USE FOR SCRAPING WORKS? I love Python as the language, but hate Scrapy as the framework because it's not simple enough. So came up with my own one, scrapex, to ensure of efficiency and flexibility: WHAT TYPICAL JOBS I CAN DO FOR YOU? - scrape a given website/directory and extract the desired dataset into csv, excel, sql, json, etc. The dataset could be potential leads, products/images, real estate properties,... - scrape e-commerce products from one site and import into your own platform. - create a custom web scraping tool to use in demand. - create scripts to keep your database updated daily with newly-added items, or existing items' changes. - parse unstructured text/pdf/image data into structured dataset.