Web Scraping & Web Automation with a systematic approach with tools selenium, Splash, with Scrapy one can develop the most efficient scripts to crawl the web with spider and get all the information you need in the fastest way possible and with fewer efforts. the best thing about it is all the information scraped can be made available in various format such as CSV, SQL, MongoDB and more ways which allow you to easily process the data further