Web Scraping Details: I use a high-perfomance Java framework for crawling: 1. Fast and easy parsing html and xml files. Maximal speed was 4 millions pages per 24 hours (not for high-secure sites). 2. All downloaded pages can be saved to disk. Information can be re-collected using only local data (no need to re-download from website). 3. Program can be launched in any number of threads for up work and downloading speed. 4. Module for using proxy servers. 5. Internal database for control new found links uniqueness. What employer can get: 1. Extracted information stored in MySQL, Pos tgreSQL and others DB or csv/xml/xls files. 2. Images/audio/video stored in local directory. 3. Executable program uploaded to your server and cron settings for regular updating. 4. Other service - let me know what you need.