What are some of the best web data scraping tools?

What are the best tools (free/paid) to scrape large amounts of data from webpages and store it in required formats?  The tool preferably should be automated to look for new data at specific intervals. Answer here.