crawl web

Crawler is useful tool to get many information from web. There are a lots of library to do it. Today I tried Scrapy. Scrapy is a fast high-level screen scraping and web crawling framework. You can install by using pip. After installed, I made sample project at first. Then peng folder was made. Next, IContinue reading “crawl web”