crawler Python crawler
Download

crawler Ranking & Summary

crawler Tags

Python library Python library crawler Python crawler

crawler Description

Python crawler crawler is a Python crawler spider.Example Code:from crawler.crawler import Crawlermycrawler = Crawler()seeds = # list of urlmycrawler.add_seeds(seeds)url_patterns = # list of regular expression for urls that crawler will work on.mycrawler.start(url_patterns) # start crawlingUbuntu installation howto:apt-get install python-lxmlapt-get install python-bsddb3Install python-crawler:python setup.py install Requirements: · Python

crawler Related Software