UyghurWebsiteCrawler

simple crawler for some uyghur website such as uy.ts.cn,bbs.bagdax.cn,www.bagdax.cn(using python and scrapy)

Preparations:

Python and Scrapy is needed.

Before run this code , please read the Scrapy Docs: http://scrapy.org/

Run

To run the code open the Terminal and run the commond some like below(where xxx is your scrapy spider name ):

scrapy crawl xxxx