下面的例子模擬登入知乎的個人設定頁面

設定代理池 scrapy + tor

#安裝tor
sudo apt-get install tor
sudo /etc/init.d/tor restart  #重啟服務
tor --hash-password mypassword  #生成hash密碼
sudo vim /etc/tor/torrc   #編輯加入如下內容
ControlPort 9051
HashedControlPassword
16:xxx   #xxx表示剛才生成的hash密碼
儲存退出
sudo /etc/init.d/tor restart  #重啟tor

class ZH(CrawlSpider)
 
:
    name = 'zhihu'
    allowed_domains = ['https://www.zhihu.com/']
    def start_requests(self):
        coo = {}
        cookie = {'你的cookie字串'}
        for seg in cookie.split(';'):
            key,value = seg.split('=',1)
            coo[key] = value
        return [scrapy.FormRequest('https://www.zhihu.com/settings/profile'
 
,cookies=coo,callback=self.parse)]
    def parse(self, response):
        print response.body  

補充一下：

#將unicode編碼轉化為utf-8
   str = unicode.encode(str,'utf-8')