scrapy爬取校花網男神圖片儲存到本地
爬蟲四部曲,本人按自己的步驟來寫,可能有很多漏洞,望各位大神指點指點
1、建立專案
scrapy startproject xiaohuawang
scrapy.cfg: 專案的配置檔案xiaohuawang/: 該專案的python模組。之後您將在此加入程式碼。xiaohuawang/items.py: 專案中的item檔案.xiaohuawang/pipelines.py: 專案中的pipelines檔案.xiaohuawang/settings.py: 專案的設定檔案.
2、進入xiaohuawang目錄然建立爬蟲名及爬取範圍
cd xiaohuawang
scrapy genspider xhwang xiaohuar.com
3、建立爬取的專案(xiaohuawang/item.py)
4、編寫爬蟲
xiaohuawang/spider/xhwang.py: 爬蟲檔案
5、儲存資料(此處使用try...expect是為剔除完整的圖片url)
6、開啟資料儲存開關(setting.py)如果有第五步的儲存資料的必要,此處需要開啟
7、開始爬取之路
在終端鍵入scrapy crawl xhwang 本地目錄出現如下資料(擷取部分)校花還看得過去,這校草嘛除了李易峰其他都沒見過o(* ̄︶ ̄*)o
終端出現的介面
2018-10-15 09:52:25 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/7e191d68e7eb029b4c1da1a3808e5059.jpg HTTP/1.1" 200 535172018-10-15 09:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.comhttp:80jpg_url is error!!!2018-10-15 09:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.comhttp:80jpg_url is error!!!2018-10-15 09:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:26 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/63d5b955486e38d0fb664bcc9e8d96d6.jpg HTTP/1.1" 200 324792018-10-15 09:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:26 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20160109/1b82558a72a175802de1c041d7c60813.jpg HTTP/1.1" 200 7790462018-10-15 09:52:31 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:31 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20170608/f07501a9d1fe9945e2fb96f0890a8d23.jpg HTTP/1.1" 200 1134622018-10-15 09:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:32 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20151018/e03c74b0e1fe13caab5e138c8b013a00.jpg HTTP/1.1" 200 338692018-10-15 09:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:32 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/9c9e3de9965854e46404af656d86a596.jpg HTTP/1.1" 200 2124372018-10-15 09:52:34 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:35 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/180584665e90af45905e3ab2ab0bdb62.jpg HTTP/1.1" 200 328052018-10-15 09:52:35 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:35 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/f96fe78647d53691e5cb3d9f483d950e.jpg HTTP/1.1" 200 1613452018-10-15 09:52:37 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.comhttp:80jpg_url is error!!!2018-10-15 09:52:37 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:37 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/1b3b53eeae45059d3f46490d3eb45672.jpg HTTP/1.1" 200 712612018-10-15 09:52:37 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:38 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/8cb2bf048b0fdcbb8aabe6ca599eaa2b.jpg HTTP/1.1" 200 783712018-10-15 09:52:38 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:38 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/d02e95d32d1aed5fb46d5744ed5f9729.jpg HTTP/1.1" 200 147882018-10-15 09:52:38 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:38 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/65d5cfc0d5f54559c07073edf2421da7.jpg HTTP/1.1" 200 8365842018-10-15 09:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:43 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/901b797f3ed0c5e1c7e861496ebe1c2d.jpg HTTP/1.1" 200 758312018-10-15 09:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:43 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/3047a6706453b987c26f54beba3e32ae.jpg HTTP/1.1" 200 817772018-10-15 09:52:44 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:44 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20151003/9177cd57017a50783a94a4c700bae808.jpg HTTP/1.1" 200 1946012018-10-15 09:52:46 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:46 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/b332da0c2a45f5ec08add990255b0071.jpg HTTP/1.1" 200 319742018-10-15 09:52:46 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.comhttp:80jpg_url is error!!!2018-10-15 09:52:46 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.comhttp:80jpg_url is error!!!2018-10-15 09:52:46 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:47 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/0540ae30cfbdf80a8121d5d6e14e8b62.jpg HTTP/1.1" 200 802612018-10-15 09:52:48 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:48 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/7e9a5cf7fd86a4afd8da51afe24cf82d.jpg HTTP/1.1" 200 487602018-10-15 09:52:48 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:48 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/ef1f9ff054246626f7a3edbcaab11810.jpg HTTP/1.1" 200 854682018-10-15 09:52:49 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:49 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/67af1100e5a0ba7e0de35f06e6d3c5fe.jpg HTTP/1.1" 200 467502018-10-15 09:52:49 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:50 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/4e0406f4073c4120b6e93cb08eafaf76.jpg HTTP/1.1" 200 114292018-10-15 09:52:50 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:50 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20150915/f51d151afdd59c2f0b94ae5ebd9df2e5.jpg HTTP/1.1" 200 1874482018-10-15 09:52:51 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:51 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/974244ea878d9d58cdeb5e581ba00c2d.png HTTP/1.1" 200 517022018-10-15 09:52:51 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:52 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/4bbf1aebc9e0ff735539e47185f07d86.jpg HTTP/1.1" 200 558322018-10-15 09:52:52 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:52 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/79f175dd8866f8bd756d0d663b56f63f.jpg HTTP/1.1" 200 976442018-10-15 09:52:53 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:53 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20160128/edb010401a9314f51ba85dcef5628640.jpg HTTP/1.1" 200 515552018-10-15 09:52:53 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:53 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/38c8daefae96096777168b878ac12457.jpg HTTP/1.1" 200 489882018-10-15 09:52:54 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:54 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/f57c0b3d74190fcdf3496f29c495a9a8.jpg HTTP/1.1" 200 890192018-10-15 09:52:55 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:55 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20161209/b0629634f424d3fc92ccf5e3311cf26d.jpg HTTP/1.1" 200 2336792018-10-15 09:52:56 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:56 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/0d1c02b6d4eb2d49e06b85c920226e12.jpg HTTP/1.1" 200 352652018-10-15 09:52:56 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:57 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20150917/1ea043c66124620e7bef39abfeaa7309.jpg HTTP/1.1" 200 1023742018-10-15 09:52:59 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:52:59 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/ba9f9d31a9c1a74c0992fc53642351b4.jpg HTTP/1.1" 200 487602018-10-15 09:53:00 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:00 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/42d1ff3f5ee54c737a2a20691a51dd2e.jpg HTTP/1.1" 200 1173882018-10-15 09:53:01 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:01 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20151004/ff3c6b4a769142bcf07d36a38090e9ca.jpg HTTP/1.1" 200 2380262018-10-15 09:53:02 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:02 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/54859a36a815d4cc9e4bfd0fa226a801.jpg HTTP/1.1" 200 656102018-10-15 09:53:03 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:03 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20150829/61d547839957d38499af8a030f181bbc.jpg HTTP/1.1" 200 346602018-10-15 09:53:06 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:06 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20170210/8e6c33aec8013aee65eb677f64ead2ff.jpg HTTP/1.1" 200 1443762018-10-15 09:53:07 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:07 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/54da0d784895352c52c8de4c4724702b.jpg HTTP/1.1" 200 708232018-10-15 09:53:07 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:08 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20151229/f7235e51a566a9b25343a3a034f47291.jpg HTTP/1.1" 200 587632018-10-15 09:53:08 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:08 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/ed3640812048582f544140c1dc29c701.jpg HTTP/1.1" 200 694132018-10-15 09:53:10 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:10 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/72edbf7ff56c981b82effd1dd2a181ff.jpg HTTP/1.1" 200 1018172018-10-15 09:53:13 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:13 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/9aad0c431d4508d2924364532e5fb405.jpg HTTP/1.1" 200 775622018-10-15 09:53:14 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:14 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/6cc7ad88b47e1191cb112deed98a96cd.jpg HTTP/1.1" 200 214542018-10-15 09:53:14 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:14 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/0cb7df1d7ee292ddf6a7de7c9084e97c.jpg HTTP/1.1" 200 964862018-10-15 09:53:15 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:15 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20170221/a6e051fd0752d6ad3beca2014a1f620e.jpg HTTP/1.1" 200 317622018-10-15 09:53:15 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:16 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/895782554cccd62f3819c0f912d8afba.jpg HTTP/1.1" 200 602902018-10-15 09:53:16 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:16 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/1a645a5896cc1a2989c9778c0dcd3d4e.jpg HTTP/1.1" 200 363272018-10-15 09:53:17 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:17 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/c077e29c5f9b89eb404505567df17c0c.jpg HTTP/1.1" 200 200202018-10-15 09:53:17 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:17 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/f825758f36e1c2c346f4f8f957df5430.jpg HTTP/1.1" 200 395162018-10-15 09:53:17 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:17 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/782cccaab95f8bdbcd6937c67cbaa3b0.jpg HTTP/1.1" 200 3800762018-10-15 09:53:22 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:22 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/97f350f3e0fe65a8f7c768664e1eaca5.jpg HTTP/1.1" 200 4221402018-10-15 09:53:25 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:25 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/883ea459b664518f60d9ea6fd9f49f0d.jpg HTTP/1.1" 200 55452018-10-15 09:53:25 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:25 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/281fd6f85bf33ace9b99b02031cb2cb9.jpg HTTP/1.1" 200 554692018-10-15 09:53:26 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:26 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/46cfceb6eac4bd6d5ab051098f413bdf.jpg HTTP/1.1" 200 1327282018-10-15 09:53:27 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.comhttp:80jpg_url is error!!!2018-10-15 09:53:27 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:27 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/c62ebcca53796107aaad2fe5577cde44.jpg HTTP/1.1" 200 102732018-10-15 09:53:27 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.comhttp:80jpg_url is error!!!2018-10-15 09:53:27 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:27 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/2219bc2968708eb47ca47b618c96e003.jpg HTTP/1.1" 200 1288372018-10-15 09:53:28 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:28 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/50c4400bda96f2305fc74de79aea913b.jpg HTTP/1.1" 200 425742018-10-15 09:53:29 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:29 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/cfdffb8e41273fbc287293bd2d0a3e59.jpg HTTP/1.1" 200 404722018-10-15 09:53:30 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:30 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20150905/ffa892119baef28dadfcadc3b7abd50a.jpg HTTP/1.1" 200 1282712018-10-15 09:53:31 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:31 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20170331/5164f1dc347b2cd5d6b57088d2614c4d.jpg HTTP/1.1" 200 301212018-10-15 09:53:31 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:31 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/299823f15c021ede81f844b30b8d543a.jpg HTTP/1.1" 200 765652018-10-15 09:53:32 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:32 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/bf464364888cfecaf95b0a2a9e3407bf.png HTTP/1.1" 200 3050392018-10-15 09:53:36 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:36 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/a9843ed50a56e020ed78e40a348bcb5c.jpg HTTP/1.1" 200 873372018-10-15 09:53:37 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:37 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/f9fe702b5e01210af5afd970e8499090.jpg HTTP/1.1" 200 1079422018-10-15 09:53:38 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:38 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/d3e3d2526686463b4a1406e039388ca6.jpg HTTP/1.1" 200 584792018-10-15 09:53:38 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:38 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/1e29bc94ee7ebde0ae50bc2b5bd112c9.jpg HTTP/1.1" 200 669402018-10-15 09:53:40 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:40 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/db4d5e02fdea2e910ee35eb6b4979a99.jpg HTTP/1.1" 200 77162018-10-15 09:53:40 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:41 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/afaf7502ffca5a0bb052eddba8195509.jpg HTTP/1.1" 200 470452018-10-15 09:53:41 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:41 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/90d63585d7230a48ddd9516dbf0dd6ab.jpg HTTP/1.1" 200 749442018-10-15 09:53:42 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:43 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/689fa17c65c8d0f049521383d43a4ab2.jpg HTTP/1.1" 200 497142018-10-15 09:53:43 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:43 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20151217/b5108ea8a7a4920b2d7bf6e27c0b1101.jpg HTTP/1.1" 200 1118502018-10-15 09:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:44 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/e81bf99a232cdeee60dc65418a8c2602.png HTTP/1.1" 200 462372018-10-15 09:53:45 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:53:45 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/04c92ce23ee91e9cd857955e4a60b46d.jpg HTTP/1.1" 200 9940182018-10-15 09:54:00 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:00 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/9a3315019ae4b15e84e18770f91e7f28.jpg HTTP/1.1" 200 991682018-10-15 09:54:02 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:02 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/2d64c4f98c23b4177ee1ae9725354ea4.jpg HTTP/1.1" 200 2587232018-10-15 09:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:07 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/0ec2c52c6954837c2b588bb61e7e2e15.jpg HTTP/1.1" 200 471232018-10-15 09:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:07 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20160220/b1e09b5d13c74f444806086a1a8aedbe.jpg HTTP/1.1" 200 334382018-10-15 09:54:08 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:11 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/6854f7987613ceac3a21049efa2f7047.jpg HTTP/1.1" 200 455452018-10-15 09:54:14 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:14 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/873316b54c2bc3bcc3573971fda73286.png HTTP/1.1" 200 369812018-10-15 09:54:14 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:14 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/117e999a87ef237115071d64b692b134.jpg HTTP/1.1" 200 2861442018-10-15 09:54:16 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:16 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/24191b9f48d9f0ee58baf69e13a18c78.jpg HTTP/1.1" 200 7041822018-10-15 09:54:21 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:21 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/2568b473a4a93b0be1366800d9194799.jpg HTTP/1.1" 200 407402018-10-15 09:54:21 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:21 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/0a83bccd885cba88a11eb93c5f789035.jpg HTTP/1.1" 200 1028352018-10-15 09:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:23 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/a55cc2a57a2af7fad3477d799215ad05.jpg HTTP/1.1" 200 637262018-10-15 09:54:23 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:24 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/cd38314fd9c336afe56ef8d61cb8416d.jpg HTTP/1.1" 200 538092018-10-15 09:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:24 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/c0a77ff668ed2bb6292ec81a4c4105c7.jpg HTTP/1.1" 200 492872018-10-15 09:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:25 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/2bb8f36b6f540360d081ea17dad0d1c6.jpg HTTP/1.1" 200 599972018-10-15 09:54:25 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:25 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/20151213/e6f03eb1bb25208f230338ee76963d73.jpg HTTP/1.1" 200 1268162018-10-15 09:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:28 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/c6bfce8e88fbeeb0ec94ed740ea02657.jpg HTTP/1.1" 200 251902018-10-15 09:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:29 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/9732937ef6b527bc9374bec637f209b4.jpg HTTP/1.1" 200 998942018-10-15 09:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): www.xiaohuar.com:802018-10-15 09:54:32 [urllib3.connectionpool] DEBUG: http://www.xiaohuar.com:80 "GET /d/file/e0f286f6c4a83c5458c99e98d692a383.png HTTP/1.1" 200 462372018-10-15 09:54:33 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.xiaohuar.com/xiaocao/>{'name': ['大連海事大學校草牟福鵬', '廣西農業職業技術學院校草王超樹', '四川師範大學校草李易峰', '南開中學校草王源', '重慶八中校草王俊凱', '清華大學校草林時完', '北京市海淀外國語實驗學校校草鹿晗', '北京師範大學珠海分校校草吳凡', '湖南重點中學湖南師大附中校草易烊千璽', '中國文化大學校草柯震東', '清華大學校草劉睿睿', '北京大學校草苑子文苑子豪', '清華大學校草李潤東', '遼寧石油化工大學順華能源學院校草李佩凡', '新疆警官高等專科學校校草楊晨', '浙江大學校草王平', '雲南國土資源學院校草李莘瞳', '吉林大學校草夏昕濛', '中國人民大學校草龍馬', '湖南師範附中梅溪湖中學校草易烊千璽', '華中科技大學校草楊逸韜', '四川師範大學校草潘子劍', '四川警察學院校草孟祥鑫', '大連理工校草儀炎彬', '深圳大學校草甘東柏', '中國民航飛行學院校草木拉丁', '西南大學校草溫浩', '蘭州交通大學校草柴鐸', '北京現代音樂學院校草陳沫燃', '長沙理工大學城南學院校草黃庭帥', '福建師範大學校草李晨希', '中南民族大學校草李春天', '清華大學校草孟湛東', '浙江警察學院校草張超賀', '杭州師範大學校草俊傑', '白城師範學院校草襲新', '江蘇省司法警官高等職業學校校草魏一川', '集美大學校草廖家漢', '華中師範大學校草鄒祖樊', '中國美院校草鳳飛飛', '山東服裝職業學院校草徐義強', '江西南昌安義二中校草校草黃凡斌', '上海杉達學院校草沈禕瑋', '哈密石油高階中學校草王競', '遼寧水利學院校草小馬', '廣西貴港屌絲中學校草蘇澤辰', '華南師範大學校草沈斌', '河南理工校草範博', '寒校草秋', '西南財經大學天府學院校草周月笙', '南昌大學校草鄧文才', '啊實打實的校草阿薩德', '北京師範大學校草秋寒', '鐵嶺市外事學院校草董立鵬', '四川帥哥校草劉亦晨', '長春汽車工業高等專科學校校草史培元', '南昌航空大學校草郭美城', '雲南警官學院校草李慶?', '安徽財經大學校草查道傑', '四川師範大學校草劉亦晨', '贛南師範學院校草王思豪', '福建師範大學校草李毅剛', '北京電影學院校草巴宇嘉', '西南政法大學校草董浩洋', '安徽大學校草張峰', '廊坊東方大學城河北體育學院校草馮政', '珠海大學校草蔡璇', '江南高中校草樸朗', '重慶南開中學高中部校草王源', '長春工程學院校草邸平濤', '北京八維大學校草李超', '玉溪校草楊玉金', '上海師範大學天華學院校草沈辛嶧', '校草校草白天明', '技師學院校草劉家森', '泉州二中校草安然', '專門磕藥大學校草丁三圓', '哈爾濱工業大學威海校區校草孫嘉良', '泰山學院校草甄文忠', '江漢大學校草曹文星', '長沙理工大學城南學院校草朱澤賢', '石家莊大學校草趙雲龍', '河南建築職業技術學院校草杜健康', '西南大學校草王壯', '復旦校草胡瑞傑', '臨汾一中校草李江灜', '清華校草詹凱', '長沙理工大學城南學院校草毛創', '東鄉一中校草周凱波', '鄱陽一中校草黃清', '西南政法大學校草李帆', '上杭職專校草曹永強', '電子科技大學校草楊星', '海南校草符是雄', '曲阜遠東職業技術學院校草王帥', '西南交通大學校草路超', '淮北師範大學校草劉家威', '河北政法學院校草柏宇', '鄱陽一中校草盧政輝', '長沙理工大學城南學院校草朱澤賢'], 'url': ['/d/file/20150909/c76fa0a8c4d63f749fa3a6883bbdd4a8.jpg', '/d/file/20161015/75541204516ea9e2118248fb374f706a.jpg', '/d/file/7e191d68e7eb029b4c1da1a3808e5059.jpg', 'http://www.xiaohuar.com/d/file/20150512105953141.jpg', 'http://www.xiaohuar.com/d/file/20150813180033144.jpg', '/d/file/63d5b955486e38d0fb664bcc9e8d96d6.jpg', '/d/file/20160109/1b82558a72a175802de1c041d7c60813.jpg', '/d/file/20170608/f07501a9d1fe9945e2fb96f0890a8d23.jpg', '/d/file/20151018/e03c74b0e1fe13caab5e138c8b013a00.jpg', '/d/file/9c9e3de9965854e46404af656d86a596.jpg', '/d/file/180584665e90af45905e3ab2ab0bdb62.jpg', '/d/file/f96fe78647d53691e5cb3d9f483d950e.jpg', 'http://www.xiaohuar.com/d/file/20140810073313127.jpg', '/d/file/1b3b53eeae45059d3f46490d3eb45672.jpg', '/d/file/8cb2bf048b0fdcbb8aabe6ca599eaa2b.jpg', '/d/file/d02e95d32d1aed5fb46d5744ed5f9729.jpg', '/d/file/65d5cfc0d5f54559c07073edf2421da7.jpg', '/d/file/901b797f3ed0c5e1c7e861496ebe1c2d.jpg', '/d/file/3047a6706453b987c26f54beba3e32ae.jpg', '/d/file/20151003/9177cd57017a50783a94a4c700bae808.jpg', '/d/file/b332da0c2a45f5ec08add990255b0071.jpg', 'http://www.xiaohuar.com/d/file/20150221160551154.jpg', 'http://www.xiaohuar.com/d/file/20150212230330155.jpg', '/d/file/0540ae30cfbdf80a8121d5d6e14e8b62.jpg', '/d/file/7e9a5cf7fd86a4afd8da51afe24cf82d.jpg', '/d/file/ef1f9ff054246626f7a3edbcaab11810.jpg', '/d/file/67af1100e5a0ba7e0de35f06e6d3c5fe.jpg', '/d/file/4e0406f4073c4120b6e93cb08eafaf76.jpg', '/d/file/20150915/f51d151afdd59c2f0b94ae5ebd9df2e5.jpg', '/d/file/974244ea878d9d58cdeb5e581ba00c2d.png', '/d/file/4bbf1aebc9e0ff735539e47185f07d86.jpg', '/d/file/79f175dd8866f8bd756d0d663b56f63f.jpg', '/d/file/20160128/edb010401a9314f51ba85dcef5628640.jpg', '/d/file/38c8daefae96096777168b878ac12457.jpg', '/d/file/f57c0b3d74190fcdf3496f29c495a9a8.jpg', '/d/file/20161209/b0629634f424d3fc92ccf5e3311cf26d.jpg', '/d/file/0d1c02b6d4eb2d49e06b85c920226e12.jpg', '/d/file/20150917/1ea043c66124620e7bef39abfeaa7309.jpg', '/d/file/ba9f9d31a9c1a74c0992fc53642351b4.jpg', '/d/file/42d1ff3f5ee54c737a2a20691a51dd2e.jpg', '/d/file/20151004/ff3c6b4a769142bcf07d36a38090e9ca.jpg', '/d/file/54859a36a815d4cc9e4bfd0fa226a801.jpg', '/d/file/20150829/61d547839957d38499af8a030f181bbc.jpg', '/d/file/20170210/8e6c33aec8013aee65eb677f64ead2ff.jpg', '/d/file/54da0d784895352c52c8de4c4724702b.jpg', '/d/file/20151229/f7235e51a566a9b25343a3a034f47291.jpg', '/d/file/ed3640812048582f544140c1dc29c701.jpg', '/d/file/72edbf7ff56c981b82effd1dd2a181ff.jpg', '/d/file/9aad0c431d4508d2924364532e5fb405.jpg', '/d/file/6cc7ad88b47e1191cb112deed98a96cd.jpg', '/d/file/0cb7df1d7ee292ddf6a7de7c9084e97c.jpg', '/d/file/20170221/a6e051fd0752d6ad3beca2014a1f620e.jpg', '/d/file/895782554cccd62f3819c0f912d8afba.jpg', '/d/file/1a645a5896cc1a2989c9778c0dcd3d4e.jpg', '/d/file/c077e29c5f9b89eb404505567df17c0c.jpg', '/d/file/f825758f36e1c2c346f4f8f957df5430.jpg', '/d/file/782cccaab95f8bdbcd6937c67cbaa3b0.jpg', '/d/file/97f350f3e0fe65a8f7c768664e1eaca5.jpg', '/d/file/883ea459b664518f60d9ea6fd9f49f0d.jpg', '/d/file/281fd6f85bf33ace9b99b02031cb2cb9.jpg', '/d/file/46cfceb6eac4bd6d5ab051098f413bdf.jpg', 'http://www.xiaohuar.com/d/file/20150221155450109.jpg', '/d/file/c62ebcca53796107aaad2fe5577cde44.jpg', 'http://www.xiaohuar.com/d/file/20150505170150104.jpg', '/d/file/2219bc2968708eb47ca47b618c96e003.jpg', '/d/file/50c4400bda96f2305fc74de79aea913b.jpg', '/d/file/cfdffb8e41273fbc287293bd2d0a3e59.jpg', '/d/file/20150905/ffa892119baef28dadfcadc3b7abd50a.jpg', '/d/file/20170331/5164f1dc347b2cd5d6b57088d2614c4d.jpg', '/d/file/299823f15c021ede81f844b30b8d543a.jpg', '/d/file/bf464364888cfecaf95b0a2a9e3407bf.png', '/d/file/a9843ed50a56e020ed78e40a348bcb5c.jpg', '/d/file/f9fe702b5e01210af5afd970e8499090.jpg', '/d/file/d3e3d2526686463b4a1406e039388ca6.jpg', '/d/file/1e29bc94ee7ebde0ae50bc2b5bd112c9.jpg', '/d/file/db4d5e02fdea2e910ee35eb6b4979a99.jpg', '/d/file/afaf7502ffca5a0bb052eddba8195509.jpg', '/d/file/90d63585d7230a48ddd9516dbf0dd6ab.jpg', '/d/file/689fa17c65c8d0f049521383d43a4ab2.jpg', '/d/file/20151217/b5108ea8a7a4920b2d7bf6e27c0b1101.jpg', '/d/file/e81bf99a232cdeee60dc65418a8c2602.png', '/d/file/04c92ce23ee91e9cd857955e4a60b46d.jpg', '/d/file/9a3315019ae4b15e84e18770f91e7f28.jpg', '/d/file/2d64c4f98c23b4177ee1ae9725354ea4.jpg', '/d/file/0ec2c52c6954837c2b588bb61e7e2e15.jpg', '/d/file/20160220/b1e09b5d13c74f444806086a1a8aedbe.jpg', '/d/file/6854f7987613ceac3a21049efa2f7047.jpg', '/d/file/873316b54c2bc3bcc3573971fda73286.png', '/d/file/117e999a87ef237115071d64b692b134.jpg', '/d/file/24191b9f48d9f0ee58baf69e13a18c78.jpg', '/d/file/2568b473a4a93b0be1366800d9194799.jpg', '/d/file/0a83bccd885cba88a11eb93c5f789035.jpg', '/d/file/a55cc2a57a2af7fad3477d799215ad05.jpg', '/d/file/cd38314fd9c336afe56ef8d61cb8416d.jpg', '/d/file/c0a77ff668ed2bb6292ec81a4c4105c7.jpg', '/d/file/2bb8f36b6f540360d081ea17dad0d1c6.jpg', '/d/file/20151213/e6f03eb1bb25208f230338ee76963d73.jpg', '/d/file/c6bfce8e88fbeeb0ec94ed740ea02657.jpg', '/d/file/9732937ef6b527bc9374bec637f209b4.jpg', '/d/file/e0f286f6c4a83c5458c99e98d692a383.png']}
研究善未成功,學習仍將深入