1. 程式人生 > >解決python3 requests中urlretrieve 403forbidden

解決python3 requests中urlretrieve 403forbidden

在用requests庫中的urllib.request.urlretrieve(urlcode,folder_path+'test.jpg')去下載圖片的是否會報出403 forbidden的訪問禁止

res=requests.get(item)
    with open(folder_path+item[-10:],'wb') as f:
        f.write(res.content)

通過以上方法便可實現下載,其中item表示圖片的連結,folder_path表示本地路徑
以下為完成的用python3實現爬蟲圖片的程式碼

import  requests
from bs4 import  BeautifulSoup
import urllib.request

url='http://jandan.net/pic/page-7707'
header = {'User-Agent':'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:23.0) Gecko/20100101 Firefox/23.0'} # header={'User-Agent':'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36'} source_code=requests.get(url,headers=header) plain_text=source_code.text
download_links=[] Soup=BeautifulSoup(plain_text) folder_path="/Users/chenmeiji/Desktop/a3/" for pic_tag in Soup.find_all("img"): pic_link=pic_tag.get('src') download_links.append(pic_link) for item in download_links: res=requests.get(item) with open(folder_path+item[-10:],'wb') as f: f.write
(res.content)

實現以上爬蟲程式碼可參考我的另一篇部落格,零基礎實現爬蟲