python 使用pycurl模塊檢測web狀態質量
阿新 • • 發佈:2018-05-16
pycurlpycurl模塊安裝
pip install pycurl
源碼安裝方法:
wget https://curl.haxx.se/download/curl-7.29.0.tar.gz
tar zxf curl-7.29.0.tar.gz
cd curl-7.29.0/
./configure
make && make install
export LD_LIBRARY_PATH=/usr/local/lib
wget https://pypi.python.org/packages/source/p/pycurl/pycurl-7.19.3.1.tar.gz --no-check-certificate
tar zxf pycurl-7.19.3.1.tar.gz
cd pycurl-7.19.3.1/
python setup.py install --curl-config=/usr/local/bin/curl-config
檢測web示例:
#!/usr/bin/env python # -*- coding: utf-8 -*- import os,sys import time import pycurl URL="http://www.baidu.com" c=pycurl.Curl() c.setopt(pycurl.URL,URL) c.setopt(pycurl.CONNECTTIMEOUT,5) c.setopt(pycurl.TIMEOUT,5) c.setopt(pycurl.NOPROGRESS,1) c.setopt(pycurl.FORBID_REUSE,1) c.setopt(pycurl.MAXREDIRS,1) c.setopt(pycurl.DNS_CACHE_TIMEOUT,30) indexfile=open(os.path.dirname(os.path.realpath(__file__))+"/content.txt","wb") c.setopt(pycurl.WRITEHEADER,indexfile) c.setopt(pycurl.WRITEDATA,indexfile) try: c.perform() except Exception,e: print "connection error 連接錯誤:"+str(e) indexfile.close() c.close() sys.exit() NAMELOOKUP_TIME=c.getinfo(c.NAMELOOKUP_TIME) CONNECT_TIME=c.getinfo(c.CONNECT_TIME) PRETRANSFER_TIME=c.getinfo(c.PRETRANSFER_TIME) STARTTRANSFER_TIME=c.getinfo(c.STARTTRANSFER_TIME) TOTAL_TIME=c.getinfo(c.TOTAL_TIME) HTTP_CODE=c.getinfo(c.HTTP_CODE) SIZE_DOWNLOAD=c.getinfo(c.SIZE_DOWNLOAD) HEADER_SIZE=c.getinfo(c.HEADER_SIZE) SPEED_DOWNLOAD=c.getinfo(c.SPEED_DOWNLOAD) print "HTTP狀態碼:%s" % (HTTP_CODE) print "DNS解析時間:%.2f ms" % (NAMELOOKUP_TIME*1000) print "建立連接時間:%.2f ms" % (CONNECT_TIME*1000) print "準備傳輸時間:%.2f ms" % (PRETRANSFER_TIME*1000) print "傳輸開始時間:%.2f ms" % (STARTTRANSFER_TIME*1000) print "傳輸結束總時間:%.2f ms" % (TOTAL_TIME*1000) print "下載數據包大小:%d bytes/s" % (SIZE_DOWNLOAD) print "HTTP頭部大小:%d byte" % (HEADER_SIZE) print "平均下載速度:%d bytes/s" % (SPEED_DOWNLOAD) indexfile.close() c.close()
運行 python url.py 輸出檢測百度頁面的結果
HTTP狀態碼:200
DNS解析時間:4.27 ms
建立連接時間:8.43 ms
準備傳輸時間:8.56 ms
傳輸開始時間:13.92 ms
傳輸結束總時間:22.70 ms
下載數據包大小:115717 bytes/s
HTTP頭部大小:948 byte
平均下載速度:5259863 bytes/s
python 使用pycurl模塊檢測web狀態質量