1、建立scrapy專案

>scrapy startproject scrapy_carhome

2、找到對應介面

3、建立爬蟲檔案

> cdscrapy_carhome\scrapy_carhome\spiders

scrapy_carhome\scrapy_carhome\spiders> scrapy genspider car https://car.autohome.com.cn/price/brand-15.html

4、註釋robots協議

//div[@class="main-title"]/a/text()

//div[@class="main-lever"]//span/span/text()
 

car.py

import scrapy


class CarSpider(scrapy.Spider):
    name = 'car'
    allowed_domains = ['https://car.autohome.com.cn/price/brand-15.html']
    # 注意如果你的請求的介面是html為結尾的  那麼是不需要加/的
    start_urls = ['https://car.autohome.com.cn/price/brand-15.html']

    def parse(self, response):
        name_list = response.xpath('
 
//div[@class="main-title"]/a/text()')
        price_list = response.xpath('//div[@class="main-lever"]//span/span/text()')
　　　　　# 遍歷列表
        for i in range(len(name_list)):
            name = name_list[i].extract()
            price = price_list[i].extract()
            print(name,price)

執行爬蟲檔案

scrapy_carhome\scrapy_carhome\spiders>scrapy crawl car