scrapy框架查看請求狀態碼

在中間件middlewares中寫一個類，查看請求的狀態碼

class GetFailedUrl(object):
    def process_response(self, response, request, spider):
        if response.status != 200:
            print(111111111111)
            print(response.status)
            print(222222222222)
        else:
            return response

然后再setting中激活中間件中的類

DOWNLOADER_MIDDLEWARES = {
   'taskspider.middlewares.GetFailedUrl': 542,
}