scrapy Post 發送數據是我們通常會用來發送請求
yield scrapy.FormRequest(
url = url,
formdata = {"email" : "xxx", "password" : "xxxxx"},
callback = self.parse_page
)
但這是發送header為 'Content-Type', 'application/x-www-form-urlencoded' 的數據,
有時候我們做一些爬蟲,會post發送json數據,否則不能返回正確的結果,如果直接用request很方便,
但在scrapy里就需要這樣用
form_data = { "limit":"5", "start":"0", "type":"1", "url":"http://118.114.241.241:8829/BASE_SCKJ/biddingInfo.do?baseUrl=10.192.6.229:8080/netWorkToData/getProjectMessageByTypeSupplierCode" } yield scrapy.Request( url='http://139.9.60.172:8071/api/transmit/to', method="POST", headers={'Content-Type': 'application/json'}, body=json.dumps(form_data), meta={"type":my.notice}, callback=self.parse, errback=self.errorback, dont_filter=True)
這樣就可以發送json 數據了