FormRequest和FormRequest.from_response的區別

scrapy.FormRequest

• 通過FormRequest函數實現向服務器發送post請求，請求參數需要配合網站設計發送特殊參數。

class FormrequestSpider(CrawlSpider):
        name='github'
        allowed_domains=['github.com']
        start_urls=['https://github.com/login']

        def parse(self, response):
            authenticity_token=response.xpath("//input[@name='authenticity_token']/@value").extract_first()
            utf8=response.xpath("//input[@name='utf8']/@value").extract_first()
            commit=response.xpath("//input[@name='commit']/@value").extract_first()
            post_data=dict(
                login="***********",
                password="**********",
                authenticity_token=authenticity_token,
                utf8=utf8,
                commit=commit,
            )
            # 表單請求
            yield scrapy.FormRequest(
                "https://github.com/session",
                formdata=post_data,
                callback=self.after_login
            )

        def after_login(self, response):
            # with open("a.html","w",encoding="utf-8") as f:
            #     f.write(response.body.decode())
            print(re.findall("********", response.body.decode()))

 

 

scrapy.FormRequest.from_response

• FormRequest.from_response模擬瀏覽器點擊行為向服務器發送post請求

• 只能應用在form標簽做的表單登錄網站上
• 只關心輸入賬號和密碼，名稱按網頁設計的標簽名稱填寫。

class GithubSpider(CrawlSpider):
    name='github2'
    allowed_domains=['github.com']
    start_urls=['https://github.com/login']

    def parse(self, response):
        yield scrapy.FormRequest.from_response(
            response,  # 自動的從response中尋找from表單
            # formdata只需要傳入字典型登錄名和密碼，字典的健是input標簽中的name屬性
            formdata={"login": "***********", "password": "**********"},
            callback=self.after_login
        )

    def after_login(self, response):
        print(response.text)

 

參考閱讀：

https://www.cnblogs.com/ywjfx/p/11089248.html