python requests下載文件慢

使用python的三方庫 requests 在下載文件時，很慢。

源代碼：直接根據返回內容寫文件，文件並不是很大，但是寫起來很慢

     response = requests.post('https://xxxx', data=json.dumps(payload), headers=headers,
                      cookies=cookies, proxies=proxies)

     if response.content:
         with open(target_path, 'wb') as f:
              f.write(response.content)
         return response.text

 

調整后代碼：

url="https://xx.gin.csv"
response = requests.get(url, stream = True)

text_file = open("data.txt","wb")
for chunk in response.iter_content(chunk_size=1024):
    text_file.write(chunk)
writing one chunk at a time to text file

 9 text_file.close()

 

 with requests.post('https://xx.com/download', data=json.dumps(payload), headers=headers,
                       cookies=cookies, proxies=proxies) as r:
        r.raise_for_status()
        with open(target_path, 'wb') as f:
            for chunk in r.iter_content(chunk_size=2048):
                # If you have chunk encoded response uncomment if
                # and set chunk_size parameter to None.
                # if chunk:
                f.write(chunk)
        delete_yhhd_file(cookies, file_code)  # 刪除文件請求