爬取VIP視頻

步驟一、在網頁上打開一個視頻，然后復制地址欄的地址
步驟二、在網頁上輸入http://jx.618g.com/?url=步驟一得出的地址

步驟三、待有視頻出來就按F12，在Network中的name找到ts結尾的請求，然后把視頻拉到最后，記錄ts請求的尾數，點擊任意ts請求，找到request_url

步驟四、修改以下程序的base_url、end_index和process_num進行下載

"""利用多線程，爬取視頻"""
import requests
from multiprocessing import Pool
 
 
def download(base_url, index):
    headers = {
        'user-agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36'}
    url = base_url % index
    res = requests.get(url=url,
                       headers=headers)
    filename = url.rsplit('/', maxsplit=1)[1]
    with open(filename, 'wb') as f:
        f.write(res.content)
    print('----------------------------------------------------')
 
 
if __name__ == '__main__':
    base_url = 'https://iqiyi.cdn9-okzy.com/20200206/5942_55236082/1000k/hls/fd903296832000%03d.ts'
    # 記錄影片的最后ts文件數字
    end_index = 682
    # 進程個數
    process_num = 5
    pool = Pool(process_num)
    for i in range(end_index + 1):
        pool.apply_async(download, (base_url, i,))
    pool.close()
    pool.join()
    print('下載完畢')

 

步驟五、cmd--->cd 下載目錄--->copy /b *.ts new.mp4