設置PhantomJS請求頭
默認情況下:
from selenium import webdriver
import time
driver = webdriver.PhantomJS()
driver.get('http://httpbin.org/user-agent')
print(driver.page_source)
driver.close()
設置User-Agent
from selenium import webdriver
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities
import time
user_agent = "Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.3 Safari/537.36"
dcap = dict(DesiredCapabilities.PHANTOMJS)
dcap["phantomjs.page.settings.userAgent"] = user_agent
dcap["phantomjs.page.customHeaders.User-Agent"] = user_agent
driver = webdriver.PhantomJS(desired_capabilities=dcap)
driver.get('http://httpbin.org/user-agent')
print(driver.page_source)
driver.close()
User-Agent已經變成指定的內容
設置PhantomJS不加載圖片
from selenium import webdriver
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities
import time
SERVICE_ARGS = ['--load-images=false', '--disk-cache=true','--ignore-ssl-errors=true']
driver = webdriver.PhantomJS(service_args=SERVICE_ARGS)
driver.get('https://www.baidu.com')
driver.save_screenshot('baidu.png')
driver.close()
SERVICE_ARGS 常用的參數
--cookies-file=/path/to/cookies.txt # 指定cookies文件
--disk-cache=[true|false] # 是否應用磁盤緩存
--ignore-ssl-errors=[true|false] # 是否忽略ssl證書錯誤
--load-images=[true|false] # 是否加載圖片
--output-encoding=encoding # 指定輸出編碼 默認是utf8
--proxy=address:port # 指定代理服務器,格式是--proxy=192.168.1.42:8080
--proxy-type=[http|socks5|none] # 指定代理服務器協議類型
--proxy-auth # 代理服務器認證,格式是--proxy-auth=username:password
更多設置可以參考官網
參數設置