Python-爬蟲-爬取知乎的標題和當頁顯示的文字


# coding:utf-8
import requests
from bs4 import BeautifulSoup

quesNumStr = str(input("請輸入搜索關鍵字:"))

url = 'https://www.zhihu.com/search?type=content&q='+quesNumStr

headers = {
    'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.95 Safari/537.36'  # your user-Agent here
}

data = requests.get(url, headers=headers)
soup = BeautifulSoup(data.text, 'lxml')
liList = soup.select('li')
print(len(liList))
for li in liList:
    try:
        temp1 = li.select('a[class="js-title-link"]')
        if temp1:
            print('The title is :')
            print(temp1[0].get_text())
        temp2 = li.select('div[class="summary hidden-expanded"]')
        if temp2:
            print('The content is:')
            print(temp2[0].text)
    except:
        pass

 


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM