本人是研究推薦系統的,最近在看到一篇文章Exploiting Ranking Consistency Principle in Representation Learning for Location Promotion覺得挺有意思的,想深入了解一下,然后想着從大眾點評上爬點數據,於是就隨手打開大眾點評,點開評論,打開源碼,研究一下爬蟲策略,這才發現,現在大眾點評除了在代理IP上下功夫反爬蟲外,在源碼上也做文章了,具體如下:
網頁源碼:
這<span class="fr-DMrt"></span>店我<span class="fr-Ky0H"></span><span class="fr-QmtS"></span><span class="fr-SHzo"></span><span class="fr-mUfe"></span>烈<span class="fr-mAqU"></span>call,<span class="fr-SHzo"></span>我<span class="fr-OL5j"></span>前在合肥吃過<span class="fr-QmtS"></span>最好吃<span class="fr-QmtS"></span>一<span class="fr-DMrt"></span><span class="fr-AaxC"></span>鍋店了。<br />首先<span class="fr-Eg8Q"></span><span class="fr-DMrt"></span><span class="fr-QmtS"></span>毛肚<span class="fr-Ky0H"></span><span class="fr-QmtS"></span>超棒,<span class="fr-BK2E"></span><span class="fr-APZx"></span><span class="fr-SHzo"></span>能看<span class="fr-QmtS"></span>出<span class="fr-gnD7"></span><span class="fr-QmtS"></span>棒,脆脆<span class="fr-QmtS"></span>口感,有些<span class="fr-AaxC"></span>鍋店<span class="fr-QmtS"></span>毛肚端上<span class="fr-gnD7"></span><span class="fr-wbqv"></span>顯能看出......</p> <a href="javascript:void(0);" class="more fold J-more">展開評論<i class="icon"></i></a> </div> <div class="info J-info-all clearfix Hide"> <p class="desc J-desc">這家店我真<span class="fr-QmtS"></span><span class="fr-SHzo"></span>強烈打call,<span class="fr-SHzo"></span>我目前在合肥吃過<span class="fr-QmtS"></span>最好吃<span class="fr-QmtS"></span><span class="fr-dK0T"></span>家火鍋店了。<br />首先他家<span class="fr-QmtS"></span>毛肚真<span class="fr-QmtS"></span>超棒,<span class="fr-BK2E"></span>量<span class="fr-SHzo"></span>能看<span class="fr-QmtS"></span>出來<span class="fr-QmtS"></span>棒,脆脆<span class="fr-QmtS"></span><span class="fr-2QAf"></span>感,有些火鍋店<span class="fr-QmtS"></span>毛肚端上來明顯能看出來發白<span class="fr-QmtS"></span>痕跡,明顯<span class="fr-SHzo"></span>凍過<span class="fr-QmtS"></span>,而它家<span class="fr-SHzo"></span>冰鮮<span class="fr-ZTIr"></span>理<span class="fr-QmtS"></span>。<br />黃喉也<span class="fr-OnYW"></span>好吃,雖然這個<span class="fr-BK2E"></span>量<span class="fr-QmtS"></span>黃喉合肥有好幾家能做到,但<span class="fr-SHzo"></span><span class="fr-wlIq"></span>格沒它家便宜<span class="fr-jT0z"></span>!!勝在性<span class="fr-wlIq"></span>比高<span class="fr-jT0z"></span>!!<br />我<span class="fr-sMte"></span>還點了<span class="fr-dK0T"></span>份<span class="fr-xiFS"></span>,哇塞,這個分量你<span class="fr-sMte"></span>可以看圖<span class="fr-dK0T"></span>,分量真<span class="fr-QmtS"></span><span class="fr-OnYW"></span><span class="fr-72sB"></span>,<span class="fr-xiFS"></span>片被片得<span class="fr-OnYW"></span>薄,在火鍋里涮幾十秒<span class="fr-O0dH"></span>能吃了!<br /><span class="fr-dK0T"></span>直覺得吃火鍋<span class="fr-O0dH"></span><span class="fr-SHzo"></span>吃鍋底,菜大同小異都差不多,我<span class="fr-sMte"></span>點<span class="fr-QmtS"></span><span class="fr-SHzo"></span>魔鬼辣,但<span class="fr-SHzo"></span>相信我,<span class="fr-dK0T"></span>點都不辣!!!!!!中間<span class="fr-SHzo"></span>有點葯膳味道<span class="fr-QmtS"></span>雞湯?可能<span class="fr-SHzo"></span>吧,白湯<span class="fr-O0dH"></span><span class="fr-SHzo"></span><span class="fr-OnYW"></span>普通<span class="fr-QmtS"></span>紅棗香菇湯。。。涮菜<span class="fr-QmtS"></span>話基本沒用白湯。這樣感覺有點浪費。強制鴛鴦!!!但辣湯真<span class="fr-QmtS"></span><span class="fr-OnYW"></span>好吃,不咸,不像有<span class="fr-QmtS"></span>店越吃越咸!!!<br />服務<span class="fr-OnYW"></span>好,<span class="fr-vsrl"></span>有<span class="fr-ALv0"></span>毛巾擦手之<span class="fr-10Lg"></span>!服務<span class="fr-ALv0"></span><span class="fr-2a4U"></span>!<br />唯<span class="fr-dK0T"></span>不太好<span class="fr-QmtS"></span>,<span class="fr-O0dH"></span><span class="fr-SHzo"></span>衛生問題,可能我去<span class="fr-QmtS"></span>時間太晚了,調料區挖蔥<span class="fr-QmtS"></span>時候小蟲子亂飛,挺影響心<span class="fr-2a4U"></span><span class="fr-QmtS"></span>!<br />不管怎么說,<span class="fr-SHzo"></span><span class="fr-vsrl"></span>二刷<span class="fr-QmtS"></span>店!</p> <a href="javascript:void(0);" class="more unfold J-more">收起評論
截取其中一句:
這<span class="fr-DMrt"></span>店我<span class="fr-Ky0H"></span><span class="fr-QmtS"></span><span class="fr-SHzo"></span><span class="fr-mUfe"></span>烈<span class="fr-mAqU"></span>call,
可以發現其中有些字被網頁元素替換了,加載到前端的時候再顯示原始評論,可以說很靈性了。