采集淘寶或天貓商品的店鋪名稱/商家旺旺/商品首圖/商品標題

本文轉載自查看原文 2019-09-19 17:57 372 PHP

一用的QueryList庫

二安裝方法

確認已經安裝了composer，因為速度會很慢，可以切換到中國鏡像：

composer config -g repo.packagist composer https://packagist.phpcomposer.com

安裝QueryList：

composer require jaeger/querylist

QueryList文檔地址，可以了解下：

http://www.querylist.cc/#one

三需求如下

通過淘寶或天貓的商品鏈接，采集該商品鏈接對應的商品標題、商品首圖、店鋪名稱、商家旺旺名稱

四目前的采集數據Demo可以適用於所有天貓商品+店鋪名稱在右邊或上邊的

五代碼如下

<?php

include "vendor/autoload.php";

use QL\QueryList;

function uni_decode($s) {  //針對部分淘寶寶貝鏈接的店鋪名被加密進行解密處理
  preg_match_all('/\&\#([0-9]{2,5})\;/', $s, $html_uni);  
  preg_match_all('/[\\\%]u([0-9a-f]{4})/ie', $s, $js_uni);  
  $source = array_merge($html_uni[0], $js_uni[0]);  
  $js = array();  
  for($i=0;$i<count($js_uni[1]);$i++) {  
    $js[] = hexdec($js_uni[1][$i]);  
  }  
  $utf8 = array_merge($html_uni[1], $js);  
  $code = $s;  
  for($j=0;$j<count($utf8);$j++) {  
    $code = str_replace($source[$j], unicode2utf8($utf8[$j]), $code);  
  }  
  return $code;
}  
   
function unicode2utf8($c) {  
  $str="";  
  if ($c < 0x80) {  
     $str.=chr($c);  
  } else if ($c < 0x800) {  
     $str.=chr(0xc0 | $c>>6);  
     $str.=chr(0x80 | $c & 0x3f);  
  } else if ($c < 0x10000) {  
     $str.=chr(0xe0 | $c>>12);  
     $str.=chr(0x80 | $c>>6 & 0x3f);  
     $str.=chr(0x80 | $c & 0x3f);  
  } else if ($c < 0x200000) {  
     $str.=chr(0xf0 | $c>>18);  
     $str.=chr(0x80 | $c>>12 & 0x3f);  
     $str.=chr(0x80 | $c>>6 & 0x3f);  
     $str.=chr(0x80 | $c & 0x3f);  
  }  
  return $str;  
} 

function get_between($input, $start, $end) {//截取指定兩個字符之間的內容

	return substr($input, strlen($start)+strpos($input, $start),(strlen($input) - strpos($input, $end))*(-1));
}

function trimall($str)//刪除空格
{
    $qian=array(" ","　","\t","\n","\r");
    $hou=array("","","","","");
    return str_replace($qian,$hou,$str); 
}

$url = 'https://item.taobao.com/item.htm?spm=a230r.1.14.34.47cd6ace3iAnm0&id=564043247193&ns=1&abbucket=19#detail';

$ql = QueryList::get($url)->encoding('UTF-8','GB2312');//防止數據亂碼

//針對1天貓寶貝鏈接 2淘寶店鋪名在右邊 3淘寶店鋪名在上面 采取不同的采集方式
if (substr($url, 0, 24) == 'https://detail.tmall.com') {

	$rt = [
		'img' 		=> $ql->find('#J_ImgBooth')->attr('src'),
		'title' 	=> $ql->find(':input[name="title"]')->attr('value'),
		'shop_name' => $ql->find('.slogo-shopname')->text()
	];

	$rt['seller_name'] = $rt['shop_name'];

} else {

	$rt = [
		'img' 		  => $ql->find('#J_ImgBooth')->attr('src'),
		'title' 	  => $ql->find('.tb-main-title')->text(),
		'shop_name'   => $ql->find('.tb-shop-name>dl>dd>strong>a')->text(),
		'seller_name' => $ql->find('.tb-seller-name')->text()
	];

	if (!$rt['shop_name']) {

		$config = substr(trimall($ql->find('script')->eq(0)->text()), 100, 150);

		$shop_name = get_between($config, "shopName:'", "',sellerId");

		$rt['shop_name'] = uni_decode($shop_name);

		$rt['seller_name'] = get_between($config, "sellerNick:'", "',sibUrl");
	}
}
	
var_dump($rt['shop_name']);

echo '<hr />';
?>


<!DOCTYPE html>
<html lang="en">
<head>
	<meta charset="UTF-8">
	<title>爬取淘寶商品數據Demo</title>
</head>
<body>
	<h4>標題：<?php echo $rt['title']; ?></h4>
	<h4>店鋪：<?php echo $rt['shop_name']; ?></h4>
	<h4>旺旺：<?php echo $rt['seller_name']; ?></h4>
	<h4>圖片：</h4>
	<img src="<?php echo $rt['img'] ?>" alt="">
</body>
</html>

六效果展示

1 天貓商品鏈接

https://detail.tmall.com/item.htm?spm=a230r.1.14.9.47cd6ace3iAnm0&id=591124740347&cm_id=140105335569ed55e27b&abbucket=19&skuId=4060807516519