碼上快樂

相關內容    簡體    繁體

curl 命令詳解

本文轉載自   查看原文   2013-07-19 15:05   11921    LINUX命令

命令事例

  • 發送POST請求：
    • 如果傳輸文件：curl -F "blob=@tmp.txt;type=text/plain" localhost:8080/request_body
    • 普通post請求：curl -d "method=searchone&module=seller&user_name=wb-liqiu&nickname=dd" -H"Host:fmp.view.lz.taobao.com" "10.235.160.141:8082/api.php"
  • 模擬登錄，傳輸cookie和參數：
    • 下載cookie，命令：curl -c ./cookie.txt -d "language=zh&password=admin&username=admin" http://***.com:8080/saiku/rest/saiku/session
    • 攜帶cookie以登錄用戶身份訪問，命令如下：curl -b ./cookie.txt -L -d "name=/homes/test2&file=/homes/search.saiku" -H"Host:***.com" "192.0.0.134:8080/saiku/rest/saiku/api/repository/resource"
  • 偽造來源地址，有的網站會判斷，請求來源地址
    • curl -e http://localhost http://www.sina.com.cn
  • 偽造cookie，防止302跳轉頁面不能下載
    • wget --cookies=on --load-cookies=cookie.txt －-keep-session-cookies --save-cookies=cookie.txt http://detail.tmall.com/item.htm?id=25139372969
  • 使用proxy緩存
    • curl -L -x127.0.0.1:13128 http://detail.tmall.com/item.htm?id=25823396605

命令事例詳解

    一、查看網頁源碼

    直接在curl命令后加上網址，就可以看到網頁源碼。我們以網址www.sina.com為例（選擇該網址，主要因為它的網頁代碼較短）

curl www.baidu.com

    如果要把這個網頁保存下來，可以使用-o參數，這就相當於使用wget命令了。

curl -o [文件名] www.baidu.com

    二、自動跳轉 有的網址是自動跳轉的。使用-L參數，curl就會跳轉到新的網址。curl -L http://item.taobao.com/item.htm?id=25823396605 鍵入上面的命令，結果就自動跳轉為http://detail.tmall.com/item.htm?id=25823396605

    三、顯示頭信息 -i 參數可以顯示http response的頭信息，連同網頁代碼一起。（-I 參數則是只顯示http response的頭信息。）

curl -i www.baidu.com
 HTTP/1.1 200 OK
Date: Fri, 28 Feb 2014 05:39:57 GMT
Content-Type: text/html
Transfer-Encoding: chunked
Connection: Keep-Alive
Vary: Accept-Encoding
Set-Cookie: BAIDUID=0F251A658E427EBB7CBEB0C3F4A70FAE:FG=1; expires=Thu, 31-Dec-37 23:55:55 GMT; max-age=2147483647; path=/; d
omain=.baidu.com
Set-Cookie: BDSVRTM=0; path=/
Set-Cookie: H_PS_PSSID=4104_5231_1445_5139_5225_5378_5368_4261_4760_5400; path=/; domain=.baidu.com
P3P: CP=" OTI DSP COR IVA OUR IND COM "
Expires: Fri, 28 Feb 2014 05:39:45 GMT
Cache-Control: private
Server: BWS/1.1
BDPAGETYPE: 1
BDQID: 0xc3b306dca955703d
BDUSERID: 0

<!DOCTYPE html>.....

    四、顯示通信過程 -v 參數可以顯示一次http通信的整個過程，包括端口連接和http request頭信息。命令：curl -v www.baidu.com

* About to connect() to www.baidu.com port 80
*   Trying 115.239.210.26... connected
* Connected to www.baidu.com (115.239.210.26) port 80
> GET / HTTP/1.1
> User-Agent: curl/7.15.5 (x86_64-redhat-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.5
> Host: www.baidu.com
> Accept: */*
> 
< HTTP/1.1 200 OK
< Date: Fri, 28 Feb 2014 05:42:37 GMT
< Content-Type: text/html
< Transfer-Encoding: chunked
< Connection: Keep-Alive
< Vary: Accept-Encoding
< Set-Cookie: BAIDUID=442AD49501EF253AE71F2BAF3E0181FB:FG=1; expires=Thu, 31-Dec-37 23:55:55 GMT; max-age=2147483647; path=/; domain=.baidu.com
< Set-Cookie: BDSVRTM=0; path=/
< Set-Cookie: H_PS_PSSID=5228_1461_5187_5138_5225_5379_5368_4261_4760_5401_5286; path=/; domain=.baidu.com
< P3P: CP=" OTI DSP COR IVA OUR IND COM "
< Expires: Fri, 28 Feb 2014 05:41:43 GMT
< Cache-Control: private
< Server: BWS/1.1
< BDPAGETYPE: 1
< BDQID: 0x906950d16fb1e95d
< BDUSERID: 0
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Spee<!DOCTYPE html><!--STATUS OK--><html><head><meta http-equiv="content-type" content="text/html;charset=utf-8"><meta http-equiv
="X-UA-Compatible" content="IE=Edge"><link rel="dns-

    如果你覺得上面的信息還不夠，那么下面的命令可以查看更詳細的通信過程: curl --trace output.txt www.baidu.com 或者 curl --trace-ascii output.txt www.baidu.com 運行后，請打開output.txt文件查看。

    當然也有更狠的，查看頁面跳轉過程：curl -L -I --trace log http://item.taobao.com/item.htm?id=25823396605

HTTP/1.1 301 Moved Permanently
Server: Tengine
Date: Fri, 28 Feb 2014 06:16:01 GMT
Content-Type: text/html;charset=GBK
Content-Length: 0
Connection: close
P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
Content-Language: zh-CN
Accept-Ranges: bytes
X-Varnish: 1206961665
Via: 1.1 varnish
location: http://detail.tmall.com/item.htm?id=25823396605&
X-Cache: MISS
Cache-Control: max-age=3

HTTP/1.1 302 Found
Server: Tengine
Date: Fri, 28 Feb 2014 06:16:01 GMT
Content-Type: text/html
Content-Length: 260
Connection: keep-alive
at_bucketid: sbucket_-1
X-Bucket-Id: -1
Location: http://jump.taobao.com/jump?target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d1
Cache-Control: 

HTTP/1.1 302 Found
Date: Fri, 28 Feb 2014 06:16:01 GMT
Content-Type: text/html
Content-Length: 260
Connection: close
Set-Cookie: _tb_token_=ktbzEwzFR6qy;domain=.taobao.com;Path=/;HttpOnly
Set-Cookie: cookie2=6c6bc65b9e9a5159cff5b3d0cae4dfd9;domain=.taobao.com;Path=/;HttpOnly
Set-Cookie: t=d768c73859b40e10ef81f7abd0824704;domain=.taobao.com;Expires=Thu, 29-May-2014 06:16:01 GMT;Path=/
P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
Location: http://pass.tmall.com/add?_tb_token_=ktbzEwzFR6qy&cookie2=6c6bc65b9e9a5159cff5b3d0cae4dfd9&t=d768c73859b40e10ef81f7abd0824704&target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d1&pacc=A_12nKe89qHIcAyauBtovg==&opi=110.75.118.230&tmsc=1393568161483632

HTTP/1.1 302 Found
Date: Fri, 28 Feb 2014 06:16:01 GMT
Content-Type: text/html
Content-Length: 260
Connection: close
P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
Set-Cookie: _tb_token_=ktbzEwzFR6qy;domain=.tmall.com;Path=/
Set-Cookie: cookie2=6c6bc65b9e9a5159cff5b3d0cae4dfd9;domain=.tmall.com;Path=/
Set-Cookie: t=d768c73859b40e10ef81f7abd0824704;domain=.tmall.com;Path=/
Location: http://detail.tmall.com/item.htm?id=25823396605&&tbpm=1

HTTP/1.1 302 Found
Server: Tengine
Date: Fri, 28 Feb 2014 06:16:01 GMT
Content-Type: text/html
Content-Length: 260
Connection: keep-alive
at_bucketid: sbucket_-1
X-Bucket-Id: -1
Location: http://jump.taobao.com/jump?target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d2
Cache-Control: 

HTTP/1.1 302 Found
Date: Fri, 28 Feb 2014 06:16:01 GMT
Content-Type: text/html
Content-Length: 260
Connection: close
Set-Cookie: _tb_token_=GgU93fEjKGT4;domain=.taobao.com;Path=/;HttpOnly
Set-Cookie: cookie2=ef3c440d74ff391de6b560da4ef8a5c9;domain=.taobao.com;Path=/;HttpOnly
Set-Cookie: t=187a71d8df58caac2c4e08d40245c31f;domain=.taobao.com;Expires=Thu, 29-May-2014 06:16:01 GMT;Path=/
P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
Location: http://pass.tmall.com/add?_tb_token_=GgU93fEjKGT4&cookie2=ef3c440d74ff391de6b560da4ef8a5c9&t=187a71d8df58caac2c4e08d40245c31f&target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d2&pacc=Vo8f-VlYEYPJ6WE3iTX96Q==&opi=110.75.118.230&tmsc=1393568161501736

HTTP/1.1 302 Found
Date: Fri, 28 Feb 2014 06:16:01 GMT
Content-Type: text/html
Content-Length: 260
Connection: close
P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
Set-Cookie: _tb_token_=GgU93fEjKGT4;domain=.tmall.com;Path=/
Set-Cookie: cookie2=ef3c440d74ff391de6b560da4ef8a5c9;domain=.tmall.com;Path=/
Set-Cookie: t=187a71d8df58caac2c4e08d40245c31f;domain=.tmall.com;Path=/
Location: http://detail.tmall.com/item.htm?id=25823396605&&tbpm=2

HTTP/1.1 302 Found
Server: Tengine
Date: Fri, 28 Feb 2014 06:16:01 GMT
Content-Type: text/html
Content-Length: 260
Connection: keep-alive
at_bucketid: sbucket_-1
X-Bucket-Id: -1
Location: http://jump.taobao.com/jump?target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d3
Cache-Control: 

HTTP/1.1 302 Found
Date: Fri, 28 Feb 2014 06:16:01 GMT
Content-Type: text/html
Content-Length: 260
Connection: close
Set-Cookie: _tb_token_=Uta86PoG6cWC;domain=.taobao.com;Path=/;HttpOnly
Set-Cookie: cookie2=cd06dba05f2bf1124200861d0b8a151b;domain=.taobao.com;Path=/;HttpOnly
Set-Cookie: t=618388c77aff03aec08309747a82f440;domain=.taobao.com;Expires=Thu, 29-May-2014 06:16:01 GMT;Path=/
P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
Location: http://pass.tmall.com/add?_tb_token_=Uta86PoG6cWC&cookie2=cd06dba05f2bf1124200861d0b8a151b&t=618388c77aff03aec08309747a82f440&target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d3&pacc=RptvnJCXDG4WtvFa0JIqoQ==&opi=110.75.118.230&tmsc=1393568161510003

HTTP/1.1 302 Found
Date: Fri, 28 Feb 2014 06:16:01 GMT
Content-Type: text/html
Content-Length: 260
Connection: close
P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
Set-Cookie: _tb_token_=Uta86PoG6cWC;domain=.tmall.com;Path=/
Set-Cookie: cookie2=cd06dba05f2bf1124200861d0b8a151b;domain=.tmall.com;Path=/
Set-Cookie: t=618388c77aff03aec08309747a82f440;domain=.tmall.com;Path=/
Location: http://detail.tmall.com/item.htm?id=25823396605&&tbpm=3

HTTP/1.1 200 OK
Server: Tengine
Date: Fri, 28 Feb 2014 06:16:01 GMT
Content-Type: text/html;charset=GBK
Connection: keep-alive
Vary: Accept-Encoding
at_bucketid: sbucket_-1
X-Bucket-Id: -1
Cache-Control: max-age=1
At_Autype: 4_103979994
At_Cat: item_50018599
X-Category: /cat/50008090
At_Nick: %E8%B6%8A%E5%BA%A6%E6%95%B0%E7%A0%81%E4%B8%93%E8%90%A5%E5%BA%97
At_Itemid: 25823396605
At_Isb: 1
At_Pgty: 2
At_Cat: 50018599
At_Brid: 272676782
At_Prid: 221236332
At_Autype: 0_103979994
At_Auid: 25823396605
Content-Language: zh-CN
X-Cache: MISS TCP_MISS dirn:-2:-2
Via: wagbridge010207087016.cm3:8888

    五、發送表單信息 發送表單信息有GET和POST兩種方法。GET方法相對簡單，只要把數據附在網址后面就行: curl baidu.com/form.cgi?data=xxx

    POST方法必須把數據和網址分開，例如：curl -d "method=searchone&module=seller&user_name=wb-liqiu&nickname=dd" -H"Host:fmp.view.lz.taobao.com" "10.235.160.141:8082/api.php"

    六、文件上傳 假定文件上傳的表單你可以用curl這樣上傳文件，命令：curl --form upload=@localfilename --form press=OK http://www.baidu.com

    七、Referer字段 有時你需要在http request頭信息中，提供一個referer字段，表示你是從哪里跳轉過來的: curl --referer http://www.baidu.com http://www.baidu.com

    八、User Agent字段 這個字段是用來表示客戶端的設備信息。服務器有時會根據這個字段，針對不同設備，返回不同格式的網頁，比如手機版和桌面版。 iPhone4的User Agent是: “Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_0 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML, like Gecko) Version/4.0.5 Mobile/8A293 Safari/6531.22.7”。curl可以這樣模擬： curl --user-agent "[User Agent]" [URL]

    九、cookie 使用--cookie參數，可以讓curl發送cookie。curl --cookie "name=xxx" www.baidu.com 至於具體的cookie的值，可以從http response頭信息的Set-Cookie字段中得到。也可以例如：curl -c ./cookie.txt http://www.baidu.com

    十、增加頭信息 有時需要在http request之中，自行增加一個頭信息。--header參數就可以起到這個作用。curl --header "xxx: xxxxxx" http://baidu.com

    十一、HTTP認證 有些網域需要HTTP認證，這時curl需要用到--user參數：curl --user name:password baidu.com

<html>
<meta http-equiv="refresh" content="0;url=http://www.baidu.com/">
</html>

    十二、設置代理緩存 -x<ip:port>

curl -L -x127.0.0.1:13128 http://detail.tmall.com/item.htm?id=25823396605

 


免責聲明！

本站轉載的文章為個人學習借鑒使用，本站對版權不負任何法律責任。如果侵犯了您的隱私權益，請聯系本站郵箱yoyou2525@163.com刪除。



猜您在找 curl : curl命令詳解 Linux curl命令詳解 Linux curl命令詳解 Linux curl命令詳解 Linux之curl命令詳解 Linux curl命令詳解 curl命令詳解 Linux curl命令詳解 curl命令詳解 Linux curl命令詳解
 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM