在使用httpcomponents-client-4.2.1時,任務運行一段時間就拋出以下一場
下面是異常的堆棧信息:
org.apache.http.TruncatedChunkException: Truncated chunk ( expected size: 47956; actual size: 35656)
at org.apache.http.impl.io.ChunkedInputStream.read(ChunkedInputStream.java:186)
at org.apache.http.conn.EofSensorInputStream.read(EofSensorInputStream.java:138)
at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:264)
at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:306)
at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:158)
at java.io.InputStreamReader.read(InputStreamReader.java:167)
at java.io.Reader.read(Reader.java:123)
at org.apache.http.util.EntityUtils.toString(EntityUtils.java:224)
at org.apache.http.util.EntityUtils.toString(EntityUtils.java:248)
at com.bw30.bjappmanage.common.service.impl.HttpClientServiceImpl$2.handleResponse(HttpClientServiceImpl.java:206)
at com.bw30.bjappmanage.common.service.impl.HttpClientServiceImpl$2.handleResponse(HttpClientServiceImpl.java:1)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:1070)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:1044)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:1035)
at com.bw30.bjappmanage.common.service.impl.HttpClientServiceImpl.getHttpEntityText(HttpClientServiceImpl.java:214)
at com.bw30.bjappmanage.task.data.crawl.LiquGetThread.run(LiquGetThread.java:73)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
1、如果是一直報這個錯 說明是服務端問題(如服務器故意給你返回錯誤的數據);
2、如果偶爾報這個錯 說明是客戶端網絡(如丟包)等問題造成的,可以考慮失敗重試兩次,如果還失敗 可以考慮記下日志,定期重試。
這個也是屬於很正常的行為,就如網絡問題,只要考慮好如失敗重試 等策略解決這種問題就行了。
可以看下httpclient源碼
你盼望1000字節 但實際獲取了100 (這個服務器可以直接給你返回少於指定的數據, 網絡問題也可能會遭遇這個問題)