streamsets http client 請求過大問題


http 請求body 過大問題

現象

com.streamsets.pipeline.api.ext.io.OverrunException: Reader exceeded the read limit '1048576'

解決

in version 2.6 and before - add the following to your ${SDC_JVM_OPTS}:
-DDataFactoryBuilder.OverRunLimit=10485760 -Doverrun.reader.read.limit=10485760
these parameters set the buffer size to 10MiB - adjust as appropriate. also, set the Max Object Length in the Data Format tab.
in our next version after 2.6 (so in 2.6.X or 2.7), you'll be able to fix this by setting a new property - parser.limit in the sdc.properties file eg: parser.limit=10485760

參考資料

https://ask.streamsets.com/question/69/comstreamsetspipelinestageorigins3badspoolobjectexception-comstreamsetspipelineapiextiooverrunexception-reader-exceeded-the-read-limit-1048576-when/


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM