[org.apache.spark.streaming.dstream.FileInputDStream] - Error finding new files


 WARN [main] [org.apache.spark.util.Utils] - Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
 WARN [JobGenerator] [org.apache.spark.streaming.dstream.FileInputDStream] - Error finding new files
java.lang.NullPointerException
    at scala.collection.mutable.ArrayOps$ofRef$.length$extension(ArrayOps.scala:192)
    at scala.collection.mutable.ArrayOps$ofRef.length(ArrayOps.scala:192)
    at scala.collection.SeqLike$class.size(SeqLike.scala:106)
    at scala.collection.mutable.ArrayOps$ofRef.size(ArrayOps.scala:186)
    at scala.collection.mutable.Builder$class.sizeHint(Builder.scala:69)
    at scala.collection.mutable.ArrayBuilder.sizeHint(ArrayBuilder.scala:22)
    at scala.collection.TraversableLike$class.builder$1(TraversableLike.scala:230)
    at scala.collection.TraversableLike$class.map(TraversableLike.scala:233)
    at scala.collection.mutable.ArrayOps$ofRef.map(ArrayOps.scala:186)
    at org.apache.spark.streaming.dstream.FileInputDStream.findNewFiles(FileInputDStream.scala:205)
    at org.apache.spark.streaming.dstream.FileInputDStream.compute(FileInputDStream.scala:149)
    at org.apache.spark.streaming.dstream.DStream$$anonfun$getOrCompute$1$$anonfun$1$$anonfun$apply$7.apply(DStream.scala:342)
    at org.apache.spark.streaming.dstream.DStream$$anonfun$getOrCompute$1$$anonfun$1$$anonfun$apply$7.apply(DStream.scala:342)
    at scala.util.DynamicVariable.withValue(DynamicVariable.scala:58)
    at org.apache.spark.streaming.dstream.DStream$$anonfun$getOrCompute$1$$anonfun$1.apply(DStream.scala:341)
    at org.apache.spark.streaming.dstream.DStream$$anonfun$getOrCompute$1$$anonfun$1.apply(DStream.scala:341)
    at org.apache.spark.streaming.dstream.DStream.createRDDWithLocalPropert

 

 

文件名稱有錯誤

看一下路徑


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM