【異常】java.lang.ClassCastException: org.apache.spark.rdd.ShuffledRDD cannot be cast to org.apache.spark.streaming.kafka010.HasOffsetRanges

本文轉載自查看原文 2020-03-21 18:42 926 SparkStreaming

對應出異常的代碼是：val offsetRanges: Array[OffsetRange] = rdd.asInstanceOf[HasOffsetRanges].offsetRanges

做foreachRDD的DStream必須是直接從KafkaUtils.createDirectStream拿到的，才能轉換為kafkaRDD. 后面做其他操作的時候會把kafkaRDD轉換為非kafkaRDD。也就是說這個HasOffsetRanges接口，只有kafkaRDD這個實現類。所以如果從kafka拿到DStream，后面需要使用foreachRDD，那么這個DStream必須是直接從KafkaUtils.createDirectStream拿到，中間不能再做其他的操作。

免責聲明！

本站轉載的文章為個人學習借鑒使用，本站對版權不負任何法律責任。如果侵犯了您的隱私權益，請聯系本站郵箱yoyou2525@163.com刪除。

猜您在找 java.lang.ClassCastException: org.apache.hadoop.io.Text cannot be cast to org.apache.h... hive orc壓縮數據異常java.lang.ClassCastException: org.apache.hadoop.io.Text cannot be cast to org.apache.hadoop.hive.ql.io.orc.OrcSerde$OrcSerdeRow spark 異常:ClassCastException: Text cannot be cast to org.apache.hadoop.hive.ql.io.orc.OrcSerde$OrcSerdeRow java.lang.ClassCastException: org.apache.taglibs.standard.tlv.JstlCoreTLV cannot be cast to javax.servlet.jsp.tagext.TagLibraryValidator 在maven項目中使用apache cxf中遇到異常 java.lang.ClassCastException: org.springframework.web.filter.CharacterEncodingFilter cannot be cast to javax.servlet.Filter 自定義 UsernamePasswordToken 報錯 java.lang.ClassCastException: org.apache.shiro.authc.UsernamePasswordToken cannot be cast to java.lang.ClassCastException: org.apache.jasper.el.ELContextImpl cannot be cast to org.apache.jasper.el.ELContextImpl解決方法 Tomcat7出現HTTP Status 500 - java.lang.ClassCastException: org.apache.jasper.el.ELContextImpl cannot be cast to org.apache.jasper.el.ELContextImpl的解決 HTTP Status 500 - java.lang.ClassCastException: org.apache.jasper.el.ELContextImpl cannot be cast to org.apache.jasper.el.ELContextImpl springboot整合shiro用戶授權java.lang.ClassCastException: org.apache.shiro.subject.SimplePrincipalCollection cannot be cast to java.lang.String