碼上快樂

相關內容    簡體    繁體

spark org.apache.spark.ml.linalg.DenseVector cannot be cast to org.apache.spark.ml.linalg.SparseVector

本文轉載自   查看原文   2019-07-05 10:13   774    Scala

在使用 import org.apache.spark.ml.feature.VectorAssembler 轉換特征后，想要放入 import org.apache.spark.mllib.classification.SVMWithSGD 去訓練的時候出現錯誤：

Caused by: java.lang.ClassCastException: org.apache.spark.ml.linalg.DenseVector cannot be cast to org.apache.spark.ml.linalg.SparseVector

修改如下：

val trainDataFrame = dataframe.rdd.map(r => LabeledPoint(
  r.getAs[Double]("label"),
org.apache.spark.mllib.linalg.Vectors.fromML(r.getAs[org.apache.spark.ml.linalg.SparseVector]("features").toDense)

))


免責聲明！

本站轉載的文章為個人學習借鑒使用，本站對版權不負任何法律責任。如果侵犯了您的隱私權益，請聯系本站郵箱yoyou2525@163.com刪除。



猜您在找 用java運行Hadoop程序報錯:org.apache.hadoop.fs.LocalFileSystem cannot be cast to org.apache. org.apache.catalina.util.DefaultAnnotationProcessor cannot be cast to org.apache.AnnotationProcessor 用kindeditor 報：org.apache.catalina.connector.RequestFacade cannot be cast to org.springframework.web.multipart.MultipartHttpServletRequest org.apache.spark.sql.AnalysisException: cannot resolve '`province`' given io.undertow.websockets.jsr.ServerWebSocketContainer cannot be cast to org.apache.tomcat.websocket.server.WsServerContainer 自定義 UsernamePasswordToken 報錯 java.lang.ClassCastException: org.apache.shiro.authc.UsernamePasswordToken cannot be cast to 在maven項目中使用apache cxf中遇到異常 java.lang.ClassCastException: org.springframework.web.filter.CharacterEncodingFilter cannot be cast to javax.servlet.Filter spark版本升級問題org.apache.spark.Logging hivesql 遷移spark3.0 sparksql報錯如Cannot safely cast '字段':StringType to IntegerType的問題 spark1.5 scala.collection.mutable.WrappedArray$ofRef cannot be cast to ...解決辦法
 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM