(Spark-ml) java.util.NosuchElementException: key not found exception on doing prediction and computing test error.

2017-06-28 Thread neha nihal
Apache spark 2.0.2 randomforest ml (standalone mode) for text >> classification. TF-IDF feature extractor is also used. The training part >> runs without any issues and returns 100% accuracy. But when I am trying to >> do prediction using trained model and compute test error, it fail

Re: (Spark-ml) java.util.NosuchElementException: key not found exception on doing prediction and computing test error.

2017-06-28 Thread Pralabh Kumar
est ml (standalone mode) for text > classification. TF-IDF feature extractor is also used. The training part > runs without any issues and returns 100% accuracy. But when I am trying to > do prediction using trained model and compute test error, it fails with > java.util.NosuchE

Fwd: (Spark-ml) java.util.NosuchElementException: key not found exception on doing prediction and computing test error.

2017-06-28 Thread neha nihal
with java.util.NosuchElementException: key not found exception. Any help will be much appreciated. Thanks

(Spark-ml) java.util.NosuchElementException: key not found exception on doing prediction and computing test error.

2017-06-27 Thread neha nihal
with java.util.NosuchElementException: key not found exception. Any help will be much appreciated. Thanks & Regards

java.util.NoSuchElementException: key not found error

2015-10-21 Thread Sourav Mazumder
goes like this - java.util.NoSuchElementException: key not found: 1910 at scala.collection.MapLike$class.default(MapLike.scala:228) at scala.collection.AbstractMap.default(Map.scala:58) at scala.collection.mutable.HashMap.apply(HashMap.scala:64) at org.apache.spark.sql.columnar.compression.Dictiona

Re: java.util.NoSuchElementException: key not found error

2015-10-21 Thread Josh Rosen
ippet - > > val splitData = merged.randomSplit(Array(70,30)) > val trainData = splitData(0).persist() > val testData = splitData(1) > > trainData.registerTempTable("trn") > > %sql select * from trn > > The exception goes like this - > > java.util.NoSuchElemen

Re: calling persist would cause java.util.NoSuchElementException: key not found:

2015-10-02 Thread Shixiong Zhu
xecute the next > line I am getting > java.util.NoSuchElementException: key not found: …. > > I tried to do persist on disk also the same thing. > > I am using: > pyspark with python3 > spark 1.5 > > > Thanks! > > > EYAD SIBAI > Risk Engineer > > *iZet

calling persist would cause java.util.NoSuchElementException: key not found:

2015-10-01 Thread Eyad Sibai
Hi I am trying to call .persist() on a dataframe but once I execute the next line I am getting java.util.NoSuchElementException: key not found: …. I tried to do persist on disk also the same thing. I am using: pyspark with python3 spark 1.5 Thanks! EYAD SIBAI Risk Engineer iZettle

Re: java.util.NoSuchElementException: key not found

2015-09-11 Thread Yin Huai
eaming throw > java.util.NoSuchElementException: key not found occasionally , is the > problem of data cause this error ? please help me if anyone got similar > problem before , Thanks very much. > > the exception accur when write into database. > > > > org.apache.spark.SparkException:

java.util.NoSuchElementException: key not found

2015-09-11 Thread guoqing0...@yahoo.com.hk
Hi all , After upgrade spark to 1.5 , Streaming throw java.util.NoSuchElementException: key not found occasionally , is the problem of data cause this error ? please help me if anyone got similar problem before , Thanks very much. the exception accur when write into database

RE: SparkSql - java.util.NoSuchElementException: key not found: node when access JSON Array

2015-03-31 Thread java8964
) 15/03/31 14:37:50 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on 192.168.1.5:57836 (size: 2.3 KB, free: 530.0 MB) 15/03/31 14:37:52 WARN TaskSetManager: Lost task 0.0 in stage 1.0 (TID 1, 192.168.1.5): java.util.NoSuchElementException: key not found: node

SparkSql - java.util.NoSuchElementException: key not found: node when access JSON Array

2015-03-31 Thread Todd Nist
, 192.168.1.5): java.util.NoSuchElementException: key not found: node at scala.collection.MapLike$class.default(MapLike.scala:228) at scala.collection.AbstractMap.default(Map.scala:58) at scala.collection.MapLike$class.apply(MapLike.scala:141) at scala.collection.AbstractMap.apply(Map.scala:58

Re: SparkSql - java.util.NoSuchElementException: key not found: node when access JSON Array

2015-03-31 Thread Todd Nist
): java.util.NoSuchElementException: key not found: node at scala.collection.MapLike$class.default(MapLike.scala:228) at scala.collection.AbstractMap.default(Map.scala:58) at scala.collection.MapLike$class.apply(MapLike.scala:141) at scala.collection.AbstractMap.apply(Map.scala:58

Re: java.util.NoSuchElementException: key not found:

2015-03-02 Thread Rok Roskar
, Shixiong Zhu zsxw...@gmail.com wrote: RDD is not thread-safe. You should not use it in multiple threads. Best Regards, Shixiong Zhu 2015-02-27 23:14 GMT+08:00 rok rokros...@gmail.com: I'm seeing this java.util.NoSuchElementException: key not found: exception pop up sometimes when I run

Re: java.util.NoSuchElementException: key not found:

2015-02-27 Thread Shixiong Zhu
RDD is not thread-safe. You should not use it in multiple threads. Best Regards, Shixiong Zhu 2015-02-27 23:14 GMT+08:00 rok rokros...@gmail.com: I'm seeing this java.util.NoSuchElementException: key not found: exception pop up sometimes when I run operations on an RDD from multiple threads

java.util.NoSuchElementException: key not found:

2015-02-27 Thread rok
I'm seeing this java.util.NoSuchElementException: key not found: exception pop up sometimes when I run operations on an RDD from multiple threads in a python application. It ends up shutting down the SparkContext so I'm assuming this is a bug -- from what I understand, I should be able to run

java.util.NoSuchElementException: key not found

2014-09-16 Thread Brad Miller
Hi All, I suspect I am experiencing a bug. I've noticed that while running larger jobs, they occasionally die with the exception java.util.NoSuchElementException: key not found xyz, where xyz denotes the ID of some particular task. I've excerpted the log from one job that died in this way below