Which spark version are you using? Could you also include the worker logs? -Xiangrui
On Wed, Apr 23, 2014 at 3:19 PM, Ian Ferreira <[email protected]> wrote: > I am getting this cryptic error running LinearRegressionwithSGD > > Data sample > LabeledPoint(39.0, [144.0, 1521.0, 20736.0, 59319.0, 2985984.0]) > > 14/04/23 15:15:34 INFO SparkContext: Starting job: first at > GeneralizedLinearAlgorithm.scala:121 > 14/04/23 15:15:34 INFO DAGScheduler: Got job 2 (first at > GeneralizedLinearAlgorithm.scala:121) with 1 output partitions > (allowLocal=true) > 14/04/23 15:15:34 INFO DAGScheduler: Final stage: Stage 2 (first at > GeneralizedLinearAlgorithm.scala:121) > 14/04/23 15:15:34 INFO DAGScheduler: Parents of final stage: List() > 14/04/23 15:15:34 INFO DAGScheduler: Missing parents: List() > 14/04/23 15:15:34 INFO DAGScheduler: Computing the requested partition > locally > 14/04/23 15:15:34 INFO HadoopRDD: Input split: > file:/Users/iferreira/data/test.csv:0+104 > 14/04/23 15:15:34 INFO SparkContext: Job finished: first at > GeneralizedLinearAlgorithm.scala:121, took 0.030158 s > 14/04/23 15:15:34 INFO SparkContext: Starting job: count at > GradientDescent.scala:137 > 14/04/23 15:15:34 INFO DAGScheduler: Got job 3 (count at > GradientDescent.scala:137) with 2 output partitions (allowLocal=false) > 14/04/23 15:15:34 INFO DAGScheduler: Final stage: Stage 3 (count at > GradientDescent.scala:137) > 14/04/23 15:15:34 INFO DAGScheduler: Parents of final stage: List() > 14/04/23 15:15:34 INFO DAGScheduler: Missing parents: List() > 14/04/23 15:15:34 INFO DAGScheduler: Submitting Stage 3 (MappedRDD[7] at map > at GeneralizedLinearAlgorithm.scala:139), which has no missing parents > 14/04/23 15:15:35 INFO DAGScheduler: Failed to run count at > GradientDescent.scala:137 > > Any clues what may trigger this error, overflow? > >
