Re: java program got Stuck at broadcasting

2015-05-21 Thread Akhil Das
sum += > (allPoints[i][j]-featureVals[j])*(allPoints[i][j]-featureVals[j]); > } > list.add(new > Tuple2<Pair,Double>(new > Pair(i,jIndex),Math.sqrt(sum))); >

Re: java program got Stuck at broadcasting

2015-05-21 Thread allanjie
} }); distance.saveAsTextFile("hdfs://HadoopV26Master:9000/user/"+args[0]); } } -- View this message in context: http://apache-spark-us

Re: java program got Stuck at broadcasting

2015-05-21 Thread allanjie
iable and then that variable will dominate the whole hdfs? P.S. when I reduce the data size to only 10 lines (200kb), it works without problem. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/java-program-got-Stuck-at-broadcasting-tp22953p22972.html Sent fro

java program got Stuck at broadcasting

2015-05-20 Thread allanjie
message in context: http://apache-spark-user-list.1001560.n3.nabble.com/java-program-got-Stuck-at-broadcasting-tp22956.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr