://geonames).sample(false,0.35) // 64MB,
2849439 Lines
// fails
val samples = sc.textFile(s3n://geonames).sample(false,0.4) // 64MB,
2849439 Lines
Any ideas?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-debug-Runs-locally-but-not-on-cluster
spark.executor.memory 58315m
spark.executor.extraLibraryPath /root/ephemeral-hdfs/lib/native/
spark.executor.extraClassPath /root/ephemeral-hdfs/conf
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-debug-Runs-locally-but-not-on-cluster-tp12081.html
Sent from
