Re: How to compute RDD[(String, Set[String])] that include large Set

was able to adopt this approach. thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-compute-RDD-String-Set-String-that-include-large-Set-tp21248p21275.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: How to compute RDD[(String, Set[String])] that include large Set

-to-compute-RDD-String-Set-String- that-include-large-Set-tp21248p21275.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands

How to compute RDD[(String, Set[String])] that include large Set

. but create RDD in RDD, NullPointerException has occured. maybe impossible this operation What might be the issue and possible solution? please lend your wisdom -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-compute-RDD-String-Set-String

Re: How to compute RDD[(String, Set[String])] that include large Set

Instead of counted.saveAsText(“/path/to/save/dir) if you call counted.collect what happens ? If you still face the same issue please paste the stacktrace here. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-compute-RDD-String-Set-String

Re: How to compute RDD[(String, Set[String])] that include large Set

in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-compute-RDD-String-Set-String-that-include-large-Set-tp21248p21251.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e

Re: How to compute RDD[(String, Set[String])] that include large Set

hoge RDD to make reduceByKey collect only counts of keys. -- View this message in context: http://apache-spark-user-list. 1001560.n3.nabble.com/How-to-compute-RDD-String-Set-String- that-include-large-Set-tp21248p21251.html Sent from the Apache Spark User List mailing list archive

Re: How to compute RDD[(String, Set[String])] that include large Set

That i want to do, get unique count for each key. so take map() or countByKey(), not get unique count. (because duplicate string is likely to be counted)... -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-compute-RDD-String-Set-String-that-include

Re: How to compute RDD[(String, Set[String])] that include large Set

() or countByKey(), not get unique count. (because duplicate string is likely to be counted)... -- View this message in context: http://apache-spark-user-list. 1001560.n3.nabble.com/How-to-compute-RDD-String-Set-String- that-include-large-Set-tp21248p21254.html Sent from the Apache Spark User List