Re: Element appear in both 2 splits of RDD after using randomSplit

2016-02-21 Thread nguyen duc tuan
val userProducts = sc.textFile("/user/tuannd/test2.txt").map(x => { >> val d =x.split(":") >> (d(0).toInt(), d(1).toInt()) >> }) >> // other steps are as same as above &g

Re: Element appear in both 2 splits of RDD after using randomSplit

2016-02-20 Thread Ted Yu
nt()) > }) > // other steps are as same as above > > I'm using spark 1.5.2. > Thanks for all your help. > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Element-appear-in-both-2-splits-of-RDD-after-usi

Element appear in both 2 splits of RDD after using randomSplit

2016-02-20 Thread tuan3w
re as same as above I'm using spark 1.5.2. Thanks for all your help. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Element-appear-in-both-2-splits-of-RDD-after-using-randomSplit-tp2