Re: optimize multiple filter operations

2014-11-29 Thread Imran Rashid
l.filter(lambda x: x != something) >> >> By doing this, I am doing two passes over the data. Is there any way to >> optimise this to do it in a single pass? >> >> Note: I was trying to look in the mailing list to see if this question has >> been asked already,

Re: optimize multiple filter operations

2014-11-28 Thread Rishi Yadav
oing this, I am doing two passes over the data. Is there any way to > optimise this to do it in a single pass? > > Note: I was trying to look in the mailing list to see if this question has > been asked already, but could not find it. > > > > -- > View this message in cont

optimize multiple filter operations

2014-11-28 Thread mrm
60.n3.nabble.com/optimize-multiple-filter-operations-tp20010.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: u