If you want to take out apple and orange you might want to try
dataRDD.filter(_._2 !=apple).filter(_._2 !=orange) and so on.
...Manas
-
Manas Kar
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/equivalent-to-sql-in-tp20599p20616.html
Sent from the
This is more a scala specific question. I would look at the List contains
implementation
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/equivalent-to-sql-in-tp20599p20600.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Option 1:
dataRDD.filter(x=(x._2 ==apple) || (x._2 ==orange))
Option 2:
val fruits = Set(apple, orange, pear)
dataRDD.filter(x=fruits.contains(x._2))
Mohammed
-Original Message-
From: dizzy5112 [mailto:dave.zee...@gmail.com]
Sent: Tuesday, December 9, 2014 2:16 PM
To:
