Can you provide the sample code you are using? In general, RDD filter receives as an input a function. The function’s input is the single record in the RDD and the output is a Boolean whether or not to include it in the result. So you can create any function you want… Assaf.
From: Soheila S. [mailto:soheila...@gmail.com] Sent: Wednesday, December 07, 2016 6:23 PM To: user@spark.apache.org Subject: filter RDD by variable Hi I am new in Spark and have a question in first steps of Spark learning. How can I filter an RDD using an String variable (for example words[i]) , instead of a fix one like "Error"? Thanks a lot in advance. Soheila
