As far as I know, spark don't support multiple outputs On Wed, Jun 3, 2015 at 2:15 PM, ayan guha <guha.a...@gmail.com> wrote:
> Why do you need to do that if filter and content of the resulting rdd are > exactly same? You may as well declare them as 1 RDD. > On 3 Jun 2015 15:28, "ÐΞ€ρ@Ҝ (๏̯͡๏)" <deepuj...@gmail.com> wrote: > >> I want to do this >> >> val qtSessionsWithQt = rawQtSession.filter(_._2.qualifiedTreatmentId >> != NULL_VALUE) >> >> val guidUidMapSessions = rawQtSession.filter(_._2. >> qualifiedTreatmentId == NULL_VALUE) >> >> This will run two different stages can this be done in one stage ? >> >> val (qtSessionsWithQt, guidUidMapSessions) = rawQtSession. >> *magicFilter*(_._2.qualifiedTreatmentId != NULL_VALUE) >> >> >> >> >> -- >> Deepak >> >> -- Best Regards Jeff Zhang
