Re: how to filter value in spark

2014-09-01 Thread Matthew Farrellee
Farrellee Cc: user@spark.apache.org Subject: Re: how to filter value in spark i see it works well,thank you!!! But in follow situation how to do var a = sc.textFile(/sparktest/1/).map((_,a)) var b = sc.textFile(/sparktest/2/).map((_,b)) How to get (3,a) and (4,a) 在 Aug 28

RE: how to filter value in spark

2014-08-31 Thread Liu, Raymond
: Friday, August 29, 2014 9:26 PM To: Matthew Farrellee Cc: user@spark.apache.org Subject: Re: how to filter value in spark i see it works well,thank you!!! But in follow situation how to do var a = sc.textFile(/sparktest/1/).map((_,a)) var b = sc.textFile(/sparktest/2/).map((_,b)) How to get (3

Re: how to filter value in spark

2014-08-29 Thread marylucy
i see it works well,thank you!!! But in follow situation how to do var a = sc.textFile(/sparktest/1/).map((_,a)) var b = sc.textFile(/sparktest/2/).map((_,b)) How to get (3,a) and (4,a) 在 Aug 28, 2014,19:54,Matthew Farrellee m...@redhat.com 写道: On 08/28/2014 07:20 AM, marylucy wrote:

Re: how to filter value in spark

2014-08-28 Thread Matthew Farrellee
On 08/28/2014 07:20 AM, marylucy wrote: fileA=1 2 3 4 one number a line,save in /sparktest/1/ fileB=3 4 5 6 one number a line,save in /sparktest/2/ I want to get 3 and 4 var a = sc.textFile(/sparktest/1/).map((_,1)) var b = sc.textFile(/sparktest/2/).map((_,1))