You're looking for this discussion: http://stackoverflow.com/q/23995040/877069
Also, a simpler alternative with DataFrames: https://github.com/apache/spark/pull/8375#issuecomment-202458325 On Wed, May 4, 2016 at 4:09 PM Afshartous, Nick <nafshart...@turbine.com> wrote: > Hi, > > > Is there any way to write out to S3 the values of a f key-value Pair RDD ? > > > I'd like each value of a pair to be written to its own file where the file > name corresponds to the key name. > > > Thanks, > > -- > > Nick >
