>From memory: def processor(iterator): for item in iterator: newitem = do_whatever(item) yield newitem
newdata = data.mapPartition(processor) Basically, your function takes an iterator as an argument, and must either be an iterator or return one. On Sat, May 14, 2016 at 12:39 AM Abi <analyst.tech.j...@gmail.com> wrote: > > > On Tue, May 10, 2016 at 2:20 PM, Abi <analyst.tech.j...@gmail.com> wrote: > >> Is there any example of this ? I want to see how you write the the >> iterable example > > > -- Mathieu Longtin 1-514-803-8977