Hi Jeroen, I do not believe that I completely agree with the idea that you will be spending more time and memory that way.
But if that was also the case why are you not using data frames and UDF? Regards, Gourav On Sun, Oct 1, 2017 at 6:17 PM, Jeroen Miller <bluedasya...@gmail.com> wrote: > On Fri, Sep 29, 2017 at 12:20 AM, Gourav Sengupta > <gourav.sengu...@gmail.com> wrote: > > Why are you not using JSON reader of SPARK? > > Since the filter I want to perform is so simple, I do not want to > spend time and memory to deserialise the JSON lines. > > Jeroen > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
