te: *Monday, January 22, 2018 at 8:19 AM
> *To: *"user@spark.apache.org" <user@spark.apache.org>
> *Subject: *[EXT] How do I extract a value in foreachRDD operation
>
>
>
> Hi,
>
>
>
> We have a spark application to parse log files and save to S3 in ORC
>
<noppani...@gmail.com>
Date: Monday, January 22, 2018 at 8:19 AM
To: "user@spark.apache.org" <user@spark.apache.org>
Subject: [EXT] How do I extract a value in foreachRDD operation
Hi,
We have a spark application to parse log files and save to S3 in ORC format.
However,
Hi,
We have a spark application to parse log files and save to S3 in ORC
format. However, during the foreachRDD operation we need to extract a date
field to be able to determine the bucket location; we partition it by date.
Currently, we just hardcode it by current date, but we have a requirement
