>>>
>>>> On Tue, Jul 26, 2016 at 2:18 AM, Mail.com <pradeep.mi...@mail.com> wrote:
>>>> Hi All,
>>>>
>>>> I have a directory which has 12 files. I want to read the entire file so I
>>>> am reading it as wholeTextFiles(dirpat
com> wrote:
>>> Hi All,
>>>
>>> I have a directory which has 12 files. I want to read the entire file so I
>>> am reading it as wholeTextFiles(dirpath, numPartitions).
>>>
>>> I run spark-submit as --num-executors 12 --executor-cores
&
have a directory which has 12 files. I want to read the entire file so I
>> am reading it as wholeTextFiles(dirpath, numPartitions).
>>
>> I run spark-submit as --num-executors 12 --executor-cores
>> 1 and numPartitions 12.
>>
>> However, when I run the jo
il.com> wrote:
> Hi All,
>
> I have a directory which has 12 files. I want to read the entire file so I am
> reading it as wholeTextFiles(dirpath, numPartitions).
>
> I run spark-submit as --num-executors 12 --executor-cores 1
> and numPartitions 12.
>
> However, wh
Hi All,
I have a directory which has 12 files. I want to read the entire file so I am
reading it as wholeTextFiles(dirpath, numPartitions).
I run spark-submit as --num-executors 12 --executor-cores 1
and numPartitions 12.
However, when I run the job I see that the stage which reads