am not sure I can do this now either.
Please clarify me if I misunderstood what you meant.
Thanks,
Jegan
On Mon, Oct 5, 2015 at 4:42 PM, Reynold Xin <r...@databricks.com> wrote:
> You can write the data to local hdfs (or local disk) and just load it from
> there.
>
>
> On Mon
-around?
Thanks again.
Regards,
Jegan
On Mon, Oct 5, 2015 at 3:53 PM, Ted Yu <yuzhih...@gmail.com> wrote:
> As a workaround, can you set the number of partitions higher in the
> sc.textFile method ?
>
> Cheers
>
> On Mon, Oct 5, 2015 at 3:31 PM, Jegan <jega...@gmail.com>
