How many reducers are you using? Daniel
> On 16 באפר׳ 2015, at 00:55, Tianqi Tong <[email protected]> wrote: > > Hi, > I'm loading data to a Parquet table with dynamic partitons. I have 40k+ > partitions, and I have skipped the partition stats computation step. > Somehow it's still exetremely slow loading data into partitions (800MB/h). > Do you have any hints on the possible reason and solution? > > Thank you > Tianqi Tong >
