Cores and memory setting of driver ?
On Wed, 23 Nov 2022, 12:56 Pralabh Kumar, wrote:
> How many cores and u are running driver with?
>
> On Tue, 22 Nov 2022, 21:00 Nikhil Goyal, wrote:
>
>> Hi folks,
>> We are running a job on our on prem cluster on K8s but writing the output
>> to S3. We
How many cores and u are running driver with?
On Tue, 22 Nov 2022, 21:00 Nikhil Goyal, wrote:
> Hi folks,
> We are running a job on our on prem cluster on K8s but writing the output
> to S3. We noticed that all the executors finish in < 1h but the driver
> takes another 5h to finish. Logs:
>
>
Hi Nikhil,
You might be using the v1 file output commit protocol.
http://www.openkb.info/2019/04/what-is-difference-between.html
What is the difference between
mapreduce.fileoutputcommitter.algorithm.version=1 and 2 | Open Knowledge Base -
Hi folks,
We are running a job on our on prem cluster on K8s but writing the output
to S3. We noticed that all the executors finish in < 1h but the driver
takes another 5h to finish. Logs:
22/11/22 02:08:29 INFO BlockManagerInfo: Removed broadcast_3_piece0 on
10.42.145.11:39001 in memory (size:
Thanks. How would I go about formally submitting a feature request for this?
On 2022/11/21 23:47:16 Andrew Melo wrote:
> I think this is the right place, just a hard question :) As far as I
> know, there's no "case insensitive flag", so YMMV
>
> On Mon, Nov 21, 2022 at 5:40 PM Patrick Tucci
