gt; --
> Cheers,
> -z
>
>
> From: Lian Jiang
> Sent: Monday, April 13, 2020 10:43
> To: user
> Subject: Spark interrupts S3 request backoff
>
> Hi,
>
> My Spark job failed when reading parquet files from S3 due to 503 slow
> down. According to
> https://docs
: Lian Jiang
Sent: Monday, April 13, 2020 10:43
To: user
Subject: Spark interrupts S3 request backoff
Hi,
My Spark job failed when reading parquet files from S3 due to 503 slow down.
According to
https://docs.aws.amazon.com/AmazonS3/latest/dev/optimizing-performance.html, I
can use backoff
Hi,
My Spark job failed when reading parquet files from S3 due to 503 slow
down. According to
https://docs.aws.amazon.com/AmazonS3/latest/dev/optimizing-performance.html,
I can use backoff to mitigate this issue. However, spark seems to interrupt
the backoff sleeping (see "sleep interrupted"). Is
