Re: Any Idea about this error : IllegalArgumentException: File segment length cannot be negative ?

2017-04-20 Thread Victor Tso-Guillen
Along with Priya's email slightly earlier than this one, we also are seeing this happen on Spark 1.5.2. On Wed, Jul 13, 2016 at 1:26 AM Dibyendu Bhattacharya < dibyendu.bhattach...@gmail.com> wrote: > In Spark Streaming job, I see a Batch failed with following error. Haven't > seen anything like

Any Idea about this error : IllegalArgumentException: File segment length cannot be negative ?

2016-07-13 Thread Dibyendu Bhattacharya
In Spark Streaming job, I see a Batch failed with following error. Haven't seen anything like this earlier. This has happened during Shuffle for one Batch (haven't reoccurred after that).. Just curious to know what can cause this error. I am running Spark 1.5.1 Regards, Dibyendu Job aborted