[jira] [Updated] (SPARK-26795) Retry remote fileSegmentManagedBuffer when create inputStream during shuffle read phase

2019-01-31 Thread feiwang (JIRA)


 [ 
https://issues.apache.org/jira/browse/SPARK-26795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

feiwang updated SPARK-26795:

Affects Version/s: 2.4.0

> Retry remote fileSegmentManagedBuffer when create inputStream during shuffle 
> read phase
> ---
>
> Key: SPARK-26795
> URL: https://issues.apache.org/jira/browse/SPARK-26795
> Project: Spark
>  Issue Type: Bug
>  Components: Shuffle
>Affects Versions: 2.3.0, 2.3.1, 2.3.2, 2.4.0
>Reporter: feiwang
>Priority: Major
> Fix For: 2.3.0, 2.3.1, 2.3.2, 2.4.0
>
>
> During shuffle read phase, the  managedBuffer which throw IOException may be 
> a remote download FileSegment and should be retry instead of throwFetchFailed 
> directly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-26795) Retry remote fileSegmentManagedBuffer when create inputStream during shuffle read phase

2019-01-31 Thread feiwang (JIRA)


 [ 
https://issues.apache.org/jira/browse/SPARK-26795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

feiwang updated SPARK-26795:

Fix Version/s: (was: 2.4.1)
   2.3.0
   2.3.1
   2.3.2
   2.4.0

> Retry remote fileSegmentManagedBuffer when create inputStream during shuffle 
> read phase
> ---
>
> Key: SPARK-26795
> URL: https://issues.apache.org/jira/browse/SPARK-26795
> Project: Spark
>  Issue Type: Bug
>  Components: Shuffle
>Affects Versions: 2.3.0, 2.3.1, 2.3.2
>Reporter: feiwang
>Priority: Major
> Fix For: 2.3.0, 2.3.1, 2.3.2, 2.4.0
>
>
> During shuffle read phase, the  managedBuffer which throw IOException may be 
> a remote download FileSegment and should be retry instead of throwFetchFailed 
> directly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-26795) Retry remote fileSegmentManagedBuffer when create inputStream during shuffle read phase

2019-01-31 Thread feiwang (JIRA)


 [ 
https://issues.apache.org/jira/browse/SPARK-26795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

feiwang updated SPARK-26795:

Target Version/s: 2.4.0, 2.3.2  (was: 2.3.2, 2.4.0)
   Fix Version/s: (was: 2.3.2)
  2.4.1

> Retry remote fileSegmentManagedBuffer when create inputStream during shuffle 
> read phase
> ---
>
> Key: SPARK-26795
> URL: https://issues.apache.org/jira/browse/SPARK-26795
> Project: Spark
>  Issue Type: Bug
>  Components: Shuffle
>Affects Versions: 2.3.0, 2.3.1, 2.3.2
>Reporter: feiwang
>Priority: Major
> Fix For: 2.4.1
>
>
> During shuffle read phase, the  managedBuffer which throw IOException may be 
> a remote download FileSegment and should be retry instead of throwFetchFailed 
> directly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-26795) Retry remote fileSegmentManagedBuffer when create inputStream during shuffle read phase

2019-01-31 Thread feiwang (JIRA)


 [ 
https://issues.apache.org/jira/browse/SPARK-26795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

feiwang updated SPARK-26795:

Description: During shuffle read phase, the  managedBuffer which throw 
IOException may be a remote download FileSegment and should be retry instead of 
throwFetchFailed directly.

> Retry remote fileSegmentManagedBuffer when create inputStream during shuffle 
> read phase
> ---
>
> Key: SPARK-26795
> URL: https://issues.apache.org/jira/browse/SPARK-26795
> Project: Spark
>  Issue Type: Bug
>  Components: Shuffle
>Affects Versions: 2.3.0, 2.3.1, 2.3.2
>Reporter: feiwang
>Priority: Major
> Fix For: 2.3.2
>
>
> During shuffle read phase, the  managedBuffer which throw IOException may be 
> a remote download FileSegment and should be retry instead of throwFetchFailed 
> directly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-26795) Retry remote fileSegmentManagedBuffer when create inputStream during shuffle read phase

2019-01-31 Thread feiwang (JIRA)


 [ 
https://issues.apache.org/jira/browse/SPARK-26795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

feiwang updated SPARK-26795:

Summary: Retry remote fileSegmentManagedBuffer when create inputStream 
during shuffle read phase  (was: During shuffle read phase, the  managedBuffer 
which throw IOException may be a remote download FileSegment and should be 
retry instead of throwFetchFailed directly.)

> Retry remote fileSegmentManagedBuffer when create inputStream during shuffle 
> read phase
> ---
>
> Key: SPARK-26795
> URL: https://issues.apache.org/jira/browse/SPARK-26795
> Project: Spark
>  Issue Type: Bug
>  Components: Shuffle
>Affects Versions: 2.3.0, 2.3.1, 2.3.2
>Reporter: feiwang
>Priority: Major
> Fix For: 2.3.2
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org