[GitHub] [spark] wypoon commented on pull request #29193: [SPARK-32003][CORE][3.0] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-08-03 Thread GitBox


wypoon commented on pull request #29193:
URL: https://github.com/apache/spark/pull/29193#issuecomment-668279447


   retest this please



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] wypoon commented on pull request #29193: [SPARK-32003][CORE][3.0] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-25 Thread GitBox


wypoon commented on pull request #29193:
URL: https://github.com/apache/spark/pull/29193#issuecomment-663910099


   Finally, this has passed the tests!



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] wypoon commented on pull request #29193: [SPARK-32003][CORE][3.0] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-24 Thread GitBox


wypoon commented on pull request #29193:
URL: https://github.com/apache/spark/pull/29193#issuecomment-663758369


   retest this please



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] wypoon commented on pull request #29193: [SPARK-32003][CORE][3.0] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-24 Thread GitBox


wypoon commented on pull request #29193:
URL: https://github.com/apache/spark/pull/29193#issuecomment-663653034


   retest this please



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] wypoon commented on pull request #29193: [SPARK-32003][CORE][3.0] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-24 Thread GitBox


wypoon commented on pull request #29193:
URL: https://github.com/apache/spark/pull/29193#issuecomment-663652966


   Urgh, BarrierTaskContextSuite seems flaky (failed in two builds now, but 
passed in two earlier builds that ran into other issues), although the failing 
test is not the same each time. And this time, ran into Kafka failures as well.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] wypoon commented on pull request #29193: [SPARK-32003][CORE][3.0] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-23 Thread GitBox


wypoon commented on pull request #29193:
URL: https://github.com/apache/spark/pull/29193#issuecomment-663309267


   retest this please



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] wypoon commented on pull request #29193: [SPARK-32003][CORE][3.0] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-23 Thread GitBox


wypoon commented on pull request #29193:
URL: https://github.com/apache/spark/pull/29193#issuecomment-663256083


   @dongjoon-hyun are you aware of any CI issues currently? I think an issue 
with PySpark pip packaging tests was fixed recently: 
[SPARK-32303](https://issues.apache.org/jira/browse/SPARK-32303). I saw the 
same symptom again in [build 
#126354](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126354/)
 above.
   Don't know if the problem is branch-3.0 specific.
   
   I also hit the bad .m2 problem in [build 
#126370](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126370/).



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] wypoon commented on pull request #29193: [SPARK-32003][CORE][3.0] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-23 Thread GitBox


wypoon commented on pull request #29193:
URL: https://github.com/apache/spark/pull/29193#issuecomment-663242892


   retest this please



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] wypoon commented on pull request #29193: [SPARK-32003][CORE][3.0] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-23 Thread GitBox


wypoon commented on pull request #29193:
URL: https://github.com/apache/spark/pull/29193#issuecomment-663242753


   org.apache.spark.sql.connector.FileDataSourceV2FallBackSuite.Fallback 
Parquet V2 to V1 failed in 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126425; 
however, earlier, it passed in 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126354/. It 
must be flaky.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] wypoon commented on pull request #29193: [SPARK-32003][CORE][3.0] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-23 Thread GitBox


wypoon commented on pull request #29193:
URL: https://github.com/apache/spark/pull/29193#issuecomment-663112765


   retest this please



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] wypoon commented on pull request #29193: [SPARK-32003][CORE][3.0] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-22 Thread GitBox


wypoon commented on pull request #29193:
URL: https://github.com/apache/spark/pull/29193#issuecomment-662780377


   retest this please



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] wypoon commented on pull request #29193: [SPARK-32003][CORE][3.0] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-22 Thread GitBox


wypoon commented on pull request #29193:
URL: https://github.com/apache/spark/pull/29193#issuecomment-662627439


   This is a backport of https://github.com/apache/spark/pull/28848 to 
branch-3.0. The backport of DAGScheduler.scala is straightforward, with a minor 
diff conflict in a comment. The backport of DAGSchedulerSuite.scala needed some 
minor adjustments, it is between the version in master and the version in 
branch-2.4.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org