[GitHub] spark pull request: Added java system variable spark.hadoop.checko...
Github user bijaybisht closed the pull request at: https://github.com/apache/spark/pull/958 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: Added java system variable spark.hadoop.checko...
GitHub user bijaybisht opened a pull request: https://github.com/apache/spark/pull/958 Added java system variable spark.hadoop.checkoutputspec. Set it to false... ... via SPARK_JAVA_OPTS=-Dspark.hadoop.checkoutputspec=false to overwrite the output directory. This is required by the restart to reprocess the input after a job has failed without committing the output directory. You can merge this pull request into a Git repository by running: $ git pull https://github.com/Guavus/spark feature/override_checkoutputspec Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/958.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #958 commit 94d1b3bef2945eaf53c6801b2e476ae7628c64a4 Author: Bijay Singh Bisht bijay.si...@guavus.com Date: 2014-06-03T16:35:01Z Added java system variable spark.hadoop.checkoutputspec. Set it to false via SPARK_JAVA_OPTS=-Dspark.hadoop.checkoutputspec=false to overwrite the output directory. This is required by the restart to re reprocess the input after a job has failed without commiting the ouput directory. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: Added java system variable spark.hadoop.checko...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/958#issuecomment-45031580 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: Added java system variable spark.hadoop.checko...
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/958#issuecomment-45041874 This is a duplicate of #947 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
