[GitHub] spark pull request: [SPARK-6078][CORE] create event log dir if not...
Github user liyezhang556520 closed the pull request at: https://github.com/apache/spark/pull/4829 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6078][CORE] create event log dir if not...
Github user liyezhang556520 commented on the pull request: https://github.com/apache/spark/pull/4829#issuecomment-76568676 sure, I'll close this PR then, thanks for your review @JoshRosen, @srowen @andrewor14 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6078][CORE] create event log dir if not...
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/4829#issuecomment-76538499 Yes, we purposefully removed this feature. @liyezhang556520 would you mind closing this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6078][CORE] create event log dir if not...
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4829#issuecomment-76529284 FWIW I think the reasoning at https://github.com/apache/spark/pull/4120#issuecomment-72954989 still stands and so we should also close this PR + JIRA as a duplicate. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6078][CORE] create event log dir if not...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4829#issuecomment-76516881 [Test build #28120 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28120/consoleFull) for PR 4829 at commit [`e76a1b4`](https://github.com/apache/spark/commit/e76a1b46383a831f9c6a0daccf1d89934cbbefd2). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6078][CORE] create event log dir if not...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4829#issuecomment-76516882 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28120/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6078][CORE] create event log dir if not...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4829#issuecomment-76516587 @srowen @vanzin @andrewor14, what are your thoughts on the usability / security trade-offs here? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6078][CORE] create event log dir if not...
Github user liyezhang556520 commented on the pull request: https://github.com/apache/spark/pull/4829#issuecomment-76516507 Hi @JoshRosen, it's duplicate with https://issues.apache.org/jira/browse/SPARK-5311, now that it won't fix, should I also close this PR? But it is really not user friendly to manually create directory if user wants to put file in a new directory. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6078][CORE] create event log dir if not...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4829#issuecomment-76516211 If we do decide to create directories, then we should only create the last missing directory, not all missing parent directories. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6078][CORE] create event log dir if not...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4829#issuecomment-76516159 This looks like a duplicate of #4120 / https://issues.apache.org/jira/browse/SPARK-5311, which we marked as "Won't Fix": https://github.com/apache/spark/pull/4120#issuecomment-72954989 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6078][CORE] create event log dir if not...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4829#issuecomment-76514752 [Test build #28120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28120/consoleFull) for PR 4829 at commit [`e76a1b4`](https://github.com/apache/spark/commit/e76a1b46383a831f9c6a0daccf1d89934cbbefd2). * This patch merges cleanly. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6078][CORE] create event log dir if not...
GitHub user liyezhang556520 opened a pull request: https://github.com/apache/spark/pull/4829 [SPARK-6078][CORE] create event log dir if not exists when event log directory does not exists, spark just throw IlleagalArgumentException and stop the job. User need manually create directory first. It's better to create the directory automatically if the directory does not exists. You can merge this pull request into a Git repository by running: $ git pull https://github.com/liyezhang556520/spark creatLogDir Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/4829.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #4829 commit 0de4f18d2b306d2f73d3b6958b400a56c6154de1 Author: Zhang, Liye Date: 2015-02-28T06:13:38Z create eventlog dir if eventlog dir does not exists commit e76a1b46383a831f9c6a0daccf1d89934cbbefd2 Author: Zhang, Liye Date: 2015-02-28T06:44:00Z throw exception when there is same file name --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
