[GitHub] spark issue #14802: [SPARK-17235][SQL] Support purging of old logs in Metada...

2016-08-26 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14802 Alright I'm going to merge this in master/2.0. @petermaxlee and @frreiss can you guys work together? --- If your project is set up for it, you can reply to this email and have your reply app

[GitHub] spark issue #14802: [SPARK-17235][SQL] Support purging of old logs in Metada...

2016-08-26 Thread frreiss
Github user frreiss commented on the issue: https://github.com/apache/spark/pull/14802 LGTM. I have written nearly the exact same thing as part of [https://github.com/apache/spark/pull/14553], but can use this version of the method instead. --- If your project is set up for it, you

[GitHub] spark issue #14802: [SPARK-17235][SQL] Support purging of old logs in Metada...

2016-08-26 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/14802 I can but I'm doing a lot of work in this area and it is a lot more difficult since they have dependencies. It would be better to merge the logically atomic pull requests. --- If your project

[GitHub] spark issue #14802: [SPARK-17235][SQL] Support purging of old logs in Metada...

2016-08-26 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14802 @petermaxlee mind to submit the consolidation PR instead when you finish? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark issue #14802: [SPARK-17235][SQL] Support purging of old logs in Metada...

2016-08-25 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/14802 @zsxwing yup I plan to consolidate them. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark issue #14802: [SPARK-17235][SQL] Support purging of old logs in Metada...

2016-08-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14802 It would be great if we can reuse codes in `FileStreamSinkLog` for both `FileStreamSource` and `FileStreamSink`. --- If your project is set up for it, you can reply to this email and have your repl

[GitHub] spark issue #14802: [SPARK-17235][SQL] Support purging of old logs in Metada...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14802 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64403/ Test PASSed. ---

[GitHub] spark issue #14802: [SPARK-17235][SQL] Support purging of old logs in Metada...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14802 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14802: [SPARK-17235][SQL] Support purging of old logs in Metada...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14802 **[Test build #64403 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64403/consoleFull)** for PR 14802 at commit [`0d9d1e6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14802: [SPARK-17235][SQL] Support purging of old logs in Metada...

2016-08-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/14802 Looks like this is a little similar to this one #13513 . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark issue #14802: [SPARK-17235][SQL] Support purging of old logs in Metada...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14802 **[Test build #64403 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64403/consoleFull)** for PR 14802 at commit [`0d9d1e6`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #14802: [SPARK-17235][SQL] Support purging of old logs in Metada...

2016-08-25 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/14802 @tdas and @zsxwing can you take a look at this? It's a pretty simple change. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y