[GitHub] spark issue #16009: [SPARK-18318][ML] ML, Graph 2.1 QA: API: New Scala APIs,...

2016-11-30 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/16009 LGTM Merging with master and branch-2.1 Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #16009: [SPARK-18318][ML] ML, Graph 2.1 QA: API: New Scal...

2016-11-30 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/16009#discussion_r90330019 --- Diff: docs/ml-features.md --- @@ -1188,7 +1188,9 @@ categorical features. The number of bins is set by the `numBuckets` parameter. I that the

[GitHub] spark issue #15982: [SPARK-18546][core] Fix merging shuffle spills when usin...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15982 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16085: [SPARK-18655][SS]Ignore Structured Streaming 2.0.2 logs ...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16085 **[Test build #3447 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3447/consoleFull)** for PR 16085 at commit

[GitHub] spark issue #16085: [SPARK-18655][SS]Ignore Structured Streaming 2.0.2 logs ...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16085 **[Test build #69429 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69429/consoleFull)** for PR 16085 at commit

[GitHub] spark issue #15923: [SPARK-4105] retry the fetch or stage if shuffle block i...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15923 **[Test build #69422 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69422/consoleFull)** for PR 15923 at commit

[GitHub] spark issue #15923: [SPARK-4105] retry the fetch or stage if shuffle block i...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15923 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69422/ Test FAILed. ---

[GitHub] spark issue #16085: [SPARK-18655][SS]Ignore Structured Streaming 2.0.2 logs ...

2016-11-30 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16085 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16085: [SPARK-18655][SS]Ignore Structured Streaming 2.0.2 logs ...

2016-11-30 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16085 > Test build #69423 has started for PR 16085 at commit 33c253f. This is hanging here but is not related to this change: ``` [info] ExternalAppendOnlyMapSuite: [info] - single

[GitHub] spark issue #15923: [SPARK-4105] retry the fetch or stage if shuffle block i...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15923 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15982: [SPARK-18546][core] Fix merging shuffle spills when usin...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15982 **[Test build #69419 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69419/consoleFull)** for PR 15982 at commit

[GitHub] spark issue #15982: [SPARK-18546][core] Fix merging shuffle spills when usin...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15982 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69419/ Test PASSed. ---

[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #69428 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69428/consoleFull)** for PR 14079 at commit

[GitHub] spark pull request #16061: [SPARK-18278] [Scheduler] Support native submissi...

2016-11-30 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/16061#discussion_r90323622 --- Diff: kubernetes/src/main/scala/org/apache/spark/scheduler/cluster/kubernetes/KubernetesClusterSchedulerBackend.scala --- @@ -0,0 +1,222 @@ +/*

[GitHub] spark issue #15813: [SPARK-18362][SQL] Use TextFileFormat in implementation ...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15813 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15813: [SPARK-18362][SQL] Use TextFileFormat in implementation ...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15813 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69418/ Test PASSed. ---

[GitHub] spark issue #15813: [SPARK-18362][SQL] Use TextFileFormat in implementation ...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15813 **[Test build #69418 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69418/consoleFull)** for PR 15813 at commit

[GitHub] spark pull request #16061: [SPARK-18278] [Scheduler] Support native submissi...

2016-11-30 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/16061#discussion_r90321324 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -596,6 +599,26 @@ object SparkSubmit extends CommandLineUtils { }

[GitHub] spark pull request #16061: [SPARK-18278] [Scheduler] Support native submissi...

2016-11-30 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/16061#discussion_r90321063 --- Diff: dev/deps/spark-deps-hadoop-2.4 --- @@ -98,7 +98,7 @@ jersey-client-2.22.2.jar jersey-common-2.22.2.jar

[GitHub] spark pull request #16061: [SPARK-18278] [Scheduler] Support native submissi...

2016-11-30 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/16061#discussion_r90320239 --- Diff: kubernetes/src/main/scala/org/apache/spark/scheduler/cluster/kubernetes/KubernetesClusterSchedulerBackend.scala --- @@ -0,0 +1,222 @@ +/*

[GitHub] spark pull request #16061: [SPARK-18278] [Scheduler] Support native submissi...

2016-11-30 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/16061#discussion_r90320078 --- Diff: kubernetes/src/main/scala/org/apache/spark/scheduler/cluster/kubernetes/KubernetesClusterSchedulerBackend.scala --- @@ -0,0 +1,222 @@ +/*

[GitHub] spark issue #15821: [SPARK-13534][WIP][PySpark] Using Apache Arrow to increa...

2016-11-30 Thread wesm
Github user wesm commented on the issue: https://github.com/apache/spark/pull/15821 Luckily we are on the home stretch for making the Java and C++ libraries binary compatible -- e.g. I'm working on automated testing today: https://github.com/apache/arrow/pull/219 --- If your

[GitHub] spark issue #15910: [SPARK-18476][SPARKR][ML]:SparkR Logistic Regression sho...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15910 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69413/ Test PASSed. ---

[GitHub] spark pull request #13147: [SPARK-6320][SQL] Move planLater method into Gene...

2016-11-30 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/13147#discussion_r90317826 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/QueryPlanner.scala --- @@ -27,6 +27,14 @@ import

[GitHub] spark issue #15910: [SPARK-18476][SPARKR][ML]:SparkR Logistic Regression sho...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15910 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15910: [SPARK-18476][SPARKR][ML]:SparkR Logistic Regression sho...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15910 **[Test build #69413 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69413/consoleFull)** for PR 15910 at commit

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-11-30 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/16030 @brkyvz @maropu Actually, we do allow users to create partitioned tables that allow data schema to contains (part of) the partition columns, and there are [test][1] [cases][2] for this use case.

[GitHub] spark issue #16085: [SPARK-18655][SS]Ignore Structured Streaming 2.0.2 logs ...

2016-11-30 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16085 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15662: [SPARK-18141][SQL] Fix to quote column names in the pred...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15662 **[Test build #69427 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69427/consoleFull)** for PR 15662 at commit

[GitHub] spark issue #15992: [SPARK-18560][CORE][STREAMING][WIP] Receiver data can no...

2016-11-30 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15992 I think this PR has one issue. There are two places requiring ClassTag. The first one is creating `Receiver`, the other one is calling `receiverStream`. If they are inconsistent (e.g., writing some

[GitHub] spark pull request #16073: [SPARK-18640] Add synchronization to TaskSchedule...

2016-11-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16073 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16080: [SPARK-18647][SQL] do not put provider in table properti...

2016-11-30 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16080 We need a test case here. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16082 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16082 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69416/ Test PASSed. ---

[GitHub] spark issue #16081: [SPARK][EXAMPLE] Added missing semicolon in quick-start-...

2016-11-30 Thread andrewor14
Github user andrewor14 commented on the issue: https://github.com/apache/spark/pull/16081 and 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #16081: [SPARK][EXAMPLE] Added missing semicolon in quick...

2016-11-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16081 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16082 **[Test build #69416 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69416/consoleFull)** for PR 16082 at commit

[GitHub] spark issue #16070: [SPARK-18553][CORE][BRANCH-1.6] Fix leak of TaskSetManag...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16070 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69414/ Test PASSed. ---

[GitHub] spark issue #16070: [SPARK-18553][CORE][BRANCH-1.6] Fix leak of TaskSetManag...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16070 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16073: [SPARK-18640] Add synchronization to TaskScheduler.runni...

2016-11-30 Thread andrewor14
Github user andrewor14 commented on the issue: https://github.com/apache/spark/pull/16073 and 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16070: [SPARK-18553][CORE][BRANCH-1.6] Fix leak of TaskSetManag...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16070 **[Test build #69414 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69414/consoleFull)** for PR 16070 at commit

[GitHub] spark issue #16073: [SPARK-18640] Add synchronization to TaskScheduler.runni...

2016-11-30 Thread andrewor14
Github user andrewor14 commented on the issue: https://github.com/apache/spark/pull/16073 LGTM merging into master 2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16084: [SPARK-18654][SQL] Remove unreachable patterns in makeRo...

2016-11-30 Thread NathanHowell
Github user NathanHowell commented on the issue: https://github.com/apache/spark/pull/16084 cc/ @HyukjinKwon --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16081: [SPARK][EXAMPLE] Added missing semicolon in quick-start-...

2016-11-30 Thread andrewor14
Github user andrewor14 commented on the issue: https://github.com/apache/spark/pull/16081 Ok, merging into master 2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15780 **[Test build #69426 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69426/consoleFull)** for PR 15780 at commit

[GitHub] spark pull request #15780: [SPARK-18284][SQL] Make ExpressionEncoder.seriali...

2016-11-30 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/15780#discussion_r90309952 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -405,13 +407,12 @@ case class WrapOption(child:

[GitHub] spark pull request #15780: [SPARK-18284][SQL] Make ExpressionEncoder.seriali...

2016-11-30 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/15780#discussion_r90309935 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/ExpressionEncoderSuite.scala --- @@ -338,6 +338,18 @@ class

[GitHub] spark pull request #15780: [SPARK-18284][SQL] Make ExpressionEncoder.seriali...

2016-11-30 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/15780#discussion_r90309905 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -171,15 +171,17 @@ case class StaticInvoke(

[GitHub] spark issue #16086: [SPARK-18653][SQL] Fix incorrect space padding for unico...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16086 **[Test build #69425 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69425/consoleFull)** for PR 16086 at commit

[GitHub] spark issue #15821: [SPARK-13534][WIP][PySpark] Using Apache Arrow to increa...

2016-11-30 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/15821 Thanks @mariusvniekerk, as @holdenk said we are going to try to get something basic working first and after we show some performance improvement, we can follow up with more things --- If your

[GitHub] spark issue #16086: [SPARK-18653][SQL] Fix incorrect space padding for unico...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16086 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16086: [SPARK-18653][SQL] Fix incorrect space padding for unico...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16086 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69424/ Test FAILed. ---

[GitHub] spark issue #16086: [SPARK-18653][SQL] Fix incorrect space padding for unico...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16086 **[Test build #69424 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69424/consoleFull)** for PR 16086 at commit

[GitHub] spark pull request #16052: [SPARK-18617][CORE][STREAMING] Close "kryo auto p...

2016-11-30 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16052#discussion_r90306255 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/StreamingContextSuite.scala --- @@ -869,6 +891,31 @@ object TestReceiver { val counter

[GitHub] spark issue #16086: [SPARK-18653][SQL] Fix incorrect space padding for unico...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16086 **[Test build #69424 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69424/consoleFull)** for PR 16086 at commit

[GitHub] spark issue #16085: [SPARK-18655][SS]Ignore Structured Streaming 2.0.2 logs ...

2016-11-30 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16085 cc @tdas --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16085: [SPARK-18655][SS]Ignore Structured Streaming 2.0.2 logs ...

2016-11-30 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16085 Another option is adding `@JsonIgnoreProperties` to these classes to ignore unknown fields. However, there are two disadvantages: - It's easy to ignore something that we don't want to

[GitHub] spark issue #16085: [SPARK-18655][SS]Ignore Structured Streaming 2.0.2 logs ...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16085 **[Test build #69423 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69423/consoleFull)** for PR 16085 at commit

[GitHub] spark pull request #16085: [SPARK-18655][SS]Ignore Structured Streaming 2.0....

2016-11-30 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/16085 [SPARK-18655][SS]Ignore Structured Streaming 2.0.2 logs in history server ## What changes were proposed in this pull request? As `queryStatus` in StreamingQueryListener events was removed

[GitHub] spark issue #16071: [SPARK-18635] [SQL] [WIP] Partition name/values not esca...

2016-11-30 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/16071 I can't vouch for how `Path` and `URI` work together to do the right thing, however the test coverage looks good. LGTM overall. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #16083: [SPARK-18097][SQL] Add exception catch to handle corrupt...

2016-11-30 Thread thomastechs
Github user thomastechs commented on the issue: https://github.com/apache/spark/pull/16083 This patch would be catching the exception happening while the metadatacheck(due to getting corrupted) and continue with a warning log and continue with the drop operation... --- If your

[GitHub] spark pull request #16071: [SPARK-18635] [SQL] [WIP] Partition name/values n...

2016-11-30 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/16071#discussion_r90303311 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/PartitionProviderCompatibilitySuite.scala --- @@ -205,6 +205,58 @@ class

[GitHub] spark issue #16084: [SPARK-18654][SQL] Remove unreachable patterns in makeRo...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16084 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16084: [SPARK-18654][SQL] Remove unreachable patterns in...

2016-11-30 Thread NathanHowell
GitHub user NathanHowell opened a pull request: https://github.com/apache/spark/pull/16084 [SPARK-18654][SQL] Remove unreachable patterns in makeRootConverter ## What changes were proposed in this pull request? `makeRootConverter` is only called with a `StructType` value.

[GitHub] spark pull request #16071: [SPARK-18635] [SQL] [WIP] Partition name/values n...

2016-11-30 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16071#discussion_r90302152 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/PartitionProviderCompatibilitySuite.scala --- @@ -205,6 +205,58 @@ class

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16082 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69420/ Test PASSed. ---

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16082 **[Test build #69420 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69420/consoleFull)** for PR 16082 at commit

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16082 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16068: [SPARK-18637][SQL]Stateful UDF should be considered as n...

2016-11-30 Thread zhzhan
Github user zhzhan commented on the issue: https://github.com/apache/spark/pull/16068 retest it please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #16071: [SPARK-18635] [SQL] [WIP] Partition name/values n...

2016-11-30 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/16071#discussion_r90300900 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/PartitionProviderCompatibilitySuite.scala --- @@ -205,6 +205,58 @@ class

[GitHub] spark issue #16061: [SPARK-18278] [Scheduler] Support native submission of s...

2016-11-30 Thread foxish
Github user foxish commented on the issue: https://github.com/apache/spark/pull/16061 Cross posting link to [the proposal](https://issues.apache.org/jira/secure/attachment/12840988/SPARK-18278%20-%20Spark%20on%20Kubernetes%20Design%20Proposal.pdf) here. --- If your project is set

[GitHub] spark issue #15923: [SPARK-4105] retry the fetch or stage if shuffle block i...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15923 **[Test build #69422 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69422/consoleFull)** for PR 15923 at commit

[GitHub] spark issue #15662: [SPARK-18141][SQL] Fix to quote column names in the pred...

2016-11-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15662 LGTM except a minor comment cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #16061: [SPARK-18278] [Scheduler] Support native submissi...

2016-11-30 Thread foxish
Github user foxish commented on a diff in the pull request: https://github.com/apache/spark/pull/16061#discussion_r90298908 --- Diff: dev/make-distribution.sh --- @@ -154,7 +154,9 @@ export MAVEN_OPTS="${MAVEN_OPTS:--Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCac # Store the

[GitHub] spark pull request #15662: [SPARK-18141][SQL] Fix to quote column names in t...

2016-11-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15662#discussion_r90298317 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala --- @@ -855,6 +855,8 @@ class JDBCSuite extends SparkFunSuite

[GitHub] spark pull request #15991: [SPARK-17843][WEB UI] Indicate event logs pending...

2016-11-30 Thread vijoshi
Github user vijoshi closed the pull request at: https://github.com/apache/spark/pull/15991 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16083: [SPARK-18097][SQL] Add exception catch to handle corrupt...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16083 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16083: [SPARK-18097][SQL] Add exception catch to handle ...

2016-11-30 Thread jayadevanmurali
GitHub user jayadevanmurali opened a pull request: https://github.com/apache/spark/pull/16083 [SPARK-18097][SQL] Add exception catch to handle corrupted metadata scenario while dropping the table ## What changes were proposed in this pull request? Add exception catch to handle

[GitHub] spark issue #15982: [SPARK-18546][core] Fix merging shuffle spills when usin...

2016-11-30 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15982 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16048: [DO_NOT_MERGE]Test kafka deletion

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16048 **[Test build #69421 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69421/consoleFull)** for PR 16048 at commit

[GitHub] spark issue #16048: [DO_NOT_MERGE]Test kafka deletion

2016-11-30 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16048 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15979: [SPARK-18251][SQL] the type of Dataset can't be Option o...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15979 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15979: [SPARK-18251][SQL] the type of Dataset can't be Option o...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15979 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69411/ Test PASSed. ---

[GitHub] spark issue #15987: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-11-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15987 Hi, @hvanhovell , @gatorsmile , @rxin . Should we remove *Expression* related stuff? Originally, #15302 does not have this kind of expression issue. It's just an extension of the

[GitHub] spark issue #15979: [SPARK-18251][SQL] the type of Dataset can't be Option o...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15979 **[Test build #69411 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69411/consoleFull)** for PR 15979 at commit

[GitHub] spark issue #15958: [SPARK-17932][SQL] Support SHOW TABLES EXTENDED LIKE 'id...

2016-11-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15958 @jiangxb1987 Could you submit a follow-up PR to correct it? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #15958: [SPARK-17932][SQL] Support SHOW TABLES EXTENDED L...

2016-11-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15958#discussion_r90293883 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -124,8 +124,8 @@ statement (USING resource

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16082 **[Test build #69420 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69420/consoleFull)** for PR 16082 at commit

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16082 **[Test build #69415 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69415/consoleFull)** for PR 16082 at commit

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16082 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69415/ Test FAILed. ---

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16082 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16064: [SPARK-18633][ML][Example]: Add multiclass logistic regr...

2016-11-30 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/16064 cc @sethah @yanboliang @MLnick --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15982: [SPARK-18546][core] Fix merging shuffle spills when usin...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15982 **[Test build #69419 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69419/consoleFull)** for PR 15982 at commit

[GitHub] spark issue #15813: [SPARK-18362][SQL] Use TextFileFormat in implementation ...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15813 **[Test build #69418 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69418/consoleFull)** for PR 15813 at commit

[GitHub] spark issue #15910: [SPARK-18476][SPARKR][ML]:SparkR Logistic Regression sho...

2016-11-30 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15910 LGTM. we need to get this in branch-2.1 because of the signature change --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16082 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16082 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69412/ Test PASSed. ---

[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #69417 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69417/consoleFull)** for PR 14079 at commit

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16082 **[Test build #69412 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69412/consoleFull)** for PR 16082 at commit

[GitHub] spark pull request #16060: [SPARK-18220][SQL] read Hive orc table with varch...

2016-11-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16060 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

<    1   2   3   4   5   6   7   >