[GitHub] spark issue #15803: [SPARK-18298][Web UI]change gmt time to local zone time ...

2016-11-09 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on the issue: https://github.com/apache/spark/pull/15803 Nah i think we have a misunderstand here. @tgravescs If understand right, what you mean is that most companies run their server in UTC timezone. That's OK. Under that condition,

[GitHub] spark issue #15682: [SPARK-18169][SQL] Suppress warnings when dropping views...

2016-11-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15682 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15689: [SPARK-9487] Use the same num. worker threads in Scala/P...

2016-11-09 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15689 @skanjila It seems something gone wrong. Could you please rebase this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15837: [SQL] Evaluate common subexpression like lazy variable w...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15837 **[Test build #68452 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68452/consoleFull)** for PR 15837 at commit

[GitHub] spark issue #15682: [SPARK-18169][SQL] Suppress warnings when dropping views...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15682 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15682: [SPARK-18169][SQL] Suppress warnings when dropping views...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15682 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68449/ Test FAILed. ---

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68447/ Test FAILed. ---

[GitHub] spark issue #15682: [SPARK-18169][SQL] Suppress warnings when dropping views...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15682 **[Test build #68449 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68449/consoleFull)** for PR 15682 at commit

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #68447 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68447/consoleFull)** for PR 15659 at commit

[GitHub] spark issue #15172: [SPARK-13331] AES support for over-the-wire encryption

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15172 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15172: [SPARK-13331] AES support for over-the-wire encryption

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15172 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68444/ Test PASSed. ---

[GitHub] spark issue #15172: [SPARK-13331] AES support for over-the-wire encryption

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15172 **[Test build #68444 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68444/consoleFull)** for PR 15172 at commit

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15620 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15620 **[Test build #68451 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68451/consoleFull)** for PR 15620 at commit

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15620 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68451/ Test FAILed. ---

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15620 **[Test build #68451 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68451/consoleFull)** for PR 15620 at commit

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-09 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15620 ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #14612: [SPARK-16803] [SQL] SaveAsTable does not work when sourc...

2016-11-09 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14612 Sure, will finish this tomorrow. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15172: [SPARK-13331] AES support for over-the-wire encry...

2016-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15172#discussion_r87336716 --- Diff: common/network-common/src/main/java/org/apache/spark/network/util/ByteArrayReadableChannel.java --- @@ -0,0 +1,73 @@ +/* + * Licensed to

[GitHub] spark pull request #15172: [SPARK-13331] AES support for over-the-wire encry...

2016-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15172#discussion_r87337925 --- Diff: common/network-common/src/main/java/org/apache/spark/network/sasl/aes/AesCipher.java --- @@ -0,0 +1,305 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #15172: [SPARK-13331] AES support for over-the-wire encry...

2016-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15172#discussion_r87337577 --- Diff: common/network-common/src/main/java/org/apache/spark/network/sasl/aes/AesConfigMessage.java --- @@ -0,0 +1,104 @@ +/* + * Licensed to the

[GitHub] spark pull request #15172: [SPARK-13331] AES support for over-the-wire encry...

2016-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15172#discussion_r87335532 --- Diff: common/network-common/src/main/java/org/apache/spark/network/sasl/SaslRpcHandler.java --- @@ -80,46 +84,74 @@ public void receive(TransportClient

[GitHub] spark pull request #15172: [SPARK-13331] AES support for over-the-wire encry...

2016-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15172#discussion_r87337169 --- Diff: common/network-common/src/main/java/org/apache/spark/network/sasl/aes/AesConfigMessage.java --- @@ -0,0 +1,104 @@ +/* + * Licensed to the

[GitHub] spark pull request #15172: [SPARK-13331] AES support for over-the-wire encry...

2016-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15172#discussion_r87338617 --- Diff: common/network-common/src/main/java/org/apache/spark/network/sasl/aes/AesCipher.java --- @@ -0,0 +1,305 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #15172: [SPARK-13331] AES support for over-the-wire encry...

2016-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15172#discussion_r87337029 --- Diff: common/network-common/src/main/java/org/apache/spark/network/sasl/aes/AesConfigMessage.java --- @@ -0,0 +1,104 @@ +/* + * Licensed to the

[GitHub] spark pull request #15172: [SPARK-13331] AES support for over-the-wire encry...

2016-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15172#discussion_r87336929 --- Diff: common/network-common/src/main/java/org/apache/spark/network/sasl/aes/AesConfigMessage.java --- @@ -0,0 +1,104 @@ +/* + * Licensed to the

[GitHub] spark pull request #15172: [SPARK-13331] AES support for over-the-wire encry...

2016-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15172#discussion_r87336379 --- Diff: common/network-common/src/main/java/org/apache/spark/network/sasl/aes/AesCipher.java --- @@ -0,0 +1,305 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #15172: [SPARK-13331] AES support for over-the-wire encry...

2016-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15172#discussion_r87334433 --- Diff: common/network-common/src/main/java/org/apache/spark/network/sasl/aes/AesCipher.java --- @@ -0,0 +1,305 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #15837: [SQL] Evaluate common subexpression like lazy variable w...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15837 **[Test build #68450 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68450/consoleFull)** for PR 15837 at commit

[GitHub] spark issue #15837: [SQL] Evaluate common subexpression like lazy variable w...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15837 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15819: [SPARK-18372][SQL].Staging directory fail to be removed

2016-11-09 Thread merlintang
Github user merlintang commented on the issue: https://github.com/apache/spark/pull/15819 Actually, I do not have the unit test, but the code list below (same as we posted in the JIRA) can reproduce this bug. The related code would be this way: val sqlContext = new

[GitHub] spark issue #15837: [SQL] Evaluate common subexpression like lazy variable w...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15837 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68445/ Test FAILed. ---

[GitHub] spark issue #15837: [SQL] Evaluate common subexpression like lazy variable w...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15837 **[Test build #68445 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68445/consoleFull)** for PR 15837 at commit

[GitHub] spark issue #14124: [SPARK-16472][SQL] Inconsistent nullability in schema af...

2016-11-09 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14124 Sorry for the delay. After thinking it again, I think it doesn't make sense to allow users to specify the nullability when reading a data source. How about we turn schema to nullable in

[GitHub] spark pull request #15652: [SPARK-16987] [None] Add spark-default.conf prope...

2016-11-09 Thread hayashidac
Github user hayashidac commented on a diff in the pull request: https://github.com/apache/spark/pull/15652#discussion_r87337126 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -85,8 +85,10 @@ private[ml] trait DecisionTreeParams extends

[GitHub] spark issue #15682: [SPARK-18169][SQL] Suppress warnings when dropping views...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15682 **[Test build #68449 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68449/consoleFull)** for PR 15682 at commit

[GitHub] spark pull request #15797: [SPARK-17990][SPARK-18302][SQL] correct several p...

2016-11-09 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15797#discussion_r87336535 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -810,13 +825,44 @@ private[spark] class

[GitHub] spark issue #15797: [SPARK-17990][SPARK-18302][SQL] correct several partitio...

2016-11-09 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15797 In [`renamePartition` of

[GitHub] spark pull request #15800: [SPARK-18334] MinHash should use binary hash dist...

2016-11-09 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15800#discussion_r87335796 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinHash.scala --- @@ -76,7 +72,19 @@ class MinHashModel private[ml] ( @Since("2.1.0")

[GitHub] spark issue #15546: [SPARK-17982][SQL] SQLBuilder should wrap the generated ...

2016-11-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15546 Hi, @gatorsmile . Could you review again? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #15297: [SPARK-9862]Handling data skew

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15297 **[Test build #68448 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68448/consoleFull)** for PR 15297 at commit

[GitHub] spark issue #15819: [SPARK-18372][SQL].Staging directory fail to be removed

2016-11-09 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15819 do you have a unit test to reproduce this bug? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15748: [SPARK-18240][ML][PySpark] Add Summary of BiKMeans and G...

2016-11-09 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/15748 @jkbradley There is somewhat misunderstanding. I close this PR because there is a similar one. Sethah created SPARK-18282 just one day after this one. And people reviewed that one. So I think

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #68447 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68447/consoleFull)** for PR 15659 at commit

[GitHub] spark issue #15837: [SQL] Evaluate common subexpression like lazy variable w...

2016-11-09 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15837 val ds = Seq(("a", 10), ("a", 20), ("b", 1), ("b", 2), ("c", 1)).toDS() ds.groupByKey(_._1).agg(typed.sum(_._2), typed.sum(_._2)).collect Part of Generated codes:

[GitHub] spark issue #15826: [SPARK-14077][ML][FOLLOW-UP] Minor refactor and cleanup ...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15826 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15826: [SPARK-14077][ML][FOLLOW-UP] Minor refactor and cleanup ...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15826 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68443/ Test PASSed. ---

[GitHub] spark issue #15826: [SPARK-14077][ML][FOLLOW-UP] Minor refactor and cleanup ...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15826 **[Test build #68443 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68443/consoleFull)** for PR 15826 at commit

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-09 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15659 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15297: [SPARK-9862]Handling data skew

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15297 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68446/ Test FAILed. ---

[GitHub] spark issue #15297: [SPARK-9862]Handling data skew

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15297 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15297: [SPARK-9862]Handling data skew

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15297 **[Test build #68446 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68446/consoleFull)** for PR 15297 at commit

[GitHub] spark issue #15297: [SPARK-9862]Handling data skew

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15297 **[Test build #68446 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68446/consoleFull)** for PR 15297 at commit

[GitHub] spark issue #15837: [SQL] Evaluate common subexpression like lazy variable w...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15837 **[Test build #68445 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68445/consoleFull)** for PR 15837 at commit

[GitHub] spark pull request #15837: [SQL] Evaluate common subexpression like lazy var...

2016-11-09 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/15837 [SQL] Evaluate common subexpression like lazy variable with a function approach ## What changes were proposed in this pull request? As per the discussion at #15807, we need to change the

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-09 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15780 Some more thoughts: in `ExpressionEncoder` we get the schema of encoder by ``` val schema = ScalaReflection.schemaFor[T] match { case ScalaReflection.Schema(s: StructType, _) => s

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68441/ Test FAILed. ---

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #68441 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68441/consoleFull)** for PR 15644 at commit

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15780 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15780 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68439/ Test PASSed. ---

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15780 **[Test build #68439 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68439/consoleFull)** for PR 15780 at commit

[GitHub] spark issue #14612: [SPARK-16803] [SQL] SaveAsTable does not work when sourc...

2016-11-09 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14612 hi @gatorsmile do you have time to work on it? I'd like to get this into 2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #14612: [SPARK-16803] [SQL] SaveAsTable does not work whe...

2016-11-09 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14612#discussion_r87330702 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala --- @@ -88,6 +88,21 @@ case class

[GitHub] spark pull request #15703: [SPARK-18186] Migrate HiveUDAFFunction to TypedIm...

2016-11-09 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15703#discussion_r87329510 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala --- @@ -365,4 +382,66 @@ private[hive] case class HiveUDAFFunction(

[GitHub] spark pull request #15807: [SPARK-18147][SQL] do not fail for very complex a...

2016-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15807 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15807: [SPARK-18147][SQL] do not fail for very complex aggregat...

2016-11-09 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15807 thanks for the review, merging to master/2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15563: [SPARK-16759][CORE] Add a configuration property to pass...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15563 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68437/ Test PASSed. ---

[GitHub] spark issue #15563: [SPARK-16759][CORE] Add a configuration property to pass...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15563 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15563: [SPARK-16759][CORE] Add a configuration property to pass...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15563 **[Test build #68437 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68437/consoleFull)** for PR 15563 at commit

[GitHub] spark issue #15172: [SPARK-13331] AES support for over-the-wire encryption

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15172 **[Test build #68444 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68444/consoleFull)** for PR 15172 at commit

[GitHub] spark issue #15172: [SPARK-13331] AES support for over-the-wire encryption

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15172 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68438/ Test FAILed. ---

[GitHub] spark issue #15172: [SPARK-13331] AES support for over-the-wire encryption

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15172 **[Test build #68438 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68438/consoleFull)** for PR 15172 at commit

[GitHub] spark issue #15172: [SPARK-13331] AES support for over-the-wire encryption

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15172 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15172: [SPARK-13331] AES support for over-the-wire encry...

2016-11-09 Thread cjjnjust
Github user cjjnjust commented on a diff in the pull request: https://github.com/apache/spark/pull/15172#discussion_r87328090 --- Diff: common/network-common/src/main/java/org/apache/spark/network/sasl/SaslClientBootstrap.java --- @@ -88,9 +90,26 @@ public void

[GitHub] spark issue #15826: [SPARK-14077][ML][FOLLOW-UP] Minor refactor and cleanup ...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15826 **[Test build #68443 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68443/consoleFull)** for PR 15826 at commit

[GitHub] spark issue #15797: [SPARK-17990][SPARK-18302][SQL] correct several partitio...

2016-11-09 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15797 Will carefully review it tonight. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15807: [SPARK-18147][SQL] do not fail for very complex aggregat...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15807 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68436/ Test PASSed. ---

[GitHub] spark issue #15807: [SPARK-18147][SQL] do not fail for very complex aggregat...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15807 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15807: [SPARK-18147][SQL] do not fail for very complex aggregat...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15807 **[Test build #68436 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68436/consoleFull)** for PR 15807 at commit

[GitHub] spark pull request #15830: [SPARK-18375][SPARK-18383][BUILD][CORE]Upgrade ne...

2016-11-09 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/15830#discussion_r87327561 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -,6 +2223,9 @@ private[spark] object Utils extends Logging {

[GitHub] spark issue #15797: [SPARK-17990][SPARK-18302][SQL] correct several partitio...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15797 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68435/ Test PASSed. ---

[GitHub] spark issue #15797: [SPARK-17990][SPARK-18302][SQL] correct several partitio...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15797 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15797: [SPARK-17990][SPARK-18302][SQL] correct several partitio...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15797 **[Test build #68435 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68435/consoleFull)** for PR 15797 at commit

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68440/ Test FAILed. ---

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #68440 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68440/consoleFull)** for PR 13909 at commit

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68429/ Test FAILed. ---

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #68429 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68429/consoleFull)** for PR 15644 at commit

[GitHub] spark issue #15297: [SPARK-9862]Handling data skew

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15297 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15297: [SPARK-9862]Handling data skew

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15297 **[Test build #68442 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68442/consoleFull)** for PR 15297 at commit

[GitHub] spark issue #15297: [SPARK-9862]Handling data skew

2016-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15297 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68442/ Test FAILed. ---

[GitHub] spark issue #15297: [SPARK-9862]Handling data skew

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15297 **[Test build #68442 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68442/consoleFull)** for PR 15297 at commit

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #68441 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68441/consoleFull)** for PR 15644 at commit

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #68440 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68440/consoleFull)** for PR 13909 at commit

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-09 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r87322412 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -133,50 +154,78 @@ case class

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15780 **[Test build #68439 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68439/consoleFull)** for PR 15780 at commit

[GitHub] spark pull request #15780: [SPARK-18284][SQL] Make ExpressionEncoder.seriali...

2016-11-09 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/15780#discussion_r87322156 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala --- @@ -935,6 +935,20 @@ class DatasetSuite extends QueryTest with SharedSQLContext

  1   2   3   4   5   >