[GitHub] spark issue #14745: [SPARK-16896][SQL] Handle duplicated field names in head...

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14745 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14728: [SPARK-17165][SQL] FileStreamSource should not track the...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14728 **[Test build #64260 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64260/consoleFull)** for PR 14728 at commit

[GitHub] spark issue #14745: [SPARK-16896][SQL] Handle duplicated field names in head...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14745 **[Test build #64250 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64250/consoleFull)** for PR 14745 at commit

[GitHub] spark pull request #14728: [SPARK-17165][SQL] FileStreamSource should not tr...

2016-08-22 Thread petermaxlee
Github user petermaxlee commented on a diff in the pull request: https://github.com/apache/spark/pull/14728#discussion_r75795996 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamSource.scala --- @@ -17,21 +17,18 @@ package

[GitHub] spark issue #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/8880 **[Test build #64259 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64259/consoleFull)** for PR 8880 at commit

[GitHub] spark issue #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/8880 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64259/ Test FAILed. ---

[GitHub] spark issue #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/8880 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14743: [SparkR][Minor] Fix Cache Folder Path in Windows

2016-08-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14743 Yup, I will organise my thought first with some researches and then open a JIRA. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/8880 **[Test build #64259 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64259/consoleFull)** for PR 8880 at commit

[GitHub] spark issue #14239: [SPARK-16593] [CORE] [WIP] Provide a pre-fetch mechanism...

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14239 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14239: [SPARK-16593] [CORE] [WIP] Provide a pre-fetch mechanism...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14239 **[Test build #64258 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64258/consoleFull)** for PR 14239 at commit

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14750 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14239: [SPARK-16593] [CORE] [WIP] Provide a pre-fetch mechanism...

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14239 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64258/ Test FAILed. ---

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14750 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64252/ Test FAILed. ---

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14750 **[Test build #64252 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64252/consoleFull)** for PR 14750 at commit

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14750 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14750 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64251/ Test FAILed. ---

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14750 **[Test build #64251 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64251/consoleFull)** for PR 14750 at commit

[GitHub] spark issue #14239: [SPARK-16593] [CORE] [WIP] Provide a pre-fetch mechanism...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14239 **[Test build #64258 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64258/consoleFull)** for PR 14239 at commit

[GitHub] spark pull request #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-22 Thread winningsix
Github user winningsix commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r75794260 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoStreamUtils.scala --- @@ -0,0 +1,104 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #14618: [SPARK-17030] [SQL] Remove/Cleanup HiveMetastoreCatalog....

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14618 do you mind update it? thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14625: [SPARK-17045] [SQL] Build/move Join-related test cases i...

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14625 hmmm, can we split this PR into multiple PRs? We are not copying tests from `HiveCompatibilitySuite` directly and it takes time to review each test and its result. --- If your project is set up

[GitHub] spark pull request #14753: [SPARK-17187][SQL] Supports using arbitrary Java ...

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14753#discussion_r75793140 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/interfaces.scala --- @@ -389,3 +389,175 @@ abstract class

[GitHub] spark pull request #14753: [SPARK-17187][SQL] Supports using arbitrary Java ...

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14753#discussion_r75793025 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/interfaces.scala --- @@ -389,3 +389,175 @@ abstract class

[GitHub] spark pull request #14753: [SPARK-17187][SQL] Supports using arbitrary Java ...

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14753#discussion_r75792744 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/interfaces.scala --- @@ -389,3 +389,175 @@ abstract class

[GitHub] spark pull request #14753: [SPARK-17187][SQL] Supports using arbitrary Java ...

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14753#discussion_r75792506 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/interfaces.scala --- @@ -389,3 +389,175 @@ abstract class

[GitHub] spark pull request #14753: [SPARK-17187][SQL] Supports using arbitrary Java ...

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14753#discussion_r75792480 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/interfaces.scala --- @@ -389,3 +389,175 @@ abstract class

[GitHub] spark pull request #14753: [SPARK-17187][SQL] Supports using arbitrary Java ...

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14753#discussion_r75792451 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/interfaces.scala --- @@ -389,3 +389,175 @@ abstract class

[GitHub] spark issue #10896: [SPARK-12978][SQL] Skip unnecessary final group-by when ...

2016-08-22 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/10896 okay, thanks. I'll fix in hours. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14572: [SPARK-17192] [SQL] Issue Exception when Users Specify t...

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14572 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14572: [SPARK-17192] [SQL] Issue Exception when Users Specify t...

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14572 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64244/ Test PASSed. ---

[GitHub] spark issue #14572: [SPARK-17192] [SQL] Issue Exception when Users Specify t...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14572 **[Test build #64244 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64244/consoleFull)** for PR 14572 at commit

[GitHub] spark issue #14749: [SPARK-17182][SQL] Mark Collect as non-deterministic

2016-08-22 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14749 Hm why does this matter? Is it failing some tests? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14763: [SPARK-17194] Use single quotes when generating SQL for ...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14763 **[Test build #64257 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64257/consoleFull)** for PR 14763 at commit

[GitHub] spark issue #14640: [SPARK-17055] [MLLIB] add labelKFold to CrossValidator

2016-08-22 Thread VinceShieh
Github user VinceShieh commented on the issue: https://github.com/apache/spark/pull/14640 @holdenk thanks for your comments. :) You are right. But as you can see, this is a variant of kFold, so I think it's better to stay close to it, otherwise, it would seems confusing, dont you

[GitHub] spark issue #14763: [SPARK-17194] Use single quotes when generating SQL for ...

2016-08-22 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/14763 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14757: [SPARK-17190] [SQL] Removal of HiveSharedState

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14757#discussion_r75791305 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala --- @@ -139,12 +139,9 @@ private[hive] class TestHiveSparkSession(

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14447 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14757: [SPARK-17190] [SQL] Removal of HiveSharedState

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14757#discussion_r75791279 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala --- @@ -139,12 +139,9 @@ private[hive] class TestHiveSparkSession(

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14447 **[Test build #64247 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64247/consoleFull)** for PR 14447 at commit

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14447 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64247/ Test FAILed. ---

[GitHub] spark issue #14753: [SPARK-17187][SQL] Supports using arbitrary Java object ...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14753 **[Test build #64256 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64256/consoleFull)** for PR 14753 at commit

[GitHub] spark pull request #14757: [SPARK-17190] [SQL] Removal of HiveSharedState

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14757#discussion_r75790997 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala --- @@ -40,6 +40,15 @@ abstract class

[GitHub] spark issue #14764: [SPARKR][MINOR] Update R DESCRIPTION file

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14764 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14757: [SPARK-17190] [SQL] Removal of HiveSharedState

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14757#discussion_r75790947 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -41,13 +42,20 @@ import org.apache.spark.sql.types.{DataType,

[GitHub] spark issue #14763: [SPARK-17194] Use single quotes when generating SQL for ...

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14763 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14763: [SPARK-17194] Use single quotes when generating SQL for ...

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14763 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64246/ Test FAILed. ---

[GitHub] spark issue #14763: [SPARK-17194] Use single quotes when generating SQL for ...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14763 **[Test build #64246 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64246/consoleFull)** for PR 14763 at commit

[GitHub] spark issue #14764: [SPARKR][MINOR] Update R DESCRIPTION file

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14764 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64249/ Test PASSed. ---

[GitHub] spark issue #14764: [SPARKR][MINOR] Update R DESCRIPTION file

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14764 **[Test build #64249 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64249/consoleFull)** for PR 14764 at commit

[GitHub] spark issue #14764: [SPARKR][MINOR] Update R DESCRIPTION file

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14764 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64248/ Test PASSed. ---

[GitHub] spark issue #14764: [SPARKR][MINOR] Update R DESCRIPTION file

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14764 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14640: [SPARK-17055] [MLLIB] add labelKFold to CrossValidator

2016-08-22 Thread VinceShieh
Github user VinceShieh commented on the issue: https://github.com/apache/spark/pull/14640 if one understands the underlying ideas behind this method (labelKFold), it's easy to take it as a class/category of data, though I do think it's not that straightforward, even a bit confusing,

[GitHub] spark issue #14764: [SPARKR][MINOR] Update R DESCRIPTION file

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14764 **[Test build #64248 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64248/consoleFull)** for PR 14764 at commit

[GitHub] spark issue #14753: [SPARK-17187][SQL] Supports using arbitrary Java object ...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14753 **[Test build #64255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64255/consoleFull)** for PR 14753 at commit

[GitHub] spark issue #13988: [SPARK-16101][SQL] Refactoring CSV data source to be con...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13988 **[Test build #64254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64254/consoleFull)** for PR 13988 at commit

[GitHub] spark issue #14752: [SPARK-17186][SQL] remove catalog table type INDEX

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14752 **[Test build #64253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64253/consoleFull)** for PR 14752 at commit

[GitHub] spark issue #14752: [SPARK-17186][SQL] remove catalog table type INDEX

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14752 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64245/ Test FAILed. ---

[GitHub] spark issue #14752: [SPARK-17186][SQL] remove catalog table type INDEX

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14752 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14752: [SPARK-17186][SQL] remove catalog table type INDEX

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14752 **[Test build #64245 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64245/consoleFull)** for PR 14752 at commit

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14750 **[Test build #64252 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64252/consoleFull)** for PR 14750 at commit

[GitHub] spark pull request #14749: [SPARK-17182][SQL] Mark Collect as non-determinis...

2016-08-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14749 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14750 **[Test build #64251 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64251/consoleFull)** for PR 14750 at commit

[GitHub] spark issue #14749: [SPARK-17182][SQL] Mark Collect as non-deterministic

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14749 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14745: [SPARK-16896][SQL] Handle duplicated field names in head...

2016-08-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14745 @falaki and @felixcheung Do you mind if I ask another quick look please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #14745: [SPARK-16896][SQL] Handle duplicated field names in head...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14745 **[Test build #64250 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64250/consoleFull)** for PR 14745 at commit

[GitHub] spark issue #14764: [SPARKR][MINOR] Update R DESCRIPTION file

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14764 **[Test build #64249 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64249/consoleFull)** for PR 14764 at commit

[GitHub] spark issue #14764: [SPARKR][MINOR] Update R DESCRIPTION file

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14764 **[Test build #64248 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64248/consoleFull)** for PR 14764 at commit

[GitHub] spark issue #14764: [SPARKR][MINOR] Update R DESCRIPTION file

2016-08-22 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/14764 Follow up on #14758 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14764: [SPARKR][MINOR] Update R DESCRIPTION file

2016-08-22 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/14764 [SPARKR][MINOR] Update R DESCRIPTION file ## What changes were proposed in this pull request? Update DESCRIPTION ## How was this patch tested? Run install

[GitHub] spark pull request #14728: [SPARK-17165][SQL] FileStreamSource should not tr...

2016-08-22 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/14728#discussion_r75786696 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamSource.scala --- @@ -17,21 +17,18 @@ package

[GitHub] spark pull request #14761: [SparkR][Minor] Add installation message for remo...

2016-08-22 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14761#discussion_r75786649 --- Diff: R/pkg/R/utils.R --- @@ -697,3 +697,20 @@ is_master_local <- function(master) { is_sparkR_shell <- function() { grepl(".*shell\\.R$",

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14447 **[Test build #64247 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64247/consoleFull)** for PR 14447 at commit

[GitHub] spark pull request #14761: [SparkR][Minor] Add installation message for remo...

2016-08-22 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14761#discussion_r75786183 --- Diff: R/pkg/R/utils.R --- @@ -697,3 +697,20 @@ is_master_local <- function(master) { is_sparkR_shell <- function() { grepl(".*shell\\.R$",

[GitHub] spark issue #14763: [SPARK-17194] Use single quotes when generating SQL for ...

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14763 **[Test build #64246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64246/consoleFull)** for PR 14763 at commit

[GitHub] spark pull request #14763: [SPARK-17194] Use single quotes when generating S...

2016-08-22 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/14763 [SPARK-17194] Use single quotes when generating SQL for string literals When Spark emits SQL for a string literal, it should wrap the string in single quotes, not double quotes. Databases which

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14079 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64242/ Test PASSed. ---

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-08-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14079 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-08-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #64242 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64242/consoleFull)** for PR 14079 at commit

[GitHub] spark pull request #14753: [SPARK-17187][SQL] Supports using arbitrary Java ...

2016-08-22 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/14753#discussion_r75784293 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/interfaces.scala --- @@ -389,3 +389,148 @@ abstract class

[GitHub] spark issue #14749: [SPARK-17182][SQL] Mark Collect as non-deterministic

2016-08-22 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14749 @cloud-fan I noticed this issue because I saw `First` and `Last` are marked as non-deterministic. Although we are not checking this property for now, it's still good to set the right values.

[GitHub] spark pull request #14749: [SPARK-17182][SQL] Mark Collect as non-determinis...

2016-08-22 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14749#discussion_r75783595 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/collect.scala --- @@ -54,6 +54,10 @@ abstract class Collect

[GitHub] spark pull request #14761: [SparkR][Minor] Add installation message for remo...

2016-08-22 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14761#discussion_r75783153 --- Diff: R/pkg/R/install.R --- @@ -125,20 +127,24 @@ robust_download_tar <- function(mirrorUrl, version, hadoopVersion, packageName, message(msg)

[GitHub] spark pull request #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptro...

2016-08-22 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14447#discussion_r75783118 --- Diff: R/pkg/R/mllib.R --- @@ -734,6 +830,28 @@ setMethod("write.ml", signature(object = "KMeansModel", path = "character"),

[GitHub] spark pull request #14759: [SPARK-16577][SPARKR] Add CRAN documentation chec...

2016-08-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14759 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14738: [SPARK-17090][FOLLOW-UP][ML]Add expert param supp...

2016-08-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14738 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14761: [SparkR][Minor] Add installation message for remo...

2016-08-22 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14761#discussion_r75782928 --- Diff: R/pkg/R/install.R --- @@ -125,20 +127,24 @@ robust_download_tar <- function(mirrorUrl, version, hadoopVersion, packageName,

[GitHub] spark issue #14757: [SPARK-17190] [SQL] Removal of HiveSharedState

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14757 is `getNewClient` equal to `getClient.newSession`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14759: [SPARK-16577][SPARKR] Add CRAN documentation checks to r...

2016-08-22 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14759 Merging this to master, branch-2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14761: [SparkR][Minor] Add installation message for remo...

2016-08-22 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14761#discussion_r75782708 --- Diff: R/pkg/R/utils.R --- @@ -697,3 +697,20 @@ is_master_local <- function(master) { is_sparkR_shell <- function() {

[GitHub] spark issue #14758: [SPARKR][MINOR] Add Xiangrui and Felix to maintainers

2016-08-22 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14758 Hmm thats a good catch. Unfortunately it looks like CRAN only wants one person / one email address to be in the Maintainer field. This is also documented at

[GitHub] spark pull request #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bu...

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14531#discussion_r75782639 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -75,18 +81,52 @@ case class CreateTableLikeCommand(

[GitHub] spark issue #14738: [SPARK-17090][FOLLOW-UP][ML]Add expert param support to ...

2016-08-22 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/14738 Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14707: [SPARK-17144] [SQL] Removal of useless CreateHive...

2016-08-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14707 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14761: [SparkR][Minor] Add installation message for remo...

2016-08-22 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14761#discussion_r75782412 --- Diff: R/pkg/R/sparkR.R --- @@ -367,19 +367,21 @@ sparkR.session <- function( overrideEnvs(sparkConfigMap, paramMap) } # do not

[GitHub] spark issue #14707: [SPARK-17144] [SQL] Removal of useless CreateHiveTableAs...

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14707 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14752: [SPARK-17186][SQL] remove catalog table type INDE...

2016-08-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14752#discussion_r75782141 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -379,8 +379,9 @@ private[hive] class HiveClientImpl(

[GitHub] spark issue #14759: [SPARK-16577][SPARKR] Add CRAN documentation checks to r...

2016-08-22 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/14759 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #14759: [SPARK-16577][SPARKR] Add CRAN documentation chec...

2016-08-22 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14759#discussion_r75781929 --- Diff: R/run-tests.sh --- @@ -26,14 +26,35 @@ rm -f $LOGFILE SPARK_TESTING=1 $FWDIR/../bin/spark-submit --driver-java-options

[GitHub] spark pull request #14759: [SPARK-16577][SPARKR] Add CRAN documentation chec...

2016-08-22 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/14759#discussion_r75781286 --- Diff: R/run-tests.sh --- @@ -26,14 +26,35 @@ rm -f $LOGFILE SPARK_TESTING=1 $FWDIR/../bin/spark-submit --driver-java-options

<    1   2   3   4   5   6   7   8   >