[GitHub] spark issue #13920: [SPARK-16166][Core] Also take off-heap memory usage into...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13920 **[Test build #61291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61291/consoleFull)** for PR 13920 at commit

[GitHub] spark pull request #13920: [SPARK-16166][Core] Also take off-heap memory usa...

2016-06-26 Thread jerryshao
GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/13920 [SPARK-16166][Core] Also take off-heap memory usage into consideration in log and webui display ## What changes were proposed in this pull request? Currently in the log and UI display,

[GitHub] spark issue #13917: [MINOR][SQL][TEST] checkAnswer does not print the rows b...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13917 **[Test build #61284 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61284/consoleFull)** for PR 13917 at commit

[GitHub] spark issue #13917: [MINOR][SQL][TEST] checkAnswer does not print the rows b...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13917 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61284/ Test PASSed. ---

[GitHub] spark issue #13917: [MINOR][SQL][TEST] checkAnswer does not print the rows b...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13917 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13918: [SPARK-16221][SQL] Redirect Parquet JUL logger via SLF4J...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13918 **[Test build #61290 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61290/consoleFull)** for PR 13918 at commit

[GitHub] spark issue #13916: [SPARK-16220][SQL] Revert Change to Bring Back SHOW FUNC...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13916 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13916: [SPARK-16220][SQL] Revert Change to Bring Back SHOW FUNC...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13916 **[Test build #61283 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61283/consoleFull)** for PR 13916 at commit

[GitHub] spark issue #13916: [SPARK-16220][SQL] Revert Change to Bring Back SHOW FUNC...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13916 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61283/ Test FAILed. ---

[GitHub] spark issue #13918: [SPARK-16221][SQL] Redirect Parquet JUL logger via SLF4J...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13918 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61287/ Test FAILed. ---

[GitHub] spark issue #13918: [SPARK-16221][SQL] Redirect Parquet JUL logger via SLF4J...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13918 **[Test build #61287 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61287/consoleFull)** for PR 13918 at commit

[GitHub] spark issue #13918: [SPARK-16221][SQL] Redirect Parquet JUL logger via SLF4J...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13918 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13765: [SPARK-16052][SQL] Add `CollapseRepartitionBy` optimizer

2016-06-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13765 Hi, @cloud-fan . Could you review this `CollapseRepartitionBy` optimizer when you have some time? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve OptimizeIn optimizer to remov...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13876 **[Test build #61289 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61289/consoleFull)** for PR 13876 at commit

[GitHub] spark issue #13839: [SPARK-16128][SQL] Allow setting length of characters to...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13839 **[Test build #61288 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61288/consoleFull)** for PR 13839 at commit

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61281/ Test FAILed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61281 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61281/consoleFull)** for PR 13758 at commit

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13915 cc @rxin and @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13917: [MINOR][SQL][TEST] checkAnswer does not print the rows b...

2016-06-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13917 Sorry, this will prints wrong items when the order is different. Closing this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #13918: [SPARK-16221][SQL] Redirect Parquet JUL logger via SLF4J...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13918 **[Test build #61287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61287/consoleFull)** for PR 13918 at commit

[GitHub] spark issue #13919: [SPARK-16222] [SQL] JDBC Sources - Handling illegal inpu...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13919 **[Test build #61286 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61286/consoleFull)** for PR 13919 at commit

[GitHub] spark pull request #13919: [SPARK-16222] [SQL] JDBC Sources - Handling illeg...

2016-06-26 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/13919 [SPARK-16222] [SQL] JDBC Sources - Handling illegal input values for `fetchsize` and `batchsize` What changes were proposed in this pull request? For JDBC data sources, users can

[GitHub] spark pull request #13918: [SPARK-16221][SQL] Redirect Parquet JUL logger vi...

2016-06-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13918#discussion_r68522055 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala --- @@ -915,15 +917,14 @@ private[sql]

[GitHub] spark pull request #13918: [SPARK-16221][SQL] Redirect Parquet JUL logger vi...

2016-06-26 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/13918 [SPARK-16221][SQL] Redirect Parquet JUL logger via SLF4J for WRITE operations ## What changes were proposed in this pull request?

[GitHub] spark pull request #13917: [MINOR][SQL][TEST] checkAnswer does not print the...

2016-06-26 Thread HyukjinKwon
Github user HyukjinKwon closed the pull request at: https://github.com/apache/spark/pull/13917 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #13893: [SPARK-14172][SQL] Hive table partition predicate not pa...

2016-06-26 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/13893 @cloud-fan could you please have a look at this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #61285 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61285/consoleFull)** for PR 13909 at commit

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables in PARQUET/ORC t...

2016-06-26 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13907 Nope. If users do not specify the intput and output formats. We will use the default `INPUTFORMAT`, which is `org.apache.hadoop.mapred.TextInputFormat` and the default `OUTPUTFORMAT`, which is

[GitHub] spark issue #13917: [MINOR][SQL][TEST] checkAnswer does not print the rows b...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13917 **[Test build #61284 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61284/consoleFull)** for PR 13917 at commit

[GitHub] spark pull request #13917: [MINOR][SQL][TEST] checkAnswer does not print the...

2016-06-26 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/13917 [MINOR][SQL][TEST] checkAnswer does not print the rows being compared in a correct order ## What changes were proposed in this pull request? This PR corrects the order of rows being

[GitHub] spark issue #13916: [SPARK-16220] Revert Change to Bring Back SHOW FUNCTIONS...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13916 **[Test build #61283 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61283/consoleFull)** for PR 13916 at commit

[GitHub] spark issue #13916: [SPARK-16220] Revert Change to Bring Back SHOW FUNCTIONS...

2016-06-26 Thread anabranch
Github user anabranch commented on the issue: https://github.com/apache/spark/pull/13916 jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61282/ Test FAILed. ---

[GitHub] spark pull request #13916: [SPARK-16220] Revert Change to Bring Back SHOW FU...

2016-06-26 Thread anabranch
GitHub user anabranch opened a pull request: https://github.com/apache/spark/pull/13916 [SPARK-16220] Revert Change to Bring Back SHOW FUNCTIONS Functionality ## What changes were proposed in this pull request? - Fix tests regarding show functions functionality - Revert

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #61282 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61282/consoleFull)** for PR 13909 at commit

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source supports custom date ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13912 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source supports custom date ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13912 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61280/ Test PASSed. ---

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source supports custom date ...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13912 **[Test build #61280 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61280/consoleFull)** for PR 13912 at commit

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/13909 How much overhead we can reduce with this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #61282 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61282/consoleFull)** for PR 13909 at commit

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-06-26 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r68519507 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameComplexTypeSuite.scala --- @@ -26,6 +26,20 @@ import

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-06-26 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r68519480 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameComplexTypeSuite.scala --- @@ -26,6 +26,20 @@ import

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-06-26 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r68519430 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -51,27 +51,52 @@ case class

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-06-26 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r68519450 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -51,27 +51,52 @@ case class

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61281 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61281/consoleFull)** for PR 13758 at commit

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13915 Thank you, @HyukjinKwon . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13915 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61279/ Test PASSed. ---

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13915 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13915 **[Test build #61279 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61279/consoleFull)** for PR 13915 at commit

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13915 Oh, this was queued up in my local to submit a PR. I will leave a comment just to note that this complies https://github.com/databricks/scala-style-guide#variable-naming-convention. --- If

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source supports custom date ...

2016-06-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13912 @rxin, Could you please take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source supports custom date ...

2016-06-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13912 @srowen Hm.. I just wonder if I should correct JSON data source to be consistent with this meaning these below: 1. Default is to write time as numeric timestamps 2. Supports both

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13915 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61278/ Test FAILed. ---

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13915 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13915 **[Test build #61278 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61278/consoleFull)** for PR 13915 at commit

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source does not write date a...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13912 **[Test build #61280 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61280/consoleFull)** for PR 13912 at commit

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13915 **[Test build #61279 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61279/consoleFull)** for PR 13915 at commit

[GitHub] spark issue #13624: [SPARK-15858][ML]: Fix calculating error by tree stack o...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13624 **[Test build #61277 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61277/consoleFull)** for PR 13624 at commit

[GitHub] spark issue #13624: [SPARK-15858][ML]: Fix calculating error by tree stack o...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13624 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13624: [SPARK-15858][ML]: Fix calculating error by tree stack o...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13624 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61277/ Test PASSed. ---

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables in PARQUET/ORC t...

2016-06-26 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/13907 With your PR, if users specify `ROW FORMAT SERDE 'org.apache.hadoop.hive.ql.io.orc.OrcSerde'`, will we convert? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13915 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61276/ Test FAILed. ---

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13915 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13915 **[Test build #61276 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61276/consoleFull)** for PR 13915 at commit

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13915 **[Test build #61278 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61278/consoleFull)** for PR 13915 at commit

[GitHub] spark issue #13624: [SPARK-15858][ML]: Fix calculating error by tree stack o...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13624 **[Test build #61277 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61277/consoleFull)** for PR 13624 at commit

[GitHub] spark pull request #13624: [SPARK-15858][ML]: Fix calculating error by tree ...

2016-06-26 Thread mhmoudr
Github user mhmoudr commented on a diff in the pull request: https://github.com/apache/spark/pull/13624#discussion_r68513737 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/tree/model/treeEnsembleModels.scala --- @@ -151,31 +151,23 @@ class GradientBoostedTreesModel

[GitHub] spark pull request #13624: [SPARK-15858][ML]: Fix calculating error by tree ...

2016-06-26 Thread mhmoudr
Github user mhmoudr commented on a diff in the pull request: https://github.com/apache/spark/pull/13624#discussion_r68513735 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/GradientBoostedTrees.scala --- @@ -205,31 +205,27 @@ private[spark] object

[GitHub] spark issue #13867: [SPARK-16161][SQL] Ambiguous error message for unsupport...

2016-06-26 Thread ioana-delaney
Github user ioana-delaney commented on the issue: https://github.com/apache/spark/pull/13867 @hvanhovell Thank you for reviewing the changes. I replied to your comments and made some updates. Please let me know. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request #13867: [SPARK-16161][SQL] Ambiguous error message for un...

2016-06-26 Thread ioana-delaney
Github user ioana-delaney commented on a diff in the pull request: https://github.com/apache/spark/pull/13867#discussion_r68513197 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -911,19 +911,30 @@ class Analyzer( *

[GitHub] spark pull request #13867: [SPARK-16161][SQL] Ambiguous error message for un...

2016-06-26 Thread ioana-delaney
Github user ioana-delaney commented on a diff in the pull request: https://github.com/apache/spark/pull/13867#discussion_r68513152 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -911,19 +911,30 @@ class Analyzer( *

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13915 **[Test build #61276 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61276/consoleFull)** for PR 13915 at commit

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13915 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13915 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61275/ Test FAILed. ---

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13915 **[Test build #61275 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61275/consoleFull)** for PR 13915 at commit

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13915 **[Test build #61275 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61275/consoleFull)** for PR 13915 at commit

[GitHub] spark pull request #13912: [SPARK-16216][SQL] CSV data source does not write...

2016-06-26 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/13912#discussion_r68511969 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVRelation.scala --- @@ -195,18 +202,50 @@ private[sql] class

[GitHub] spark pull request #13912: [SPARK-16216][SQL] CSV data source does not write...

2016-06-26 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/13912#discussion_r68511688 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVRelation.scala --- @@ -195,18 +202,50 @@ private[sql] class

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13065 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13065 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61273/ Test PASSed. ---

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13065 **[Test build #61273 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61273/consoleFull)** for PR 13065 at commit

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13915 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13915 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61274/ Test FAILed. ---

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13915 **[Test build #61274 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61274/consoleFull)** for PR 13915 at commit

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13915 **[Test build #61274 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61274/consoleFull)** for PR 13915 at commit

[GitHub] spark pull request #13915: [SPARK-16081] Disallow using `l` as variable name

2016-06-26 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/13915 [SPARK-16081] Disallow using `l` as variable name ## What changes were proposed in this pull request? This PR adds a ScalaStyle custom rule, `DisallowMisleadingVariableName`, by

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11863 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61272/ Test PASSed. ---

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11863 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11863 **[Test build #61272 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61272/consoleFull)** for PR 11863 at commit

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13065 **[Test build #61273 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61273/consoleFull)** for PR 13065 at commit

[GitHub] spark pull request #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13885 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13760: [SPARK-16012][SparkR] implement gapplyCollect whi...

2016-06-26 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/13760#discussion_r68508656 --- Diff: R/pkg/R/group.R --- @@ -243,17 +236,73 @@ setMethod("gapply", signature(x = "GroupedData"), function(x, func,

[GitHub] spark issue #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-26 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/13885 LGTM. Thanks @felixcheung - Merging this into master and branch-2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61271/ Test PASSed. ---

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61271 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61271/consoleFull)** for PR 13494 at commit

[GitHub] spark issue #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-26 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/13885 @shivaram this is ready, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-26 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/11863 Moved the prefered location and consumer creation strategies to an explicit interface, let me know if that's more usable from your point of view. Scala api looks like

  1   2   3   >