[GitHub] spark pull request #16684: [SPARK-16101][HOTFIX] Fix the build with Scala 2....

2017-01-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16684 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16308: [SPARK-18936][SQL] Infrastructure for session loc...

2017-01-23 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/16308#discussion_r97490521 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DateFunctionsSuite.scala --- @@ -475,6 +1164,45 @@ class DateFunctionsSuite extends QueryTest with

[GitHub] spark pull request #16138: [SPARK-16609] Add to_date/to_timestamp with forma...

2017-01-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16138#discussion_r97490239 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -1047,6 +1048,64 @@ case class

[GitHub] spark issue #16687: [SPARK-19343][DStreams] Do once optimistic checkpoint be...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16687 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71914/ Test PASSed. ---

[GitHub] spark issue #16687: [SPARK-19343][DStreams] Do once optimistic checkpoint be...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16687 **[Test build #71914 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71914/testReport)** for PR 16687 at commit

[GitHub] spark issue #16687: [SPARK-19343][DStreams] Do once optimistic checkpoint be...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16687 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16138: [SPARK-16609] Add to_date/to_timestamp with forma...

2017-01-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16138#discussion_r97489950 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -1047,6 +1048,64 @@ case class

[GitHub] spark issue #16552: [SPARK-19152][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16552 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16552: [SPARK-19152][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16552 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71910/ Test PASSed. ---

[GitHub] spark issue #16552: [SPARK-19152][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16552 **[Test build #71910 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71910/testReport)** for PR 16552 at commit

[GitHub] spark issue #16138: [SPARK-16609] Add to_date/to_timestamp with format funct...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16138 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16138: [SPARK-16609] Add to_date/to_timestamp with format funct...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16138 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71913/ Test FAILed. ---

[GitHub] spark issue #16138: [SPARK-16609] Add to_date/to_timestamp with format funct...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16138 **[Test build #71913 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71913/testReport)** for PR 16138 at commit

[GitHub] spark issue #16594: [SPARK-17078] [SQL] Show stats when explain

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16594 **[Test build #71921 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71921/testReport)** for PR 16594 at commit

[GitHub] spark issue #16269: [SPARK-19080][SQL] simplify data source analysis

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16269 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16269: [SPARK-19080][SQL] simplify data source analysis

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16269 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71908/ Test PASSed. ---

[GitHub] spark issue #16269: [SPARK-19080][SQL] simplify data source analysis

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16269 **[Test build #71908 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71908/testReport)** for PR 16269 at commit

[GitHub] spark issue #16654: [SPARK-19303][ML][WIP] Add evaluate method in clustering...

2017-01-23 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/16654 Existing metrics (WSSSE,Loglikelihood) are relevant to detail of algorithm. Computation of WSSSE for KMeans/BisectKMeans use the average vectors as the centers, but for KMedoids the medoids,

[GitHub] spark issue #16553: [SPARK-9435][SQL] Reuse function in Java UDF to correctl...

2017-01-23 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16553 Thank you @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16658: [DOCS] Fix typo in docs

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16658 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16658: [DOCS] Fix typo in docs

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16658 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71915/ Test PASSed. ---

[GitHub] spark issue #16658: [DOCS] Fix typo in docs

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16658 **[Test build #71915 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71915/testReport)** for PR 16658 at commit

[GitHub] spark pull request #16687: [SPARK-19343][DStreams] Do once optimistic checkp...

2017-01-23 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/16687#discussion_r97483845 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobGenerator.scala --- @@ -146,6 +147,11 @@ class JobGenerator(jobScheduler:

[GitHub] spark issue #16689: SPARK-19342 bug fixed in collect method for collecting t...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16689 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16687: [SPARK-19343][DStreams] Do once optimistic checkp...

2017-01-23 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/16687#discussion_r97483687 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/StreamingContextSuite.scala --- @@ -837,6 +839,29 @@ class StreamingContextSuite extends

[GitHub] spark pull request #16689: SPARK-19342 bug fixed in collect method for colle...

2017-01-23 Thread titicaca
GitHub user titicaca opened a pull request: https://github.com/apache/spark/pull/16689 SPARK-19342 bug fixed in collect method for collecting timestamp column ## What changes were proposed in this pull request? Fix a bug in collect method for collecting timestamp column,

[GitHub] spark issue #16552: [SPARK-19152][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16552 **[Test build #71920 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71920/testReport)** for PR 16552 at commit

[GitHub] spark issue #16688: [TESTS][SQL] Setup testdata at the beginning for tests t...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16688 **[Test build #71919 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71919/testReport)** for PR 16688 at commit

[GitHub] spark pull request #16688: [TESTS][SQL] Setup testdata at the beginning for ...

2017-01-23 Thread dilipbiswal
GitHub user dilipbiswal opened a pull request: https://github.com/apache/spark/pull/16688 [TESTS][SQL] Setup testdata at the beginning for tests to run independently ## What changes were proposed in this pull request? In CachedTableSuite, we are not setting up the test data

[GitHub] spark issue #16552: [SPARK-19152][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16552 **[Test build #71918 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71918/testReport)** for PR 16552 at commit

[GitHub] spark issue #16552: [SPARK-19152][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-23 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16552 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15945: [SPARK-12978][SQL] Merge unnecessary partial aggregates

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15945 **[Test build #71917 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71917/testReport)** for PR 15945 at commit

[GitHub] spark issue #16658: [DOCS] Fix typo in docs

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16658 **[Test build #71915 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71915/testReport)** for PR 16658 at commit

[GitHub] spark pull request #16594: [SPARK-17078] [SQL] Show stats when explain

2017-01-23 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/16594#discussion_r97482084 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/Statistics.scala --- @@ -54,11 +56,32 @@ case class Statistics(

[GitHub] spark pull request #16308: [SPARK-18936][SQL] Infrastructure for session loc...

2017-01-23 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/16308#discussion_r97482071 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DateFunctionsSuite.scala --- @@ -103,6 +153,51 @@ class DateFunctionsSuite extends QueryTest with

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare atomic and string type column...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #71916 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71916/testReport)** for PR 15880 at commit

[GitHub] spark pull request #16683: [SPARK-19268][SS]Disallow adaptive query executio...

2017-01-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16683 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Classification and regression...

2017-01-23 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/16171 cc @yanboliang @sethah @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16672: [SPARK-19329][SQL]insert data to a not exist location da...

2017-01-23 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16672 It seems to me following hive is safer, any other ideas? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16606: [SPARK-19246][SQL]CataLogTable's partitionSchema order a...

2017-01-23 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16606 LGTM, pending tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16683: [SPARK-19268][SS]Disallow adaptive query execution for s...

2017-01-23 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16683 Thanks. Merging to master and 2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16687: [SPARK-19343][DStreams] Do once optimistic checkpoint be...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16687 **[Test build #71914 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71914/testReport)** for PR 16687 at commit

[GitHub] spark pull request #16594: [SPARK-17078] [SQL] Show stats when explain

2017-01-23 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/16594#discussion_r97481455 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/Statistics.scala --- @@ -54,11 +56,32 @@ case class Statistics(

[GitHub] spark pull request #16687: [SPARK-19343][DStreams] Do once optimistic checkp...

2017-01-23 Thread uncleGen
GitHub user uncleGen opened a pull request: https://github.com/apache/spark/pull/16687 [SPARK-19343][DStreams] Do once optimistic checkpoint before stop ## What changes were proposed in this pull request? Streaming job restarts from checkpoint, and it will rebuild several

[GitHub] spark issue #14038: [SPARK-16317][SQL] Add a new interface to filter files i...

2017-01-23 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/14038 @liancheng ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #16553: [SPARK-9435][SQL] Reuse function in Java UDF to c...

2017-01-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16553 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16594: [SPARK-17078] [SQL] Show stats when explain

2017-01-23 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/16594 @gatorsmile I just did a quick fix to show how the improved stats look like. If @rxin @hvanhovell accept the change proposed in this pr, I'll update to remove the flag :) --- If your project is set

[GitHub] spark pull request #16552: [SPARK-19152][SQL]DataFrameWriter.saveAsTable sup...

2017-01-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16552#discussion_r97481030 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -1461,6 +1461,25 @@ class SQLQuerySuite extends

[GitHub] spark issue #16553: [SPARK-9435][SQL] Reuse function in Java UDF to correctl...

2017-01-23 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16553 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16552: [SPARK-19152][SQL]DataFrameWriter.saveAsTable sup...

2017-01-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16552#discussion_r97480933 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ddl.scala --- @@ -65,6 +65,10 @@ case class CreateTempViewUsing( }

[GitHub] spark pull request #16552: [SPARK-19152][SQL]DataFrameWriter.saveAsTable sup...

2017-01-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16552#discussion_r97480861 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala --- @@ -112,12 +112,6 @@ case class

[GitHub] spark pull request #16582: [SPARK-19220][UI] Make redirection to HTTPS apply...

2017-01-23 Thread sarutak
Github user sarutak commented on a diff in the pull request: https://github.com/apache/spark/pull/16582#discussion_r97478738 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -337,17 +350,20 @@ private[spark] object JettyUtils extends Logging {

[GitHub] spark pull request #16582: [SPARK-19220][UI] Make redirection to HTTPS apply...

2017-01-23 Thread sarutak
Github user sarutak commented on a diff in the pull request: https://github.com/apache/spark/pull/16582#discussion_r97479049 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -274,25 +277,28 @@ private[spark] object JettyUtils extends Logging {

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Classification and regression...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Classification and regression...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #71911 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71911/testReport)** for PR 16171 at commit

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Classification and regression...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71911/ Test PASSed. ---

[GitHub] spark pull request #16661: [SPARK-19313][ML][MLLIB] GaussianMixture should l...

2017-01-23 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/16661#discussion_r97479326 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -486,6 +491,9 @@ class GaussianMixture @Since("2.0.0") (

[GitHub] spark issue #16594: [SPARK-17078] [SQL] Show stats when explain

2017-01-23 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16594 I still do not think using an internal configuration is a user friendly way to show the plan costs. Using this way, we do not want users to see it. --- If your project is set up for it, you can

[GitHub] spark pull request #16594: [SPARK-17078] [SQL] Show stats when explain

2017-01-23 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16594#discussion_r97478978 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/Statistics.scala --- @@ -54,11 +56,32 @@ case class Statistics(

[GitHub] spark issue #16594: [SPARK-17078] [SQL] Show stats when explain

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16594 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71906/ Test FAILed. ---

[GitHub] spark issue #16677: [WIP][SQL] Use map output statistices to improve global ...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16677 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71905/ Test FAILed. ---

[GitHub] spark issue #16677: [WIP][SQL] Use map output statistices to improve global ...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16677 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16594: [SPARK-17078] [SQL] Show stats when explain

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16594 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16638: [SPARK-19115] [SQL] Supporting Create External Table Lik...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16638 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16594: [SPARK-17078] [SQL] Show stats when explain

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16594 **[Test build #71906 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71906/testReport)** for PR 16594 at commit

[GitHub] spark issue #16638: [SPARK-19115] [SQL] Supporting Create External Table Lik...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16638 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71904/ Test PASSed. ---

[GitHub] spark issue #16638: [SPARK-19115] [SQL] Supporting Create External Table Lik...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16638 **[Test build #71904 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71904/testReport)** for PR 16638 at commit

[GitHub] spark issue #16677: [WIP][SQL] Use map output statistices to improve global ...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16677 **[Test build #71905 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71905/testReport)** for PR 16677 at commit

[GitHub] spark issue #16138: [SPARK-16609] Add to_date/to_timestamp with format funct...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16138 **[Test build #71913 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71913/testReport)** for PR 16138 at commit

[GitHub] spark pull request #16661: [SPARK-19313][ML][MLLIB] GaussianMixture should l...

2017-01-23 Thread zhengruifeng
Github user zhengruifeng commented on a diff in the pull request: https://github.com/apache/spark/pull/16661#discussion_r97478414 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -486,6 +491,9 @@ class GaussianMixture @Since("2.0.0") (

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71907/ Test FAILed. ---

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #71907 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71907/testReport)** for PR 15880 at commit

[GitHub] spark issue #16138: [SPARK-16609] Add to_date/to_timestamp with format funct...

2017-01-23 Thread anabranch
Github user anabranch commented on the issue: https://github.com/apache/spark/pull/16138 @cloud-fan - Reynold referred me to your for this test failure. My two tests are failing because Hive tests *allegedly* cover something like this. ``` SELECT

[GitHub] spark issue #16606: [SPARK-19246][SQL]CataLogTable's partitionSchema order a...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16606 **[Test build #71912 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71912/testReport)** for PR 16606 at commit

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Classification and regression...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Classification and regression...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71909/ Test PASSed. ---

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Classification and regression...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #71909 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71909/testReport)** for PR 16171 at commit

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Classification and regression...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #71911 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71911/testReport)** for PR 16171 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-23 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15880 LGTM The PR title is not right. BTW, we might need a release note for this PR. This will change the behaviors. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #12135: [SPARK-14352][SQL] approxQuantile should support multi c...

2017-01-23 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/12135 @MLnick @jkbradley Could you mind making a final pass? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #16138: [SPARK-16609] Add to_date/to_timestamp with format funct...

2017-01-23 Thread anabranch
Github user anabranch commented on the issue: https://github.com/apache/spark/pull/16138 @felixcheung Thank you for your feedback! Small request, can you tell me if my R test case is sufficient for this? It doesn't seem like there is extensive R testing right now for virtually any

[GitHub] spark issue #16606: [SPARK-19246][SQL]CataLogTable's partitionSchema order a...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16606 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71902/ Test PASSed. ---

[GitHub] spark issue #16606: [SPARK-19246][SQL]CataLogTable's partitionSchema order a...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16606 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16606: [SPARK-19246][SQL]CataLogTable's partitionSchema order a...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16606 **[Test build #71902 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71902/testReport)** for PR 16606 at commit

[GitHub] spark issue #16552: [SPARK-19152][SQL]DataFrameWriter.saveAsTable support hi...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16552 **[Test build #71910 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71910/testReport)** for PR 16552 at commit

[GitHub] spark issue #14872: [SPARK-3162][MLlib][WIP] Add local tree training for dec...

2017-01-23 Thread smurching
Github user smurching commented on the issue: https://github.com/apache/spark/pull/14872 No worries, apologies for being busy on my end -- I'll leave the branch up & try to contribute in other ways when I have the time! --- If your project is set up for it, you can reply to this

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Classification and regression...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #71909 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71909/testReport)** for PR 16171 at commit

[GitHub] spark pull request #16668: [SPARK-18788][SPARKR] Add API for getNumPartition...

2017-01-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16668#discussion_r97475352 --- Diff: R/pkg/R/DataFrame.R --- @@ -3406,3 +3406,28 @@ setMethod("randomSplit", } sapply(sdfs, dataFrame)

[GitHub] spark pull request #16668: [SPARK-18788][SPARKR] Add API for getNumPartition...

2017-01-23 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16668#discussion_r97475188 --- Diff: R/pkg/R/DataFrame.R --- @@ -3406,3 +3406,28 @@ setMethod("randomSplit", } sapply(sdfs, dataFrame)

[GitHub] spark pull request #16668: [SPARK-18788][SPARKR] Add API for getNumPartition...

2017-01-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16668#discussion_r97474262 --- Diff: R/pkg/R/DataFrame.R --- @@ -3406,3 +3406,28 @@ setMethod("randomSplit", } sapply(sdfs, dataFrame)

[GitHub] spark pull request #16668: [SPARK-18788][SPARKR] Add API for getNumPartition...

2017-01-23 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16668#discussion_r97473647 --- Diff: R/pkg/R/DataFrame.R --- @@ -3406,3 +3406,28 @@ setMethod("randomSplit", } sapply(sdfs, dataFrame)

[GitHub] spark pull request #16679: [SPARK-19272][SQL] Remove the param `viewOriginal...

2017-01-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16679 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16679: [SPARK-19272][SQL] Remove the param `viewOriginalText` f...

2017-01-23 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16679 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16679: [SPARK-19272][SQL] Remove the param `viewOriginalText` f...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16679 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71900/ Test PASSed. ---

[GitHub] spark issue #16679: [SPARK-19272][SQL] Remove the param `viewOriginalText` f...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16679 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16269: [SPARK-19080][SQL] simplify data source analysis

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16269 **[Test build #71908 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71908/testReport)** for PR 16269 at commit

[GitHub] spark issue #16679: [SPARK-19272][SQL] Remove the param `viewOriginalText` f...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16679 **[Test build #71900 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71900/testReport)** for PR 16679 at commit

[GitHub] spark pull request #16638: [SPARK-19115] [SQL] Supporting Create External Ta...

2017-01-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16638#discussion_r97471913 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -81,8 +81,8 @@ statement rowFormat?

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #71907 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71907/testReport)** for PR 15880 at commit

  1   2   3   4   5   6   7   >