[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14452 **[Test build #63108 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63108/consoleFull)** for PR 14452 at commit

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14452 **[Test build #63107 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63107/consoleFull)** for PR 14452 at commit

[GitHub] spark pull request #14452: [SPARK-16849][SQL] Improve subquery execution by ...

2016-08-01 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/14452 [SPARK-16849][SQL] Improve subquery execution by deduplicating the subqueries with the same results ## What changes were proposed in this pull request? The subqueries in SparkSQL will be

[GitHub] spark issue #14420: [SPARK-14204] [SQL] register driverClass rather than use...

2016-08-01 Thread zzcclp
Github user zzcclp commented on the issue: https://github.com/apache/spark/pull/14420 @JoshRosen can you have a look at this pr? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14451: [SPARK-16848][SQL] Make jdbc() and read.format("jdbc") c...

2016-08-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14451 Yeah, keep it open. That PR just tries to get all the possible holes (corner cases). You know, I do not care which PR is merged, but, in my opinion, we need to cover all the cases. That is for

[GitHub] spark issue #14451: [SPARK-16848][SQL] Make jdbc() and read.format("jdbc") c...

2016-08-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14451 Oh, you took a look already. Yes, it seems your PR includes this change. Do you mind if I leave this open? This bit seems arguably get merged quickly. I don't mind if this credits to

[GitHub] spark issue #14451: [SPARK-16848][SQL] Make jdbc() and read.format("jdbc") c...

2016-08-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14451 Is this related to: https://github.com/apache/spark/pull/13770? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14451: [SPARK-16848][SQL] Make jdbc() and read.format("jdbc") c...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14451 **[Test build #63106 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63106/consoleFull)** for PR 14451 at commit

[GitHub] spark pull request #14451: Make jdbc() and read.format("jdbc") consistently ...

2016-08-01 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/14451 Make jdbc() and read.format("jdbc") consistently throwing exception for user-specified schema ## What changes were proposed in this pull request? Currently, ```scala

[GitHub] spark issue #14449: [SPARK-16843][MLLIB] add the percentage ChiSquareSelecto...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14449 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14298: [SPARK-16283][SQL] Implement `percentile_approx` SQL fun...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14298 **[Test build #63105 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63105/consoleFull)** for PR 14298 at commit

[GitHub] spark issue #14450: [SPARK-16847][SQL] Prevent to potentially read corrupt s...

2016-08-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14450 This will be a legitimate change because this replaces the deprecated usage of constructor. Please let me cc @liancheng and @srowen as well as it is also partly about building. --- If your

[GitHub] spark issue #14450: [SPARK-16847][SQL] Prevent to potentially read corrupt s...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14450 **[Test build #63104 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63104/consoleFull)** for PR 14450 at commit

[GitHub] spark pull request #14450: [SPARK-16847][SQL] Prevent to potentially read co...

2016-08-01 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/14450 [SPARK-16847][SQL] Prevent to potentially read corrupt statstics on binary in Parquet a VectorizedReader ## What changes were proposed in this pull request? it is still possible to

[GitHub] spark pull request #14449: [SPARK-16843][MLLIB] add the percentage ChiSquare...

2016-08-01 Thread mpjlu
GitHub user mpjlu opened a pull request: https://github.com/apache/spark/pull/14449 [SPARK-16843][MLLIB] add the percentage ChiSquareSelector feature ## What changes were proposed in this pull request? add the percentage ChiSquareSelector feature ## How was

[GitHub] spark issue #14446: [SPARK-16841][SQL] Improves the row level metrics perfor...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14446 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63101/ Test PASSed. ---

[GitHub] spark issue #14446: [SPARK-16841][SQL] Improves the row level metrics perfor...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14446 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14446: [SPARK-16841][SQL] Improves the row level metrics perfor...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14446 **[Test build #63101 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63101/consoleFull)** for PR 14446 at commit

[GitHub] spark issue #11411: [SPARK-13385][MLlib] Enable AssociationRules to generate...

2016-08-01 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/11411 Test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #12135: [SPARK-14352][SQL] approxQuantile should support multi c...

2016-08-01 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/12135 Test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #12983: [SPARK-15213][PySpark] Unify 'range' usages

2016-08-01 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/12983 @srowen In Python2, `xrange` is more efficient than `range`. This PR add 'range = xrange' in files like `python/pyspark/accumulators.py` `python/pyspark/heapq3.py`

[GitHub] spark pull request #13657: [SPARK-15939][ML][PySpark] Clarify ml.linalg usag...

2016-08-01 Thread zhengruifeng
Github user zhengruifeng closed the pull request at: https://github.com/apache/spark/pull/13657 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #14368: [SPARK-16734][EXAMPLES][SQL] Revise examples of all lang...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14368 **[Test build #63103 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63103/consoleFull)** for PR 14368 at commit

[GitHub] spark issue #14368: [SPARK-16734][EXAMPLES][SQL] Revise examples of all lang...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14368 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14368: [SPARK-16734][EXAMPLES][SQL] Revise examples of all lang...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14368 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63103/ Test PASSed. ---

[GitHub] spark issue #14448: [Spark-16579][SparkR] Add install.spark function

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14448 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14448: [Spark-16579][SparkR] Add install.spark function

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14448 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63102/ Test PASSed. ---

[GitHub] spark issue #14448: [Spark-16579][SparkR] Add install.spark function

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14448 **[Test build #63102 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63102/consoleFull)** for PR 14448 at commit

[GitHub] spark issue #14368: [SPARK-16734][EXAMPLES][SQL] Revise examples of all lang...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14368 **[Test build #63103 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63103/consoleFull)** for PR 14368 at commit

[GitHub] spark issue #13893: [SPARK-14172][SQL] Hive table partition predicate not pa...

2016-08-01 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/13893 ping @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14368: [SPARK-16734][EXAMPLES][SQL] Revise examples of all lang...

2016-08-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14368 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14368: [SPARK-16734][EXAMPLES][SQL] Revise examples of all lang...

2016-08-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14368 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14401: [SPARK-16793][SQL]Set the temporary warehouse path to sc...

2016-08-01 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/14401 @rxin As @yhuai previously addressed, this change benifits in following cases: 1. Right now, we set the warehouse path to the default one firstly, and then we override the setting in

[GitHub] spark issue #14427: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-08-01 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14427 Done --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #14427: [SPARK-16818] Exchange reuse incorrectly reuses s...

2016-08-01 Thread ericl
Github user ericl closed the pull request at: https://github.com/apache/spark/pull/14427 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14427: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-08-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14427 @ericl can you close this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14427: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-08-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14427 Merging in branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14448: [Spark-16579][SparkR] Add install.spark function

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14448 **[Test build #63102 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63102/consoleFull)** for PR 14448 at commit

[GitHub] spark pull request #14448: [Spark-16579][SparkR] Add install.spark function

2016-08-01 Thread junyangq
GitHub user junyangq opened a pull request: https://github.com/apache/spark/pull/14448 [Spark-16579][SparkR] Add install.spark function ## What changes were proposed in this pull request? Add an `install.spark` function to the SparkR package. User can run `install.spark()`

[GitHub] spark issue #14446: [SPARK-16841][SQL] Improves the row level metrics perfor...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14446 **[Test build #63101 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63101/consoleFull)** for PR 14446 at commit

[GitHub] spark issue #14446: [SPARK-16841][SQL] Improves the row level metrics perfor...

2016-08-01 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/14446 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11157 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63099/ Test PASSed. ---

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11157 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11157 **[Test build #63099 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63099/consoleFull)** for PR 11157 at commit

[GitHub] spark issue #14446: [SPARK-16841][SQL] Improves the row level metrics perfor...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14446 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14446: [SPARK-16841][SQL] Improves the row level metrics perfor...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14446 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63097/ Test FAILed. ---

[GitHub] spark issue #14440: [SPARK-16835][ML] add training data unpersist handling w...

2016-08-01 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/14440 sounds reasonable... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14396: [SPARK-16787] SparkContext.addFile() should not throw if...

2016-08-01 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/14396 @zsxwing, I meant to describe what happens on executors in the following scenario: - `addFile(foo)` is called for the first time at `timestamp = 1` - A task runs on an executor and

[GitHub] spark pull request #14440: [SPARK-16835][ML] add training data unpersist han...

2016-08-01 Thread WeichenXu123
Github user WeichenXu123 closed the pull request at: https://github.com/apache/spark/pull/14440 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #14446: [SPARK-16841][SQL] Improves the row level metrics perfor...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14446 **[Test build #63097 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63097/consoleFull)** for PR 14446 at commit

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-08-01 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/13778 ping @cloud-fan again, this is waiting for a while. Do you have time to look at again? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-01 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/14447 hi @mengxr , could you please tell me how to debug R wrapper? Thanks a lot I tried to read documentation and google, but cannot figure it out myself. From SparkR console, the error

[GitHub] spark issue #14442: [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_...

2016-08-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14442 Can you add an end-to-end test for this in SQLQuerySuite? It's not a great place but we will refactor it soon. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14447 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14447 **[Test build #63100 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63100/consoleFull)** for PR 14447 at commit

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14447 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63100/ Test FAILed. ---

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14447 **[Test build #63100 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63100/consoleFull)** for PR 14447 at commit

[GitHub] spark pull request #14434: [SPARK-16828][SQL] remove MaxOf and MinOf

2016-08-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14434 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptro...

2016-08-01 Thread keypointt
GitHub user keypointt opened a pull request: https://github.com/apache/spark/pull/14447 [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Classifier wrapper in SparkR https://issues.apache.org/jira/browse/SPARK-16445 ## What changes were proposed in this pull request?

[GitHub] spark issue #14434: [SPARK-16828][SQL] remove MaxOf and MinOf

2016-08-01 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14434 Thanks. Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14392: [SPARK-16446] [SparkR] [ML] Gaussian Mixture Mode...

2016-08-01 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/14392#discussion_r73079016 --- Diff: R/pkg/R/mllib.R --- @@ -632,3 +659,106 @@ setMethod("predict", signature(object = "AFTSurvivalRegressionModel"), function(object,

[GitHub] spark issue #13647: [SPARK-15784][ML]:Add Power Iteration Clustering to spar...

2016-08-01 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/13647 ping @mengxr @jkbradley @yanboliang Can you give me some comments on this PR? I can start improving it for 2.1+. Thanks! --- If your project is set up for it, you can reply to this

[GitHub] spark issue #14433: [SPARK-16829][SparkR]:sparkR sc.setLogLevel doesn't work

2016-08-01 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/14433 @felixcheung I will try to retrieve terminal/shell type before printing out the message. I will update the PR if I can find a way of doing that. Thanks! --- If your project is set up for it,

[GitHub] spark issue #14445: [SPARK-16320] [SQL] Fix performance regression for parqu...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14445 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63096/ Test PASSed. ---

[GitHub] spark issue #14445: [SPARK-16320] [SQL] Fix performance regression for parqu...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14445 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14445: [SPARK-16320] [SQL] Fix performance regression for parqu...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14445 **[Test build #63096 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63096/consoleFull)** for PR 14445 at commit

[GitHub] spark pull request #14368: [SPARK-16734][EXAMPLES][SQL] Revise examples of a...

2016-08-01 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14368#discussion_r73076628 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -18,31 +18,43 @@ library(SparkR) # $example on:init_session$

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11157 **[Test build #63099 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63099/consoleFull)** for PR 11157 at commit

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11157 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11157 **[Test build #63098 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63098/consoleFull)** for PR 11157 at commit

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11157 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63098/ Test FAILed. ---

[GitHub] spark pull request #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor po...

2016-08-01 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/11157#discussion_r73074211 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -356,4 +374,233 @@ private[mesos] trait

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11157 **[Test build #63098 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63098/consoleFull)** for PR 11157 at commit

[GitHub] spark issue #14446: [SPARK-16841][SQL] Improves the row level metrics perfor...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14446 **[Test build #63097 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63097/consoleFull)** for PR 14446 at commit

[GitHub] spark pull request #14434: [SPARK-16828][SQL] remove MaxOf and MinOf

2016-08-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14434#discussion_r73073652 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -662,10 +662,6 @@ object NullPropagation extends

[GitHub] spark pull request #14446: [SPARK-16841][SQL] Improves the row level metrics...

2016-08-01 Thread clockfly
GitHub user clockfly opened a pull request: https://github.com/apache/spark/pull/14446 [SPARK-16841][SQL] Improves the row level metrics performance when reading Parquet table ## What changes were proposed in this pull request? When reading from Parquet table, Spark

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing LIMI...

2016-08-01 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/14411 @hvanhovell, First, my apologies for delaying the replies. I am travelling this week, only getting spontaneous connections. Thank you for your explanation of the implementation and the

[GitHub] spark issue #14445: [SPARK-16320] [SQL] Fix performance regression for parqu...

2016-08-01 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/14445 @gatorsmile Thanks! updated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14176: [SPARK-16525][SQL] Enable Row Based HashMap in Ha...

2016-08-01 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14176#discussion_r73070005 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/HashAggregateExec.scala --- @@ -279,9 +280,15 @@ case class

[GitHub] spark issue #14384: [Spark-16443][SparkR] Alternating Least Squares (ALS) wr...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14384 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63095/ Test FAILed. ---

[GitHub] spark issue #14384: [Spark-16443][SparkR] Alternating Least Squares (ALS) wr...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14384 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14445: [SPARK-16320][SQL] Fix performance regression for parque...

2016-08-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14445 Maybe, we can correct the PR description and make it more accurate. This PR avoids the extra memory copy when the vectorized parquet record reader is not being used for reading a

[GitHub] spark issue #14384: [Spark-16443][SparkR] Alternating Least Squares (ALS) wr...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14384 **[Test build #63095 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63095/consoleFull)** for PR 14384 at commit

[GitHub] spark issue #14445: [SPARK-16320][SQL] Fix performance regression for parque...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14445 **[Test build #63096 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63096/consoleFull)** for PR 14445 at commit

[GitHub] spark issue #14442: [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_...

2016-08-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14442 LGTM FYI, MySQL and PostgreSQL support NOW as a synonym of CURRENT_TIMESTAMP --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #14384: [Spark-16443][SparkR] Alternating Least Squares (ALS) wr...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14384 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14384: [Spark-16443][SparkR] Alternating Least Squares (ALS) wr...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14384 **[Test build #63094 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63094/consoleFull)** for PR 14384 at commit

[GitHub] spark issue #14384: [Spark-16443][SparkR] Alternating Least Squares (ALS) wr...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14384 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63094/ Test FAILed. ---

[GitHub] spark pull request #14445: [SPARK-16320][SQL] Fix performance regression for...

2016-08-01 Thread clockfly
GitHub user clockfly opened a pull request: https://github.com/apache/spark/pull/14445 [SPARK-16320][SQL] Fix performance regression for parquet table with nested fields ## What changes were proposed in this pull request? For non-partitioned parquet table with nested

[GitHub] spark pull request #14439: [SPARK-16714][SPARK-16735][SPARK-16646] array, ma...

2016-08-01 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/14439#discussion_r73064350 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -157,6 +145,26 @@ object TypeCoercion { })

[GitHub] spark issue #14439: [SPARK-16714][SPARK-16735][SPARK-16646] array, map, grea...

2016-08-01 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14439 It will be good to summarize the behaviors of other systems in the description. Let's also explain the behavioral change of this pr in the description. So, others can understand its implication.

[GitHub] spark issue #14384: [Spark-16443][SparkR] Alternating Least Squares (ALS) wr...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14384 **[Test build #63095 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63095/consoleFull)** for PR 14384 at commit

[GitHub] spark issue #14212: [SPARK-16558][Examples][MLlib] examples/mllib/LDAExample...

2016-08-01 Thread yinxusen
Github user yinxusen commented on the issue: https://github.com/apache/spark/pull/14212 @MLnick They serve different purpose. This one is for users who have built their tools upon it. The `LatentDirichletAllocationExample` is for ML docs. --- If your project is set up for it, you

[GitHub] spark issue #14444: [SPARK-16839] [SQL] redundant aliases after cleanupAlias...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/1 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14444: [SPARK-16839] [SQL] redundant aliases after cleanupAlias...

2016-08-01 Thread eyalfa
Github user eyalfa commented on the issue: https://github.com/apache/spark/pull/1 @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #14444: [SPARK-16839] [SQL] redundant aliases after clean...

2016-08-01 Thread eyalfa
GitHub user eyalfa opened a pull request: https://github.com/apache/spark/pull/1 [SPARK-16839] [SQL] redundant aliases after cleanupAliases ## What changes were proposed in this pull request? a failing test, soon to add a proposed fix ## How was this patch tested?

[GitHub] spark issue #14384: [Spark-16443][SparkR] Alternating Least Squares (ALS) wr...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14384 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14384: [Spark-16443][SparkR] Alternating Least Squares (ALS) wr...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14384 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63093/ Test FAILed. ---

[GitHub] spark issue #14384: [Spark-16443][SparkR] Alternating Least Squares (ALS) wr...

2016-08-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14384 **[Test build #63093 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63093/consoleFull)** for PR 14384 at commit

[GitHub] spark issue #14441: [SPARK-16837] [SQL] TimeWindow incorrectly drops slideDu...

2016-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14441 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63090/ Test PASSed. ---

  1   2   3   4   >