[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14452 **[Test build #64422 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64422/consoleFull)** for PR 14452 at commit

[GitHub] spark issue #14808: [SPARK-17156][ML][EXAMPLE] Add multiclass logistic regre...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14808 **[Test build #64423 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64423/consoleFull)** for PR 14808 at commit

[GitHub] spark pull request #14808: [SPARK-17156][ML][EXAMPLE] Add multiclass logisti...

2016-08-25 Thread jaceklaskowski
GitHub user jaceklaskowski opened a pull request: https://github.com/apache/spark/pull/14808 [SPARK-17156][ML][EXAMPLE] Add multiclass logistic regression Scala Example ## What changes were proposed in this pull request? New example for `MultinomialLogisticRegression` ML

[GitHub] spark issue #14579: [SPARK-16921][PYSPARK] RDD/DataFrame persist()/cache() s...

2016-08-25 Thread nchammas
Github user nchammas commented on the issue: https://github.com/apache/spark/pull/14579 Looks good to me. 👍 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14750 **[Test build #64421 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64421/consoleFull)** for PR 14750 at commit

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76251185 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeTableCommand.scala --- @@ -88,14 +89,70 @@ case class

[GitHub] spark pull request #14781: [SPARK-17167] [2.0] [SQL] Issue Exceptions when A...

2016-08-25 Thread gatorsmile
Github user gatorsmile closed the pull request at: https://github.com/apache/spark/pull/14781 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76248746 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeTableCommand.scala --- @@ -88,14 +89,70 @@ case class

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76248301 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeTableCommand.scala --- @@ -88,14 +89,70 @@ case class

[GitHub] spark pull request #14573: [SPARK-16984][SQL] don't try whole dataset immedi...

2016-08-25 Thread robert3005
Github user robert3005 commented on a diff in the pull request: https://github.com/apache/spark/pull/14573#discussion_r76245512 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1296,6 +1296,7 @@ abstract class RDD[T: ClassTag]( * an exception if called

[GitHub] spark pull request #14573: [SPARK-16984][SQL] don't try whole dataset immedi...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14573#discussion_r76244574 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1296,6 +1296,7 @@ abstract class RDD[T: ClassTag]( * an exception if called

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14452 **[Test build #64420 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64420/consoleFull)** for PR 14452 at commit

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14750 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64416/ Test FAILed. ---

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14750 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14750 **[Test build #64416 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64416/consoleFull)** for PR 14750 at commit

[GitHub] spark issue #14786: [SPARK-17212][SQL] TypeCoercion supports widening conver...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14786 **[Test build #64419 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64419/consoleFull)** for PR 14786 at commit

[GitHub] spark pull request #14786: [SPARK-17212][SQL] TypeCoercion supports widening...

2016-08-25 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/14786#discussion_r76241650 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercionSuite.scala --- @@ -188,6 +188,7 @@ class TypeCoercionSuite

[GitHub] spark issue #14785: [SPARK-17207][MLLIB]fix comparing Vector bug in TestingU...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14785 **[Test build #64418 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64418/consoleFull)** for PR 14785 at commit

[GitHub] spark issue #12374: [SPARK-14610][ML] Remove superfluous split for continuou...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12374 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12374: [SPARK-14610][ML] Remove superfluous split for continuou...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12374 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64417/ Test PASSed. ---

[GitHub] spark issue #12374: [SPARK-14610][ML] Remove superfluous split for continuou...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12374 **[Test build #64417 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64417/consoleFull)** for PR 12374 at commit

[GitHub] spark pull request #14777: [SPARK-17205] Literal.sql should handle Infinity ...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14777#discussion_r76240220 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/literals.scala --- @@ -251,8 +251,21 @@ case class Literal (value: Any,

[GitHub] spark issue #14785: [SPARK-17207][MLLIB]fix comparing Vector bug in TestingU...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14785 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14785: [SPARK-17207][MLLIB]fix comparing Vector bug in TestingU...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14785 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64418/ Test FAILed. ---

[GitHub] spark issue #14744: [SPARK-17178][SPARKR][SPARKSUBMIT] Allow to set sparkr s...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14744 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64413/ Test FAILed. ---

[GitHub] spark issue #14744: [SPARK-17178][SPARKR][SPARKSUBMIT] Allow to set sparkr s...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14744 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14744: [SPARK-17178][SPARKR][SPARKSUBMIT] Allow to set sparkr s...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14744 **[Test build #64413 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64413/consoleFull)** for PR 14744 at commit

[GitHub] spark issue #14807: Remove double quotes in spark/bin batch files to avoid c...

2016-08-25 Thread qualiu
Github user qualiu commented on the issue: https://github.com/apache/spark/pull/14807 @srowen : Thank you! Glad to hear opinions and maybe need more discussion. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #14785: [SPARK-17207][MLLIB]fix comparing Vector bug in TestingU...

2016-08-25 Thread mpjlu
Github user mpjlu commented on the issue: https://github.com/apache/spark/pull/14785 Hi @dbtsai , PR 2294 added Matrix comparing in TestingUtils, but did not add any test cases in TestingUtilsSuite. I did not add test cases for Matrix comparing in the PR either. If Matrix

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14737 OK, another config eh. If there's no default change in behavior, and it's undocumented and it doesn't introduce much complexity, seems OK --- If your project is set up for it, you can reply to this

[GitHub] spark issue #14807: Remove double quotes in spark/bin batch files to avoid c...

2016-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14807 I can't evaluate this since I don't use windows, but maybe others who made the original change can. You should check https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark BTW.

[GitHub] spark issue #14807: Remove double quotes in spark/bin batch files to avoid c...

2016-08-25 Thread qualiu
Github user qualiu commented on the issue: https://github.com/apache/spark/pull/14807 @srowen : Sorry that there's something misleading in my example about the --jar. The key points in short are : * The double quotes with **spark-submit.cmd** doesn't work** if the full

[GitHub] spark issue #14785: [SPARK-17207][MLLIB]fix comparing Vector bug in TestingU...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14785 **[Test build #64418 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64418/consoleFull)** for PR 14785 at commit

[GitHub] spark issue #14781: [SPARK-17167] [2.0] [SQL] Issue Exceptions when Analyze ...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14781 @gatorsmile I have merged this PR. The merge script can only close PRs that are targeted at master. Can you close it? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #14781: [SPARK-17167] [2.0] [SQL] Issue Exceptions when Analyze ...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14781 LGTM - merging to branch-2.0. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14573: [SPARK-16984][SQL] don't try whole dataset immediately w...

2016-08-25 Thread robert3005
Github user robert3005 commented on the issue: https://github.com/apache/spark/pull/14573 @hvanhovell made all the suggested changes. I initially misunderstood what getByteArrayRdd does. Shuold be good now --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #12374: [SPARK-14610][ML] Remove superfluous split for continuou...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12374 **[Test build #64417 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64417/consoleFull)** for PR 12374 at commit

[GitHub] spark pull request #14661: [SPARK-16991][SPARK-17099][SPARK-17120][SQL] Fix ...

2016-08-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14661 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14661: [SPARK-16991][SPARK-17099][SPARK-17120][SQL] Fix Outer J...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14661 LGTM - merging to master/2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14806: [SPARK-17061][SPARK-17093][SQL] MapObjects should...

2016-08-25 Thread hvanhovell
Github user hvanhovell closed the pull request at: https://github.com/apache/spark/pull/14806 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #14806: [SPARK-17061][SPARK-17093][SQL] MapObjects should make c...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14806 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14806: [SPARK-17061][SPARK-17093][SQL] MapObjects should make c...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14806 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64415/ Test PASSed. ---

[GitHub] spark issue #14806: [SPARK-17061][SPARK-17093][SQL] MapObjects should make c...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14806 **[Test build #64415 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64415/consoleFull)** for PR 14806 at commit

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14750 **[Test build #64416 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64416/consoleFull)** for PR 14750 at commit

[GitHub] spark pull request #14573: [SPARK-16984][SQL] don't try whole dataset immedi...

2016-08-25 Thread robert3005
Github user robert3005 commented on a diff in the pull request: https://github.com/apache/spark/pull/14573#discussion_r76230260 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1296,6 +1296,7 @@ abstract class RDD[T: ClassTag]( * an exception if called

[GitHub] spark pull request #14702: [SPARK-15694] Implement ScriptTransformation in s...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14702#discussion_r76230236 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/script/ScriptTransformationExec.scala --- @@ -0,0 +1,313 @@ +/* + * Licensed to

[GitHub] spark pull request #14786: [SPARK-17212][SQL] TypeCoercion supports widening...

2016-08-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14786#discussion_r76230207 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercionSuite.scala --- @@ -188,6 +188,7 @@ class TypeCoercionSuite

[GitHub] spark pull request #14702: [SPARK-15694] Implement ScriptTransformation in s...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14702#discussion_r76229790 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/script/ScriptTransformationExec.scala --- @@ -0,0 +1,313 @@ +/* + * Licensed to

[GitHub] spark pull request #14573: [SPARK-16984][SQL] don't try whole dataset immedi...

2016-08-25 Thread robert3005
Github user robert3005 commented on a diff in the pull request: https://github.com/apache/spark/pull/14573#discussion_r76229774 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala --- @@ -311,30 +311,32 @@ abstract class SparkPlan extends

[GitHub] spark pull request #14702: [SPARK-15694] Implement ScriptTransformation in s...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14702#discussion_r76229814 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/script/ScriptTransformationExec.scala --- @@ -0,0 +1,313 @@ +/* + * Licensed to

[GitHub] spark pull request #14702: [SPARK-15694] Implement ScriptTransformation in s...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14702#discussion_r76229653 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/script/ScriptTransformationExec.scala --- @@ -0,0 +1,313 @@ +/* + * Licensed to

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-25 Thread cenyuhai
Github user cenyuhai commented on the issue: https://github.com/apache/spark/pull/14737 @srowen Why I set this value 2, because a "JOIN" action needs 2 elements.Because Users always don't care about how many partitions the graphs has, they just want to know the relations from DAG

[GitHub] spark pull request #14573: [SPARK-16984][SQL] don't try whole dataset immedi...

2016-08-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14573#discussion_r76228058 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1296,6 +1296,7 @@ abstract class RDD[T: ClassTag]( * an exception if called on an

[GitHub] spark pull request #14573: [SPARK-16984][SQL] don't try whole dataset immedi...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14573#discussion_r76227923 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala --- @@ -311,30 +311,32 @@ abstract class SparkPlan extends

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14737 I can see the value in this, but it also removes any indication that there are more elements to the graph that are not displayed. I wonder if there is any easy way to do that or do I misunderstand?

[GitHub] spark pull request #14573: [SPARK-16984][SQL] don't try whole dataset immedi...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14573#discussion_r76227554 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala --- @@ -311,30 +311,32 @@ abstract class SparkPlan extends

[GitHub] spark issue #14807: Remove double quotes in spark/bin batch files to avoid c...

2016-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14807 I see, your example shows, I think, submitting an invalid JAR file right? you've specified your JAR with --jars but then don't specify a main JAR. That may be the root cause. I see

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-25 Thread cenyuhai
Github user cenyuhai commented on the issue: https://github.com/apache/spark/pull/14737 I am very sorry about, the first picture is for stage, the second picture is for job, but it is the same job "select count(1) from partitionedTables " --- If your project is set up for it, you

[GitHub] spark issue #14753: [SPARK-17187][SQL] Supports using arbitrary Java object ...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14753 @clockfly is this supposed to work with window functions? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #14753: [SPARK-17187][SQL] Supports using arbitrary Java ...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14753#discussion_r76225656 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/interfaces.scala --- @@ -389,3 +389,144 @@ abstract class

[GitHub] spark issue #14788: [SPARK-17174][SQL][WIP] Add the support for TimestampTyp...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14788 NP :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14788: [SPARK-17174][SQL][WIP] Add the support for TimestampTyp...

2016-08-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14788 Sorry, it takes a bit longer than I thought I will finish up this within this week. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #14807: Remove double quotes in spark/bin batch files to avoid c...

2016-08-25 Thread qualiu
Github user qualiu commented on the issue: https://github.com/apache/spark/pull/14807 And what's more, current `spark-submit.cmd` will cause an extra error of **"The input line is too long."** if you call `spark-submit.cmd` in an batch file under some case ``` Pi* d:\tmp

[GitHub] spark issue #14807: Remove double quotes in spark/bin batch files to avoid c...

2016-08-25 Thread qualiu
Github user qualiu commented on the issue: https://github.com/apache/spark/pull/14807 @srowen : thanks for your reply. But as I've mentioned above , path with spaces is not work now: ``` D:\opengit\spark\bin - Copy>spark-submit.cmd --jars just-to-start

[GitHub] spark issue #13852: [SPARK-16200][SQL] Rename AggregateFunction#supportsPart...

2016-08-25 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/13852 okay, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #13852: [SPARK-16200][SQL] Rename AggregateFunction#suppo...

2016-08-25 Thread maropu
Github user maropu closed the pull request at: https://github.com/apache/spark/pull/13852 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14786: [SPARK-17212][SQL] TypeCoercion supports widening conver...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14786 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64411/ Test PASSed. ---

[GitHub] spark issue #14786: [SPARK-17212][SQL] TypeCoercion supports widening conver...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14786 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14786: [SPARK-17212][SQL] TypeCoercion supports widening conver...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14786 **[Test build #64411 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64411/consoleFull)** for PR 14786 at commit

[GitHub] spark issue #14807: Remove double quotes in spark/bin batch files to avoid c...

2016-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14807 I don't think we can do that, because then paths with spaces don't work for example. don't you just need to escape your argument? --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #14800: [SPARK-15382][SQL] Fix a bug in sampling with replacemen...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14800 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64412/ Test PASSed. ---

[GitHub] spark issue #14800: [SPARK-15382][SQL] Fix a bug in sampling with replacemen...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14800 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13852: [SPARK-16200][SQL] Rename AggregateFunction#supportsPart...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/13852 @maropu we are close to merging PR https://github.com/apache/spark/pull/14753. This will eliminate the need for a per-group (sorted) aggregation approach. On the longer run, it might also

[GitHub] spark issue #14800: [SPARK-15382][SQL] Fix a bug in sampling with replacemen...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14800 **[Test build #64412 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64412/consoleFull)** for PR 14800 at commit

[GitHub] spark issue #14807: Remove double quotes in spark/bin batch files to avoid c...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14807 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14807: Remove double quotes in spark/bin batch files to ...

2016-08-25 Thread qualiu
GitHub user qualiu opened a pull request: https://github.com/apache/spark/pull/14807 Remove double quotes in spark/bin batch files to avoid cutting off arguments that double quoted as contain special character. ## What changes were proposed in this pull request? Remove

[GitHub] spark pull request #10896: [SPARK-12978][SQL] Skip unnecessary final group-b...

2016-08-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10896 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #10896: [SPARK-12978][SQL] Skip unnecessary final group-by when ...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/10896 LGTM - merging to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14804: [MINOR][Web UI] Correctly convert bytes in web UI

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14804 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14806: [SPARK-17061][SPARK-17093][SQL] MapObjects should make c...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14806 **[Test build #64415 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64415/consoleFull)** for PR 14806 at commit

[GitHub] spark pull request #14573: [SPARK-16984][SQL] don't try whole dataset immedi...

2016-08-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14573#discussion_r76217738 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1296,6 +1296,7 @@ abstract class RDD[T: ClassTag]( * an exception if called

[GitHub] spark issue #14804: [MINOR][Web UI] Correctly convert bytes in web UI

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14804 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64410/ Test FAILed. ---

[GitHub] spark issue #14804: [MINOR][Web UI] Correctly convert bytes in web UI

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14804 **[Test build #64410 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64410/consoleFull)** for PR 14804 at commit

[GitHub] spark pull request #14806: [SPARK-17061][SPARK-17093][SQL] MapObjects` shoul...

2016-08-25 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/14806 [SPARK-17061][SPARK-17093][SQL] MapObjects` should make copies of unsafe-backed data [Backport] ## What changes were proposed in this pull request? This PR backports

[GitHub] spark issue #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/8880 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64408/ Test PASSed. ---

[GitHub] spark issue #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/8880 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/8880 **[Test build #64408 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64408/consoleFull)** for PR 8880 at commit

[GitHub] spark issue #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/8880 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64407/ Test PASSed. ---

[GitHub] spark issue #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/8880 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/8880 **[Test build #64407 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64407/consoleFull)** for PR 8880 at commit

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14737 Pardon the dumb question, but your before and after pictures seem like different graphs. Is that really showing the before and after of one display? --- If your project is set up for it, you can

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-25 Thread cenyuhai
Github user cenyuhai commented on the issue: https://github.com/apache/spark/pull/14737 @srowen please review the latest codes, thank you. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14617: [SPARK-17019][Core] Expose on-heap and off-heap memory u...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14617 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14617: [SPARK-17019][Core] Expose on-heap and off-heap memory u...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14617 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64406/ Test FAILed. ---

[GitHub] spark issue #14617: [SPARK-17019][Core] Expose on-heap and off-heap memory u...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14617 **[Test build #64406 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64406/consoleFull)** for PR 14617 at commit

[GitHub] spark pull request #14766: [SPARK-17197] [ML] [PySpark] PySpark LiR/LoR supp...

2016-08-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14766 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14805: [MINOR][DOCS] Fix minor typos in python example code

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14805 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64414/ Test PASSed. ---

[GitHub] spark pull request #14698: [SPARK-17061][SPARK-17093][SQL] `MapObjects` shou...

2016-08-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14698 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14803: [SPARK-17153][SQL] Should read partition data when readi...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14803 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64405/ Test PASSed. ---

[GitHub] spark issue #14805: [MINOR][DOCS] Fix minor typos in python example code

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14805 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

<    1   2   3   4   5   6   >