[GitHub] spark issue #13553: [SPARK-15814][SQL] Aggregator can return null result

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13553 **[Test build #60356 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60356/consoleFull)** for PR 13553 at commit

[GitHub] spark issue #13553: [SPARK-15814][SQL] Aggregator can return null result

2016-06-11 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13553 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13604: [SPARK-15856][SQL] Revert API breaking changes made in D...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13604 **[Test build #60355 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60355/consoleFull)** for PR 13604 at commit

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13617 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13617 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60354/ Test PASSed. ---

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13617 **[Test build #60354 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60354/consoleFull)** for PR 13617 at commit

[GitHub] spark issue #13619: [SPARK-15892][ML] Incorrectly merged AFTAggregator with ...

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13619 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13619: [SPARK-15892][ML] Incorrectly merged AFTAggregator with ...

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13619 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60353/ Test PASSed. ---

[GitHub] spark issue #13619: [SPARK-15892][ML] Incorrectly merged AFTAggregator with ...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13619 **[Test build #60353 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60353/consoleFull)** for PR 13619 at commit

[GitHub] spark pull request #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work ...

2016-06-11 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12601#discussion_r66716164 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRelation.scala --- @@ -96,7 +97,16 @@ private[sql] case class

[GitHub] spark pull request #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work ...

2016-06-11 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12601#discussion_r66716162 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcRelationProvider.scala --- @@ -19,37 +19,105 @@ package

[GitHub] spark pull request #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work ...

2016-06-11 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12601#discussion_r66716158 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcRelationProvider.scala --- @@ -19,37 +19,105 @@ package

[GitHub] spark pull request #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work ...

2016-06-11 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12601#discussion_r66716161 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcRelationProvider.scala --- @@ -19,37 +19,105 @@ package

[GitHub] spark issue #13614: Support Stata-like tabulation of values in a single colu...

2016-06-11 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13614 I think it will be nicer if it follows https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pys...

2016-06-11 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/13599#discussion_r66716081 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonWorkerFactory.scala --- @@ -29,7 +30,10 @@ import org.apache.spark._ import

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13617 **[Test build #60354 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60354/consoleFull)** for PR 13617 at commit

[GitHub] spark issue #13619: [SPARK-15892][ML] Incorrectly merged AFTAggregator with ...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13619 **[Test build #60353 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60353/consoleFull)** for PR 13619 at commit

[GitHub] spark issue #13619: [SPARK-15892][ML] Incorrectly merged AFTAggregator with ...

2016-06-11 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13619 @jkbradley Sure! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #8416: [SPARK-10185] [SQL] Feat sql comma separated paths

2016-06-11 Thread koertkuipers
Github user koertkuipers commented on the issue: https://github.com/apache/spark/pull/8416 this patch should not have broken reading files that include comma. i also added unit test for this:

[GitHub] spark pull request #13381: [SPARK-15608][ml][examples][doc] add examples and...

2016-06-11 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/13381#discussion_r66715565 --- Diff: docs/ml-classification-regression.md --- @@ -685,6 +685,76 @@ The implementation matches the result from R's survival function

[GitHub] spark issue #13381: [SPARK-15608][ml][examples][doc] add examples and docume...

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13381 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60352/ Test PASSed. ---

[GitHub] spark issue #13381: [SPARK-15608][ml][examples][doc] add examples and docume...

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13381 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13381: [SPARK-15608][ml][examples][doc] add examples and docume...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13381 **[Test build #60352 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60352/consoleFull)** for PR 13381 at commit

[GitHub] spark issue #13621: [SPARK-2623] [ML] Implement stacked autoencoder

2016-06-11 Thread avulanov
Github user avulanov commented on the issue: https://github.com/apache/spark/pull/13621 @mengxr @jkbradley could you take a look --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13381: [SPARK-15608][ml][examples][doc] add examples and docume...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13381 **[Test build #60352 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60352/consoleFull)** for PR 13381 at commit

[GitHub] spark issue #13381: [SPARK-15608][ml][examples][doc] add examples and docume...

2016-06-11 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/13381 Other than that, this looks ready. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13381: [SPARK-15608][ml][examples][doc] add examples and...

2016-06-11 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/13381#discussion_r66714994 --- Diff: docs/ml-classification-regression.md --- @@ -685,6 +685,76 @@ The implementation matches the result from R's survival function

[GitHub] spark issue #13621: [SPARK-2623] [ML] Implement stacked autoencoder

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13621 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60351/ Test PASSed. ---

[GitHub] spark issue #13621: [SPARK-2623] [ML] Implement stacked autoencoder

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13621 **[Test build #60351 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60351/consoleFull)** for PR 13621 at commit

[GitHub] spark issue #13621: [SPARK-2623] [ML] Implement stacked autoencoder

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13621 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13586: [SPARK-15860] Metrics for codegen size and perf

2016-06-11 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/13586 Fixed On Sat, Jun 11, 2016, 7:07 PM UCB AMPLab wrote: > Test PASSed. > > > Refer to this link for build results (access rights to CI server

[GitHub] spark issue #13586: [SPARK-15860] Metrics for codegen size and perf

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13586 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60349/ Test PASSed. ---

[GitHub] spark issue #13586: [SPARK-15860] Metrics for codegen size and perf

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13586 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13586: [SPARK-15860] Metrics for codegen size and perf

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13586 **[Test build #60349 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60349/consoleFull)** for PR 13586 at commit

[GitHub] spark pull request #13585: [SPARK-15859][SQL] Optimize the partition pruning...

2016-06-11 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/13585#discussion_r66714698 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala --- @@ -92,6 +92,36 @@ object PhysicalOperation extends

[GitHub] spark issue #13545: [SPARK-15807][SQL] Support varargs for dropDuplicates in...

2016-06-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13545 Thank you for merging, @rxin ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13621: [SPARK-2623] [ML] Implement stacked autoencoder

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13621 **[Test build #60351 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60351/consoleFull)** for PR 13621 at commit

[GitHub] spark issue #13524: [SPARK-15776][SQL] Type coercion incorrect

2016-06-11 Thread watermen
Github user watermen commented on the issue: https://github.com/apache/spark/pull/13524 @davies @rxin Can you review the code for this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13561: [SPARK-15824][SQL] Run 'with ... insert ... select' fail...

2016-06-11 Thread watermen
Github user watermen commented on the issue: https://github.com/apache/spark/pull/13561 @davies @rxin Can you review the code for this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #13585: [SPARK-15859][SQL] Optimize the partition pruning...

2016-06-11 Thread yangw1234
Github user yangw1234 commented on a diff in the pull request: https://github.com/apache/spark/pull/13585#discussion_r66714468 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala --- @@ -92,6 +92,36 @@ object PhysicalOperation extends

[GitHub] spark issue #13621: [SPARK-2623] [ML] Implement stacked autoencoder

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13621 **[Test build #60350 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60350/consoleFull)** for PR 13621 at commit

[GitHub] spark issue #13621: [SPARK-2623] [ML] Implement stacked autoencoder

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13621 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60350/ Test FAILed. ---

[GitHub] spark issue #13621: [SPARK-2623] [ML] Implement stacked autoencoder

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13621 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13621: [SPARK-2623] [ML] Implement stacked autoencoder

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13621 **[Test build #60350 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60350/consoleFull)** for PR 13621 at commit

[GitHub] spark pull request #13621: [SPARK-2623] [ML] Implement stacked autoencoder

2016-06-11 Thread avulanov
GitHub user avulanov opened a pull request: https://github.com/apache/spark/pull/13621 [SPARK-2623] [ML] Implement stacked autoencoder ## What changes were proposed in this pull request? Implement stacked autoencoder - Base on ml.ann Layer and LossFunction - Implement

[GitHub] spark pull request #13585: [SPARK-15859][SQL] Optimize the partition pruning...

2016-06-11 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/13585#discussion_r66714358 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala --- @@ -65,15 +65,20 @@ private[hive] trait HiveStrategies {

[GitHub] spark pull request #13585: [SPARK-15859][SQL] Optimize the partition pruning...

2016-06-11 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/13585#discussion_r66714324 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala --- @@ -92,6 +92,36 @@ object PhysicalOperation extends

[GitHub] spark pull request #13585: [SPARK-15859][SQL] Optimize the partition pruning...

2016-06-11 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/13585#discussion_r66714314 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/QueryPartitionSuite.scala --- @@ -65,4 +69,95 @@ class QueryPartitionSuite extends

[GitHub] spark issue #13585: [SPARK-15859][SQL] Optimize the partition pruning within...

2016-06-11 Thread chenghao-intel
Github user chenghao-intel commented on the issue: https://github.com/apache/spark/pull/13585 Thank you all for the review, but I am not going to solve the CNF, the intention of this PR is to exact more partition pruning expression, so we will get have less partition to scan during

[GitHub] spark pull request #13585: [SPARK-15859][SQL] Optimize the partition pruning...

2016-06-11 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/13585#discussion_r66714297 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala --- @@ -92,6 +92,36 @@ object PhysicalOperation extends

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/12836 We can do it in a separate pr -- it'd be great to move all Python and R methods over to a single class. Otherwise it has two major problems: 1. Those methods are public for Java. 2.

[GitHub] spark issue #13602: [SPARK-15878][CORE][TEST] fix cleanup in EventLoggingLis...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13602 **[Test build #3080 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3080/consoleFull)** for PR 13602 at commit

[GitHub] spark issue #12983: [SPARK-15213][PySpark] Unify 'range' usages

2016-06-11 Thread asfer
Github user asfer commented on the issue: https://github.com/apache/spark/pull/12983 Apart from the merge conflict, everything looks good to me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #13338: [SPARK-13723] [YARN] Change behavior of --num-exe...

2016-06-11 Thread rdblue
Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/13338#discussion_r66714041 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2262,21 +2262,39 @@ private[spark] object Utils extends Logging { }

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12836 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12836 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60348/ Test PASSed. ---

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12836 **[Test build #60348 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60348/consoleFull)** for PR 12836 at commit

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-11 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/12836 @rxin I think in this case we need access to grouping expression and DataFrame from within the RelationalGroupedDataset class. One solution could be to move the function `flatMapGroupsInR` to the

[GitHub] spark issue #13586: [SPARK-15860] Metrics for codegen size and perf

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13586 **[Test build #60349 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60349/consoleFull)** for PR 13586 at commit

[GitHub] spark pull request #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on ...

2016-06-11 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/12836#discussion_r66713462 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/RelationalGroupedDataset.scala --- @@ -381,6 +385,50 @@ class RelationalGroupedDataset

[GitHub] spark pull request #13482: [SPARK-15725][YARN] Ensure ApplicationMaster slee...

2016-06-11 Thread rdblue
Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/13482#discussion_r66713200 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -462,10 +464,23 @@ private[spark] class ApplicationMaster(

[GitHub] spark issue #13482: [SPARK-15725][YARN] Ensure ApplicationMaster sleeps for ...

2016-06-11 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/13482 @andrewor14, I think we should consider two problems here: the fact that the thread will sleep for less than the min interval if something triggers it and whatever is currently triggering it. We

[GitHub] spark pull request #13482: [SPARK-15725][YARN] Ensure ApplicationMaster slee...

2016-06-11 Thread rdblue
Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/13482#discussion_r66713080 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -462,10 +464,23 @@ private[spark] class ApplicationMaster(

[GitHub] spark issue #13602: [SPARK-15878][CORE][TEST] fix cleanup in EventLoggingLis...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13602 **[Test build #3080 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3080/consoleFull)** for PR 13602 at commit

[GitHub] spark issue #8416: [SPARK-10185] [SQL] Feat sql comma separated paths

2016-06-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/8416 @marmbrus mind sharing how to do it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #8416: [SPARK-10185] [SQL] Feat sql comma separated paths

2016-06-11 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/8416 @rxin I believe I fixed that limitation in my recent refactoring. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #13161: [SPARK-14851] [Core] Support radix sort with nullable lo...

2016-06-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13161 FYI I accidentally merged this in branch-2.0 too, but I reverted it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #13586: [SPARK-15860] Metrics for codegen size and perf

2016-06-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13586 Looks like this failed some tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #13545: [SPARK-15807][SQL] Support varargs for dropDuplic...

2016-06-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13545 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13545: [SPARK-15807][SQL] Support varargs for dropDuplicates in...

2016-06-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13545 Merging in master/2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #13161: [SPARK-14851] [Core] Support radix sort with null...

2016-06-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13161 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13161: [SPARK-14851] [Core] Support radix sort with nullable lo...

2016-06-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13161 Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #13595: [MINOR][SQL] Standardize 'continuous queries' to 'stream...

2016-06-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13595 @tdas this matches what we discussed right? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #8416: [SPARK-10185] [SQL] Feat sql comma separated paths

2016-06-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/8416 Is there still a way to specify a file that includes comma after this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #13605: [SPARK-15856][SQL] Revert API breaking changes ma...

2016-06-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13605 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13604: [SPARK-15856][SQL] Revert API breaking changes made in D...

2016-06-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13604 Can you update the pr and link to this ticket? https://issues.apache.org/jira/browse/SPARK-15898 Thanks. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request #13607: [SPARK-15881] Update microbenchmark results for W...

2016-06-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13607 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13605: [SPARK-15856][SQL] Revert API breaking changes made in S...

2016-06-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13605 Merging in master/2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13607: [SPARK-15881] Update microbenchmark results for WideSche...

2016-06-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13607 Merging in master/2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #13607: [SPARK-15881] Update microbenchmark results for W...

2016-06-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13607#discussion_r66712617 --- Diff: project/SparkBuild.scala --- @@ -833,7 +833,7 @@ object TestSettings { javaOptions in Test += "-Dspark.ui.enabled=false",

[GitHub] spark pull request #13607: [SPARK-15881] Update microbenchmark results for W...

2016-06-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13607#discussion_r66712619 --- Diff: project/SparkBuild.scala --- @@ -833,7 +833,7 @@ object TestSettings { javaOptions in Test += "-Dspark.ui.enabled=false",

[GitHub] spark pull request #13607: [SPARK-15881] Update microbenchmark results for W...

2016-06-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13607#discussion_r66712579 --- Diff: project/SparkBuild.scala --- @@ -833,7 +833,7 @@ object TestSettings { javaOptions in Test += "-Dspark.ui.enabled=false",

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12836 **[Test build #60348 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60348/consoleFull)** for PR 12836 at commit

[GitHub] spark pull request #13616: [SPARK-15585][SQL] Add doc for turning off quotat...

2016-06-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13616 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13616: [SPARK-15585][SQL] Add doc for turning off quotations

2016-06-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13616 Merging in master/2.0. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13552: [SPARK-15813] Improve Canceling log message to make it l...

2016-06-11 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13552 The line is too long @peterableda but otherwise looks fine. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-11 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 Thanks @liancheng and @rxin ! With respect to your point, @rxin - "private[sql] signature in public APIs ." dapply added that signature to `Dataset.scala `and gapply adds it to

[GitHub] spark pull request #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on ...

2016-06-11 Thread NarineK
Github user NarineK commented on a diff in the pull request: https://github.com/apache/spark/pull/12836#discussion_r66712035 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/RelationalGroupedDataset.scala --- @@ -381,6 +385,50 @@ class RelationalGroupedDataset

[GitHub] spark issue #13615: Fix the import typo in Python example

2016-06-11 Thread sjjpo2002
Github user sjjpo2002 commented on the issue: https://github.com/apache/spark/pull/13615 I'm closing this. I'm not sure how this caused build errors. I just referred to the typo in the documentation and didn't make any changes! --- If your project is set up for it, you can reply to

[GitHub] spark pull request #13615: Fix the import typo in Python example

2016-06-11 Thread sjjpo2002
Github user sjjpo2002 closed the pull request at: https://github.com/apache/spark/pull/13615 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13617 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60347/ Test PASSed. ---

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13617 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13617 **[Test build #60347 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60347/consoleFull)** for PR 13617 at commit

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13617 **[Test build #60347 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60347/consoleFull)** for PR 13617 at commit

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-06-11 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/13617 jenkins add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13611: [SPARK-15887][SQL] Bring back the hive-site.xml support ...

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13611 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60346/ Test FAILed. ---

[GitHub] spark issue #13611: [SPARK-15887][SQL] Bring back the hive-site.xml support ...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13611 **[Test build #60346 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60346/consoleFull)** for PR 13611 at commit

[GitHub] spark issue #13611: [SPARK-15887][SQL] Bring back the hive-site.xml support ...

2016-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13611 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13611: [SPARK-15887][SQL] Bring back the hive-site.xml support ...

2016-06-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13611 **[Test build #60346 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60346/consoleFull)** for PR 13611 at commit

[GitHub] spark pull request #13611: [SPARK-15887][SQL] Bring back the hive-site.xml s...

2016-06-11 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13611#discussion_r66710277 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SharedState.scala --- @@ -40,10 +42,16 @@ private[sql] class SharedState(val sparkContext:

  1   2   >