[GitHub] spark pull request #16043: [SPARK-18601][SQL] Simplify Create/Get complex ex...

2017-01-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16043#discussion_r98613398 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala --- @@ -293,6 +293,12 @@ object SimplifyConditionals exte

[GitHub] spark pull request #16043: [SPARK-18601][SQL] Simplify Create/Get complex ex...

2017-01-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16043#discussion_r98613430 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala --- @@ -293,6 +293,12 @@ object SimplifyConditionals exte

[GitHub] spark pull request #16043: [SPARK-18601][SQL] Simplify Create/Get complex ex...

2017-01-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16043#discussion_r98613413 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala --- @@ -293,6 +293,12 @@ object SimplifyConditionals exte

[GitHub] spark pull request #16689: [SPARK-19342][SPARKR] bug fixed in collect method...

2017-01-30 Thread titicaca
Github user titicaca commented on a diff in the pull request: https://github.com/apache/spark/pull/16689#discussion_r98612545 --- Diff: R/pkg/R/DataFrame.R --- @@ -1138,6 +1138,11 @@ setMethod("collect", if (!is.null(PRIMITIVE_TYPES[[colType]]) && colType !=

[GitHub] spark pull request #16689: [SPARK-19342][SPARKR] bug fixed in collect method...

2017-01-30 Thread titicaca
Github user titicaca commented on a diff in the pull request: https://github.com/apache/spark/pull/16689#discussion_r98611766 --- Diff: R/pkg/R/DataFrame.R --- @@ -1138,6 +1138,11 @@ setMethod("collect", if (!is.null(PRIMITIVE_TYPES[[colType]]) && colType !=

[GitHub] spark issue #16746: [SPARK-15648][SQL] Add teradataDialect for JDBC connecti...

2017-01-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16746 BTW, @klinvill . Do you use a real instance? Could you advice how the other persons like me can verify your PR on Teradata? Maybe, can we check Teradata Express or AWS Marketplace? --- I

[GitHub] spark pull request #16746: [SPARK-15648][SQL] Add teradataDialect for JDBC c...

2017-01-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16746#discussion_r98608480 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/jdbc/TeradataDialect.scala --- @@ -0,0 +1,33 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #16746: [SPARK-15648][SQL] Add teradataDialect for JDBC c...

2017-01-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16746#discussion_r98607602 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/jdbc/TeradataDialect.scala --- @@ -0,0 +1,33 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16043 **[Test build #72189 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72189/testReport)** for PR 16043 at commit [`81442fc`](https://github.com/apache/spark/commit/81

[GitHub] spark pull request #16746: [SPARK-15648][SQL] Add teradataDialect for JDBC c...

2017-01-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16746#discussion_r98607321 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/jdbc/TeradataDialect.scala --- @@ -0,0 +1,33 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #13932: [SPARK-15354] [CORE] Topology aware block replication st...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13932 **[Test build #72188 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72188/testReport)** for PR 13932 at commit [`93eb511`](https://github.com/apache/spark/commit/93

[GitHub] spark issue #16726: [SPARK-19390][SQL] Replace the unnecessary usages of hiv...

2017-01-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16726 +1 for reducing the dependency! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark issue #13932: [SPARK-15354] [CORE] Topology aware block replication st...

2017-01-30 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/13932 jenkins ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-01-30 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r98604570 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -188,24 +189,45 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-01-30 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r98603116 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1131,14 +1131,47 @@ private[spark] class BlockManager( }

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-01-30 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r98604381 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -188,24 +189,45 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-01-30 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r98603889 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -188,24 +189,45 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-01-30 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r98603866 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1152,20 +1185,25 @@ private[spark] class BlockManager(

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-01-30 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r98605803 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -188,24 +189,45 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-01-30 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r98603462 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1152,20 +1185,25 @@ private[spark] class BlockManager(

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-01-30 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r98603908 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -188,24 +189,45 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-01-30 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r98602812 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1131,14 +1131,47 @@ private[spark] class BlockManager( }

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-01-30 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r98603310 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1131,14 +1131,47 @@ private[spark] class BlockManager( }

[GitHub] spark issue #16737: [SPARK-19397] [SQL] Make option names of LIBSVM and TEXT...

2017-01-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16737 +1. LGTM except one typo! @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request #16689: [SPARK-19342][SPARKR] bug fixed in collect method...

2017-01-30 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16689#discussion_r98605236 --- Diff: R/pkg/R/DataFrame.R --- @@ -1138,6 +1138,11 @@ setMethod("collect", if (!is.null(PRIMITIVE_TYPES[[colType]]) && colType !

[GitHub] spark pull request #16689: [SPARK-19342][SPARKR] bug fixed in collect method...

2017-01-30 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16689#discussion_r98605157 --- Diff: R/pkg/R/DataFrame.R --- @@ -1138,6 +1138,11 @@ setMethod("collect", if (!is.null(PRIMITIVE_TYPES[[colType]]) && colType !

[GitHub] spark pull request #16739: [SPARK-19399][SPARKR] Add R coalesce API for Data...

2017-01-30 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16739#discussion_r98605173 --- Diff: R/pkg/R/DataFrame.R --- @@ -680,14 +680,45 @@ setMethod("storageLevel", storageLevelToString(callJMethod(x@sdf, "storageLevel"))

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16722 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72184/ Test PASSed. ---

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16722 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16722 **[Test build #72184 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72184/testReport)** for PR 16722 at commit [`159c5a6`](https://github.com/apache/spark/commit/1

[GitHub] spark pull request #16749: [BACKPORT-2.1][SPARKR][DOCS] update R API doc for...

2017-01-30 Thread felixcheung
Github user felixcheung closed the pull request at: https://github.com/apache/spark/pull/16749 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[GitHub] spark issue #16749: [BACKPORT-2.1][SPARKR][DOCS] update R API doc for subset...

2017-01-30 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16749 merged to branch-2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16689: [SPARK-19342][SPARKR] bug fixed in collect method for co...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16689 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16689: [SPARK-19342][SPARKR] bug fixed in collect method for co...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16689 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72186/ Test PASSed. ---

[GitHub] spark issue #16689: [SPARK-19342][SPARKR] bug fixed in collect method for co...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16689 **[Test build #72186 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72186/testReport)** for PR 16689 at commit [`8379c38`](https://github.com/apache/spark/commit/8

[GitHub] spark pull request #16739: [SPARK-19399][SPARKR] Add R coalesce API for Data...

2017-01-30 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16739#discussion_r98604331 --- Diff: R/pkg/R/DataFrame.R --- @@ -680,14 +680,45 @@ setMethod("storageLevel", storageLevelToString(callJMethod(x@sdf, "storageLevel")

[GitHub] spark issue #14412: [SPARK-15355] [CORE] Proactive block replication

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14412 **[Test build #72187 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72187/testReport)** for PR 14412 at commit [`016ea9f`](https://github.com/apache/spark/commit/01

[GitHub] spark issue #14412: [SPARK-15355] [CORE] Proactive block replication

2017-01-30 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/14412 jenkins ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16736: [WIP][SPARK][SQL][Follow-up] Configurable `tableRelation...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16736 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72183/ Test PASSed. ---

[GitHub] spark issue #16736: [WIP][SPARK][SQL][Follow-up] Configurable `tableRelation...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16736 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16736: [WIP][SPARK][SQL][Follow-up] Configurable `tableRelation...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16736 **[Test build #72183 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72183/testReport)** for PR 16736 at commit [`9614ff3`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #16740: [SPARK-19400][ML] Allow GLM to handle intercept only mod...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16740 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16740: [SPARK-19400][ML] Allow GLM to handle intercept only mod...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16740 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72185/ Test PASSed. ---

[GitHub] spark issue #16740: [SPARK-19400][ML] Allow GLM to handle intercept only mod...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16740 **[Test build #72185 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72185/testReport)** for PR 16740 at commit [`0b3c085`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #16737: [SPARK-19397] [SQL] Make option names of LIBSVM a...

2017-01-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16737#discussion_r98602527 --- Diff: mllib/src/main/scala/org/apache/spark/ml/source/libsvm/LibSVMOptions.scala --- @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Softwa

[GitHub] spark issue #16689: [SPARK-19342][SPARKR] bug fixed in collect method for co...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16689 **[Test build #72186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72186/testReport)** for PR 16689 at commit [`8379c38`](https://github.com/apache/spark/commit/83

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-30 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/16722 Thanks for taking a look @imatiach-msft, much appreciated! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark issue #16731: [SPARK-19393][SQL] Add `approx_percentile` Dataset/DataF...

2017-01-30 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/16731 understood. they really were lots of functions -- let's tell users to use `expr("approx_percentile(...)")`. closing this. thanks for the comments! --- If your project is set up for it, you

[GitHub] spark pull request #16731: [SPARK-19393][SQL] Add `approx_percentile` Datase...

2017-01-30 Thread lw-lin
Github user lw-lin closed the pull request at: https://github.com/apache/spark/pull/16731 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-30 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/16722 sorry haven't finished reviewing yet, will look more tomorrow --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark pull request #16722: [SPARK-9478][ML][MLlib] Add sample weights to dec...

2017-01-30 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/16722#discussion_r98600282 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/RandomForestClassifier.scala --- @@ -126,20 +127,22 @@ class RandomForestClassifier

[GitHub] spark pull request #16722: [SPARK-9478][ML][MLlib] Add sample weights to dec...

2017-01-30 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/16722#discussion_r98600175 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/RandomForestClassifier.scala --- @@ -126,20 +127,22 @@ class RandomForestClassifier

[GitHub] spark pull request #16722: [SPARK-9478][ML][MLlib] Add sample weights to dec...

2017-01-30 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/16722#discussion_r98599986 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/DecisionTreeClassifier.scala --- @@ -106,14 +122,18 @@ class DecisionTreeClassifier

[GitHub] spark pull request #16722: [SPARK-9478][ML][MLlib] Add sample weights to dec...

2017-01-30 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/16722#discussion_r98599783 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/DecisionTreeClassifier.scala --- @@ -45,7 +48,7 @@ import org.apache.spark.sql.Datas

[GitHub] spark pull request #16722: [SPARK-9478][ML][MLlib] Add sample weights to dec...

2017-01-30 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/16722#discussion_r98599033 --- Diff: mllib-local/src/test/scala/org/apache/spark/ml/util/TestingUtils.scala --- @@ -31,7 +31,7 @@ object TestingUtils { * Note that if x o

[GitHub] spark pull request #16722: [SPARK-9478][ML][MLlib] Add sample weights to dec...

2017-01-30 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/16722#discussion_r98599006 --- Diff: mllib-local/src/test/scala/org/apache/spark/ml/util/TestingUtils.scala --- @@ -48,7 +48,7 @@ object TestingUtils { /** * Priva

[GitHub] spark pull request #16739: [SPARK-19399][SPARKR] Add R coalesce API for Data...

2017-01-30 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16739#discussion_r98598572 --- Diff: R/pkg/R/DataFrame.R --- @@ -680,14 +680,45 @@ setMethod("storageLevel", storageLevelToString(callJMethod(x@sdf, "storageLevel"))

[GitHub] spark issue #16740: [SPARK-19400][ML] Allow GLM to handle intercept only mod...

2017-01-30 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16740 @sethah Thanks for your review. Yes, using `foldLeft` would be the simplest fix. I have included both your suggested changes in the new commit. Yes, we could handle the special case of

[GitHub] spark issue #16740: [SPARK-19400][ML] Allow GLM to handle intercept only mod...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16740 **[Test build #72185 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72185/testReport)** for PR 16740 at commit [`0b3c085`](https://github.com/apache/spark/commit/0b

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16722 **[Test build #72184 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72184/testReport)** for PR 16722 at commit [`159c5a6`](https://github.com/apache/spark/commit/15

[GitHub] spark issue #16749: [BACKPORT-2.1][SPARKR][DOCS] update R API doc for subset...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16749 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72181/ Test PASSed. ---

[GitHub] spark issue #16749: [BACKPORT-2.1][SPARKR][DOCS] update R API doc for subset...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16749 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16749: [BACKPORT-2.1][SPARKR][DOCS] update R API doc for subset...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16749 **[Test build #72181 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72181/testReport)** for PR 16749 at commit [`f421a1c`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #16736: [WIP][SPARK][SQL][Follow-up] Configurable `tableRelation...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16736 **[Test build #72183 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72183/testReport)** for PR 16736 at commit [`9614ff3`](https://github.com/apache/spark/commit/96

[GitHub] spark pull request #16736: [WIP][SPARK][SQL][Follow-up] Configurable `tableR...

2017-01-30 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/16736#discussion_r98592980 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/internal/SQLConfSuite.scala --- @@ -221,17 +221,8 @@ class SQLConfSuite extends QueryTest with SharedS

[GitHub] spark issue #16603: [SPARK-19244][Core] Sort MemoryConsumers according to th...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16603 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16603: [SPARK-19244][Core] Sort MemoryConsumers according to th...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16603 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72179/ Test PASSed. ---

[GitHub] spark issue #16603: [SPARK-19244][Core] Sort MemoryConsumers according to th...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16603 **[Test build #72179 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72179/testReport)** for PR 16603 at commit [`3176756`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #16689: [SPARK-19342][SPARKR] bug fixed in collect method for co...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16689 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72182/ Test FAILed. ---

[GitHub] spark issue #16689: [SPARK-19342][SPARKR] bug fixed in collect method for co...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16689 **[Test build #72182 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72182/testReport)** for PR 16689 at commit [`7903bb3`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #16689: [SPARK-19342][SPARKR] bug fixed in collect method for co...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16689 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15237: [SPARK-17663] [CORE] SchedulableBuilder should handle in...

2017-01-30 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/15237 @erenavsarogullari sorry to push back, but if you're willing to do the filename thing now, why not just tackle it in this same pr? seems pretty minor to separate into its own issue, and conceptually

[GitHub] spark issue #16689: [SPARK-19342][SPARKR] bug fixed in collect method for co...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16689 **[Test build #72182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72182/testReport)** for PR 16689 at commit [`7903bb3`](https://github.com/apache/spark/commit/79

[GitHub] spark pull request #15505: [SPARK-18890][CORE] Move task serialization from ...

2017-01-30 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15505#discussion_r98591359 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala --- @@ -51,8 +54,39 @@ private[spark] class TaskDescription( val index

[GitHub] spark issue #16749: [BACKPORT-2.1][SPARKR][DOCS] update R API doc for subset...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16749 **[Test build #72181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72181/testReport)** for PR 16749 at commit [`f421a1c`](https://github.com/apache/spark/commit/f4

[GitHub] spark pull request #16749: [BACKPORT-2.1][SPARKR][DOCS] update R API doc for...

2017-01-30 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/16749 [BACKPORT-2.1][SPARKR][DOCS] update R API doc for subset/extract ## What changes were proposed in this pull request? backport #16721 to branch-2.1 ## How was this patch tested?

[GitHub] spark issue #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener callback...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16664 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16748: [BACKPORT-2.1][SPARKR][DOCS] update R API doc for...

2017-01-30 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/16748 [BACKPORT-2.1][SPARKR][DOCS] update R API doc for subset/extract ## What changes were proposed in this pull request? backport #16721 to branch-2.1 ## How was this patch tested?

[GitHub] spark issue #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener callback...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16664 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72178/ Test PASSed. ---

[GitHub] spark pull request #16748: [BACKPORT-2.1][SPARKR][DOCS] update R API doc for...

2017-01-30 Thread felixcheung
Github user felixcheung closed the pull request at: https://github.com/apache/spark/pull/16748 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[GitHub] spark issue #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener callback...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16664 **[Test build #72178 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72178/testReport)** for PR 16664 at commit [`752125a`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #16721: [SPARKR][DOCS] update R API doc for subset/extrac...

2017-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16721 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16712: [SPARK-18873][SQL][TEST] New test cases for scalar subqu...

2017-01-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16712 LGTM. cc @hvanhovell for final sign off --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16736: [WIP][SPARK][SQL][Follow-up] Configurable `tableR...

2017-01-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16736#discussion_r98589964 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -464,6 +464,16 @@ object SQLConf { .intConf .create

[GitHub] spark pull request #16745: [SPARK-19406] [SQL] Fix function to_json to respe...

2017-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16745 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener callback...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16664 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener callback...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16664 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72177/ Test PASSed. ---

[GitHub] spark issue #16745: [SPARK-19406] [SQL] Fix function to_json to respect user...

2017-01-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16745 Thanks! Merging to master/2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener callback...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16664 **[Test build #72177 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72177/testReport)** for PR 16664 at commit [`b0392ed`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #16736: [WIP][SPARK][SQL][Follow-up] Configurable `tableR...

2017-01-30 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/16736#discussion_r98589474 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -464,6 +464,16 @@ object SQLConf { .intConf .createWith

[GitHub] spark pull request #16736: [WIP][SPARK][SQL][Follow-up] Configurable `tableR...

2017-01-30 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/16736#discussion_r98589278 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/internal/SQLConfSuite.scala --- @@ -221,6 +221,19 @@ class SQLConfSuite extends QueryTest with SharedS

[GitHub] spark issue #16744: [SPARK-19405][STREAMING] Support for cross-account Kines...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16744 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16744: [SPARK-19405][STREAMING] Support for cross-account Kines...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16744 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72175/ Test PASSed. ---

[GitHub] spark issue #16744: [SPARK-19405][STREAMING] Support for cross-account Kines...

2017-01-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16744 **[Test build #72175 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72175/testReport)** for PR 16744 at commit [`2298dd7`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #16740: [SPARK-19400][ML] Allow GLM to handle intercept o...

2017-01-30 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/16740#discussion_r98579939 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/IterativelyReweightedLeastSquares.scala --- @@ -86,13 +86,9 @@ private[ml] class IterativelyReweight

[GitHub] spark pull request #16740: [SPARK-19400][ML] Allow GLM to handle intercept o...

2017-01-30 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/16740#discussion_r98578921 --- Diff: mllib/src/test/scala/org/apache/spark/ml/regression/GeneralizedLinearRegressionSuite.scala --- @@ -743,6 +743,54 @@ class GeneralizedLinearRegressi

[GitHub] spark issue #16740: [SPARK-19400][ML] Allow GLM to handle intercept only mod...

2017-01-30 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/16740 Since we already compute the number of features in the train method, why don't we just check if `numFeatures == 0` and then just compute the intercept as the link of the weighted average of the label

[GitHub] spark pull request #16699: [SPARK-18710][ML] Add offset in GLM

2017-01-30 Thread actuaryzhang
Github user actuaryzhang commented on a diff in the pull request: https://github.com/apache/spark/pull/16699#discussion_r98580805 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/GeneralizedLinearRegression.scala --- @@ -336,14 +361,19 @@ class GeneralizedLinearRegres

[GitHub] spark issue #15821: [SPARK-13534][WIP][PySpark] Using Apache Arrow to increa...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15821 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72180/ Test FAILed. ---

[GitHub] spark issue #15821: [SPARK-13534][WIP][PySpark] Using Apache Arrow to increa...

2017-01-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15821 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

  1   2   3   4   >