[GitHub] spark issue #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14500 **[Test build #63279 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63279/consoleFull)** for PR 14500 at commit [`7f4f38d`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #14411: [SPARK-16804][SQL] Correlated subqueries containi...

2016-08-05 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14411#discussion_r73746412 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1021,6 +1021,19 @@ class Analyzer( case

[GitHub] spark pull request #14176: [SPARK-16525][SQL] Enable Row Based HashMap in Ha...

2016-08-05 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14176#discussion_r73747068 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/AggregateHashMapSuite.scala --- @@ -0,0 +1,41 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #14176: [SPARK-16525][SQL] Enable Row Based HashMap in Ha...

2016-08-05 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14176#discussion_r73747170 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -499,14 +499,16 @@ object SQLConf { .intConf

[GitHub] spark issue #14484: [SPARK-16796][Web UI] Mask spark.authenticate.secret on ...

2016-08-05 Thread Devian-ua
Github user Devian-ua commented on the issue: https://github.com/apache/spark/pull/14484 @srowen Can you verify the patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14484: [SPARK-16796][Web UI] Mask spark.authenticate.secret on ...

2016-08-05 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14484 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14484: [SPARK-16796][Web UI] Mask spark.authenticate.secret on ...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14484 **[Test build #63280 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63280/consoleFull)** for PR 14484 at commit [`a73d818`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #14488: [SPARK-16826][SQL] Switch to java.net.URI for parse_url(...

2016-08-05 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14488 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #14065: [SPARK-14743][YARN] Add a configurable credential manage...

2016-08-05 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14065 @jerryshao do you plan to address the remaining feedback? (https://github.com/apache/spark/pull/14065#discussion_r73423485) --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request #14488: [SPARK-16826][SQL] Switch to java.net.URI for par...

2016-08-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14488 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14308: [SPARK-16421][EXAMPLES][ML] Improve ML Example Outputs

2016-08-05 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14308 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark pull request #14308: [SPARK-16421][EXAMPLES][ML] Improve ML Example Ou...

2016-08-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14308 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-08-05 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r73750991 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -25,30 +25,36 @@ import org.apache.spark.sql.t

[GitHub] spark pull request #14508: [SPARK-16586][core] Handle JVM errors printed to ...

2016-08-05 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/14508 [SPARK-16586][core] Handle JVM errors printed to stdout. Some very rare JVM errors are printed to stdout, and that confuses the code in spark-class. So add a check so that those cases are det

[GitHub] spark pull request #13152: [SPARK-15353] [CORE] Making peer selection for bl...

2016-08-05 Thread shubhamchopra
Github user shubhamchopra commented on a diff in the pull request: https://github.com/apache/spark/pull/13152#discussion_r73751665 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1088,109 +1108,88 @@ private[spark] class BlockManager( }

[GitHub] spark issue #11127: [SPARK-13238][Core] Add ganglia dmax parameter

2016-08-05 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/11127 Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14508 **[Test build #63281 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63281/consoleFull)** for PR 14508 at commit [`4ed4483`](https://github.com/apache/spark/commit/4

[GitHub] spark pull request #11127: [SPARK-13238][Core] Add ganglia dmax parameter

2016-08-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11127 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-08-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r73753275 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -25,30 +25,36 @@ import org.apache.spark.sql.

[GitHub] spark issue #14109: [SPARK-16404][ML] LeastSquaresAggregators serializes unn...

2016-08-05 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/14109 @dbtsai @yanboliang I went ahead and added a couple comments so someone will not mistakenly change this behavior in the future. Let me know if you see anything else, thanks! --- If your project is

[GitHub] spark issue #14109: [SPARK-16404][ML] LeastSquaresAggregators serializes unn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14109 **[Test build #63282 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63282/consoleFull)** for PR 14109 at commit [`0d99795`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/14500#discussion_r73753834 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -827,6 +827,45 @@ class DDLSuite extends QueryTest with Shared

[GitHub] spark issue #13323: [SPARK-15555] [Mesos] Driver with --supervise option can...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13323 **[Test build #63276 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63276/consoleFull)** for PR 13323 at commit [`e5e182e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13323: [SPARK-15555] [Mesos] Driver with --supervise option can...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13323 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13323: [SPARK-15555] [Mesos] Driver with --supervise option can...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13323 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63276/ Test PASSed. ---

[GitHub] spark issue #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14500 **[Test build #63283 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63283/consoleFull)** for PR 14500 at commit [`e478c3a`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #14488: [SPARK-16826][SQL] Switch to java.net.URI for parse_url(...

2016-08-05 Thread sylvinus
Github user sylvinus commented on the issue: https://github.com/apache/spark/pull/14488 Thanks a lot! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #14109: [SPARK-16404][ML] LeastSquaresAggregators seriali...

2016-08-05 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14109#discussion_r73754722 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/LinearRegression.scala --- @@ -996,19 +1013,24 @@ private class LeastSquaresCostFun( fe

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11746 **[Test build #63277 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63277/consoleFull)** for PR 11746 at commit [`477d2be`](https://github.com/apache/spark/commit/

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11746 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11746 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63277/ Test PASSed. ---

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14508 **[Test build #63284 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63284/consoleFull)** for PR 14508 at commit [`5e9c042`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #14231: [SPARK-16586] Change the way the exit code of launcher i...

2016-08-05 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14231 Let's close this in favor of https://github.com/apache/spark/pull/14508 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter ...

2016-08-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/13701#discussion_r73756701 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala --- @@ -199,6 +209,19 @@ private[sql] case class FileSourceScanExec

[GitHub] spark issue #14507: [SPARK-16919] Configurable update interval for console p...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14507 **[Test build #63278 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63278/consoleFull)** for PR 14507 at commit [`ab7e1e2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14507: [SPARK-16919] Configurable update interval for console p...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14507 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14507: [SPARK-16919] Configurable update interval for console p...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14507 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63278/ Test PASSed. ---

[GitHub] spark pull request #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/13950#discussion_r73757257 --- Diff: core/pom.xml --- @@ -127,6 +127,16 @@ org.eclipse.jetty + jetty-proxy --- End diff -- These new

[GitHub] spark pull request #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/13950#discussion_r73757480 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -753,6 +757,7 @@ private[deploy] class Master( workers += worker

[GitHub] spark pull request #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/13950#discussion_r73757885 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -186,6 +188,66 @@ private[spark] object JettyUtils extends Logging { context

[GitHub] spark pull request #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/13950#discussion_r73757842 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -186,6 +188,66 @@ private[spark] object JettyUtils extends Logging { context

[GitHub] spark pull request #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/13950#discussion_r73758012 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -186,6 +188,66 @@ private[spark] object JettyUtils extends Logging { context

[GitHub] spark pull request #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/13950#discussion_r73758157 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -186,6 +188,66 @@ private[spark] object JettyUtils extends Logging { context

[GitHub] spark pull request #14509: [SPARK-16924][SQL] - Support option("inferSchema"...

2016-08-05 Thread xwu0226
GitHub user xwu0226 opened a pull request: https://github.com/apache/spark/pull/14509 [SPARK-16924][SQL] - Support option("inferSchema", true) option for DataStreamReadder ## What changes were proposed in this pull request? The issue is that `DataSource.sourceSchema()` has a che

[GitHub] spark pull request #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/13950#discussion_r73758964 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -186,6 +188,66 @@ private[spark] object JettyUtils extends Logging { context

[GitHub] spark pull request #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/13950#discussion_r73759305 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -186,6 +188,67 @@ private[spark] object JettyUtils extends Logging { context

[GitHub] spark pull request #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/13950#discussion_r73759385 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -186,6 +188,66 @@ private[spark] object JettyUtils extends Logging { context

[GitHub] spark issue #14509: [SPARK-16924][SQL] - Support option("inferSchema", true)...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14509 **[Test build #63285 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63285/consoleFull)** for PR 14509 at commit [`8692d1c`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14455: [SPARK-16750] [Follow-up] [ML] Add transformSchema for S...

2016-08-05 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14455 Merged to master/2.0 also --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #14455: [SPARK-16750] [Follow-up] [ML] Add transformSchem...

2016-08-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14455 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse proxy ...

2016-08-05 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/13950 One idea is that if you use `spark.ui.proxyBase`, as YARN does, you don't need the proxy servlet to modify the HTML returned to the clients. But then you'd need something like Hadoop's `AmIpFilter` i

[GitHub] spark issue #14109: [SPARK-16404][ML] LeastSquaresAggregators serializes unn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14109 **[Test build #63282 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63282/consoleFull)** for PR 14109 at commit [`0d99795`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14505: Branch 2.0

2016-08-05 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14505 @baifanwudi please close this pr. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #14109: [SPARK-16404][ML] LeastSquaresAggregators serializes unn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14109 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14109: [SPARK-16404][ML] LeastSquaresAggregators serializes unn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14109 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63282/ Test PASSed. ---

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing non-...

2016-08-05 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/14411 Done. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark pull request #14510: [SPARK-16925] Master should call schedule() after...

2016-08-05 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/14510 [SPARK-16925] Master should call schedule() after all executor exits, not only failures ## What changes were proposed in this pull request? This patch fixes a bug in Spark's standalone M

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing non-...

2016-08-05 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14411 LGTM - pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark issue #14510: [SPARK-16925] Master should call schedule() after all ex...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14510 **[Test build #63286 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63286/consoleFull)** for PR 14510 at commit [`c567a7e`](https://github.com/apache/spark/commit/c

[GitHub] spark pull request #14407: [SPARK-16779][TRIVIAL] Avoid using postfix operat...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14407#discussion_r73761135 --- Diff: core/src/main/scala/org/apache/spark/deploy/FaultToleranceTest.scala --- @@ -113,7 +112,7 @@ private object FaultToleranceTest extends App with Log

[GitHub] spark pull request #14110: [SPARK-16455] Add a new hook in CoarseGrainedSche...

2016-08-05 Thread lovexi
Github user lovexi closed the pull request at: https://github.com/apache/spark/pull/14110 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #14407: [SPARK-16779][TRIVIAL] Avoid using postfix operat...

2016-08-05 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/14407#discussion_r73761555 --- Diff: core/src/main/scala/org/apache/spark/deploy/FaultToleranceTest.scala --- @@ -113,7 +112,7 @@ private object FaultToleranceTest extends App with Lo

[GitHub] spark pull request #14407: [SPARK-16779][TRIVIAL] Avoid using postfix operat...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14407#discussion_r73761784 --- Diff: core/src/main/scala/org/apache/spark/deploy/FaultToleranceTest.scala --- @@ -113,7 +112,7 @@ private object FaultToleranceTest extends App with Log

[GitHub] spark issue #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14500 **[Test build #63279 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63279/consoleFull)** for PR 14500 at commit [`7f4f38d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14500 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63279/ Test PASSed. ---

[GitHub] spark issue #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14500 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #12753: [SPARK-3767] [CORE] Support wildcard in Spark properties

2016-08-05 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/12753 Also the PR title is misleading, since this change is adding a single "wildcard" to a single configuration. The title makes it sound like it's way more generic than it is. --- If your project is se

[GitHub] spark pull request #14407: [SPARK-16779][TRIVIAL] Avoid using postfix operat...

2016-08-05 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/14407#discussion_r73762888 --- Diff: core/src/main/scala/org/apache/spark/deploy/FaultToleranceTest.scala --- @@ -113,7 +112,7 @@ private object FaultToleranceTest extends App with Lo

[GitHub] spark issue #14308: [SPARK-16421][EXAMPLES][ML] Improve ML Example Outputs

2016-08-05 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/14308 Thanks @srowen! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #14511: [SPARK-16927] [SPARK-16923] Override task propert...

2016-08-05 Thread mgummelt
GitHub user mgummelt opened a pull request: https://github.com/apache/spark/pull/14511 [SPARK-16927] [SPARK-16923] Override task properties at dispatcher. ## What changes were proposed in this pull request? - enable setting default properties for all jobs submitted through t

[GitHub] spark pull request #14511: [SPARK-16927] [SPARK-16923] Override task propert...

2016-08-05 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14511#discussion_r73764731 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -358,14 +358,12 @@ private[spark] class MesosClus

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-05 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/14511 @skonto Can you take a look at this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14511 **[Test build #63287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63287/consoleFull)** for PR 14511 at commit [`f42ac25`](https://github.com/apache/spark/commit/f

[GitHub] spark pull request #14371: [SPARK-16736] WiP Core+ SQL superfluous fs calls

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14371#discussion_r73765083 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala --- @@ -278,14 +278,15 @@ private[state]

[GitHub] spark pull request #14109: [SPARK-16404][ML] LeastSquaresAggregators seriali...

2016-08-05 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/14109#discussion_r73765222 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/LinearRegression.scala --- @@ -996,19 +1013,24 @@ private class LeastSquaresCostFun( fe

[GitHub] spark pull request #14371: [SPARK-16736] WiP Core+ SQL superfluous fs calls

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14371#discussion_r73765169 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala --- @@ -443,6 +445,9 @@ private[state] cl

[GitHub] spark pull request #14371: [SPARK-16736] WiP Core+ SQL superfluous fs calls

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14371#discussion_r73765309 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/util/FileBasedWriteAheadLog.scala --- @@ -231,13 +232,17 @@ private[streaming] class FileBasedW

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #63289 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63289/consoleFull)** for PR 11105 at commit [`177c6bf`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #14371: [SPARK-16736] WiP Core+ SQL superfluous fs calls

2016-08-05 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14371 Looks pretty good, can you remove the wip from the pr title? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark issue #14109: [SPARK-16404][ML] LeastSquaresAggregators serializes unn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14109 **[Test build #63288 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63288/consoleFull)** for PR 14109 at commit [`9c2bf47`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #14484: [SPARK-16796][Web UI] Mask spark.authenticate.secret on ...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14484 **[Test build #63280 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63280/consoleFull)** for PR 14484 at commit [`a73d818`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14484: [SPARK-16796][Web UI] Mask spark.authenticate.secret on ...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14484 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63280/ Test PASSed. ---

[GitHub] spark issue #14484: [SPARK-16796][Web UI] Mask spark.authenticate.secret on ...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14484 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14510: [SPARK-16925] Master should call schedule() after all ex...

2016-08-05 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14510 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featu

[GitHub] spark pull request #14512: [WIP] Add SSL support to dispatcher and spark-sub...

2016-08-05 Thread mgummelt
GitHub user mgummelt opened a pull request: https://github.com/apache/spark/pull/14512 [WIP] Add SSL support to dispatcher and spark-submit ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch t

[GitHub] spark issue #14512: [WIP] Add SSL support to dispatcher and spark-submit

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14512 **[Test build #63290 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63290/consoleFull)** for PR 14512 at commit [`09e1183`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #14512: [WIP] Add SSL support to dispatcher and spark-submit

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14512 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63290/ Test FAILed. ---

[GitHub] spark issue #14512: [WIP] Add SSL support to dispatcher and spark-submit

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14512 **[Test build #63290 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63290/consoleFull)** for PR 14512 at commit [`09e1183`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14512: [WIP] Add SSL support to dispatcher and spark-submit

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14512 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14118: [SPARK-16462][SPARK-16460][SPARK-15144][SQL] Make CSV ca...

2016-08-05 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14118 You can specify "com.databricks.spark.csv" as the source. On Fri, Aug 5, 2016 at 11:58 PM, djk121 wrote: > Is there a way to fall back to the old databricks csv library in spark 2

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14508 **[Test build #63281 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63281/consoleFull)** for PR 14508 at commit [`4ed4483`](https://github.com/apache/spark/commit/

[GitHub] spark issue #12694: [SPARK-14914] Fix Command too long for windows. Especial...

2016-08-05 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/12694 Update: I thought about using argument files, but they're only supported by javac (`javac @argfile`) and not by java. So if fixing anything, I'm in favor of: - removing the use of "driverJav

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14508 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14389: [SPARK-16714][SQL] Refactor type widening for consistenc...

2016-08-05 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/14389 Which part do you want me to update? I thought you've already committed the changes needed. Let me know and I will update this. --- If your project is set up for it, you can reply to this emai

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14508 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63281/ Test PASSed. ---

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14513 cc @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] spark pull request #14513: [SPARK-16928][SQL] Recursive call of ColumnVector...

2016-08-05 Thread ooq
GitHub user ooq opened a pull request: https://github.com/apache/spark/pull/14513 [SPARK-16928][SQL] Recursive call of ColumnVector::getInt() breaks JIT inlining ## What changes were proposed in this pull request? In both `OnHeapColumnVector` and `OffHeapColumnVector`, we i

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14513 **[Test build #63291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63291/consoleFull)** for PR 14513 at commit [`70e32c6`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #14176: [SPARK-16525][SQL] Enable Row Based HashMap in HashAggre...

2016-08-05 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/14176 Let's hold on this, if we are going to have single implementation for fast hash map (based on the benchmark result in another PR), do need to merge this fancy implementation choosing. cc @rxin ---

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/14513 We should also update VectorizedColumnReader.decodeDictionaryIds() to use the new method. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as we

<    1   2   3   4   5   >