[GitHub] spark issue #14801: [SPARK-17234] [SQL] Table Existence Checking when Index ...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14801 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14801: [SPARK-17234] [SQL] Table Existence Checking when Index ...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14801 **[Test build #64599 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64599/consoleFull)** for PR 14801 at commit [`ce35aa0`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14854: [SPARK-17283][WIP][Core] Cancel job in RDD.take() as soo...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14854 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14854: [SPARK-17283][WIP][Core] Cancel job in RDD.take() as soo...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14854 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64593/ Test FAILed. ---

[GitHub] spark issue #14854: [SPARK-17283][WIP][Core] Cancel job in RDD.take() as soo...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14854 **[Test build #64593 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64593/consoleFull)** for PR 14854 at commit [`62168e3`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14870: [SPARK-17303] Added spark-warehouse to dev/.rat-excludes

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14870 **[Test build #64608 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64608/consoleFull)** for PR 14870 at commit [`850261f`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14870: [SPARK-17303] Added spark-warehouse to dev/.rat-excludes

2016-08-29 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/14870 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fea

[GitHub] spark issue #14870: [SPARK-17303] Added spark-warehouse to dev/.rat-excludes

2016-08-29 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/14870 Jenkins, this is ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14452 **[Test build #64607 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64607/consoleFull)** for PR 14452 at commit [`38c57e8`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #14803: [SPARK-17153][SQL] Should read partition data whe...

2016-08-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14803#discussion_r76705391 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamSource.scala --- @@ -129,13 +129,20 @@ class FileStreamSource(

[GitHub] spark issue #14868: Implements percentile_approx aggregation function which ...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14868 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64602/ Test FAILed. ---

[GitHub] spark issue #14868: Implements percentile_approx aggregation function which ...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14868 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14868: Implements percentile_approx aggregation function which ...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14868 **[Test build #64602 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64602/consoleFull)** for PR 14868 at commit [`6be2ebe`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14870: [SPARK-17303] Added spark-warehouse to dev/.rat-excludes

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14870 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #14870: [SPARK-17303] Added spark-warehouse to dev/.rat-e...

2016-08-29 Thread frreiss
GitHub user frreiss opened a pull request: https://github.com/apache/spark/pull/14870 [SPARK-17303] Added spark-warehouse to dev/.rat-excludes ## What changes were proposed in this pull request? Excludes the `spark-warehouse` directory from the Apache RAT checks that src/ru

[GitHub] spark issue #14861: [SPARK-17287] [PYSPARK] Add recursive kwarg to Python Sp...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14861 **[Test build #64606 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64606/consoleFull)** for PR 14861 at commit [`03d29b8`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #14750: [SPARK-17183][SQL] put hive serde table schema to...

2016-08-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14750#discussion_r76703496 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -413,29 +415,48 @@ private[spark] class HiveExternalCatalog(c

[GitHub] spark issue #14861: [SPARK-17287] [PYSPARK] Add recursive kwarg to Python Sp...

2016-08-29 Thread jpiper
Github user jpiper commented on the issue: https://github.com/apache/spark/pull/14861 I fixed the Python style issue and amended the last commit - tests should be good now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #14867: [SPARK-17296][SQL] Simplify join parser join processing.

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14867 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64596/ Test PASSed. ---

[GitHub] spark issue #14867: [SPARK-17296][SQL] Simplify join parser join processing.

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14867 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14867: [SPARK-17296][SQL] Simplify join parser join processing.

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14867 **[Test build #64596 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64596/consoleFull)** for PR 14867 at commit [`f9cb0d2`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14750: [SPARK-17183][SQL] put hive serde table schema to...

2016-08-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14750#discussion_r76702974 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -413,29 +415,48 @@ private[spark] class HiveExternalCatalog(c

[GitHub] spark issue #14868: Implements percentile_approx aggregation function which ...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14868 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14868: Implements percentile_approx aggregation function which ...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14868 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64600/ Test FAILed. ---

[GitHub] spark issue #14868: Implements percentile_approx aggregation function which ...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14868 **[Test build #64600 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64600/consoleFull)** for PR 14868 at commit [`88232ed`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14204: [SPARK-16520] [WEBUI] Link executors to corresponding wo...

2016-08-29 Thread nblintao
Github user nblintao commented on the issue: https://github.com/apache/spark/pull/14204 Interesting, test again please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request #14710: [SPARK-16533][CORE] resolve deadlocking in driver...

2016-08-29 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14710#discussion_r76700923 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -478,19 +487,24 @@ class CoarseGrainedSchedulerBa

[GitHub] spark pull request #14750: [SPARK-17183][SQL] put hive serde table schema to...

2016-08-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14750#discussion_r76699427 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala --- @@ -373,7 +373,7 @@ case class InsertIn

[GitHub] spark pull request #14710: [SPARK-16533][CORE] resolve deadlocking in driver...

2016-08-29 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14710#discussion_r76699077 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -478,19 +487,24 @@ class CoarseGrainedSchedule

[GitHub] spark pull request #14750: [SPARK-17183][SQL] put hive serde table schema to...

2016-08-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14750#discussion_r76697635 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -166,15 +165,19 @@ private[spark] class HiveExternalCatalog(c

[GitHub] spark pull request #14868: Implements percentile_approx aggregation function...

2016-08-29 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/14868#discussion_r76697179 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/ApproximatePercentileQuerySuite.scala --- @@ -0,0 +1,226 @@ +/* + * Licensed to the Apache S

[GitHub] spark issue #14869: [SPARK-17301][SQL] Remove unused classTag field from Ato...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14869 **[Test build #64605 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64605/consoleFull)** for PR 14869 at commit [`da28f08`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #14868: Implements percentile_approx aggregation function which ...

2016-08-29 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/14868 @yhuai @cloud-fan, can you take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #14868: Implements percentile_approx aggregation function which ...

2016-08-29 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/14868 @thunterdb 1. Looks like current impl of QuantileSummaries will not do automatically compression in some cases. For example: `(1 to 1000).foreach(qualileSummaries.insert(_))` p

[GitHub] spark issue #14856: [SPARK-17241][SparkR][MLlib] SparkR spark.glm should hav...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14856 **[Test build #64598 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64598/consoleFull)** for PR 14856 at commit [`492f29f`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14869: [SPARK-17301][SQL] Remove unused classTag field f...

2016-08-29 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/14869 [SPARK-17301][SQL] Remove unused classTag field from AtomicType base class There's an unused `classTag` val in the AtomicType base class which is causing unnecessary slowness in deserialization b

[GitHub] spark issue #14856: [SPARK-17241][SparkR][MLlib] SparkR spark.glm should hav...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14856 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14856: [SPARK-17241][SparkR][MLlib] SparkR spark.glm should hav...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14856 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64598/ Test PASSed. ---

[GitHub] spark pull request #14868: Implements percentile_approx aggregation function...

2016-08-29 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/14868#discussion_r76695715 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/ApproximatePercentile.scala --- @@ -0,0 +1,302 @@ +/* + *

[GitHub] spark issue #14746: [SPARK-17180] [SQL] Fix View Resolution Order in ALTER V...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14746 **[Test build #64603 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64603/consoleFull)** for PR 14746 at commit [`baa8a1f`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #14521: [SPARK-16935] [SQL] Verification of Function-related Ext...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14521 **[Test build #64604 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64604/consoleFull)** for PR 14521 at commit [`58cba4b`](https://github.com/apache/spark/commit/5

[GitHub] spark pull request #14868: Implements percentile_approx aggregation function...

2016-08-29 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/14868#discussion_r76695365 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/ApproximatePercentileQuerySuite.scala --- @@ -0,0 +1,226 @@ +/* + * Licensed to the Apache S

[GitHub] spark issue #14856: [SPARK-17241][SparkR][MLlib] SparkR spark.glm should hav...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14856 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14864: [SPARK-15453] [SQL] FileSourceScanExec to extract `outpu...

2016-08-29 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/14864 cc @rxin , @cloud-fan for review --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #14856: [SPARK-17241][SparkR][MLlib] SparkR spark.glm should hav...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14856 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64597/ Test PASSed. ---

[GitHub] spark issue #14856: [SPARK-17241][SparkR][MLlib] SparkR spark.glm should hav...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14856 **[Test build #64597 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64597/consoleFull)** for PR 14856 at commit [`c8bdd3b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14521: [SPARK-16935] [SQL] Verification of Function-related Ext...

2016-08-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14521 cc @cloud-fan Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14388: [SPARK-16362][SQL] Support ArrayType and StructType in v...

2016-08-29 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/14388 @viirya If I do a simple `select` on an array field it works, but if I add an `order by` clause which orders by the array column I get exceptions like ``` 16/08/29 21:47:01 ERROR Executo

[GitHub] spark issue #14521: [SPARK-16935] [SQL] Verification of Function-related Ext...

2016-08-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14521 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark pull request #14868: Implements percentile_approx aggregation function...

2016-08-29 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/14868#discussion_r76695042 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/ApproximatePercentile.scala --- @@ -0,0 +1,302 @@ +/* + *

[GitHub] spark issue #14746: [SPARK-17180] [SQL] Fix View Resolution Order in ALTER V...

2016-08-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14746 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark pull request #14855: [SPARK-17284] [SQL] Remove Statistics-related Tab...

2016-08-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14855#discussion_r76694730 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -791,11 +791,22 @@ case class ShowCreateTableCommand(table:

[GitHub] spark issue #14868: Implements percentile_approx aggregation function which ...

2016-08-29 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/14868 The test failure is caused by https://issues.apache.org/jira/browse/SPARK-17289 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y

[GitHub] spark issue #14298: [SPARK-16283][SQL] Implement `percentile_approx` SQL fun...

2016-08-29 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/14298 @lw-lin There are other issues to fix besides partial aggregation, like out of memory, argument type (B, and percentages should use catalyst expression instead so that we support constant fold

[GitHub] spark issue #14868: Implements percentile_approx aggregation function which ...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14868 **[Test build #64602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64602/consoleFull)** for PR 14868 at commit [`6be2ebe`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #13493: [SPARK-15750][MLLib][PYSPARK] Constructing FPGrowth fail...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13493 **[Test build #3236 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3236/consoleFull)** for PR 13493 at commit [`56cd7cf`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14855: [SPARK-17284] [SQL] Remove Statistics-related Tab...

2016-08-29 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14855#discussion_r76692456 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -791,11 +791,22 @@ case class ShowCreateTableCommand(table:

[GitHub] spark issue #12415: [SPARK-14662] LinearRegressionModel use default paramete...

2016-08-29 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/12415 It looks like this was fixed in SPARK-15339, so can you please close this issue? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #13762: [SPARK-14926] [ML] OneVsRest labelMetadata uses incorrec...

2016-08-29 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/13762 Ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fea

[GitHub] spark issue #14868: Implements percentile_approx aggregation function which ...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14868 **[Test build #64600 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64600/consoleFull)** for PR 14868 at commit [`88232ed`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14219: [SPARK-16566][MLLib] sort sparseVector's indices before ...

2016-08-29 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/14219 SparseVector indices are assumed to be sorted already. We should not re-sort them during operations. The deeper issue which needs to be fixed is SPARK-14707 I commented in the JIRA as well.

[GitHub] spark pull request #14868: Implements percentile_approx aggregation function...

2016-08-29 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/14868#discussion_r76690870 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/QuantileSummaries.scala --- @@ -41,7 +41,7 @@ import org.apache.spark.sql.catalys

[GitHub] spark pull request #14855: [SPARK-17284] [SQL] Remove Statistics-related Tab...

2016-08-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14855#discussion_r76690858 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -791,11 +791,22 @@ case class ShowCreateTableCommand(table:

[GitHub] spark issue #14835: [SPARK-17243] [Web UI] Spark 2.0 History Server won't lo...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14835 **[Test build #64601 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64601/consoleFull)** for PR 14835 at commit [`bbb9718`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13704 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13704 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64594/ Test PASSed. ---

[GitHub] spark pull request #14868: Implements percentile_approx aggregation function...

2016-08-29 Thread clockfly
GitHub user clockfly opened a pull request: https://github.com/apache/spark/pull/14868 Implements percentile_approx aggregation function which supports partial aggregation. ## What changes were proposed in this pull request? This PR implements aggregation function `percenti

[GitHub] spark issue #14835: [SPARK-17243] [Web UI] Spark 2.0 History Server won't lo...

2016-08-29 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/14835 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14864: [SPARK-15453] [SQL] FileSourceScanExec to extract `outpu...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14864 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13704 **[Test build #64594 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64594/consoleFull)** for PR 13704 at commit [`c8f87a1`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14835: [SPARK-17243] [Web UI] Spark 2.0 History Server won't lo...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14835 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14835: [SPARK-17243] [Web UI] Spark 2.0 History Server won't lo...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14835 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64595/ Test FAILed. ---

[GitHub] spark issue #14801: [SPARK-17234] [SQL] Table Existence Checking when Index ...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14801 **[Test build #64599 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64599/consoleFull)** for PR 14801 at commit [`ce35aa0`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14835: [SPARK-17243] [Web UI] Spark 2.0 History Server won't lo...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14835 **[Test build #64595 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64595/consoleFull)** for PR 14835 at commit [`bbb9718`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14864: [SPARK-15453] [SQL] FileSourceScanExec to extract `outpu...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14864 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64592/ Test PASSed. ---

[GitHub] spark issue #14864: [SPARK-15453] [SQL] FileSourceScanExec to extract `outpu...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14864 **[Test build #64592 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64592/consoleFull)** for PR 14864 at commit [`07196a8`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14204: [SPARK-16520] [WEBUI] Link executors to corresponding wo...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14204 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64583/ Test FAILed. ---

[GitHub] spark issue #14204: [SPARK-16520] [WEBUI] Link executors to corresponding wo...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14204 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14204: [SPARK-16520] [WEBUI] Link executors to corresponding wo...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14204 **[Test build #64583 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64583/consoleFull)** for PR 14204 at commit [`bed0310`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14855: [SPARK-17284] [SQL] Remove Statistics-related Tab...

2016-08-29 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14855#discussion_r76687807 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -791,11 +791,22 @@ case class ShowCreateTableCommand(table:

[GitHub] spark issue #14866: [SPARK-17298][SQL] Require explicit CROSS join for carte...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14866 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14866: [SPARK-17298][SQL] Require explicit CROSS join for carte...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14866 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64590/ Test FAILed. ---

[GitHub] spark issue #14856: [SPARK-17241][SparkR][MLlib] SparkR spark.glm should hav...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14856 **[Test build #64598 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64598/consoleFull)** for PR 14856 at commit [`492f29f`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #14866: [SPARK-17298][SQL] Require explicit CROSS join for carte...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14866 **[Test build #64590 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64590/consoleFull)** for PR 14866 at commit [`250d96d`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-08-29 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r76685355 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,395 @@ +/* + * Licensed to the Apache Software Found

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9571 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9571 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64586/ Test PASSed. --- I

[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14531 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14856: [SPARK-17241][SparkR][MLlib] SparkR spark.glm should hav...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14856 **[Test build #64597 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64597/consoleFull)** for PR 14856 at commit [`c8bdd3b`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14531 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64589/ Test PASSed. ---

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9571 **[Test build #64586 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64586/consoleFull)** for PR 9571 at commit [`d39996a`](https://github.com/apache/spark/commit/d3

[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14531 **[Test build #64589 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64589/consoleFull)** for PR 14531 at commit [`f81a49b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14855: [SPARK-17284] [SQL] Remove Statistics-related Table Prop...

2016-08-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14855 cc @hvanhovell @cloud-fan @liancheng @yhuai Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark issue #11956: [SPARK-14098][SQL] Generate Java code that gets a float/...

2016-08-29 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/11956 We could compress them in memory with MEMORY_AND_DISK_SER, this could be controlled by a flag. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-08-29 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r76683789 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,395 @@ +/* + * Licensed to the Apache Software Found

[GitHub] spark pull request #14866: [SPARK-17298][SQL] Require explicit CROSS join fo...

2016-08-29 Thread srinathshankar
Github user srinathshankar commented on a diff in the pull request: https://github.com/apache/spark/pull/14866#discussion_r76683461 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1534,6 +1542,34 @@ object SimplifyCaseConversio

[GitHub] spark issue #14859: [SPARK-17200][PROJECT INFRA][BUILD][SparkR] Automate bui...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14859 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64556/ Test FAILed. ---

[GitHub] spark issue #14859: [SPARK-17200][PROJECT INFRA][BUILD][SparkR] Automate bui...

2016-08-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14859 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-08-29 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r76683228 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,395 @@ +/* + * Licensed to the Apache Software Found

[GitHub] spark issue #14854: [SPARK-17283][WIP][Core] Cancel job in RDD.take() as soo...

2016-08-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14854 **[Test build #64561 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64561/consoleFull)** for PR 14854 at commit [`e9c7dfb`](https://github.com/apache/spark/commit/

<    1   2   3   4   5   6   7   >