[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14079 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #68694 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68694/consoleFull)** for PR 14079 at commit

[GitHub] spark issue #15717: [SPARK-17910][SQL] Allow users to update the comment of ...

2016-11-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15717 Another question about this PR: does it support data source tables? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15901: [SPARK-18467][SQL] Refactor StaticInvoke, Invoke and New...

2016-11-15 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/15901 @rxin I introduced features as follows: 1. `StaticInvoke` and `Invoke` had a risk to exceed 64kb JVM limit to prepare arguments but after this patch they can handle them because they share

[GitHub] spark issue #15902: [SPARK-18430][SQL][BACKPORT-2.0] Fixed Exception Message...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15902 **[Test build #68704 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68704/consoleFull)** for PR 15902 at commit

[GitHub] spark pull request #15902: [SPARK-18430][SQL][BACKPORT-2.0] Fixed Exception ...

2016-11-15 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/15902 [SPARK-18430][SQL][BACKPORT-2.0] Fixed Exception Messages when Hitting an Invocation Exception of Function Lookup ### What changes were proposed in this pull request? This PR is to backport

[GitHub] spark issue #15900: [SPARK-18464][SQL] support old table which doesn't store...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15900 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68697/ Test FAILed. ---

[GitHub] spark issue #15900: [SPARK-18464][SQL] support old table which doesn't store...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15900 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15900: [SPARK-18464][SQL] support old table which doesn't store...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15900 **[Test build #68697 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68697/consoleFull)** for PR 15900 at commit

[GitHub] spark pull request #15899: [SPARK-18466] added withFilter method to RDD

2016-11-15 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15899#discussion_r88180989 --- Diff: core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala --- @@ -70,6 +70,7 @@ class RDDSuite extends SparkFunSuite with SharedSparkContext {

[GitHub] spark issue #15901: [SPARK-18467][SQL] Refactor StaticInvoke, Invoke and New...

2016-11-15 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15901 So the refactoring for simplification adds more code than it deletes? Did you introduce new features as well? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #15884: [SPARK-18433][SQL] Improve DataSource option keys to be ...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15884 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15884: [SPARK-18433][SQL] Improve DataSource option keys to be ...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15884 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68695/ Test PASSed. ---

[GitHub] spark issue #15884: [SPARK-18433][SQL] Improve DataSource option keys to be ...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15884 **[Test build #68695 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68695/consoleFull)** for PR 15884 at commit

[GitHub] spark issue #15815: [DOCS][SPARK-18365] Improve Sample Method Documentation

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15815 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68691/ Test FAILed. ---

[GitHub] spark issue #15815: [DOCS][SPARK-18365] Improve Sample Method Documentation

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15815 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15815: [DOCS][SPARK-18365] Improve Sample Method Documentation

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15815 **[Test build #68691 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68691/consoleFull)** for PR 15815 at commit

[GitHub] spark issue #15898: [SPARK-18457][SQL] ORC and other columnar formats using ...

2016-11-15 Thread aray
Github user aray commented on the issue: https://github.com/apache/spark/pull/15898 @tejasapatil yes that is the use case where this applies. It's only tested against whatever version is included in the hadoop2.7+hive build configuration listed above. Is there anything in particular

[GitHub] spark issue #15877: [SPARK-18429] [SQL] implement a new Aggregate for CountM...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15877 **[Test build #68703 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68703/consoleFull)** for PR 15877 at commit

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15868 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68696/ Test FAILed. ---

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15868 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15868 **[Test build #68696 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68696/consoleFull)** for PR 15868 at commit

[GitHub] spark issue #15898: [SPARK-18457][SQL] ORC and other columnar formats using ...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15898 **[Test build #68702 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68702/consoleFull)** for PR 15898 at commit

[GitHub] spark issue #15898: [SPARK-18457][SQL] ORC and other columnar formats using ...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15898 **[Test build #68701 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68701/consoleFull)** for PR 15898 at commit

[GitHub] spark issue #15898: [SPARK-18457][SQL] ORC and other columnar formats using ...

2016-11-15 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/15898 Feels like this will only help for `select count(*) from table` without any projections and filters. Which version of ORC have you tested against ? In past I have seen PRs which do

[GitHub] spark pull request #15898: [SPARK-18457][SQL] ORC and other columnar formats...

2016-11-15 Thread tejasapatil
Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/15898#discussion_r88174485 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/OrcQuerySuite.scala --- @@ -577,4 +579,23 @@ class OrcQuerySuite extends QueryTest with

[GitHub] spark pull request #15898: [SPARK-18457][SQL] ORC and other columnar formats...

2016-11-15 Thread tejasapatil
Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/15898#discussion_r88174566 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/OrcQuerySuite.scala --- @@ -577,4 +579,23 @@ class OrcQuerySuite extends QueryTest with

[GitHub] spark issue #15901: [SPARK-18467][SQL] Refactor StaticInvoke, Invoke and New...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15901 **[Test build #68700 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68700/consoleFull)** for PR 15901 at commit

[GitHub] spark pull request #15901: [SPARK-18467][SQL] Refactor StaticInvoke, Invoke ...

2016-11-15 Thread ueshin
GitHub user ueshin opened a pull request: https://github.com/apache/spark/pull/15901 [SPARK-18467][SQL] Refactor StaticInvoke, Invoke and NewInstance. ## What changes were proposed in this pull request? Refactor `StaticInvoke`, `Invoke` and `NewInstance` as: -

[GitHub] spark issue #15877: [SPARK-18429] [SQL] implement a new Aggregate for CountM...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15877 **[Test build #68699 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68699/consoleFull)** for PR 15877 at commit

[GitHub] spark pull request #15898: [SPARK-18457][SQL] ORC and other columnar formats...

2016-11-15 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15898#discussion_r88175031 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/OrcQuerySuite.scala --- @@ -577,4 +579,23 @@ class OrcQuerySuite extends QueryTest with

[GitHub] spark pull request #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOptio...

2016-11-15 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15868#discussion_r88175070 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala --- @@ -667,7 +667,14 @@ object JdbcUtils extends

[GitHub] spark issue #15884: [SPARK-18433][SQL] Improve DataSource option keys to be ...

2016-11-15 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15884 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #15884: [SPARK-18433][SQL] Improve DataSource option keys...

2016-11-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15884#discussion_r88174866 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -1366,7 +1366,7 @@ class JsonSuite extends

[GitHub] spark issue #15898: [SPARK-18457][SQL] ORC and other columnar formats using ...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15898 **[Test build #68698 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68698/consoleFull)** for PR 15898 at commit

[GitHub] spark issue #15900: [SPARK-18464][SQL] support old table which doesn't store...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15900 **[Test build #68697 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68697/consoleFull)** for PR 15900 at commit

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15868 Could we have a test case for this new parameter? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-15 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15880 to be safe, how about we retargeting this ticket to 2.2? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15900: [SPARK-18464][SQL] support old table which doesn't store...

2016-11-15 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15900 cc @yhuai @ericl @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15868 LGTM except one minor comment. Also CC @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #15900: [SPARK-18464][SQL] support old table which doesn'...

2016-11-15 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/15900 [SPARK-18464][SQL] support old table which doesn't store schema in metastore ## What changes were proposed in this pull request? Before Spark 2.1, users can create an external data

[GitHub] spark pull request #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOptio...

2016-11-15 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15868#discussion_r88174214 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -358,7 +358,8 @@ case class DataSource(

[GitHub] spark issue #15803: [SPARK-18298][Web UI]change gmt time to local zone time ...

2016-11-15 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on the issue: https://github.com/apache/spark/pull/15803 @ajbozarth In browser side the timezone used to build Date from epoch time is the one **at browser side**, not that one in **History Server side**. These two are different in many cases. So

[GitHub] spark issue #15898: [SPARK-18457][SQL] ORC and other columnar formats using ...

2016-11-15 Thread aray
Github user aray commented on the issue: https://github.com/apache/spark/pull/15898 The code that is being changed originated 2 years ago with the addition of Hive 0.13 support by @zhzhan, see

[GitHub] spark issue #15899: [SPARK-18466] added withFilter method to RDD

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15899 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15898: [SPARK-18457][SQL] ORC and other columnar formats using ...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15898 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68693/ Test PASSed. ---

[GitHub] spark issue #15898: [SPARK-18457][SQL] ORC and other columnar formats using ...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15898 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15898: [SPARK-18457][SQL] ORC and other columnar formats using ...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15898 **[Test build #68693 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68693/consoleFull)** for PR 15898 at commit

[GitHub] spark pull request #15899: [SPARK-18466] added withFilter method to RDD

2016-11-15 Thread reggert
GitHub user reggert opened a pull request: https://github.com/apache/spark/pull/15899 [SPARK-18466] added withFilter method to RDD ## What changes were proposed in this pull request? A `withFilter` method has been added to `RDD` as an alias for the `filter` method. When

[GitHub] spark pull request #15703: [SPARK-18186] Migrate HiveUDAFFunction to TypedIm...

2016-11-15 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15703#discussion_r88172060 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala --- @@ -365,4 +380,66 @@ private[hive] case class HiveUDAFFunction( val

[GitHub] spark pull request #15703: [SPARK-18186] Migrate HiveUDAFFunction to TypedIm...

2016-11-15 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15703#discussion_r88171437 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala --- @@ -289,73 +302,75 @@ private[hive] case class HiveUDAFFunction(

[GitHub] spark pull request #15703: [SPARK-18186] Migrate HiveUDAFFunction to TypedIm...

2016-11-15 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15703#discussion_r88171373 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala --- @@ -289,73 +302,75 @@ private[hive] case class HiveUDAFFunction(

[GitHub] spark pull request #15703: [SPARK-18186] Migrate HiveUDAFFunction to TypedIm...

2016-11-15 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15703#discussion_r88171285 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala --- @@ -289,73 +302,75 @@ private[hive] case class HiveUDAFFunction(

[GitHub] spark pull request #15703: [SPARK-18186] Migrate HiveUDAFFunction to TypedIm...

2016-11-15 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15703#discussion_r88171097 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala --- @@ -289,73 +302,75 @@ private[hive] case class HiveUDAFFunction(

[GitHub] spark issue #15898: [SPARK-18457][SQL] ORC and other columnar formats using ...

2016-11-15 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15898 I was just watching the JIRA just for my curiosity. Actually, aren't we able to add test for `SparkOrcNewRecordReader` like the one as below? ```scala test("Empty schema does not

[GitHub] spark pull request #15703: [SPARK-18186] Migrate HiveUDAFFunction to TypedIm...

2016-11-15 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15703#discussion_r88170694 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala --- @@ -263,8 +265,19 @@ private[hive] case class HiveGenericUDTF( }

[GitHub] spark pull request #15703: [SPARK-18186] Migrate HiveUDAFFunction to TypedIm...

2016-11-15 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15703#discussion_r88170550 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala --- @@ -263,8 +265,19 @@ private[hive] case class HiveGenericUDTF( }

[GitHub] spark pull request #15874: [Spark-18408][ML] API Improvements for LSH

2016-11-15 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15874#discussion_r88169546 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/LSH.scala --- @@ -179,16 +211,13 @@ private[ml] abstract class LSHModel[T <: LSHModel[T]]

[GitHub] spark issue #15898: [SPARK-18457][SQL] ORC and other columnar formats using ...

2016-11-15 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15898 Can we add a unit test for this function? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15868 **[Test build #68696 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68696/consoleFull)** for PR 15868 at commit

[GitHub] spark pull request #15703: [SPARK-18186] Migrate HiveUDAFFunction to TypedIm...

2016-11-15 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15703#discussion_r88168751 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala --- @@ -263,8 +265,19 @@ private[hive] case class HiveGenericUDTF( }

[GitHub] spark issue #15898: [SPARK-18457][SQL] ORC and other columnar formats using ...

2016-11-15 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15898 cc @piaozhexiu I think you changed this last? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15874: [Spark-18408][ML] API Improvements for LSH

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15874 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68689/ Test PASSed. ---

[GitHub] spark issue #15874: [Spark-18408][ML] API Improvements for LSH

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15874 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15884: [SPARK-18433][SQL] Improve DataSource option keys to be ...

2016-11-15 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15884 Rebased to resolve conflicts. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15874: [Spark-18408][ML] API Improvements for LSH

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15874 **[Test build #68689 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68689/consoleFull)** for PR 15874 at commit

[GitHub] spark issue #15811: [SPARK-18361] [PySpark] Expose RDD localCheckpoint in Py...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15811 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68692/ Test PASSed. ---

[GitHub] spark issue #15811: [SPARK-18361] [PySpark] Expose RDD localCheckpoint in Py...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15811 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15811: [SPARK-18361] [PySpark] Expose RDD localCheckpoint in Py...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15811 **[Test build #68692 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68692/consoleFull)** for PR 15811 at commit

[GitHub] spark issue #15884: [SPARK-18433][SQL] Improve DataSource option keys to be ...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15884 **[Test build #68695 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68695/consoleFull)** for PR 15884 at commit

[GitHub] spark issue #15883: [SPARK-18438][SPARKR][ML] spark.mlp should support RForm...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15883 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15883: [SPARK-18438][SPARKR][ML] spark.mlp should support RForm...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15883 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68690/ Test PASSed. ---

[GitHub] spark issue #15883: [SPARK-18438][SPARKR][ML] spark.mlp should support RForm...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15883 **[Test build #68690 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68690/consoleFull)** for PR 15883 at commit

[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #68694 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68694/consoleFull)** for PR 14079 at commit

[GitHub] spark pull request #15825: [SPARK-18377][SQL] warehouse path should be a sta...

2016-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15825 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15896: [SPARK-18465] Uncache table shouldn't throw an exception...

2016-11-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15896 After fixed the styles, LGTM pending testing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15898: [SPARK-18457][SQL] ORC and other columnar formats using ...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15898 **[Test build #68693 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68693/consoleFull)** for PR 15898 at commit

[GitHub] spark pull request #15898: [SPARK-18457][SQL] ORC and other columnar formats...

2016-11-15 Thread aray
GitHub user aray opened a pull request: https://github.com/apache/spark/pull/15898 [SPARK-18457][SQL] ORC and other columnar formats using HiveShim read all columns when doing a simple count ## What changes were proposed in this pull request? When reading zero columns

[GitHub] spark issue #15811: [SPARK-18361] [PySpark] Expose RDD localCheckpoint in Py...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15811 **[Test build #68692 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68692/consoleFull)** for PR 15811 at commit

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-15 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r88165296 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -133,50 +153,79 @@ case class

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-15 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r88165267 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -133,50 +153,79 @@ case class

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-15 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r88165166 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -56,29 +56,49 @@ case class

[GitHub] spark pull request #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-11-15 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r88165483 --- Diff: yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala --- @@ -121,13 +121,20 @@ private[spark] abstract class

[GitHub] spark issue #15811: [SPARK-18361] [PySpark] Expose RDD localCheckpoint in Py...

2016-11-15 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15811 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15811: [SPARK-18361] [PySpark] Expose RDD localCheckpoint in Py...

2016-11-15 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15811 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15869: [YARN][DOC] Update Yarn configuration doc

2016-11-15 Thread weiqingy
Github user weiqingy commented on the issue: https://github.com/apache/spark/pull/15869 @tgravescs Thanks for the reply. I have updated the PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15811: [SPARK-18361] [PySpark] Expose RDD localCheckpoint in Py...

2016-11-15 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15811 Looks like just an IO problem when archiving logs after successful tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-11-15 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r88164697 --- Diff: yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala --- @@ -121,13 +121,20 @@ private[spark] abstract class

[GitHub] spark issue #15825: [SPARK-18377][SQL] warehouse path should be a static con...

2016-11-15 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15825 I added a `releasenotes` label to the ticket, so that we won't forget --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15825: [SPARK-18377][SQL] warehouse path should be a static con...

2016-11-15 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15825 Merging in master/branch-2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15855: [SPARK-16808][Core] History Server main page does not ho...

2016-11-15 Thread vijoshi
Github user vijoshi commented on the issue: https://github.com/apache/spark/pull/15855 Thanks @vanzin ! Closed the PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-11-15 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/13909 Except for the two comments regarding the test, I don't have other question for now. cc @hvanhovell @cloud-fan for more checks. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request #15855: [SPARK-16808][Core] History Server main page does...

2016-11-15 Thread vijoshi
Github user vijoshi closed the pull request at: https://github.com/apache/spark/pull/15855 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15883: [SPARK-18438][SPARKR][ML] spark.mlp should support RForm...

2016-11-15 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15883 @felixcheung Both ```paste``` and ```paste0``` should work well in this scenario, since ```RFormula``` can handle space between each term. I think it would be better to unify them, so I use

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-15 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r88163630 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala --- @@ -42,15 +42,55 @@ trait

[GitHub] spark issue #15895: [SPARK-18459][SPARK-18460][StructuredStreaming] Rename t...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15895 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68682/ Test FAILed. ---

[GitHub] spark issue #15895: [SPARK-18459][SPARK-18460][StructuredStreaming] Rename t...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15895 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15895: [SPARK-18459][SPARK-18460][StructuredStreaming] Rename t...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15895 **[Test build #68682 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68682/consoleFull)** for PR 15895 at commit

[GitHub] spark issue #15815: [DOCS][SPARK-18365] Improve Sample Method Documentation

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15815 **[Test build #68691 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68691/consoleFull)** for PR 15815 at commit

[GitHub] spark issue #15883: [SPARK-18438][SPARKR][ML] spark.mlp should support RForm...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15883 **[Test build #68690 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68690/consoleFull)** for PR 15883 at commit

  1   2   3   4   5   >