[GitHub] spark issue #17717: [SPARK-20430][SQL] Initialise RangeExec parameters in a ...

2017-04-21 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17717 LGTM pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17712 **[Test build #76057 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76057/testReport)** for PR 17712 at commit

[GitHub] spark issue #17717: [SPARK-20430][SQL] Initialise RangeExec parameters in a ...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17717 **[Test build #76056 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76056/testReport)** for PR 17717 at commit

[GitHub] spark pull request #17717: [SPARK-20430][SQL] Initialise RangeExec parameter...

2017-04-21 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17717#discussion_r112803448 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -1732,4 +1732,10 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark pull request #17717: [SPARK-20430][SQL] Initialise RangeExec parameter...

2017-04-21 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/17717#discussion_r112803232 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -1732,4 +1732,10 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark pull request #17717: [SPARK-20430][SQL] Initialise RangeExec parameter...

2017-04-21 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/17717#discussion_r112803234 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -1732,4 +1732,10 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark pull request #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17712#discussion_r112803151 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala --- @@ -45,14 +45,33 @@ import

[GitHub] spark pull request #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/17712#discussion_r112803097 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala --- @@ -45,14 +45,33 @@ import

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17725 **[Test build #76055 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76055/testReport)** for PR 17725 at commit

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-21 Thread markgrover
Github user markgrover commented on the issue: https://github.com/apache/spark/pull/17725 Few decisions that I made here: * I considered if just `sun.java.command` property should be checked and redacted but that seemed to specific and likely a bandaid to the current problem, not

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17725 **[Test build #76054 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76054/testReport)** for PR 17725 at commit

[GitHub] spark pull request #17693: [SPARK-16548][SQL] Inconsistent error handling in...

2017-04-21 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17693#discussion_r112801838 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala --- @@ -149,7 +149,8 @@ case class

[GitHub] spark issue #17693: [SPARK-16548][SQL] Inconsistent error handling in JSON p...

2017-04-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17693 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17712 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76053/ Test FAILed. ---

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17712 **[Test build #76053 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76053/testReport)** for PR 17712 at commit

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17712 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17725 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17725 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76051/ Test FAILed. ---

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17712 **[Test build #76053 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76053/testReport)** for PR 17712 at commit

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17725 **[Test build #76051 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76051/testReport)** for PR 17725 at commit

[GitHub] spark pull request #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17712#discussion_r112801078 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala --- @@ -45,14 +45,33 @@ import

[GitHub] spark issue #17672: [SPARK-20371][R] Add wrappers for collect_list and colle...

2017-04-21 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17672 Will be probably cleaner --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17712#discussion_r112800829 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala --- @@ -45,14 +45,33 @@ import

[GitHub] spark pull request #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/17712#discussion_r112800640 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala --- @@ -45,14 +45,33 @@ import

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17724 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17724 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76049/ Test PASSed. ---

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17724 **[Test build #76049 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76049/testReport)** for PR 17724 at commit

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17712 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17712 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76052/ Test FAILed. ---

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17712 **[Test build #76052 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76052/testReport)** for PR 17712 at commit

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17712 **[Test build #76052 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76052/testReport)** for PR 17712 at commit

[GitHub] spark issue #17672: [SPARK-20371][R] Add wrappers for collect_list and colle...

2017-04-21 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17672 Yeah, I have this feeling that it could be deliberate, but I cannot figure out what is the purpose. Removing `@exports` should be enough, shouldn't it? I thought about cleaning this up, but

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17725 **[Test build #76051 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76051/testReport)** for PR 17725 at commit

[GitHub] spark pull request #17725: [SPARK-20435][CORE] More thorough redaction of se...

2017-04-21 Thread markgrover
GitHub user markgrover opened a pull request: https://github.com/apache/spark/pull/17725 [SPARK-20435][CORE] More thorough redaction of sensitive information This change does a more thorough redaction of sensitive information from logs and UI Add unit tests that ensure that no

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/17723 cc @vanzin @jerryshao @skonto BTW @vanzin, I decided to parameterize `HadoopFSCredentialProvider` with a new `HadoopAccessManager` object, for which YARN provides a custom

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17712 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76050/ Test FAILed. ---

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17712 **[Test build #76050 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76050/testReport)** for PR 17712 at commit

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17712 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17723 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17723 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76047/ Test PASSed. ---

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17723 **[Test build #76047 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76047/testReport)** for PR 17723 at commit

[GitHub] spark issue #17672: [SPARK-20371][R] Add wrappers for collect_list and colle...

2017-04-21 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17672 Not really its just inconsistent handling. Some comment changes can be deliberated though. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17712 **[Test build #76050 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76050/testReport)** for PR 17712 at commit

[GitHub] spark issue #17672: [SPARK-20371][R] Add wrappers for collect_list and colle...

2017-04-21 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17672 BTW @felixcheung - is there any deeper reason behind current stat of `generics.R`? I mean: - Inconsistent usage of standard and `roxygen` comments. - Marking functions which are not to

[GitHub] spark issue #17719: [SPARK-20431][SQL] Specify a schema by using a DDL-forma...

2017-04-21 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17719 cc: @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #17717: [SPARK-20430][SQL] Initialise RangeExec parameters in a ...

2017-04-21 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17717 cc: @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-21 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17712#discussion_r112795922 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala --- @@ -47,12 +47,20 @@ case class UserDefinedFunction

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-21 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/17724 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17724 **[Test build #76049 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76049/testReport)** for PR 17724 at commit

[GitHub] spark issue #17648: [SPARK-19851] Add support for EVERY and ANY (SOME) aggre...

2017-04-21 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17648 I was saying rather than implementing them, just rewrite them into an aggregate on the conditions and compare them against the value. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #17723: [SPARK-20434] Move kerberos delegation token code...

2017-04-21 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r112788867 --- Diff: core/pom.xml --- @@ -357,6 +357,34 @@ org.apache.commons commons-crypto + + + +

[GitHub] spark issue #17713: [SPARK-20417][SQL] Move subquery error handling to check...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17713 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17713: [SPARK-20417][SQL] Move subquery error handling to check...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17713 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76043/ Test PASSed. ---

[GitHub] spark issue #17713: [SPARK-20417][SQL] Move subquery error handling to check...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17713 **[Test build #76043 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76043/testReport)** for PR 17713 at commit

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17724 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17724 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76048/ Test FAILed. ---

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17724 **[Test build #76048 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76048/testReport)** for PR 17724 at commit

[GitHub] spark pull request #17697: [SPARK-20414][MLLIB] avoid creating only 16 reduc...

2017-04-21 Thread yangyangyyy
Github user yangyangyyy commented on a diff in the pull request: https://github.com/apache/spark/pull/17697#discussion_r112783447 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/rdd/MLPairRDDFunctions.scala --- @@ -39,8 +39,8 @@ class MLPairRDDFunctions[K: ClassTag, V:

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17724 **[Test build #76048 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76048/testReport)** for PR 17724 at commit

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-21 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/17724 cc @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #17724: [SPARK-18127] Add hooks and extension points to S...

2017-04-21 Thread sameeragarwal
GitHub user sameeragarwal opened a pull request: https://github.com/apache/spark/pull/17724 [SPARK-18127] Add hooks and extension points to Spark ## What changes were proposed in this pull request? This patch adds support for customizing the spark session by injecting

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17723 **[Test build #76047 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76047/testReport)** for PR 17723 at commit

[GitHub] spark issue #17693: [SPARK-16548][SQL] Inconsistent error handling in JSON p...

2017-04-21 Thread ewasserman
Github user ewasserman commented on the issue: https://github.com/apache/spark/pull/17693 Reverted from use of toString on the org.apache.spark.unsafe.types.UTF8String by running the byte array through a java.io.Reader. This still fixes the bug and is also more efficient on the JSON

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17723 **[Test build #76046 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76046/testReport)** for PR 17723 at commit

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17723 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17723 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76046/ Test FAILed. ---

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17723 **[Test build #76046 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76046/testReport)** for PR 17723 at commit

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17723 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17723 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76045/ Test FAILed. ---

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17723 **[Test build #76045 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76045/testReport)** for PR 17723 at commit

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17723 **[Test build #76045 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76045/testReport)** for PR 17723 at commit

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17723 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17723 **[Test build #76044 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76044/testReport)** for PR 17723 at commit

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17723 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76044/ Test FAILed. ---

[GitHub] spark issue #17723: [SPARK-20434] Move kerberos delegation token code from y...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17723 **[Test build #76044 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76044/testReport)** for PR 17723 at commit

[GitHub] spark pull request #17723: [SPARK-20434] Move kerberos delegation token code...

2017-04-21 Thread mgummelt
GitHub user mgummelt opened a pull request: https://github.com/apache/spark/pull/17723 [SPARK-20434] Move kerberos delegation token code from yarn to core ## What changes were proposed in this pull request? Move kerberos delegation token code from yarn to core, so that

[GitHub] spark issue #17648: [SPARK-19851] Add support for EVERY and ANY (SOME) aggre...

2017-04-21 Thread ptkool
Github user ptkool commented on the issue: https://github.com/apache/spark/pull/17648 @rxin I'm not sure where you're going with your proposal. These are aggregate functions, not scalar functions. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #17688: [MINOR][DOCS][PYTHON] Adding missing boolean type for re...

2017-04-21 Thread vundela
Github user vundela commented on the issue: https://github.com/apache/spark/pull/17688 @holdenk Thanks for the review. Can you please let me know the line number where you are expecting list of types missing. Is this for fillna or other API? --- If your project is set up for it, you

[GitHub] spark issue #17683: [SPARK-20386][Spark Core]modify the log info if the bloc...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17683 **[Test build #3672 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3672/testReport)** for PR 17683 at commit

[GitHub] spark issue #17688: [MINOR][DOCS][PYTHON] Adding missing boolean type for re...

2017-04-21 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17688 We should also update the list of types a few lines up while we are fixing this. thanks a lot for catching this @vundela --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #17694: [SPARK-12717][PYSPARK] Resolving race condition with pys...

2017-04-21 Thread vundela
Github user vundela commented on the issue: https://github.com/apache/spark/pull/17694 Filed a PR for fixing the issue in spark1.6 branch. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-21 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112764788 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala --- @@ -147,6 +153,17 @@ class

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-21 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112764350 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala --- @@ -112,7 +116,8 @@ class

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-21 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112765111 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala --- @@ -17,21 +17,24 @@ package

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-21 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112765206 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala --- @@ -17,21 +17,24 @@ package

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-21 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112766374 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala --- @@ -147,6 +153,17 @@ class

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-21 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112766633 --- Diff: external/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDDSuite.scala --- @@ -101,6 +101,37 @@ abstract class

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-21 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112764808 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala --- @@ -147,6 +153,17 @@ class

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-21 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112764344 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala --- @@ -83,7 +86,8 @@ class

[GitHub] spark issue #17713: [SPARK-20417][SQL] Move subquery error handling to check...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17713 **[Test build #76043 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76043/testReport)** for PR 17713 at commit

[GitHub] spark issue #17672: [SPARK-20371][R] Add wrappers for collect_list and colle...

2017-04-21 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17672 Thanks @felixcheung --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17688: [MINOR][DOCS][PYTHON] Adding missing boolean type for re...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17688 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76042/ Test PASSed. ---

[GitHub] spark issue #17688: [MINOR][DOCS][PYTHON] Adding missing boolean type for re...

2017-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17688 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17688: [MINOR][DOCS][PYTHON] Adding missing boolean type for re...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17688 **[Test build #76042 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76042/testReport)** for PR 17688 at commit

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-04-21 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15125 @dding3 @mallman one last thing to consider, with this PR we are having `spark.graphx.pregel.checkpointInterval` defaulting to 10. This changes the existing behavior (where

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-04-21 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15125 thanks @mallman I'll digest this and see what improvements we could make in gf. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request #17697: [SPARK-20414][MLLIB] avoid creating only 16 reduc...

2017-04-21 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17697#discussion_r112758437 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/rdd/MLPairRDDFunctions.scala --- @@ -39,8 +39,8 @@ class MLPairRDDFunctions[K: ClassTag, V:

[GitHub] spark issue #17688: [MINOR][DOCS][PYTHON] Adding missing boolean type for re...

2017-04-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17688 **[Test build #76042 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76042/testReport)** for PR 17688 at commit

[GitHub] spark pull request #17696: [SPARK-20401][DOC]In the spark official configura...

2017-04-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17696 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17672: [SPARK-20371][R] Add wrappers for collect_list an...

2017-04-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17672 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

  1   2   3   4   >