[GitHub] spark issue #17581: [SPARK-20248][ SQL]Spark SQL add limit parameter to enha...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17581 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75819/ Test PASSed. ---

[GitHub] spark issue #17581: [SPARK-20248][ SQL]Spark SQL add limit parameter to enha...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17581 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17581: [SPARK-20248][ SQL]Spark SQL add limit parameter to enha...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17581 **[Test build #75819 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75819/testReport)** for PR 17581 at commit

[GitHub] spark issue #17630: [SPARK-20318][SQL] Use Catalyst type for min/max in Colu...

2017-04-14 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/17630 > are we storing UTF8Strings directly in the catalog for statistics? That doesn't make sense ... if we are not, then we are not using internal types. @rxin By "in the catalog for statistics",

[GitHub] spark issue #17623: [SPARK-20292][SQL] Clean up string representation of Tre...

2017-04-14 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17623 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17623 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75818/ Test PASSed. ---

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17623 **[Test build #75818 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75818/testReport)** for PR 17623 at commit

[GitHub] spark issue #17642: [SPARK-20343][BUILD] Force Avro 1.7.7 in sbt build to re...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17642 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75817/ Test FAILed. ---

[GitHub] spark issue #17642: [SPARK-20343][BUILD] Force Avro 1.7.7 in sbt build to re...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17642 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17642: [SPARK-20343][BUILD] Force Avro 1.7.7 in sbt build to re...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17642 **[Test build #75817 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75817/testReport)** for PR 17642 at commit

[GitHub] spark issue #17556: [SPARK-16957][MLlib] Use weighted midpoints for split va...

2017-04-14 Thread facaiy
Github user facaiy commented on the issue: https://github.com/apache/spark/pull/17556 @sethah Perhaps it's hard to compare R with Spark's behavior, since many factors involved. I'd like to read R GBM's code, and verify consistency of both side's design on split criteria. Is it OK?

[GitHub] spark pull request #17556: [SPARK-16957][MLlib] Use weighted midpoints for s...

2017-04-14 Thread facaiy
Github user facaiy commented on a diff in the pull request: https://github.com/apache/spark/pull/17556#discussion_r111656245 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -104,6 +104,18 @@ class RandomForestSuite extends SparkFunSuite

[GitHub] spark pull request #17556: [SPARK-16957][MLlib] Use weighted midpoints for s...

2017-04-14 Thread facaiy
Github user facaiy commented on a diff in the pull request: https://github.com/apache/spark/pull/17556#discussion_r111656240 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -126,9 +138,10 @@ class RandomForestSuite extends SparkFunSuite

[GitHub] spark pull request #17556: [SPARK-16957][MLlib] Use weighted midpoints for s...

2017-04-14 Thread facaiy
Github user facaiy commented on a diff in the pull request: https://github.com/apache/spark/pull/17556#discussion_r111656235 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -112,9 +124,9 @@ class RandomForestSuite extends SparkFunSuite

[GitHub] spark pull request #17637: [SPARK-20337][CORE] Support upgrade a jar depende...

2017-04-14 Thread wangyum
Github user wangyum closed the pull request at: https://github.com/apache/spark/pull/17637 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17581: [SPARK-20248][ SQL]Spark SQL add limit parameter to enha...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17581 **[Test build #75819 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75819/testReport)** for PR 17581 at commit

[GitHub] spark pull request #17642: [SPARK-20343][BUILD] Force Avro 1.7.7 in sbt buil...

2017-04-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17642#discussion_r111654148 --- Diff: project/SparkBuild.scala --- @@ -448,7 +448,9 @@ object DockerIntegrationTests { */ object DependencyOverrides { lazy val

[GitHub] spark issue #17642: [SPARK-20343][BUILD] Force Avro 1.7.7 in sbt build to re...

2017-04-14 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17642 cc @srowen and @vanzin. I think apparently it is a similar issue with [SPARK-11538](https://issues.apache.org/jira/browse/SPARK-11538). Could you check if it makes sense? I think this

[GitHub] spark pull request #17642: [SPARK-20343][BUILD] Force Avro 1.7.7 in sbt buil...

2017-04-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17642#discussion_r111653875 --- Diff: project/SparkBuild.scala --- @@ -448,7 +448,9 @@ object DockerIntegrationTests { */ object DependencyOverrides { lazy val

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17623 **[Test build #75818 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75818/testReport)** for PR 17623 at commit

[GitHub] spark issue #17642: [SPARK-20343][BUILD] Force Avro 1.7.7 in sbt build to re...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17642 **[Test build #75817 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75817/testReport)** for PR 17642 at commit

[GitHub] spark pull request #17642: [SPARK-20343][BUILD] Force Avro 1.7.7 in sbt buil...

2017-04-14 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/17642 [SPARK-20343][BUILD] Force Avro 1.7.7 in sbt build to resolve build failure in SBT Hadoop 2.6 master on Jenkins ## What changes were proposed in this pull request? Currently, the

[GitHub] spark pull request #17596: [SPARK-12837][CORE] Do not send the accumulator n...

2017-04-14 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17596#discussion_r111653739 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilterSuite.scala --- @@ -537,3 +539,27 @@ class

[GitHub] spark issue #17149: [SPARK-19257][SQL]location for table/partition/database ...

2017-04-14 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17149 @cnauroth Thank you so much for your help. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17149: [SPARK-19257][SQL]location for table/partition/database ...

2017-04-14 Thread cnauroth
Github user cnauroth commented on the issue: https://github.com/apache/spark/pull/17149 @HyukjinKwon , nice to meet you! I see I got notified here for a bit of Hadoop `Path` knowledge, and particularly on Windows. > Is it okay to use both URIs and local file paths for the

[GitHub] spark issue #17416: [SPARK-20075][CORE][WIP] Support classifier, packaging i...

2017-04-14 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/17416 @srowen , I finally had some time to look into this and I was able to get the correct jar on the classpath. The fix was to use the code you had in the previous commit for

[GitHub] spark issue #17506: [SPARK-20189][DStream] Fix spark kinesis testcases to re...

2017-04-14 Thread yssharma
Github user yssharma commented on the issue: https://github.com/apache/spark/pull/17506 Thanks @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #17641: [SPARK-20329][SQL] Make timezone aware expression withou...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17641 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17641: [SPARK-20329][SQL] Make timezone aware expression withou...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17641 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75816/ Test FAILed. ---

[GitHub] spark issue #17641: [SPARK-20329][SQL] Make timezone aware expression withou...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17641 **[Test build #75816 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75816/testReport)** for PR 17641 at commit

[GitHub] spark issue #17640: [SPARK-17608][SPARKR]:Long type has incorrect serializat...

2017-04-14 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/17640 cc @felixcheung --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17640: [SPARK-17608][SPARKR]:Long type has incorrect serializat...

2017-04-14 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/17640 I will some bound check and error handling. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17640: [SPARK-17608][SPARKR]:Long type has incorrect serializat...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17640 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17640: [SPARK-17608][SPARKR]:Long type has incorrect serializat...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17640 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75815/ Test PASSed. ---

[GitHub] spark issue #17640: [SPARK-17608][SPARKR]:Long type has incorrect serializat...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17640 **[Test build #75815 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75815/testReport)** for PR 17640 at commit

[GitHub] spark issue #17582: [SPARK-20239][Core] Improve HistoryServer's ACL mechanis...

2017-04-14 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/17582 Been following this but haven't had time to do a proper review, but @tgravescs since you brought up the UI vs API thing, as of 2.0 the UI gets it's list from the API so that's where the security

[GitHub] spark issue #17641: [SPARK-20329][SQL] Make timezone aware expression withou...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17641 **[Test build #75816 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75816/testReport)** for PR 17641 at commit

[GitHub] spark pull request #17641: [SPARK-20329][SQL] Make timezone aware expression...

2017-04-14 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/17641 [SPARK-20329][SQL] Make timezone aware expression without timezone unresolved. ## What changes were proposed in this pull request? TBD ## How was this patch tested? TBD You

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-14 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/17540 @cloud-fan, could you have another look at this? There are a few new changes: * withNewExecutionId now warns instead of throwing an exception, but still throws exceptions if

[GitHub] spark issue #17568: [SPARK-20254][SQL] Remove unnecessary data conversion fo...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17568 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75814/ Test FAILed. ---

[GitHub] spark issue #17568: [SPARK-20254][SQL] Remove unnecessary data conversion fo...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17568 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17568: [SPARK-20254][SQL] Remove unnecessary data conversion fo...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17568 **[Test build #75814 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75814/testReport)** for PR 17568 at commit

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-04-14 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/17087 @marmbrus could you please take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17640: [SPARK-17608][SPARKR]:Long type has incorrect serializat...

2017-04-14 Thread frreiss
Github user frreiss commented on the issue: https://github.com/apache/spark/pull/17640 Overall, this looks like a sensible approach to a messy problem. You might want to think about adding some overflow handling to the SQL-->R translation. That is, if a Dataframe contains a

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17540 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75813/ Test FAILed. ---

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17540 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17540 **[Test build #75813 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75813/testReport)** for PR 17540 at commit

[GitHub] spark pull request #17568: [SPARK-20254][SQL] Remove unnecessary data conver...

2017-04-14 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/17568#discussion_r111614833 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetPrimitiveSuite.scala --- @@ -253,4 +256,27 @@ class DatasetPrimitiveSuite extends QueryTest

[GitHub] spark pull request #17568: [SPARK-20254][SQL] Remove unnecessary data conver...

2017-04-14 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/17568#discussion_r111614744 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/objects.scala --- @@ -96,3 +99,32 @@ object CombineTypedFilters extends

[GitHub] spark pull request #17568: [SPARK-20254][SQL] Remove unnecessary data conver...

2017-04-14 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/17568#discussion_r111614710 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala --- @@ -368,6 +369,8 @@ case class NullPropagation(conf:

[GitHub] spark issue #17530: [SPARK-5158] Access kerberized HDFS from Spark standalon...

2017-04-14 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/17530 > Right now the PR doesn't set that, so it needs to be set under the user's HADOOP_CONF even though it had no real effect. That probably should be changed. Yep, same problem I'm seeing.

[GitHub] spark issue #17621: [SPARK-6227][MLLIB][PYSPARK] Implement PySpark wrappers ...

2017-04-14 Thread MechCoder
Github user MechCoder commented on the issue: https://github.com/apache/spark/pull/17621 Thanks @MLnick ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17640: [SPARK-17608][SPARKR]:Long type has incorrect serializat...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17640 **[Test build #75815 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75815/testReport)** for PR 17640 at commit

[GitHub] spark pull request #17640: [SPARK-17608][SPARKR]:Long type has incorrect ser...

2017-04-14 Thread wangmiao1981
GitHub user wangmiao1981 opened a pull request: https://github.com/apache/spark/pull/17640 [SPARK-17608][SPARKR]:Long type has incorrect serialization/deserialization ## What changes were proposed in this pull request? `bigint` is not supported in schema and the serialization is

[GitHub] spark issue #17568: [SPARK-20254][SQL] Remove unnecessary data conversion fo...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17568 **[Test build #75814 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75814/testReport)** for PR 17568 at commit

[GitHub] spark issue #17630: [SPARK-20318][SQL] Use Catalyst type for min/max in Colu...

2017-04-14 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17630 Wait - are we storing UTF8Strings directly in the catalog for statistics? That doesn't make sense ... if we are not, then we are not using internal types. In that case we should document clearly

[GitHub] spark issue #17633: [SPARK-20331][SQL] Enhanced Hive partition pruning predi...

2017-04-14 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17633 Then it should work. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17623 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75811/ Test PASSed. ---

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17623 **[Test build #75811 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75811/testReport)** for PR 17623 at commit

[GitHub] spark issue #17637: [SPARK-20337][CORE] Support upgrade a jar dependency and...

2017-04-14 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17637 This does not work. Any classes that have already been loaded from the old jar will not be unloaded. So you're going to end up with really odd issues when two classes from different jars don't agree

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17623 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75810/ Test PASSed. ---

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17623 **[Test build #75810 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75810/testReport)** for PR 17623 at commit

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17540 **[Test build #75813 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75813/testReport)** for PR 17540 at commit

[GitHub] spark issue #13440: [SPARK-15699] [ML] Implement a Chi-Squared test statisti...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13440 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75812/ Test FAILed. ---

[GitHub] spark issue #13440: [SPARK-15699] [ML] Implement a Chi-Squared test statisti...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13440 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13440: [SPARK-15699] [ML] Implement a Chi-Squared test statisti...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13440 **[Test build #75812 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75812/testReport)** for PR 13440 at commit

[GitHub] spark issue #13440: [SPARK-15699] [ML] Implement a Chi-Squared test statisti...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13440 **[Test build #75812 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75812/testReport)** for PR 13440 at commit

[GitHub] spark issue #17633: [SPARK-20331][SQL] Enhanced Hive partition pruning predi...

2017-04-14 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/17633 > Does this work for non-Hive tables? This is geared towards Hive partitioned tables. If we have another system that prunes table partitions based on a string-ified pruning predicate I'm

[GitHub] spark issue #13440: [SPARK-15699] [ML] Implement a Chi-Squared test statisti...

2017-04-14 Thread erikerlandson
Github user erikerlandson commented on the issue: https://github.com/apache/spark/pull/13440 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17639: [SPARK-19716][SQL][follow-up] UnresolvedMapObjects shoul...

2017-04-14 Thread koertkuipers
Github user koertkuipers commented on the issue: https://github.com/apache/spark/pull/17639 @cloud-fan thanks for doing this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17639: [SPARK-19716][SQL][follow-up] UnresolvedMapObjects shoul...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17639 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17639: [SPARK-19716][SQL][follow-up] UnresolvedMapObjects shoul...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17639 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75809/ Test PASSed. ---

[GitHub] spark issue #17639: [SPARK-19716][SQL][follow-up] UnresolvedMapObjects shoul...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17639 **[Test build #75809 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75809/testReport)** for PR 17639 at commit

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17623 **[Test build #75811 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75811/testReport)** for PR 17623 at commit

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17623 **[Test build #75810 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75810/testReport)** for PR 17623 at commit

[GitHub] spark issue #17582: [SPARK-20239][Core] Improve HistoryServer's ACL mechanis...

2017-04-14 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/17582 Sorry again the wording above and all the different configs are a bit confusing to me as to what the real issues are here. >Here actually has two list of acls, one is controlled by

[GitHub] spark issue #17592: [SPARK-20243][TESTS] DebugFilesystem.assertNoOpenStreams...

2017-04-14 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/17592 I cherry picked this into branch-2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17623 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75808/ Test FAILed. ---

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17623 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17623 **[Test build #75808 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75808/testReport)** for PR 17623 at commit

[GitHub] spark issue #17639: [SPARK-19716][SQL][follow-up] UnresolvedMapObjects shoul...

2017-04-14 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17639 cc @koertkuipers --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17639: [SPARK-19716][SQL][follow-up] UnresolvedMapObjects shoul...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17639 **[Test build #75809 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75809/testReport)** for PR 17639 at commit

[GitHub] spark pull request #17639: [SPARK-19716][SQL][follow-up] UnresolvedMapObject...

2017-04-14 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/17639 [SPARK-19716][SQL][follow-up] UnresolvedMapObjects should always be serializable ## What changes were proposed in this pull request? In https://github.com/apache/spark/pull/17398 we

[GitHub] spark issue #17637: [SPARK-20337][CORE] Support upgrade a jar dependency and...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17637 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17637: [SPARK-20337][CORE] Support upgrade a jar dependency and...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17637 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75806/ Test PASSed. ---

[GitHub] spark issue #17637: [SPARK-20337][CORE] Support upgrade a jar dependency and...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17637 **[Test build #75806 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75806/testReport)** for PR 17637 at commit

[GitHub] spark issue #17568: [SPARK-20254][SQL] Remove unnecessary data conversion fo...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17568 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17568: [SPARK-20254][SQL] Remove unnecessary data conversion fo...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17568 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75807/ Test FAILed. ---

[GitHub] spark issue #17568: [SPARK-20254][SQL] Remove unnecessary data conversion fo...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17568 **[Test build #75807 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75807/testReport)** for PR 17568 at commit

[GitHub] spark issue #17533: [WIP][SPARK-20219] Schedule tasks based on size of input...

2017-04-14 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17533 I think the failed unit test can be fixed in https://github.com/apache/spark/pull/17634 and https://github.com/apache/spark/pull/17603 --- If your project is set up for it, you can reply to

[GitHub] spark issue #17636: [SPARK-20334][SQL] Return a better error message when co...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17636 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17636: [SPARK-20334][SQL] Return a better error message when co...

2017-04-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17636 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75805/ Test PASSed. ---

[GitHub] spark issue #17636: [SPARK-20334][SQL] Return a better error message when co...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17636 **[Test build #75805 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75805/testReport)** for PR 17636 at commit

[GitHub] spark issue #17374: [SPARK-19019][PYTHON][BRANCH-2.0] Fix hijacked `collecti...

2017-04-14 Thread jbloom22
Github user jbloom22 commented on the issue: https://github.com/apache/spark/pull/17374 Our users (https://hail.is) are running into this bug. Will the backport be merged soon? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #17364: [SPARK-20038] [SQL]: FileFormatWriter.ExecuteWriteTask.r...

2017-04-14 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/17364 thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #17623: [SPARK-20292][SQL][WIP] Clean up string representation o...

2017-04-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17623 **[Test build #75808 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75808/testReport)** for PR 17623 at commit

[GitHub] spark issue #17477: [SPARK-18692][BUILD][DOCS] Test Java 8 unidoc build on J...

2017-04-14 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17477 The build should use 1.7.7, yes. Hadoop pulls in 1.7.4, but, it does so in 2.6 and 2.7. And the SBT and Maven builds seem to get that right as intended because the POM directly overrides this

  1   2   3   >