[GitHub] spark pull request: [SPARK-10934][SQL] handle hashCode of unsafe a...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8987#issuecomment-145689808 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10934][SQL] handle hashCode of unsafe a...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8987#issuecomment-145689839 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10916] Set perm gen size when launching...

2015-10-05 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/8970#issuecomment-145689866 LGTM too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-05 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/8983#issuecomment-145689983 if you change the `value` type to boolean, then we have to change each element in `list` to boolean type too, which maybe dangerous as a lot of types can't be casted t

[GitHub] spark pull request: [SPARK-10934][SQL] handle hashCode of unsafe a...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8987#issuecomment-145690282 [Test build #43256 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43256/consoleFull) for PR 8987 at commit [`99c62b6`](https://gith

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8971#issuecomment-145690634 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8971#issuecomment-145690608 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8971#issuecomment-145691725 [Test build #43257 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43257/consoleFull) for PR 8971 at commit [`3b9f59e`](https://gith

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-05 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/8988 [SPARK-8848] [SQL] Refactors Parquet write path to follow parquet-format This PR refactors Parquet write path to follow parquet-format spec. It's a successor of PR #7679, but with less non-essent

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-145692337 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-145692361 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10648] Proposed bug fix when oracle ret...

2015-10-05 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/8780#issuecomment-145693030 @travishegner looks like it is best to just do it in the oracle dialect. --- If your project is set up for it, you can reply to this email and have your reply appear on Gi

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-145693262 [Test build #43258 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43258/consoleFull) for PR 8988 at commit [`d1583f8`](https://gith

[GitHub] spark pull request: [SPARK-10932] [PROJECT INFRA] Port two minor c...

2015-10-05 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8986#issuecomment-145695189 Can we add some code here to check the return code of `make_binary_release` ? i.e. we could fail the entire release if one of the binary releases fail ? --- If your

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-10-05 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-145695707 Jenkins, add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-05 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8985#issuecomment-145695755 Jenkins, add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-05 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8985#issuecomment-145695768 Jenkins, ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-10-05 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-145695744 Jenkins, ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-145695956 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-145695972 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8985#issuecomment-145695950 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8985#issuecomment-145695973 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8985#issuecomment-145696273 [Test build #43259 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43259/consoleFull) for PR 8985 at commit [`0aa94a2`](https://gith

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-145696374 [Test build #43260 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43260/consoleFull) for PR 8984 at commit [`b44152e`](https://gith

[GitHub] spark pull request: [SPARK-10938] [SQL] remove typeId in columnar ...

2015-10-05 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/8989#issuecomment-145696568 cc @liancheng @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-10938] [SQL] remove typeId in columnar ...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8989#issuecomment-145696599 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10938] [SQL] remove typeId in columnar ...

2015-10-05 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/8989 [SPARK-10938] [SQL] remove typeId in columnar cache This PR remove the typeId in columnar cache, it's not needed anymore, it also remove DATE and TIMESTAMP (use INT/LONG instead). You can merge this

[GitHub] spark pull request: [SPARK-10938] [SQL] remove typeId in columnar ...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8989#issuecomment-145696629 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-05 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/8983#issuecomment-145696762 Thanks Wenchen. You are right that not all types can be casted to boolean. However, in this case, we are not trying to cast the in list types to the LHS typ

[GitHub] spark pull request: [SPARK-10938] [SQL] remove typeId in columnar ...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8989#issuecomment-145696942 [Test build #43261 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43261/consoleFull) for PR 8989 at commit [`e74d7fd`](https://gith

[GitHub] spark pull request: [SPARK-10932] [PROJECT INFRA] Port two minor c...

2015-10-05 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8986#issuecomment-145697359 @shivaram, good idea. Note, however, that the build that was used to publish the 0.5.1 binary releases _did_ actually fail in Jenkins. Aside from adding additi

[GitHub] spark pull request: [SPARK-10666][SPARK-6880][CORE] Use properties...

2015-10-05 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/6291#discussion_r41210828 --- Diff: core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala --- @@ -1256,6 +1259,136 @@ class DAGSchedulerSuite assertData

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-145698830 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-145698757 [Test build #43260 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43260/console) for PR 8984 at commit [`b44152e`](https://github.

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-145698829 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/8990 [SPARK-10337][SQL] fix hive views on non-hive-compatible tables. add a new config to deal with this special case. You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-145698931 cc @yhuai @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-145699371 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-145699358 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-145699504 [Test build #43262 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43262/consoleFull) for PR 8990 at commit [`c427159`](https://gith

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-145699560 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-145699557 [Test build #43262 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43262/console) for PR 8990 at commit [`c427159`](https://github.

[GitHub] spark pull request: [SPARK-10855] [SQL] Add a JDBC dialect for Apa...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8982#issuecomment-145699684 [Test build #43250 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43250/console) for PR 8982 at commit [`11fdb04`](https://github.

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-145699559 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10855] [SQL] Add a JDBC dialect for Apa...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8982#issuecomment-145699761 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10855] [SQL] Add a JDBC dialect for Apa...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8982#issuecomment-145699758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10938] [SQL] remove typeId in columnar ...

2015-10-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/8989#discussion_r41212131 --- Diff: project/MimaExcludes.scala --- @@ -42,7 +42,9 @@ object MimaExcludes { excludePackage("org.spark-project.jetty"), MimaBuild.ex

[GitHub] spark pull request: [SPARK-10841][SQL] Add pushdown support of UDF...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8922#issuecomment-145699987 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10841][SQL] Add pushdown support of UDF...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8922#issuecomment-14565 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8983#discussion_r41212281 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala --- @@ -305,12 +305,17 @@ object HiveTypeCoercion {

[GitHub] spark pull request: [SPARK-1267][PYSPARK] Adds pip installer for p...

2015-10-05 Thread alope107
Github user alope107 commented on a diff in the pull request: https://github.com/apache/spark/pull/8318#discussion_r41212537 --- Diff: python/setup.py --- @@ -0,0 +1,18 @@ +#!/usr/bin/env python + +from setuptools import setup + +exec(compile(open("pyspark/pyspar

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-145700624 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-145700612 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10841][SQL] Add pushdown support of UDF...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8922#issuecomment-145700872 [Test build #43263 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43263/consoleFull) for PR 8922 at commit [`89fe512`](https://gith

[GitHub] spark pull request: [SPARK-1267][PYSPARK] Adds pip installer for p...

2015-10-05 Thread alope107
Github user alope107 commented on a diff in the pull request: https://github.com/apache/spark/pull/8318#discussion_r41212659 --- Diff: python/pyspark/__init__.py --- @@ -36,6 +36,31 @@ Finer-grained cache persistence levels. """ +import os +import sys

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-145700870 [Test build #43264 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43264/consoleFull) for PR 8990 at commit [`0e7e3e0`](https://gith

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8971#issuecomment-145701518 [Test build #43253 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43253/console) for PR 8971 at commit [`3ad1e9c`](https://github.

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8971#issuecomment-145701555 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8971#issuecomment-145701554 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-1267][PYSPARK] Adds pip installer for p...

2015-10-05 Thread alope107
Github user alope107 commented on a diff in the pull request: https://github.com/apache/spark/pull/8318#discussion_r41213092 --- Diff: python/pyspark/pyspark_version.py --- @@ -0,0 +1,17 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contr

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-05 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8988#discussion_r41214391 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/CatalystSchemaConverter.scala --- @@ -553,16 +557,8 @@ private[parquet

[GitHub] spark pull request: [SPARK-10934][SQL] handle hashCode of unsafe a...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8987#issuecomment-145705208 [Test build #1844 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1844/console) for PR 8987 at commit [`99c62b6`](https://github

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145706494 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145706396 [Test build #43251 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43251/console) for PR 8959 at commit [`ac3ffcf`](https://github.

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145706493 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10932] [PROJECT INFRA] Port two minor c...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8986#issuecomment-145707821 [Test build #43248 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43248/console) for PR 8986 at commit [`fa19e44`](https://github.

[GitHub] spark pull request: [SPARK-10934][SQL] handle hashCode of unsafe a...

2015-10-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8987 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-10934][SQL] handle hashCode of unsafe a...

2015-10-05 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/8987#issuecomment-145707957 Merged into master and branch-1.5, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10932] [PROJECT INFRA] Port two minor c...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8986#issuecomment-145708102 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10932] [PROJECT INFRA] Port two minor c...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8986#issuecomment-145708104 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10934][SQL] handle hashCode of unsafe a...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8987#issuecomment-145709251 [Test build #43256 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43256/console) for PR 8987 at commit [`99c62b6`](https://github.

[GitHub] spark pull request: [SPARK-10934][SQL] handle hashCode of unsafe a...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8987#issuecomment-145709331 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10934][SQL] handle hashCode of unsafe a...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8987#issuecomment-145709330 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10938] [SQL] remove typeId in columnar ...

2015-10-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/8989#discussion_r41215725 --- Diff: project/MimaExcludes.scala --- @@ -42,7 +42,9 @@ object MimaExcludes { excludePackage("org.spark-project.jetty"), MimaBuild.

[GitHub] spark pull request: [SPARK-10938] [SQL] remove typeId in columnar ...

2015-10-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/8989#discussion_r41215823 --- Diff: project/MimaExcludes.scala --- @@ -42,7 +42,9 @@ object MimaExcludes { excludePackage("org.spark-project.jetty"), MimaBuild.

[GitHub] spark pull request: [SPARK-10585][SQL][follow-up] remove no-longer...

2015-10-05 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/8991 [SPARK-10585][SQL][follow-up] remove no-longer-necessary code for unsafe generation These code was left there to produce clear diff for https://github.com/apache/spark/pull/8747 You can merge th

[GitHub] spark pull request: [SPARK-10585][SQL][follow-up] remove no-longer...

2015-10-05 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/8991#issuecomment-145709982 cc @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-10585][SQL][follow-up] remove no-longer...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8991#issuecomment-145710228 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10585][SQL][follow-up] remove no-longer...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8991#issuecomment-145710265 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10585][SQL][follow-up] remove no-longer...

2015-10-05 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/8991#issuecomment-145710261 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-05 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/8983#issuecomment-145711558 Hi Wenchen, Here is the link i could find where its a bit confusing on the equality operator. https://cwiki.apache.org/confluence/display/Hive/Lang

[GitHub] spark pull request: [SPARK-10585][SQL][follow-up] remove no-longer...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8991#issuecomment-145711403 [Test build #43265 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43265/consoleFull) for PR 8991 at commit [`d973701`](https://gith

[GitHub] spark pull request: [SPARK-10938] [SQL] remove typeId in columnar ...

2015-10-05 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/8989#issuecomment-145711979 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-05 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/8983#issuecomment-145712756 can you try `select null in (1,2,null)`? I wanna make sure hive doesn't execute the `In` operation when `value` is null type. --- If your project is set up for it, yo

[GitHub] spark pull request: Use json4s 3.3.0. DefaultFormats is now serial...

2015-10-05 Thread tylerprete
GitHub user tylerprete opened a pull request: https://github.com/apache/spark/pull/8992 Use json4s 3.3.0. DefaultFormats is now serializable. Having serializable Formats makes json4s much nicer to work with in Spark. This seems like a worthwhile upgrade, especially since it's

[GitHub] spark pull request: Use json4s 3.3.0. DefaultFormats is now serial...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8992#issuecomment-145713116 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-05 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/8983#issuecomment-145713214 hive> select null in (1,2,null) from tnull; OK NULL NULL NULL Time taken: 0.139 seconds, Fetched: 3 row(s) --- If your project is set up for it

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-145713344 [Test build #43258 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43258/console) for PR 8988 at commit [`d1583f8`](https://github.

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-145713434 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-145713432 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10885][Streaming]Display the failed out...

2015-10-05 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/8950#discussion_r41217146 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/BatchPage.scala --- @@ -265,16 +323,20 @@ private[ui] class BatchPage(parent: StreamingTab)

[GitHub] spark pull request: [SPARK-10934][SQL] handle hashCode of unsafe a...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8987#issuecomment-145713975 [Test build #43254 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43254/console) for PR 8987 at commit [`540b3c0`](https://github.

[GitHub] spark pull request: [SPARK-10934][SQL] handle hashCode of unsafe a...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8987#issuecomment-145714195 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10934][SQL] handle hashCode of unsafe a...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8987#issuecomment-145714198 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10900][Streaming]Add output operation e...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8958#issuecomment-145717661 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10900][Streaming]Add output operation e...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8958#issuecomment-145717651 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10900][Streaming]Add output operation e...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8958#issuecomment-145717879 [Test build #43266 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43266/consoleFull) for PR 8958 at commit [`320fb33`](https://gith

[GitHub] spark pull request: [SPARK-10841][SQL] Add pushdown support of UDF...

2015-10-05 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/8922#issuecomment-145717868 Hmm, because the sql query and data schema is sensitive for company business, I may not be able to post publicly here. The data size is hundreds GB to 1TB, and the sql qu

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-05 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/8983#issuecomment-145718166 btw you can send another PR to add a rule in `Optimizer` so that if `value` is literal null, we can just return null. --- If your project is set up for it, you can re

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-05 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/8983#issuecomment-145717934 I checked our [implementation](https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala#L126-L

<    1   2   3   4   >