Github user bolkedebruin commented on the pull request:
https://github.com/apache/spark/pull/4064#issuecomment-113956052
To make it a bit more specific: the latest spark does not support secure
hive 0.14 yet. I tried the patch but this fails when using a yarn cluster
(spark-shell --ma
Github user bolkedebruin commented on the pull request:
https://github.com/apache/spark/pull/4064#issuecomment-113505275
@zhzhan @WangTaoTheTonic I just cloned the latest and this issue still
seems to exist. This is on Hadoop 2.6 from HDP 2.2 and Hive 0.14 + Kerberos
---
If your pro
Github user zhzhan commented on the pull request:
https://github.com/apache/spark/pull/4064#issuecomment-112875139
@WangTaoTheTonic The problem happens with spark-1.3 and hadoop-2.6 in
kerberos cluster. With hive-0.14 support, I suppose the problem may be gone,
but I didn't verify it
Github user zhzhan closed the pull request at:
https://github.com/apache/spark/pull/4064
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enab
Github user WangTaoTheTonic commented on the pull request:
https://github.com/apache/spark/pull/4064#issuecomment-112679214
@zhzhan Hey Could you describe the error and your configurations in detail
please? As we now use Hive 13 + Hadoop 2.7 in our product and never ran into
this.
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4064#issuecomment-87847743
[Test build #29420 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29420/consoleFull)
for PR 4064 at commit
[`77871ca`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/4064#issuecomment-8784
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4064#issuecomment-87817047
[Test build #29420 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29420/consoleFull)
for PR 4064 at commit
[`77871ca`](https://githu
Github user zhzhan commented on the pull request:
https://github.com/apache/spark/pull/4064#issuecomment-87141038
@liancheng By the way, if you think it can be merged to upstream, please
let me know. Because SparkSQLCLIDriver also need to replace the method to make
it work.
Github user zhzhan commented on the pull request:
https://github.com/apache/spark/pull/4064#issuecomment-87139435
@liancheng This is to port HIVE-7620 into spark to solve hadoop
incompatibility issue. It will replace the getHadoopSaslProperties in
org.apache.hadoop.hive.thrift.Hadoop
Github user liancheng commented on the pull request:
https://github.com/apache/spark/pull/4064#issuecomment-86889339
@zhzhan Would you mind to give a summary of the code added in this PR? I
feel kinda hesitant to have this... Mostly because Spark doesn't explicitly
support Hadoop 2.5.
Github user zhzhan commented on the pull request:
https://github.com/apache/spark/pull/4064#issuecomment-70897525
@marmbrus Can you take a look at this and let you know if you have any
concern?
---
If your project is set up for it, you can reply to this email and have your
reply appe
GitHub user zhzhan opened a pull request:
https://github.com/apache/spark/pull/4064
[Spark-5111][SQL]HiveContext and Thriftserver cannot work in secure cluster
beyond hadoop2.5
Hive0.13 cannot work with secure cluster in hadoop-2.5 and beyound. Due to
"java.lang.NoSuchFieldError: S
13 matches
Mail list logo
