[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914192#comment-16914192
]
Rahul Kulkarni commented on SPARK-18112:
Getting this issue on Spark 2.4.3 with Hive 2.3.3. Also
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863598#comment-16863598
]
HonglunChen commented on SPARK-18112:
-
[~dongjoon] Thank you, I get it.
> Spark2.x does not support
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862432#comment-16862432
]
Dongjoon Hyun commented on SPARK-18112:
---
[~honglun]. You should not replace Apache Spark jars in
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860734#comment-16860734
]
HonglunChen commented on SPARK-18112:
-
[~hyukjin.kwon] Thanks, I did not remove the 1.2.1 jars, and
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860711#comment-16860711
]
Hyukjin Kwon commented on SPARK-18112:
--
you should place 2.3.3 jars if you want do use 2.3.3.
>
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860605#comment-16860605
]
HonglunChen commented on SPARK-18112:
-
[~dongjoon],I replaced the hive-1.x
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860595#comment-16860595
]
Dongjoon Hyun commented on SPARK-18112:
---
What is your issue, [~honglun]? In this issue,
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860512#comment-16860512
]
HonglunChen commented on SPARK-18112:
-
Why do my issue still exist，I use the Spark-2.4.3 and
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631186#comment-16631186
]
Hyukjin Kwon commented on SPARK-18112:
--
To avoid Hive fork 1.2.1 in Spark itself at all, please
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631159#comment-16631159
]
Hyukjin Kwon commented on SPARK-18112:
--
{quote}
If I use that 1.2.1 fork I was getting some query
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630689#comment-16630689
]
Eugeniu commented on SPARK-18112:
-
_"The problem here looks, you guys completely replaced the jars into
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630543#comment-16630543
]
Hyukjin Kwon commented on SPARK-18112:
--
Also, take a look for the codes, open JIRAs and PRs before
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630542#comment-16630542
]
Hyukjin Kwon commented on SPARK-18112:
--
To be more specific, the code you guys pointed out is
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630485#comment-16630485
]
Hyukjin Kwon commented on SPARK-18112:
--
At that code you pointed out, Spark's Hive fork should be
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630487#comment-16630487
]
Hyukjin Kwon commented on SPARK-18112:
--
I asked questions because i'm pretty sure it's
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630472#comment-16630472
]
Tavis Barr commented on SPARK-18112:
Why are you even asking these questions? I have already
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630236#comment-16630236
]
Hyukjin Kwon commented on SPARK-18112:
--
Such things should be asked to mailing list really. It
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630233#comment-16630233
]
Hyukjin Kwon commented on SPARK-18112:
--
It uses Hive fork (1.2.1) jar at that point. When it
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630024#comment-16630024
]
Eugeniu commented on SPARK-18112:
-
Tried setting it to "maven" and then to "/usr/lib/hive/lib" from
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630002#comment-16630002
]
Hyukjin Kwon commented on SPARK-18112:
--
Have you provided the jars into
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629946#comment-16629946
]
Eugeniu commented on SPARK-18112:
-
RE:
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629749#comment-16629749
]
Hyukjin Kwon commented on SPARK-18112:
--
Hive 3 support. See
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629743#comment-16629743
]
Hyukjin Kwon commented on SPARK-18112:
--
Re:
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629742#comment-16629742
]
Hyukjin Kwon commented on SPARK-18112:
--
Hive 3 support is blocked by Hadoop 3 profile. See
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629420#comment-16629420
]
t oo commented on SPARK-18112:
--
here, here!
> Spark2.x does not support read data from Hive 2.x metastore
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629182#comment-16629182
]
Leo Gallucci commented on SPARK-18112:
--
And to get things worse Hive is already in version 3. Same
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629000#comment-16629000
]
Eugeniu commented on SPARK-18112:
-
I can only describe my situation. I am using AWS EMR 5.17.0 with
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628865#comment-16628865
]
Hyukjin Kwon commented on SPARK-18112:
--
Can you post reproducer steps please before we open this?
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628852#comment-16628852
]
Eugeniu commented on SPARK-18112:
-
This issue should be reopened.
As already commented by [~Tavis]
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605186#comment-16605186
]
Hyukjin Kwon commented on SPARK-18112:
--
We need the metastore jar if I understood correctly. FWIW,
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604391#comment-16604391
]
Sean Owen commented on SPARK-18112:
---
I don't know much about this part, but do we need Hive 2.x on the
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604176#comment-16604176
]
Hyukjin Kwon commented on SPARK-18112:
--
Can you post reproducer step by step? did you set
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604167#comment-16604167
]
t oo commented on SPARK-18112:
--
[~hyukjin.kwon] [~srowen] can this ticket be re-opened? This code is still
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589721#comment-16589721
]
Leo Gallucci commented on SPARK-18112:
--
Same issue. It only gets resolved if I remove
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448634#comment-16448634
]
Tavis Barr commented on SPARK-18112:
Sorry, following myself up... the next parameter,
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448587#comment-16448587
]
Tavis Barr commented on SPARK-18112:
It looks to me like this issue has actually not been fixed. As
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326303#comment-16326303
]
JP Moresmau commented on SPARK-18112:
-
I'm using Hive 2.3.2 and Spark 2.2.1, but I still run into
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904429#comment-15904429
]
Apache Spark commented on SPARK-18112:
--
User 'gatorsmile' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904362#comment-15904362
]
Xiao Li commented on SPARK-18112:
-
Let me resolve it for supporting Hive 2.1.0 metastore.
> Spark2.x
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15814474#comment-15814474
]
Hyukjin Kwon commented on SPARK-18112:
--
Could we resolve this as a duplicate of SPARK-13446?
>
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15621678#comment-15621678
]
Sean Owen commented on SPARK-18112:
---
Yes, this may be an instance where Hive 2 will have to shim to be
[
https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610286#comment-15610286
]
KaiXu commented on SPARK-18112:
---
Spark 2.0 removes JavaSparkListener and change SparkListener from a trait
42 matches
Mail list logo
