[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364627#comment-17364627
]
Hyukjin Kwon commented on SPARK-18673:
--
[~nssalian] please file a JIRA and go ahead for a PR.
>
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364409#comment-17364409
]
Neelesh Srinivas Salian commented on SPARK-18673:
-
Hitting this in Spark 3.1.1 using
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823631#comment-16823631
]
Hyukjin Kwon commented on SPARK-18673:
--
This is blocked by SPARK-23710
> Dataframes doesn't work
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823462#comment-16823462
]
KaiXu commented on SPARK-18673:
---
I'm OOO, please expect slow email response, sorry for the inconvenience.
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823458#comment-16823458
]
shanyu zhao commented on SPARK-18673:
-
Ping. What is the verdict here for users want to use Spark
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769768#comment-16769768
]
t oo commented on SPARK-18673:
--
gentle ping
> Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664418#comment-16664418
]
Hyukjin Kwon commented on SPARK-18673:
--
Please provide some input in SPARK-20202 or
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664286#comment-16664286
]
Dagang Wei commented on SPARK-18673:
Is it possible to fix in org.spark-project.hive before
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652449#comment-16652449
]
t oo commented on SPARK-18673:
--
bump
> Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530830#comment-16530830
]
Hyukjin Kwon commented on SPARK-18673:
--
It's currently blocked by SPARK-20202. Please provide some
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530826#comment-16530826
]
Emma Tang commented on SPARK-18673:
---
Hadoop 3.x.y is supported in the latest. Is the plan to upgrade
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497931#comment-16497931
]
Saisai Shao commented on SPARK-18673:
-
Thanks Steve, looking forward to your inputs.
> Dataframes
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497928#comment-16497928
]
Steve Loughran commented on SPARK-18673:
Jerry, I list up the other commits I'd like to put in;
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496187#comment-16496187
]
Saisai Shao commented on SPARK-18673:
-
I created a PR for this issue
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466088#comment-16466088
]
Darek commented on SPARK-18673:
---
PR20819 for Spark => Hive 2.x was done but not merged and deleted.
>
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465950#comment-16465950
]
Steve Loughran commented on SPARK-18673:
Good Q, [~Bidek]. That SPARK-23807 POM fixes up the
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465934#comment-16465934
]
Darek commented on SPARK-18673:
---
Based on the recent PR, the community is moving toward Hadoop 3.1, why do
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465925#comment-16465925
]
Steve Loughran commented on SPARK-18673:
Josh Rosen added some changes, particularly:
*
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452215#comment-16452215
]
Steve Loughran commented on SPARK-18673:
looking @ our local commit logs, the HDP version
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452196#comment-16452196
]
Steve Loughran commented on SPARK-18673:
HIVE-16081 commit 93db527f47 contains the one-line
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449857#comment-16449857
]
Steve Loughran commented on SPARK-18673:
It's a big hive patch, but most of it is hbase related.
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405604#comment-16405604
]
Darek commented on SPARK-18673:
---
[~joshrosen] Would you know who can help adding the current version of
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388757#comment-16388757
]
Darek commented on SPARK-18673:
---
When running the pyspark tests using Hadoop 3.0.0 I am not getting the
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388223#comment-16388223
]
Marcelo Vanzin commented on SPARK-18673:
We can't close this because Spark is not using the
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388014#comment-16388014
]
Darek commented on SPARK-18673:
---
HIVE tickets are closed already, can we close this ticket?
> Dataframes
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385474#comment-16385474
]
Saisai Shao commented on SPARK-18673:
-
Thanks for the info [~aihuaxu].
> Dataframes doesn't work on
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384044#comment-16384044
]
Aihua Xu commented on SPARK-18673:
--
[~jerryshao] We only need HIVE-15016 and HIVE-18550 to support
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382929#comment-16382929
]
Saisai Shao commented on SPARK-18673:
-
Spark itself uses it own hive (1.2.1.spark2), I think we need
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284485#comment-16284485
]
Mingjie Tang commented on SPARK-18673:
--
Hi Steve, the hive side is updated.
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252007#comment-16252007
]
Aihua Xu commented on SPARK-18673:
--
HIVE-15016 has been committed, so now Hive supports hadoop-3. Can
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234679#comment-16234679
]
Aihua Xu commented on SPARK-18673:
--
Hive is working on the Hadoop3.x support (HIVE-15016).
>
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711735#comment-15711735
]
Steve Loughran commented on SPARK-18673:
HADOOP-13852 provides a quick workaround, limited DF
[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711675#comment-15711675
]
Steve Loughran commented on SPARK-18673:
{code}
java.lang.IllegalArgumentException:
33 matches
Mail list logo
