[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451155#comment-17451155
]
Joao Miguel Pinto commented on SPARK-10925:
---
Hi guys. I had the same problem and the only way
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088868#comment-17088868
]
Kushal Yellam commented on SPARK-10925:
---
[~aseigneurin] pls help me on above issue.
> Exception
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088715#comment-17088715
]
Kushal Yellam commented on SPARK-10925:
---
Hi Team
> Exception when joining DataFrames
>
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088714#comment-17088714
]
Kushal Yellam commented on SPARK-10925:
---
Hi Team
> Exception when joining DataFrames
>
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905435#comment-16905435
]
Wenchen Fan commented on SPARK-10925:
-
Now Spark can at least detect this case and fail with a
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823045#comment-16823045
]
Rafik commented on SPARK-10925:
---
I managed to solve this by renaming the column after group by to
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16467142#comment-16467142
]
howie yu commented on SPARK-10925:
--
Same issue on Spark 2.3.0. Add checkpoint still have same error
>
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354627#comment-16354627
]
Clay Stevens commented on SPARK-10925:
--
I was having the same problem and " `df.rdd.toDF()` before
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173139#comment-16173139
]
peay commented on SPARK-10925:
--
Same issue on Spark 2.1.0. I have been working around this using
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015176#comment-16015176
]
Haifeng Li commented on SPARK-10925:
I tried the code with spark 2.1.1, I got same error. I added
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458996#comment-15458996
]
Chen Zhang commented on SPARK-10925:
I have the same issue too. Very annoying. After I do several
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15430302#comment-15430302
]
Alexander Bij commented on SPARK-10925:
---
Relates to issue SPARK-14948 (Exception joining same DF)
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15430290#comment-15430290
]
Alexander Bij commented on SPARK-10925:
---
We also encountered this issue using with (HDP 2.4.2.0)
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259650#comment-15259650
]
Saurabh Santhosh commented on SPARK-10925:
--
[~smilegator]
Hi,
I have created another ticket
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15207915#comment-15207915
]
Wenchen Fan commented on SPARK-10925:
-
If you wanna remove duplicated join keys, you can do
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968427#comment-14968427
]
Xiao Li commented on SPARK-10925:
-
There is another ongoing JIRA that has a big impact on the fix for
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957170#comment-14957170
]
Xiao Li commented on SPARK-10925:
-
Hi, Alexis,
The schema of your query results has the duplicate
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956367#comment-14956367
]
Xiao Li commented on SPARK-10925:
-
Also hit the same problem. Trying to narrow down the root cause of the
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957731#comment-14957731
]
Alexis Seigneurin commented on SPARK-10925:
---
Well, technically, it's not a duplicate column. An
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958054#comment-14958054
]
Xiao Li commented on SPARK-10925:
-
I have not tried Spark 1.4, but inner joining 2 tables with the same
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944303#comment-14944303
]
Jason C Lee commented on SPARK-10925:
-
I removed your 2nd step "apply an UDF on column "name"" and
21 matches
Mail list logo
