[
https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417186#comment-15417186
]
immerrr again commented on SPARK-16975:
---
The figures were:
1.6.2: ~6s
2.0.0: ~12s
Interestingly
[
https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417172#comment-15417172
]
immerrr again commented on SPARK-16975:
---
But it works. I have suppressed WARN logs and
[
https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417113#comment-15417113
]
immerrr again commented on SPARK-16975:
---
I have built the code from the PR and it indeed succeeds
[
https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416034#comment-15416034
]
immerrr again commented on SPARK-16975:
---
Great, thank you! That was so fast!
I'll try to look at
[
https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416013#comment-15416013
]
immerrr again commented on SPARK-16975:
---
Yes, a seemingly similar one.
> Spark-2.0.0 unable to
[
https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416003#comment-15416003
]
immerrr again commented on SPARK-16975:
---
I mean, this line from the original report
{code}
In [87]:
[
https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415998#comment-15415998
]
immerrr again edited comment on SPARK-16975 at 8/10/16 8:57 PM:
You mean
[
https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415998#comment-15415998
]
immerrr again commented on SPARK-16975:
---
You mean the one I use to write the data, I don't have the
[
https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415961#comment-15415961
]
immerrr again commented on SPARK-16975:
---
oh, that's unfortunate. coming from python world,
immerrr again created SPARK-16975:
-
Summary: Spark-2.0.0 unable to infer schema for parquet data
written by Spark-1.6.2
Key: SPARK-16975
URL: https://issues.apache.org/jira/browse/SPARK-16975
10 matches
Mail list logo