[jira] [Commented] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

2016-08-11 Thread immerrr again (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417186#comment-15417186 ] immerrr again commented on SPARK-16975: --- The figures were: 1.6.2: ~6s 2.0.0: ~12s Interestingly

[jira] [Commented] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

2016-08-11 Thread immerrr again (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417172#comment-15417172 ] immerrr again commented on SPARK-16975: --- But it works. I have suppressed WARN logs and

[jira] [Commented] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

2016-08-11 Thread immerrr again (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417113#comment-15417113 ] immerrr again commented on SPARK-16975: --- I have built the code from the PR and it indeed succeeds

[jira] [Commented] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

2016-08-10 Thread immerrr again (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416034#comment-15416034 ] immerrr again commented on SPARK-16975: --- Great, thank you! That was so fast! I'll try to look at

[jira] [Commented] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

2016-08-10 Thread immerrr again (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416013#comment-15416013 ] immerrr again commented on SPARK-16975: --- Yes, a seemingly similar one. > Spark-2.0.0 unable to

[jira] [Commented] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

2016-08-10 Thread immerrr again (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416003#comment-15416003 ] immerrr again commented on SPARK-16975: --- I mean, this line from the original report {code} In [87]:

[jira] [Comment Edited] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

2016-08-10 Thread immerrr again (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415998#comment-15415998 ] immerrr again edited comment on SPARK-16975 at 8/10/16 8:57 PM: You mean

[jira] [Commented] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

2016-08-10 Thread immerrr again (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415998#comment-15415998 ] immerrr again commented on SPARK-16975: --- You mean the one I use to write the data, I don't have the

[jira] [Commented] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

2016-08-10 Thread immerrr again (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415961#comment-15415961 ] immerrr again commented on SPARK-16975: --- oh, that's unfortunate. coming from python world,

[jira] [Created] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

2016-08-09 Thread immerrr again (JIRA)
immerrr again created SPARK-16975: - Summary: Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2 Key: SPARK-16975 URL: https://issues.apache.org/jira/browse/SPARK-16975