[jira] [Updated] (SPARK-21852) Empty Parquet Files created as a result of spark jobs fail when read

2017-08-28 Thread Shivam Dalmia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivam Dalmia updated SPARK-21852: -- Description: I have faced an issue intermittently with certain spark jobs writing parquet file

[jira] [Commented] (SPARK-21852) Empty Parquet Files created as a result of spark jobs fail when read

2017-08-28 Thread Shivam Dalmia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143975#comment-16143975 ] Shivam Dalmia commented on SPARK-21852: --- Of course, this is because of the empty di

[jira] [Created] (SPARK-21852) Empty Parquet Files created as a result of spark jobs fail when read

2017-08-28 Thread Shivam Dalmia (JIRA)
Shivam Dalmia created SPARK-21852: - Summary: Empty Parquet Files created as a result of spark jobs fail when read Key: SPARK-21852 URL: https://issues.apache.org/jira/browse/SPARK-21852 Project: Spark

[jira] [Commented] (SPARK-15393) Writing empty Dataframes doesn't save any _metadata files

2017-08-28 Thread Shivam Dalmia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143621#comment-16143621 ] Shivam Dalmia commented on SPARK-15393: --- Is this issue fixed through spark? I am st

[jira] [Commented] (SPARK-19388) Reading an empty folder as parquet causes an Analysis Exception

2017-08-28 Thread Shivam Dalmia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143607#comment-16143607 ] Shivam Dalmia commented on SPARK-19388: --- I am also facing this issue; any reason wh

[jira] [Created] (SPARK-19488) CSV infer schema does not take into account Inf,-Inf,NaN

2017-02-07 Thread Shivam Dalmia (JIRA)
Shivam Dalmia created SPARK-19488: - Summary: CSV infer schema does not take into account Inf,-Inf,NaN Key: SPARK-19488 URL: https://issues.apache.org/jira/browse/SPARK-19488 Project: Spark Is