[jira] [Commented] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-21 Thread Krish (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17161952#comment-17161952 ] Krish commented on SPARK-32317: --- Yes I do agree with your second point, if we map required

[jira] [Commented] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-19 Thread Krish (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160776#comment-17160776 ] Krish commented on SPARK-32317: --- Thanks for the update. The problem here I see is given be

[jira] [Commented] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-17 Thread Krish (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159849#comment-17159849 ] Krish commented on SPARK-32317: --- Yes, but the biggest problem that I see here is, spark is

[jira] [Updated] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-14 Thread Krish (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krish updated SPARK-32317: -- Description: Hi,   We generate parquet files which are partitioned on Date on a daily basis, and we send up

[jira] [Updated] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-14 Thread Krish (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krish updated SPARK-32317: -- Description: Hi,   We generate parquet files which are partitioned on Date on a daily basis, and we send up

[jira] [Created] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-14 Thread Krish (Jira)
Krish created SPARK-32317: - Summary: Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected Key: SPARK-32317 URL: https://issues.apache.org/jira/browse/SPARK-32317 Proje

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2015-10-14 Thread Balaji Krish (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957661#comment-14957661 ] Balaji Krish commented on SPARK-10528: -- Following steps solved my problem 1. Open C