[jira] [Comment Edited] (SPARK-36203) Spark SQL can't use "group by" on the column of map type.

[ https://issues.apache.org/jira/browse/SPARK-36203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17761796#comment-17761796 ] Paul Praet edited comment on SPARK-36203 at 9/4/23 11:55 AM: - This problem

[jira] [Commented] (SPARK-36203) Spark SQL can't use "group by" on the column of map type.

[ https://issues.apache.org/jira/browse/SPARK-36203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17761796#comment-17761796 ] Paul Praet commented on SPARK-36203: This problem is still present in 3.3.2 (and I think also in

[jira] [Commented] (SPARK-34779) ExecutorMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

[ https://issues.apache.org/jira/browse/SPARK-34779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610965#comment-17610965 ] Paul Praet commented on SPARK-34779: We are seeing spurious failures on the assert(): {noformat}

[jira] [Created] (SPARK-40388) SQL configuration spark.sql.mapKeyDedupPolicy not always applied

Paul Praet created SPARK-40388: -- Summary: SQL configuration spark.sql.mapKeyDedupPolicy not always applied Key: SPARK-40388 URL: https://issues.apache.org/jira/browse/SPARK-40388 Project: Spark

[jira] [Commented] (SPARK-12837) Spark driver requires large memory space for serialized results even there are no data collected to the driver

[ https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342341#comment-17342341 ] Paul Praet commented on SPARK-12837: Seeing the same issue on Spark 2.4.6. Excessive number of tasks

[jira] [Commented] (SPARK-16044) input_file_name() returns empty strings in data sources based on NewHadoopRDD.

[ https://issues.apache.org/jira/browse/SPARK-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693200#comment-16693200 ] Paul Praet commented on SPARK-16044: Still has issues. See

[jira] [Created] (SPARK-26128) filter breaks input_file_name

Paul Praet created SPARK-26128: -- Summary: filter breaks input_file_name Key: SPARK-26128 URL: https://issues.apache.org/jira/browse/SPARK-26128 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18660) Parquet complains "Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImp

[ https://issues.apache.org/jira/browse/SPARK-18660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643418#comment-16643418 ] Paul Praet commented on SPARK-18660: It's really polluting our logs. Any workaround ? > Parquet

[jira] [Commented] (SPARK-21402) Java encoders - switch fields on collectAsList

[ https://issues.apache.org/jira/browse/SPARK-21402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636957#comment-16636957 ] Paul Praet commented on SPARK-21402: Still there in Spark 2.3.1. > Java encoders - switch fields on

[jira] [Commented] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575026#comment-16575026 ] Paul Praet commented on SPARK-24502: We are only creating SparkSessions with a

[jira] [Commented] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16574410#comment-16574410 ] Paul Praet commented on SPARK-24502: Find it hard to believe above pull requests were accepted,

[jira] [Commented] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573149#comment-16573149 ] Paul Praet commented on SPARK-24502: [~cloud_fan] Does this mean users also have to call this

[jira] [Created] (SPARK-21747) Java encoders - switch fields on collectAsList

Paul Praet created SPARK-21747: -- Summary: Java encoders - switch fields on collectAsList Key: SPARK-21747 URL: https://issues.apache.org/jira/browse/SPARK-21747 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-21402) Java encoders - switch fields on collectAsList

[ https://issues.apache.org/jira/browse/SPARK-21402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121401#comment-16121401 ] Paul Praet commented on SPARK-21402: It seems changing the order of the fields in the struct can give

[jira] [Comment Edited] (SPARK-21402) Java encoders - switch fields on collectAsList

[ https://issues.apache.org/jira/browse/SPARK-21402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121297#comment-16121297 ] Paul Praet edited comment on SPARK-21402 at 8/10/17 9:04 AM: - I can confirm

[jira] [Comment Edited] (SPARK-21402) Java encoders - switch fields on collectAsList

[ https://issues.apache.org/jira/browse/SPARK-21402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121297#comment-16121297 ] Paul Praet edited comment on SPARK-21402 at 8/10/17 9:03 AM: - I can confirm

[jira] [Commented] (SPARK-21402) Java encoders - switch fields on collectAsList

[ https://issues.apache.org/jira/browse/SPARK-21402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121297#comment-16121297 ] Paul Praet commented on SPARK-21402: I can confirm this problem persists in Spark 2.2.0: fields get

[jira] [Created] (SPARK-21666) Cannot handle Parquet type FIXED_LEN_BYTE_ARRAY

Paul Praet created SPARK-21666: -- Summary: Cannot handle Parquet type FIXED_LEN_BYTE_ARRAY Key: SPARK-21666 URL: https://issues.apache.org/jira/browse/SPARK-21666 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2489) Unsupported parquet datatype optional fixed_len_byte_array

[ https://issues.apache.org/jira/browse/SPARK-2489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118093#comment-16118093 ] Paul Praet commented on SPARK-2489: --- No progress on this ? > Unsupported parquet datatype optional

[jira] [Commented] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems

[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017912#comment-16017912 ] Paul Praet commented on SPARK-4820: --- I confirm - still an issue when trying to build Spark 2.1.1 on