[jira] [Commented] (SPARK-39915) Dataset.repartition(N) may not create N partitions

[ https://issues.apache.org/jira/browse/SPARK-39915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576319#comment-17576319 ] Shixiong Zhu commented on SPARK-39915: -- {code:java} Welcome to __ /

[jira] [Commented] (SPARK-39999) Replace postgresql 42.3.3 with 42.2.26

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576284#comment-17576284 ] Apache Spark commented on SPARK-3: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Assigned] (SPARK-39999) Replace postgresql 42.3.3 with 42.2.26

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: (was: Apache Spark) > Replace postgresql 42.3.3 with 42.2.26 >

[jira] [Assigned] (SPARK-39999) Replace postgresql 42.3.3 with 42.2.26

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: Apache Spark > Replace postgresql 42.3.3 with 42.2.26 >

[jira] [Commented] (SPARK-39999) Replace postgresql 42.3.3 with 42.2.26

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576283#comment-17576283 ] Apache Spark commented on SPARK-3: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Commented] (SPARK-39915) Dataset.repartition(N) may not create N partitions

[ https://issues.apache.org/jira/browse/SPARK-39915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576282#comment-17576282 ] Pablo Langa Blanco commented on SPARK-39915: Hi [~zsxwing] , I can't reproduce it, do you

[jira] [Comment Edited] (SPARK-39796) Add a regexp_extract variant which returns an array of all the matched capture groups

[ https://issues.apache.org/jira/browse/SPARK-39796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576281#comment-17576281 ] Pablo Langa Blanco edited comment on SPARK-39796 at 8/6/22 9:17 PM:

[jira] [Updated] (SPARK-39999) Replace postgresql 42.3.3 with 42.2.26

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-3: Description: postgresql >= 42.3.0, < 42.4.1 is affected by

[jira] [Created] (SPARK-39999) Replace postgresql 42.3.3 with 42.2.26

Bjørn Jørgensen created SPARK-3: --- Summary: Replace postgresql 42.3.3 with 42.2.26 Key: SPARK-3 URL: https://issues.apache.org/jira/browse/SPARK-3 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39796) Add a regexp_extract variant which returns an array of all the matched capture groups

[ https://issues.apache.org/jira/browse/SPARK-39796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576281#comment-17576281 ] Pablo Langa Blanco commented on SPARK-39796: Hi [~augustine_theodore] , Is this what are

[jira] [Commented] (SPARK-39996) Upgrade postgresql to 42.4.1

[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576274#comment-17576274 ] Bjørn Jørgensen commented on SPARK-39996: - [GA testes

[jira] [Commented] (SPARK-39998) Can't set pyspark log level in log4j2.properties

[ https://issues.apache.org/jira/browse/SPARK-39998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576265#comment-17576265 ] Mario Grgic commented on SPARK-39998: - It turns out this is related to

[jira] [Created] (SPARK-39998) Can't set pyspark log level in log4j2.properties

Mario Grgic created SPARK-39998: --- Summary: Can't set pyspark log level in log4j2.properties Key: SPARK-39998 URL: https://issues.apache.org/jira/browse/SPARK-39998 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39997) ParquetSchemaConverter fails match schema by id

[ https://issues.apache.org/jira/browse/SPARK-39997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576229#comment-17576229 ] Apache Spark commented on SPARK-39997: -- User 'zinking' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39997) ParquetSchemaConverter fails match schema by id

[ https://issues.apache.org/jira/browse/SPARK-39997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39997: Assignee: (was: Apache Spark) > ParquetSchemaConverter fails match schema by id >

[jira] [Assigned] (SPARK-39997) ParquetSchemaConverter fails match schema by id

[ https://issues.apache.org/jira/browse/SPARK-39997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39997: Assignee: Apache Spark > ParquetSchemaConverter fails match schema by id >

[jira] [Updated] (SPARK-39997) ParquetSchemaConverter fails match schema by id

[ https://issues.apache.org/jira/browse/SPARK-39997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Wang updated SPARK-39997: -- Description: {code:scala} test("SPARK-38094: absence of field ids: reading nested schema struct

[jira] [Created] (SPARK-39997) ParquetSchemaConverter fails match schema by id

Zhen Wang created SPARK-39997: - Summary: ParquetSchemaConverter fails match schema by id Key: SPARK-39997 URL: https://issues.apache.org/jira/browse/SPARK-39997 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-39996) Upgrade postgresql to 42.4.1

[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39996: Description: Security - fix:

[jira] [Updated] (SPARK-39996) Upgrade postgresql to 42.4.1

[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39996: Description: Security - fix: CVE-2022-31197 Fixes SQL generated in PgResultSet.refresh()

[jira] [Created] (SPARK-39996) Upgrade postgresql to 42.4.1

Bjørn Jørgensen created SPARK-39996: --- Summary: Upgrade postgresql to 42.4.1 Key: SPARK-39996 URL: https://issues.apache.org/jira/browse/SPARK-39996 Project: Spark Issue Type: Dependency

[jira] [Commented] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576167#comment-17576167 ] Apache Spark commented on SPARK-39929: -- User 'zheniantoushipashi' has created a pull request for

[jira] [Assigned] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39929: Assignee: (was: Apache Spark) > DS V2 supports push down string functions(non ANSI)

[jira] [Assigned] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39929: Assignee: Apache Spark > DS V2 supports push down string functions(non ANSI) >

[jira] [Commented] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576166#comment-17576166 ] Apache Spark commented on SPARK-39929: -- User 'zheniantoushipashi' has created a pull request for

[jira] [Created] (SPARK-39995) PySpark installation doesn't support Scala 2.13 binaries

Oleksandr Shevchenko created SPARK-39995: Summary: PySpark installation doesn't support Scala 2.13 binaries Key: SPARK-39995 URL: https://issues.apache.org/jira/browse/SPARK-39995 Project:

[jira] [Comment Edited] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17573529#comment-17573529 ] Sun BiaoBiao edited comment on SPARK-39929 at 8/6/22 8:55 AM: -- ||Function

[jira] [Comment Edited] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17573529#comment-17573529 ] Sun BiaoBiao edited comment on SPARK-39929 at 8/6/22 8:52 AM: -- ||Function

[jira] [Comment Edited] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17573529#comment-17573529 ] Sun BiaoBiao edited comment on SPARK-39929 at 8/6/22 8:49 AM: -- ||Function

[jira] [Comment Edited] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17573529#comment-17573529 ] Sun BiaoBiao edited comment on SPARK-39929 at 8/6/22 8:45 AM: -- ||Function

[jira] [Comment Edited] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17573529#comment-17573529 ] Sun BiaoBiao edited comment on SPARK-39929 at 8/6/22 6:41 AM: -- ||Function

[jira] [Commented] (SPARK-39963) Simplify the implementation of SimplifyCasts

[ https://issues.apache.org/jira/browse/SPARK-39963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576148#comment-17576148 ] Apache Spark commented on SPARK-39963: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Comment Edited] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17573529#comment-17573529 ] Sun BiaoBiao edited comment on SPARK-39929 at 8/6/22 6:34 AM: -- ||Function

[jira] [Comment Edited] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17573529#comment-17573529 ] Sun BiaoBiao edited comment on SPARK-39929 at 8/6/22 6:30 AM: -- ||Function