[jira] [Assigned] (SPARK-41462) Date and timestamp type can up cast to TimestampNTZ

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41462: Assignee: Apache Spark (was: Gengliang Wang) > Date and timestamp type can up cast to Ti

[jira] [Commented] (SPARK-41462) Date and timestamp type can up cast to TimestampNTZ

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645143#comment-17645143 ] Apache Spark commented on SPARK-41462: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-41462) Date and timestamp type can up cast to TimestampNTZ

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41462: Assignee: Gengliang Wang (was: Apache Spark) > Date and timestamp type can up cast to Ti

[jira] [Created] (SPARK-41463) Ensure error class (and subclass) names contain only capital letters, numbers and underscores

2022-12-09 Thread Bo Zhang (Jira)
Bo Zhang created SPARK-41463: Summary: Ensure error class (and subclass) names contain only capital letters, numbers and underscores Key: SPARK-41463 URL: https://issues.apache.org/jira/browse/SPARK-41463

[jira] [Commented] (SPARK-41463) Ensure error class (and subclass) names contain only capital letters, numbers and underscores

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645155#comment-17645155 ] Apache Spark commented on SPARK-41463: -- User 'bozhang2820' has created a pull reque

[jira] [Assigned] (SPARK-41463) Ensure error class (and subclass) names contain only capital letters, numbers and underscores

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41463: Assignee: Apache Spark > Ensure error class (and subclass) names contain only capital let

[jira] [Assigned] (SPARK-41463) Ensure error class (and subclass) names contain only capital letters, numbers and underscores

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41463: Assignee: (was: Apache Spark) > Ensure error class (and subclass) names contain only

[jira] [Resolved] (SPARK-41439) Implement `DataFrame.melt` and `DataFrame.unpivot`

2022-12-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41439. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38973 [https://

[jira] [Assigned] (SPARK-41439) Implement `DataFrame.melt` and `DataFrame.unpivot`

2022-12-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41439: - Assignee: Ruifeng Zheng > Implement `DataFrame.melt` and `DataFrame.unpivot` >

[jira] [Created] (SPARK-41464) Implement DataFrame.to

2022-12-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41464: - Summary: Implement DataFrame.to Key: SPARK-41464 URL: https://issues.apache.org/jira/browse/SPARK-41464 Project: Spark Issue Type: Sub-task Compo

[jira] [Commented] (SPARK-41244) Introducing a Protobuf serializer for UI data on KV store

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645166#comment-17645166 ] Apache Spark commented on SPARK-41244: -- User 'pan3793' has created a pull request f

[jira] [Commented] (SPARK-41461) protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645178#comment-17645178 ] Apache Spark commented on SPARK-41461: -- User 'WolverineJiang' has created a pull re

[jira] [Assigned] (SPARK-41461) protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41461: Assignee: Apache Spark > protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14 > ---

[jira] [Assigned] (SPARK-41461) protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41461: Assignee: (was: Apache Spark) > protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14 >

[jira] [Commented] (SPARK-41461) protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645179#comment-17645179 ] Apache Spark commented on SPARK-41461: -- User 'WolverineJiang' has created a pull re

[jira] [Commented] (SPARK-41455) Resolve dtypes inconsistencies of date/timestamp functions

2022-12-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645204#comment-17645204 ] Hyukjin Kwon commented on SPARK-41455: -- Spark Connect currently doesn't support con

[jira] [Commented] (SPARK-41402) Override nodeName of StringDecode

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645205#comment-17645205 ] Apache Spark commented on SPARK-41402: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-41402) Override nodeName of StringDecode

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41402: Assignee: Apache Spark > Override nodeName of StringDecode >

[jira] [Assigned] (SPARK-41402) Override nodeName of StringDecode

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41402: Assignee: (was: Apache Spark) > Override nodeName of StringDecode > -

[jira] [Created] (SPARK-41465) Assign a name to the error class _LEGACY_ERROR_TEMP_1235

2022-12-09 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-41465: --- Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_1235 Key: SPARK-41465 URL: https://issues.apache.org/jira/browse/SPARK-41465 Project: Spark Issue

[jira] [Commented] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645207#comment-17645207 ] Apache Spark commented on SPARK-40270: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-41465) Assign a name to the error class _LEGACY_ERROR_TEMP_1235

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41465: Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_1235 > -

[jira] [Assigned] (SPARK-41465) Assign a name to the error class _LEGACY_ERROR_TEMP_1235

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41465: Assignee: (was: Apache Spark) > Assign a name to the error class _LEGACY_ERROR_TEMP_1

[jira] [Commented] (SPARK-41465) Assign a name to the error class _LEGACY_ERROR_TEMP_1235

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645210#comment-17645210 ] Apache Spark commented on SPARK-41465: -- User 'panbingkun' has created a pull reques

[jira] [Commented] (SPARK-41465) Assign a name to the error class _LEGACY_ERROR_TEMP_1235

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645212#comment-17645212 ] Apache Spark commented on SPARK-41465: -- User 'panbingkun' has created a pull reques

[jira] [Resolved] (SPARK-41377) Fix spark-version-info.properties not found on Windows

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41377. --- Fix Version/s: 3.4.0 Resolution: Fixed This is resolved via https://github.com/apache

[jira] [Assigned] (SPARK-41377) Fix spark-version-info.properties not found on Windows

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41377: - Assignee: Gautham Banasandra > Fix spark-version-info.properties not found on Windows >

[jira] [Reopened] (SPARK-39948) exclude velocity 1.5 jar

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-39948: --- > exclude velocity 1.5 jar > > > Key: SPARK-39948 >

[jira] [Updated] (SPARK-39948) exclude velocity 1.5 jar

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39948: -- Affects Version/s: (was: 3.3.0) > exclude velocity 1.5 jar > > >

[jira] [Resolved] (SPARK-39948) exclude velocity 1.5 jar

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39948. --- Fix Version/s: 3.4.0 Resolution: Fixed This is resolved via https://github.com/apache

[jira] [Assigned] (SPARK-39948) exclude velocity 1.5 jar

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39948: - Assignee: Dongjoon Hyun > exclude velocity 1.5 jar > > >

[jira] [Updated] (SPARK-39948) Exclude hive-vector-code-gen dependency

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39948: -- Summary: Exclude hive-vector-code-gen dependency (was: exclude velocity 1.5 jar) > Exclude h

[jira] [Updated] (SPARK-39948) exclude velocity 1.5 jar

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39948: -- Priority: Minor (was: Major) > exclude velocity 1.5 jar > > >

[jira] [Assigned] (SPARK-39948) Exclude hive-vector-code-gen dependency

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39948: - Assignee: (was: Dongjoon Hyun) > Exclude hive-vector-code-gen dependency >

[jira] [Assigned] (SPARK-39948) Exclude hive-vector-code-gen dependency

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39948: - Assignee: Zhou Yifan > Exclude hive-vector-code-gen dependency > --

[jira] [Assigned] (SPARK-37863) Add submitTime for Spark Application

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37863: - Assignee: Zhou Yifan (was: Apache Spark) > Add submitTime for Spark Application >

[jira] [Assigned] (SPARK-8731) Beeline doesn't work with -e option when started in background

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-8731: Assignee: Zhou Yifan (was: Apache Spark) > Beeline doesn't work with -e option when start

[jira] [Created] (SPARK-41466) Change Scala Style configuration to catch AnyFunSuite instead of FunSuite

2022-12-09 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41466: Summary: Change Scala Style configuration to catch AnyFunSuite instead of FunSuite Key: SPARK-41466 URL: https://issues.apache.org/jira/browse/SPARK-41466 Project: Sp

[jira] [Assigned] (SPARK-41466) Change Scala Style configuration to catch AnyFunSuite instead of FunSuite

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41466: Assignee: (was: Apache Spark) > Change Scala Style configuration to catch AnyFunSuite

[jira] [Assigned] (SPARK-41466) Change Scala Style configuration to catch AnyFunSuite instead of FunSuite

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41466: Assignee: Apache Spark > Change Scala Style configuration to catch AnyFunSuite instead of

[jira] [Commented] (SPARK-41466) Change Scala Style configuration to catch AnyFunSuite instead of FunSuite

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645229#comment-17645229 ] Apache Spark commented on SPARK-41466: -- User 'HyukjinKwon' has created a pull reque

[jira] [Created] (SPARK-41467) Upgrade httpclient from 4.5.13 to 4.5.14

2022-12-09 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-41467: --- Summary: Upgrade httpclient from 4.5.13 to 4.5.14 Key: SPARK-41467 URL: https://issues.apache.org/jira/browse/SPARK-41467 Project: Spark Issue Type: Improvemen

[jira] [Commented] (SPARK-41467) Upgrade httpclient from 4.5.13 to 4.5.14

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645248#comment-17645248 ] Apache Spark commented on SPARK-41467: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-41467) Upgrade httpclient from 4.5.13 to 4.5.14

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41467: Assignee: Apache Spark > Upgrade httpclient from 4.5.13 to 4.5.14 > -

[jira] [Assigned] (SPARK-41467) Upgrade httpclient from 4.5.13 to 4.5.14

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41467: Assignee: (was: Apache Spark) > Upgrade httpclient from 4.5.13 to 4.5.14 > --

[jira] [Commented] (SPARK-41233) High-order function: array_prepend

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645254#comment-17645254 ] Apache Spark commented on SPARK-41233: -- User 'infoankitp' has created a pull reques

[jira] [Commented] (SPARK-41233) High-order function: array_prepend

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645255#comment-17645255 ] Apache Spark commented on SPARK-41233: -- User 'infoankitp' has created a pull reques

[jira] [Assigned] (SPARK-41450) PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler"

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41450: Assignee: (was: Apache Spark) > PySpark built from master code raise error "java.lang

[jira] [Assigned] (SPARK-41450) PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler"

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41450: Assignee: Apache Spark > PySpark built from master code raise error "java.lang.ClassNotFo

[jira] [Commented] (SPARK-41450) PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler"

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645256#comment-17645256 ] Apache Spark commented on SPARK-41450: -- User 'pan3793' has created a pull request f

[jira] [Commented] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645257#comment-17645257 ] Apache Spark commented on SPARK-40270: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645258#comment-17645258 ] Apache Spark commented on SPARK-40270: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645260#comment-17645260 ] Apache Spark commented on SPARK-41392: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41392: Assignee: Apache Spark > spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-m

[jira] [Assigned] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41392: Assignee: (was: Apache Spark) > spark builds against hadoop trunk/3.4.0-SNAPSHOT fail

[jira] [Commented] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645261#comment-17645261 ] Apache Spark commented on SPARK-41392: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645263#comment-17645263 ] Apache Spark commented on SPARK-40270: -- User 'Yikun' has created a pull request for

[jira] [Created] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions

2022-12-09 Thread Peter Toth (Jira)
Peter Toth created SPARK-41468: -- Summary: Fix PlanExpression handling in EquivalentExpressions Key: SPARK-41468 URL: https://issues.apache.org/jira/browse/SPARK-41468 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41225) Disable unsupported functions

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645281#comment-17645281 ] Apache Spark commented on SPARK-41225: -- User 'grundprinzip' has created a pull requ

[jira] [Resolved] (SPARK-41395) InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data

2022-12-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41395. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38923 [https://gi

[jira] [Assigned] (SPARK-41395) InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data

2022-12-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41395: Assignee: Bruce Robbins > InterpretedMutableProjection can corrupt unsafe buffer when use

[jira] [Updated] (SPARK-41395) InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data

2022-12-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41395: - Fix Version/s: 3.2.3 3.3.2 > InterpretedMutableProjection can corrupt unsafe

[jira] [Assigned] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41468: Assignee: Apache Spark > Fix PlanExpression handling in EquivalentExpressions > -

[jira] [Commented] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645289#comment-17645289 ] Apache Spark commented on SPARK-41468: -- User 'peter-toth' has created a pull reques

[jira] [Assigned] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41468: Assignee: (was: Apache Spark) > Fix PlanExpression handling in EquivalentExpressions

[jira] [Commented] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645290#comment-17645290 ] Apache Spark commented on SPARK-41468: -- User 'peter-toth' has created a pull reques

[jira] [Resolved] (SPARK-41446) Make `createDataFrame` support schema and more input dataset types

2022-12-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41446. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38979 [https://

[jira] [Assigned] (SPARK-41446) Make `createDataFrame` support schema and more input dataset types

2022-12-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41446: - Assignee: Ruifeng Zheng > Make `createDataFrame` support schema and more input dataset

[jira] [Assigned] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service

2022-12-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41458: Assignee: Cheng Pan > Correctly transform the SPI services for Yarn Shuffle Service > ---

[jira] [Resolved] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service

2022-12-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41458. -- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service

2022-12-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41458: - Priority: Minor (was: Major) > Correctly transform the SPI services for Yarn Shuffle Service >

[jira] [Resolved] (SPARK-41402) Override nodeName of StringDecode

2022-12-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41402. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39001 [https://gi

[jira] [Assigned] (SPARK-41402) Override nodeName of StringDecode

2022-12-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41402: Assignee: Xinrong Meng > Override nodeName of StringDecode >

[jira] [Created] (SPARK-41469) Task rerun on decommissioned executor can be avoided if shuffle data has migrated

2022-12-09 Thread wuyi (Jira)
wuyi created SPARK-41469: Summary: Task rerun on decommissioned executor can be avoided if shuffle data has migrated Key: SPARK-41469 URL: https://issues.apache.org/jira/browse/SPARK-41469 Project: Spark

[jira] [Assigned] (SPARK-41469) Task rerun on decommissioned executor can be avoided if shuffle data has migrated

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41469: Assignee: (was: Apache Spark) > Task rerun on decommissioned executor can be avoided

[jira] [Commented] (SPARK-41469) Task rerun on decommissioned executor can be avoided if shuffle data has migrated

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645344#comment-17645344 ] Apache Spark commented on SPARK-41469: -- User 'Ngone51' has created a pull request f

[jira] [Assigned] (SPARK-41469) Task rerun on decommissioned executor can be avoided if shuffle data has migrated

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41469: Assignee: Apache Spark > Task rerun on decommissioned executor can be avoided if shuffle

[jira] [Resolved] (SPARK-41450) PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler"

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41450. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38999 [https://

[jira] [Assigned] (SPARK-41450) PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler"

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41450: - Assignee: Weichen Xu > PySpark built from master code raise error "java.lang.ClassNotFo

[jira] [Created] (SPARK-41470) SPJ shouldn't assume InternalRow implements equals and hashCode

2022-12-09 Thread Chao Sun (Jira)
Chao Sun created SPARK-41470: Summary: SPJ shouldn't assume InternalRow implements equals and hashCode Key: SPARK-41470 URL: https://issues.apache.org/jira/browse/SPARK-41470 Project: Spark Issu

[jira] [Updated] (SPARK-37376) SPJ: Introduce a new DataSource V2 interface HasPartitionKey

2022-12-09 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-37376: - Summary: SPJ: Introduce a new DataSource V2 interface HasPartitionKey (was: Introduce a new DataSource

[jira] [Updated] (SPARK-37378) SPJ: Convert V2 Transform expressions into catalyst expressions and load their associated functions from V2 FunctionCatalog

2022-12-09 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-37378: - Summary: SPJ: Convert V2 Transform expressions into catalyst expressions and load their associated funct

[jira] [Updated] (SPARK-37377) SPJ: Initial implementation of Storage-Partitioned Join

2022-12-09 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-37377: - Summary: SPJ: Initial implementation of Storage-Partitioned Join (was: Initial implementation of Storag

[jira] [Created] (SPARK-41471) SPJ: reduce Spark shuffle when only one side of a join is KeyGroupedPartitioning

2022-12-09 Thread Chao Sun (Jira)
Chao Sun created SPARK-41471: Summary: SPJ: reduce Spark shuffle when only one side of a join is KeyGroupedPartitioning Key: SPARK-41471 URL: https://issues.apache.org/jira/browse/SPARK-41471 Project: Spa

[jira] [Updated] (SPARK-41413) SPJ: Spark should avoid shuffle when partition keys mismatch, but join expressions are compatible

2022-12-09 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-41413: - Summary: SPJ: Spark should avoid shuffle when partition keys mismatch, but join expressions are compatib

[jira] [Updated] (SPARK-41413) SPJ: Avoid shuffle when partition keys mismatch, but join expressions are compatible

2022-12-09 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-41413: - Summary: SPJ: Avoid shuffle when partition keys mismatch, but join expressions are compatible (was: SPJ

[jira] [Updated] (SPARK-37375) Umbrella: Storage Partitioned Join (SPJ)

2022-12-09 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-37375: - Summary: Umbrella: Storage Partitioned Join (SPJ) (was: Umbrella: Storage Partitioned Join) > Umbrella

[jira] [Updated] (SPARK-40946) SPJ: Introduce a new DataSource V2 interface SupportsPushDownClusterKeys

2022-12-09 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-40946: - Summary: SPJ: Introduce a new DataSource V2 interface SupportsPushDownClusterKeys (was: Introduce a new

[jira] [Updated] (SPARK-41398) SPJ: Relax constraints on Storage-Partitioned Join when partition keys after runtime filtering do not match

2022-12-09 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-41398: - Summary: SPJ: Relax constraints on Storage-Partitioned Join when partition keys after runtime filtering

[jira] [Updated] (SPARK-41471) SPJ: Reduce Spark shuffle when only one side of a join is KeyGroupedPartitioning

2022-12-09 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-41471: - Summary: SPJ: Reduce Spark shuffle when only one side of a join is KeyGroupedPartitioning (was: SPJ: re

[jira] [Updated] (SPARK-41470) SPJ: Spark shouldn't assume InternalRow implements equals and hashCode

2022-12-09 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-41470: - Summary: SPJ: Spark shouldn't assume InternalRow implements equals and hashCode (was: SPJ shouldn't ass

[jira] [Resolved] (SPARK-41462) Date and timestamp type can up cast to TimestampNTZ

2022-12-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41462. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38997 [https://github.com

[jira] [Resolved] (SPARK-41466) Change Scala Style configuration to catch AnyFunSuite instead of FunSuite

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41466. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39004 [https://

[jira] [Assigned] (SPARK-41466) Change Scala Style configuration to catch AnyFunSuite instead of FunSuite

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41466: - Assignee: Hyukjin Kwon > Change Scala Style configuration to catch AnyFunSuite instead

[jira] [Updated] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs

2022-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41376: -- Fix Version/s: 3.2.4 3.3.2 > Executor netty direct memory check should resp

[jira] [Created] (SPARK-41472) Implement the rest of string/binary functions

2022-12-09 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-41472: Summary: Implement the rest of string/binary functions Key: SPARK-41472 URL: https://issues.apache.org/jira/browse/SPARK-41472 Project: Spark Issue Type: Sub

[jira] [Assigned] (SPARK-41283) Feature parity: Functions API in Spark Connect

2022-12-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-41283: Assignee: Ruifeng Zheng (was: Xinrong Meng) > Feature parity: Functions API in Spark Con

[jira] [Assigned] (SPARK-41472) Implement the rest of string/binary functions

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41472: Assignee: (was: Apache Spark) > Implement the rest of string/binary functions > -

[jira] [Assigned] (SPARK-41472) Implement the rest of string/binary functions

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41472: Assignee: Apache Spark > Implement the rest of string/binary functions >

[jira] [Commented] (SPARK-41472) Implement the rest of string/binary functions

2022-12-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645505#comment-17645505 ] Apache Spark commented on SPARK-41472: -- User 'xinrong-meng' has created a pull requ

  1   2   >