[jira] [Resolved] (SPARK-39935) Switch validateParsingError onto checkError

[ https://issues.apache.org/jira/browse/SPARK-39935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39935. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37363 [https://github.com

[jira] [Created] (SPARK-39948) exclude velocity 1.5 jar

melin created SPARK-39948: - Summary: exclude velocity 1.5 jar Key: SPARK-39948 URL: https://issues.apache.org/jira/browse/SPARK-39948 Project: Spark Issue Type: Improvement Components: SQL

[jira] [Assigned] (SPARK-39947) Upgrade jersey to 2.36

[ https://issues.apache.org/jira/browse/SPARK-39947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39947: Assignee: (was: Apache Spark) > Upgrade jersey to 2.36 > -- > >

[jira] [Commented] (SPARK-39947) Upgrade jersey to 2.36

[ https://issues.apache.org/jira/browse/SPARK-39947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574044#comment-17574044 ] Apache Spark commented on SPARK-39947: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-39947) Upgrade jersey to 2.36

[ https://issues.apache.org/jira/browse/SPARK-39947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39947: Assignee: Apache Spark > Upgrade jersey to 2.36 > -- > >

[jira] [Created] (SPARK-39947) Upgrade jersey to 2.36

Yang Jie created SPARK-39947: Summary: Upgrade jersey to 2.36 Key: SPARK-39947 URL: https://issues.apache.org/jira/browse/SPARK-39947 Project: Spark Issue Type: Improvement Components:

[jira] [Created] (SPARK-39946) Upgrade jersey to 2.36

Yang Jie created SPARK-39946: Summary: Upgrade jersey to 2.36 Key: SPARK-39946 URL: https://issues.apache.org/jira/browse/SPARK-39946 Project: Spark Issue Type: Improvement Components:

[jira] [Assigned] (SPARK-39917) Use different error classes for numeric/interval arithmetic overflow

[ https://issues.apache.org/jira/browse/SPARK-39917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39917: Assignee: Apache Spark > Use different error classes for numeric/interval arithmetic over

[jira] [Assigned] (SPARK-39917) Use different error classes for numeric/interval arithmetic overflow

[ https://issues.apache.org/jira/browse/SPARK-39917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39917: Assignee: (was: Apache Spark) > Use different error classes for numeric/interval arit

[jira] [Commented] (SPARK-39917) Use different error classes for numeric/interval arithmetic overflow

[ https://issues.apache.org/jira/browse/SPARK-39917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574037#comment-17574037 ] Apache Spark commented on SPARK-39917: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-39911) Optimize global Sort to RepartitionByExpression

[ https://issues.apache.org/jira/browse/SPARK-39911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574036#comment-17574036 ] Apache Spark commented on SPARK-39911: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-39911) Optimize global Sort to RepartitionByExpression

[ https://issues.apache.org/jira/browse/SPARK-39911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574035#comment-17574035 ] Apache Spark commented on SPARK-39911: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574029#comment-17574029 ] Sumeet commented on SPARK-39902: Hi [~dongjoon] - Noted. Thank you for updating the tic

[jira] [Commented] (SPARK-39944) Upgrade dropwizard metrics to 4.2.10

[ https://issues.apache.org/jira/browse/SPARK-39944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574022#comment-17574022 ] Apache Spark commented on SPARK-39944: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-39944) Upgrade dropwizard metrics to 4.2.10

[ https://issues.apache.org/jira/browse/SPARK-39944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39944: Assignee: (was: Apache Spark) > Upgrade dropwizard metrics to 4.2.10 > --

[jira] [Commented] (SPARK-39944) Upgrade dropwizard metrics to 4.2.10

[ https://issues.apache.org/jira/browse/SPARK-39944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574021#comment-17574021 ] Apache Spark commented on SPARK-39944: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-39944) Upgrade dropwizard metrics to 4.2.10

[ https://issues.apache.org/jira/browse/SPARK-39944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39944: Assignee: Apache Spark > Upgrade dropwizard metrics to 4.2.10 > -

[jira] [Assigned] (SPARK-39873) Remove OptimizeLimitZero and merge it into EliminateLimits

[ https://issues.apache.org/jira/browse/SPARK-39873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39873: --- Assignee: jiaan.geng > Remove OptimizeLimitZero and merge it into EliminateLimits > ---

[jira] [Resolved] (SPARK-39873) Remove OptimizeLimitZero and merge it into EliminateLimits

[ https://issues.apache.org/jira/browse/SPARK-39873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39873. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37295 [https://gith

[jira] [Resolved] (SPARK-39933) Check query context by checkError()

[ https://issues.apache.org/jira/browse/SPARK-39933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39933. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37357 [https://github.com

[jira] [Commented] (SPARK-39945) Upgrade sbt-mima-plugin to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-39945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574013#comment-17574013 ] Apache Spark commented on SPARK-39945: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-39945) Upgrade sbt-mima-plugin to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-39945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39945: Assignee: (was: Apache Spark) > Upgrade sbt-mima-plugin to 1.1.0 > --

[jira] [Assigned] (SPARK-39945) Upgrade sbt-mima-plugin to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-39945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39945: Assignee: Apache Spark > Upgrade sbt-mima-plugin to 1.1.0 > -

[jira] [Commented] (SPARK-39945) Upgrade sbt-mima-plugin to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-39945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574014#comment-17574014 ] Apache Spark commented on SPARK-39945: -- User 'williamhyun' has created a pull reque

[jira] [Created] (SPARK-39945) Upgrade sbt-mima-plugin to 1.1.0

William Hyun created SPARK-39945: Summary: Upgrade sbt-mima-plugin to 1.1.0 Key: SPARK-39945 URL: https://issues.apache.org/jira/browse/SPARK-39945 Project: Spark Issue Type: Bug Co

[jira] [Commented] (SPARK-39943) Upgrade rocksdbjni to 7.4.4

[ https://issues.apache.org/jira/browse/SPARK-39943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574006#comment-17574006 ] Apache Spark commented on SPARK-39943: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-39943) Upgrade rocksdbjni to 7.4.4

[ https://issues.apache.org/jira/browse/SPARK-39943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39943: Assignee: (was: Apache Spark) > Upgrade rocksdbjni to 7.4.4 > ---

[jira] [Assigned] (SPARK-39943) Upgrade rocksdbjni to 7.4.4

[ https://issues.apache.org/jira/browse/SPARK-39943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39943: Assignee: Apache Spark > Upgrade rocksdbjni to 7.4.4 > --- > >

[jira] [Commented] (SPARK-39943) Upgrade rocksdbjni to 7.4.4

[ https://issues.apache.org/jira/browse/SPARK-39943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574005#comment-17574005 ] Apache Spark commented on SPARK-39943: -- User 'williamhyun' has created a pull reque

[jira] [Created] (SPARK-39944) Upgrade dropwizard metrics to 4.2.10

Yang Jie created SPARK-39944: Summary: Upgrade dropwizard metrics to 4.2.10 Key: SPARK-39944 URL: https://issues.apache.org/jira/browse/SPARK-39944 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-39943) Upgrade rocksdbjni to 7.4.4

William Hyun created SPARK-39943: Summary: Upgrade rocksdbjni to 7.4.4 Key: SPARK-39943 URL: https://issues.apache.org/jira/browse/SPARK-39943 Project: Spark Issue Type: Bug Compone

[jira] [Commented] (SPARK-39940) Batch query cannot read the updates from streaming query if streaming query writes to the catalog table via DSv1 sink

[ https://issues.apache.org/jira/browse/SPARK-39940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574004#comment-17574004 ] Apache Spark commented on SPARK-39940: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-39940) Batch query cannot read the updates from streaming query if streaming query writes to the catalog table via DSv1 sink

[ https://issues.apache.org/jira/browse/SPARK-39940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574003#comment-17574003 ] Apache Spark commented on SPARK-39940: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-39942) The input parameter of nsmallest should be validated as Integer

[ https://issues.apache.org/jira/browse/SPARK-39942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574002#comment-17574002 ] Apache Spark commented on SPARK-39942: -- User 'bzhaoopenstack' has created a pull re

[jira] [Assigned] (SPARK-39940) Batch query cannot read the updates from streaming query if streaming query writes to the catalog table via DSv1 sink

[ https://issues.apache.org/jira/browse/SPARK-39940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39940: Assignee: (was: Apache Spark) > Batch query cannot read the updates from streaming qu

[jira] [Assigned] (SPARK-39940) Batch query cannot read the updates from streaming query if streaming query writes to the catalog table via DSv1 sink

[ https://issues.apache.org/jira/browse/SPARK-39940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39940: Assignee: Apache Spark > Batch query cannot read the updates from streaming query if stre

[jira] [Assigned] (SPARK-39942) The input parameter of nsmallest should be validated as Integer

[ https://issues.apache.org/jira/browse/SPARK-39942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39942: Assignee: (was: Apache Spark) > The input parameter of nsmallest should be validated

[jira] [Assigned] (SPARK-39942) The input parameter of nsmallest should be validated as Integer

[ https://issues.apache.org/jira/browse/SPARK-39942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39942: Assignee: Apache Spark > The input parameter of nsmallest should be validated as Integer

[jira] [Created] (SPARK-39942) The input parameter of nsmallest should be validated as Integer

bo zhao created SPARK-39942: --- Summary: The input parameter of nsmallest should be validated as Integer Key: SPARK-39942 URL: https://issues.apache.org/jira/browse/SPARK-39942 Project: Spark Issue

[jira] [Commented] (SPARK-39941) window and min_periods parameters in rolling func need to be validated as a Integer

[ https://issues.apache.org/jira/browse/SPARK-39941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573998#comment-17573998 ] Apache Spark commented on SPARK-39941: -- User 'bzhaoopenstack' has created a pull re

[jira] [Assigned] (SPARK-39941) window and min_periods parameters in rolling func need to be validated as a Integer

[ https://issues.apache.org/jira/browse/SPARK-39941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39941: Assignee: (was: Apache Spark) > window and min_periods parameters in rolling func nee

[jira] [Commented] (SPARK-39941) window and min_periods parameters in rolling func need to be validated as a Integer

[ https://issues.apache.org/jira/browse/SPARK-39941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573999#comment-17573999 ] Apache Spark commented on SPARK-39941: -- User 'bzhaoopenstack' has created a pull re

[jira] [Assigned] (SPARK-39941) window and min_periods parameters in rolling func need to be validated as a Integer

[ https://issues.apache.org/jira/browse/SPARK-39941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39941: Assignee: Apache Spark > window and min_periods parameters in rolling func need to be val

[jira] [Updated] (SPARK-39941) window and min_periods parameters in rolling func need to be validated as a Integer

[ https://issues.apache.org/jira/browse/SPARK-39941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bo zhao updated SPARK-39941: Component/s: Pandas API on Spark (was: PySpark) > window and min_periods parameters i

[jira] [Commented] (SPARK-39940) Batch query cannot read the updates from streaming query if streaming query writes to the catalog table via DSv1 sink

[ https://issues.apache.org/jira/browse/SPARK-39940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573997#comment-17573997 ] Jungtaek Lim commented on SPARK-39940: -- Will submit a fix shortly. > Batch query c

[jira] [Created] (SPARK-39941) window and min_periods parameters in rolling func need to be validated as a Integer

bo zhao created SPARK-39941: --- Summary: window and min_periods parameters in rolling func need to be validated as a Integer Key: SPARK-39941 URL: https://issues.apache.org/jira/browse/SPARK-39941 Project: Sp

[jira] [Created] (SPARK-39940) Batch query cannot read the updates from streaming query if streaming query writes to the catalog table via DSv1 sink

Jungtaek Lim created SPARK-39940: Summary: Batch query cannot read the updates from streaming query if streaming query writes to the catalog table via DSv1 sink Key: SPARK-39940 URL: https://issues.apache.org/jira

[jira] [Assigned] (SPARK-39939) shift() func need support periods=0

[ https://issues.apache.org/jira/browse/SPARK-39939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39939: Assignee: (was: Apache Spark) > shift() func need support periods=0 > ---

[jira] [Assigned] (SPARK-39939) shift() func need support periods=0

[ https://issues.apache.org/jira/browse/SPARK-39939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39939: Assignee: Apache Spark > shift() func need support periods=0 > --

[jira] [Commented] (SPARK-39939) shift() func need support periods=0

[ https://issues.apache.org/jira/browse/SPARK-39939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573988#comment-17573988 ] Apache Spark commented on SPARK-39939: -- User 'bzhaoopenstack' has created a pull re

[jira] [Created] (SPARK-39939) shift() func need support periods=0

bo zhao created SPARK-39939: --- Summary: shift() func need support periods=0 Key: SPARK-39939 URL: https://issues.apache.org/jira/browse/SPARK-39939 Project: Spark Issue Type: Bug Component

[jira] [Resolved] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39902. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37325 [https://

[jira] [Assigned] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39902: - Assignee: Sumeet > Add Scan details to spark plan scan node in SparkUI > --

[jira] [Updated] (SPARK-39938) The prefix/suffix parameter validation in add_prefix/add_suffix should follow the pandas behavior

[ https://issues.apache.org/jira/browse/SPARK-39938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bo zhao updated SPARK-39938: Priority: Minor (was: Major) > The prefix/suffix parameter validation in add_prefix/add_suffix should fol

[jira] [Assigned] (SPARK-39938) The prefix/suffix parameter validation in add_prefix/add_suffix should follow the pandas behavior

[ https://issues.apache.org/jira/browse/SPARK-39938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39938: Assignee: (was: Apache Spark) > The prefix/suffix parameter validation in add_prefix/

[jira] [Assigned] (SPARK-39938) The prefix/suffix parameter validation in add_prefix/add_suffix should follow the pandas behavior

[ https://issues.apache.org/jira/browse/SPARK-39938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39938: Assignee: Apache Spark > The prefix/suffix parameter validation in add_prefix/add_suffix

[jira] [Commented] (SPARK-39938) The prefix/suffix parameter validation in add_prefix/add_suffix should follow the pandas behavior

[ https://issues.apache.org/jira/browse/SPARK-39938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573985#comment-17573985 ] Apache Spark commented on SPARK-39938: -- User 'bzhaoopenstack' has created a pull re

[jira] [Commented] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573984#comment-17573984 ] Dongjoon Hyun commented on SPARK-39902: --- Thank you, [~sumeet.gajjar] . Apache Spar

[jira] [Created] (SPARK-39938) The prefix/suffix parameter validation in add_prefix/add_suffix should follow the pandas behavior

bo zhao created SPARK-39938: --- Summary: The prefix/suffix parameter validation in add_prefix/add_suffix should follow the pandas behavior Key: SPARK-39938 URL: https://issues.apache.org/jira/browse/SPARK-39938

[jira] [Updated] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39902: -- Affects Version/s: 3.4.0 (was: 3.3.1) > Add Scan details to spark p

[jira] [Updated] (SPARK-39917) Use different error classes for numeric/interval arithmetic overflow

[ https://issues.apache.org/jira/browse/SPARK-39917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39917: -- Fix Version/s: (was: 3.4.0) > Use different error classes for numeric/interval arithmetic

[jira] [Reopened] (SPARK-39917) Use different error classes for numeric/interval arithmetic overflow

[ https://issues.apache.org/jira/browse/SPARK-39917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-39917: --- Assignee: (was: Gengliang Wang) This is reverted via https://github.com/apache/spark/

[jira] [Assigned] (SPARK-39936) Spark View creation with hyphens in column-type names fails

[ https://issues.apache.org/jira/browse/SPARK-39936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39936: Assignee: (was: Apache Spark) > Spark View creation with hyphens in column-type names

[jira] [Commented] (SPARK-39936) Spark View creation with hyphens in column-type names fails

[ https://issues.apache.org/jira/browse/SPARK-39936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573964#comment-17573964 ] Apache Spark commented on SPARK-39936: -- User 'Jeffreychen99' has created a pull req

[jira] [Assigned] (SPARK-39936) Spark View creation with hyphens in column-type names fails

[ https://issues.apache.org/jira/browse/SPARK-39936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39936: Assignee: Apache Spark > Spark View creation with hyphens in column-type names fails > --

[jira] [Updated] (SPARK-39937) Substring

[ https://issues.apache.org/jira/browse/SPARK-39937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Davies updated SPARK-39937: -- Description: Hello, We hit a potential limitation of the substring function today that we thi

[jira] [Updated] (SPARK-39937) Substring

[ https://issues.apache.org/jira/browse/SPARK-39937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Davies updated SPARK-39937: -- Description: Hello, We hit a potential limitation of the substring function today that we thi

[jira] [Created] (SPARK-39937) Substring

Daniel Davies created SPARK-39937: - Summary: Substring Key: SPARK-39937 URL: https://issues.apache.org/jira/browse/SPARK-39937 Project: Spark Issue Type: New Feature Components: Spa

[jira] [Resolved] (SPARK-39914) Add DS V2 Filter to V1 Filter conversion

[ https://issues.apache.org/jira/browse/SPARK-39914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39914. Fix Version/s: 3.4.0 Assignee: Huaxin Gao Resolution: Fixed > Add DS V2 Filter to

[jira] [Resolved] (SPARK-39917) Use different error classes for numeric/interval arithmetic overflow

[ https://issues.apache.org/jira/browse/SPARK-39917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39917. Fix Version/s: 3.4.0 Resolution: Fixed > Use different error classes for numeric/in

[jira] [Created] (SPARK-39936) Spark View creation with hyphens in column-type names fails

Jeffrey Chen created SPARK-39936: Summary: Spark View creation with hyphens in column-type names fails Key: SPARK-39936 URL: https://issues.apache.org/jira/browse/SPARK-39936 Project: Spark

[jira] [Resolved] (SPARK-39848) Upgrade Kafka to 3.2.1

[ https://issues.apache.org/jira/browse/SPARK-39848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39848. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37261 [https://

[jira] [Assigned] (SPARK-39848) Upgrade Kafka to 3.2.1

[ https://issues.apache.org/jira/browse/SPARK-39848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39848: - Assignee: Dongjoon Hyun > Upgrade Kafka to 3.2.1 > -- > >

[jira] [Assigned] (SPARK-39935) Switch validateParsingError onto checkError

[ https://issues.apache.org/jira/browse/SPARK-39935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39935: Assignee: Apache Spark (was: Max Gekk) > Switch validateParsingError onto checkError > -

[jira] [Assigned] (SPARK-39935) Switch validateParsingError onto checkError

[ https://issues.apache.org/jira/browse/SPARK-39935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39935: Assignee: Max Gekk (was: Apache Spark) > Switch validateParsingError onto checkError > -

[jira] [Commented] (SPARK-39935) Switch validateParsingError onto checkError

[ https://issues.apache.org/jira/browse/SPARK-39935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573787#comment-17573787 ] Apache Spark commented on SPARK-39935: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-39935) Switch validateParsingError onto checkError

Max Gekk created SPARK-39935: Summary: Switch validateParsingError onto checkError Key: SPARK-39935 URL: https://issues.apache.org/jira/browse/SPARK-39935 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-33933) Broadcast timeout happened unexpectedly in AQE

[ https://issues.apache.org/jira/browse/SPARK-33933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573780#comment-17573780 ] Apache Spark commented on SPARK-33933: -- User 'weixiuli' has created a pull request

[jira] [Assigned] (SPARK-39925) Add array_sort(column, comparator) overload to DataFrame operations

[ https://issues.apache.org/jira/browse/SPARK-39925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39925: Assignee: (was: Apache Spark) > Add array_sort(column, comparator) overload to DataFr

[jira] [Assigned] (SPARK-39925) Add array_sort(column, comparator) overload to DataFrame operations

[ https://issues.apache.org/jira/browse/SPARK-39925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39925: Assignee: Apache Spark > Add array_sort(column, comparator) overload to DataFrame operati

[jira] [Commented] (SPARK-39925) Add array_sort(column, comparator) overload to DataFrame operations

[ https://issues.apache.org/jira/browse/SPARK-39925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573747#comment-17573747 ] Apache Spark commented on SPARK-39925: -- User 'brandondahler' has created a pull req

[jira] [Commented] (SPARK-39931) Improve performance of applyInPandas for very small groups

[ https://issues.apache.org/jira/browse/SPARK-39931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573746#comment-17573746 ] Apache Spark commented on SPARK-39931: -- User 'EnricoMi' has created a pull request

[jira] [Assigned] (SPARK-39931) Improve performance of applyInPandas for very small groups

[ https://issues.apache.org/jira/browse/SPARK-39931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39931: Assignee: Apache Spark > Improve performance of applyInPandas for very small groups > ---

[jira] [Commented] (SPARK-39931) Improve performance of applyInPandas for very small groups

[ https://issues.apache.org/jira/browse/SPARK-39931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573744#comment-17573744 ] Apache Spark commented on SPARK-39931: -- User 'EnricoMi' has created a pull request

[jira] [Assigned] (SPARK-39931) Improve performance of applyInPandas for very small groups

[ https://issues.apache.org/jira/browse/SPARK-39931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39931: Assignee: (was: Apache Spark) > Improve performance of applyInPandas for very small g

[jira] [Assigned] (SPARK-25342) Support rolling back a result stage

[ https://issues.apache.org/jira/browse/SPARK-25342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25342: Assignee: Apache Spark > Support rolling back a result stage > --

[jira] [Assigned] (SPARK-25342) Support rolling back a result stage

[ https://issues.apache.org/jira/browse/SPARK-25342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25342: Assignee: (was: Apache Spark) > Support rolling back a result stage > ---

[jira] [Commented] (SPARK-25342) Support rolling back a result stage

[ https://issues.apache.org/jira/browse/SPARK-25342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573727#comment-17573727 ] Apache Spark commented on SPARK-25342: -- User 'caican00' has created a pull request

[jira] [Commented] (SPARK-39933) Check query context by checkError()

[ https://issues.apache.org/jira/browse/SPARK-39933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573712#comment-17573712 ] Apache Spark commented on SPARK-39933: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-39933) Check query context by checkError()

[ https://issues.apache.org/jira/browse/SPARK-39933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39933: Assignee: Max Gekk (was: Apache Spark) > Check query context by checkError() > -

[jira] [Commented] (SPARK-39933) Check query context by checkError()

[ https://issues.apache.org/jira/browse/SPARK-39933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573711#comment-17573711 ] Apache Spark commented on SPARK-39933: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-39933) Check query context by checkError()

[ https://issues.apache.org/jira/browse/SPARK-39933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39933: Assignee: Apache Spark (was: Max Gekk) > Check query context by checkError() > -

[jira] [Updated] (SPARK-39931) Improve performance of applyInPandas for very small groups

[ https://issues.apache.org/jira/browse/SPARK-39931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-39931: -- Description: Calling `DataFrame.groupby(...).applyInPandas(...)` for very small groups in PyS

[jira] [Updated] (SPARK-39934) takeRDD in R is slow

[ https://issues.apache.org/jira/browse/SPARK-39934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deshanxiao updated SPARK-39934: --- Description: The api of SparkR:::takeRDD retrieves the result one partition per round. We can re-imp

[jira] [Assigned] (SPARK-39932) WindowExec should clear the final partition buffer

[ https://issues.apache.org/jira/browse/SPARK-39932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39932: Assignee: Apache Spark > WindowExec should clear the final partition buffer > ---

[jira] [Assigned] (SPARK-39932) WindowExec should clear the final partition buffer

[ https://issues.apache.org/jira/browse/SPARK-39932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39932: Assignee: (was: Apache Spark) > WindowExec should clear the final partition buffer >

[jira] [Commented] (SPARK-39932) WindowExec should clear the final partition buffer

[ https://issues.apache.org/jira/browse/SPARK-39932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573696#comment-17573696 ] Apache Spark commented on SPARK-39932: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-37935) Migrate onto error classes

[ https://issues.apache.org/jira/browse/SPARK-37935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573695#comment-17573695 ] Apache Spark commented on SPARK-37935: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-37935) Migrate onto error classes

[ https://issues.apache.org/jira/browse/SPARK-37935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573694#comment-17573694 ] Apache Spark commented on SPARK-37935: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-39934) takeRDD in R is slow

deshanxiao created SPARK-39934: -- Summary: takeRDD in R is slow Key: SPARK-39934 URL: https://issues.apache.org/jira/browse/SPARK-39934 Project: Spark Issue Type: Improvement Components

  1   2   >