[jira] [Updated] (SPARK-39225) Support spark.history.fs.update.batchSize

[ https://issues.apache.org/jira/browse/SPARK-39225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39225: -- Summary: Support spark.history.fs.update.batchSize (was: History Server initial scan may bloc

[jira] [Updated] (SPARK-39216) Do not collapse projects in CombineUnions if it hasCorrelatedSubquery

[ https://issues.apache.org/jira/browse/SPARK-39216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39216: -- Summary: Do not collapse projects in CombineUnions if it hasCorrelatedSubquery (was: Issue wi

[jira] [Assigned] (SPARK-39216) Issue with correlated subquery and Union

[ https://issues.apache.org/jira/browse/SPARK-39216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39216: - Assignee: yuming.wang > Issue with correlated subquery and Union >

[jira] [Updated] (SPARK-39216) Issue with correlated subquery and Union

[ https://issues.apache.org/jira/browse/SPARK-39216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39216: -- Fix Version/s: 3.3.1 (was: 3.3.0) > Issue with correlated subquery and

[jira] [Resolved] (SPARK-39216) Issue with correlated subquery and Union

[ https://issues.apache.org/jira/browse/SPARK-39216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39216. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36595 [https://

[jira] [Assigned] (SPARK-39216) Issue with correlated subquery and Union

[ https://issues.apache.org/jira/browse/SPARK-39216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39216: - Assignee: Yuming Wang (was: yuming.wang) > Issue with correlated subquery and Union >

[jira] [Assigned] (SPARK-39226) Fix the precision of the return type of round-like functions

[ https://issues.apache.org/jira/browse/SPARK-39226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39226: -- Assignee: Wenchen Fan > Fix the precision of the return type of round-like functions

[jira] [Resolved] (SPARK-39226) Fix the precision of the return type of round-like functions

[ https://issues.apache.org/jira/browse/SPARK-39226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39226. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36598 [https:

[jira] [Assigned] (SPARK-39232) Spark History Main Page App List Filtering

[ https://issues.apache.org/jira/browse/SPARK-39232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39232: Assignee: (was: Apache Spark) > Spark History Main Page App List Filtering >

[jira] [Commented] (SPARK-39232) Spark History Main Page App List Filtering

[ https://issues.apache.org/jira/browse/SPARK-39232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539302#comment-17539302 ] Apache Spark commented on SPARK-39232: -- User 'hai-tao-1' has created a pull request

[jira] [Assigned] (SPARK-39232) Spark History Main Page App List Filtering

[ https://issues.apache.org/jira/browse/SPARK-39232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39232: Assignee: Apache Spark > Spark History Main Page App List Filtering > ---

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539292#comment-17539292 ] Dongjoon Hyun commented on SPARK-6305: -- Hi, [~prathapn] . FYI, Apache Spark 3.3 is s

[jira] [Created] (SPARK-39232) Spark History Main Page App List Filtering

Hai Tao created SPARK-39232: --- Summary: Spark History Main Page App List Filtering Key: SPARK-39232 URL: https://issues.apache.org/jira/browse/SPARK-39232 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-39231) Change to use ConstantColumnVector to store partition columns in `VectorizedParquetRecordReader`

[ https://issues.apache.org/jira/browse/SPARK-39231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39231: - Summary: Change to use ConstantColumnVector to store partition columns in `VectorizedParquetRecordReader

[jira] [Updated] (SPARK-39231) Change to use `ConstantColumnVector` to store partition columns in `VectorizedParquetRecordReader`

[ https://issues.apache.org/jira/browse/SPARK-39231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39231: - Summary: Change to use `ConstantColumnVector` to store partition columns in `VectorizedParquetRecordRead

[jira] [Created] (SPARK-39231) Change to use ConstantColumnVector for partition column in `VectorizedParquetRecordReader`

Yang Jie created SPARK-39231: Summary: Change to use ConstantColumnVector for partition column in `VectorizedParquetRecordReader` Key: SPARK-39231 URL: https://issues.apache.org/jira/browse/SPARK-39231 Pr

[jira] [Resolved] (SPARK-39202) Introduce a `putByteArrays` method to `WritableColumnVector` to support setting multiple duplicate `byte[]`

[ https://issues.apache.org/jira/browse/SPARK-39202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-39202. -- Resolution: Won't Fix > Introduce a `putByteArrays` method to `WritableColumnVector` to support > set

[jira] [Updated] (SPARK-39224) Lower general ProcfsMetricsGetter error log levels except /proc/ lookup error

[ https://issues.apache.org/jira/browse/SPARK-39224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39224: -- Summary: Lower general ProcfsMetricsGetter error log levels except /proc/ lookup error (was:

[jira] [Resolved] (SPARK-39224) Ignore noisy. warning message in ProcfsMetricsGetter

[ https://issues.apache.org/jira/browse/SPARK-39224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39224. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36596 [https://

[jira] [Assigned] (SPARK-39224) Ignore noisy. warning message in ProcfsMetricsGetter

[ https://issues.apache.org/jira/browse/SPARK-39224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39224: - Assignee: angerszhu > Ignore noisy. warning message in ProcfsMetricsGetter > --

[jira] [Assigned] (SPARK-39229) Separate query contexts from error-classes.json

[ https://issues.apache.org/jira/browse/SPARK-39229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39229: Assignee: Gengliang Wang (was: Apache Spark) > Separate query contexts from error-classe

[jira] [Assigned] (SPARK-39229) Separate query contexts from error-classes.json

[ https://issues.apache.org/jira/browse/SPARK-39229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39229: Assignee: Apache Spark (was: Gengliang Wang) > Separate query contexts from error-classe

[jira] [Commented] (SPARK-28516) Data Type Formatting Functions: `to_char`

[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539185#comment-17539185 ] Apache Spark commented on SPARK-28516: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-28516) Data Type Formatting Functions: `to_char`

[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539187#comment-17539187 ] Apache Spark commented on SPARK-28516: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-39229) Separate query contexts from error-classes.json

[ https://issues.apache.org/jira/browse/SPARK-39229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539186#comment-17539186 ] Apache Spark commented on SPARK-39229: -- User 'gengliangwang' has created a pull req

[jira] [Updated] (SPARK-39230) Support ANSI Aggregate Function: regr_slope

[ https://issues.apache.org/jira/browse/SPARK-39230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39230: --- Description: REGR_SLOPE is an ANSI aggregate functions. many database support it. > Support ANSI Ag

[jira] [Created] (SPARK-39230) Support ANSI Aggregate Function: regr_slope

jiaan.geng created SPARK-39230: -- Summary: Support ANSI Aggregate Function: regr_slope Key: SPARK-39230 URL: https://issues.apache.org/jira/browse/SPARK-39230 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-39219) Promote Structured Streaming over Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-39219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-39219. -- Fix Version/s: 3.3.0 3.2.2 3.1.3 Resolution: Fixed

[jira] [Assigned] (SPARK-39219) Promote Structured Streaming over Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-39219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-39219: Assignee: Jungtaek Lim > Promote Structured Streaming over Spark Streaming >

[jira] [Created] (SPARK-39229) Separate query contexts from error-classes.json

Gengliang Wang created SPARK-39229: -- Summary: Separate query contexts from error-classes.json Key: SPARK-39229 URL: https://issues.apache.org/jira/browse/SPARK-39229 Project: Spark Issue Typ

[jira] [Updated] (SPARK-37525) Timedelta support in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-37525: - Summary: Timedelta support in pandas API on Spark (was: Support TimedeltaIndex in pandas API on

[jira] [Assigned] (SPARK-39163) Throw an exception w/ error class for an invalid bucket file

[ https://issues.apache.org/jira/browse/SPARK-39163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39163: Assignee: Apache Spark > Throw an exception w/ error class for an invalid bucket file > -

[jira] [Assigned] (SPARK-39163) Throw an exception w/ error class for an invalid bucket file

[ https://issues.apache.org/jira/browse/SPARK-39163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39163: Assignee: (was: Apache Spark) > Throw an exception w/ error class for an invalid buck

[jira] [Commented] (SPARK-39163) Throw an exception w/ error class for an invalid bucket file

[ https://issues.apache.org/jira/browse/SPARK-39163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539153#comment-17539153 ] Apache Spark commented on SPARK-39163: -- User 'panbingkun' has created a pull reques

[jira] [Resolved] (SPARK-39168) Consider all values in a python list when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39168. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36545 [https://gi

[jira] [Assigned] (SPARK-39168) Consider all values in a python list when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39168: Assignee: Brian Schaefer > Consider all values in a python list when inferring schema > -

[jira] [Resolved] (SPARK-37525) Support TimedeltaIndex in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-37525. -- Resolution: Resolved > Support TimedeltaIndex in pandas API on Spark > ---

[jira] [Commented] (SPARK-38987) Handle fallback when merged shuffle blocks are corrupted and spark.shuffle.detectCorrupt is set to true

[ https://issues.apache.org/jira/browse/SPARK-38987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539112#comment-17539112 ] Apache Spark commented on SPARK-38987: -- User 'akpatnam25' has created a pull reques

[jira] [Resolved] (SPARK-39119) Upgrade to Hadoop 3.3.3

[ https://issues.apache.org/jira/browse/SPARK-39119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39119. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36474 [https://

[jira] [Assigned] (SPARK-39119) Upgrade to Hadoop 3.3.3

[ https://issues.apache.org/jira/browse/SPARK-39119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39119: - Assignee: Chao Sun > Upgrade to Hadoop 3.3.3 > --- > >

[jira] [Commented] (SPARK-39212) Use double quotes for values of SQL configs/DS options in error messages

[ https://issues.apache.org/jira/browse/SPARK-39212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539071#comment-17539071 ] Apache Spark commented on SPARK-39212: -- User 'MaxGekk' has created a pull request f

[jira] [Updated] (SPARK-39213) Create ANY_VALUE aggregate function

[ https://issues.apache.org/jira/browse/SPARK-39213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vitalii Li updated SPARK-39213: --- Affects Version/s: 3.4.0 (was: 3.3.0) > Create ANY_VALUE aggregate functi

[jira] [Assigned] (SPARK-39228) Implement `skipna` of `Series.argmax`

[ https://issues.apache.org/jira/browse/SPARK-39228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39228: Assignee: Apache Spark > Implement `skipna` of `Series.argmax` >

[jira] [Assigned] (SPARK-39228) Implement `skipna` of `Series.argmax`

[ https://issues.apache.org/jira/browse/SPARK-39228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39228: Assignee: (was: Apache Spark) > Implement `skipna` of `Series.argmax` > -

[jira] [Commented] (SPARK-39228) Implement `skipna` of `Series.argmax`

[ https://issues.apache.org/jira/browse/SPARK-39228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539061#comment-17539061 ] Apache Spark commented on SPARK-39228: -- User 'xinrong-databricks' has created a pul

[jira] [Created] (SPARK-39228) Implement `skipna` of `Series.argmax`

Xinrong Meng created SPARK-39228: Summary: Implement `skipna` of `Series.argmax` Key: SPARK-39228 URL: https://issues.apache.org/jira/browse/SPARK-39228 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-39225) History Server initial scan may block new eventlog update

[ https://issues.apache.org/jira/browse/SPARK-39225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39225: -- Fix Version/s: (was: 3.1.2) (was: 3.0.3) (was

[jira] [Updated] (SPARK-39225) History Server initial scan may block new eventlog update

[ https://issues.apache.org/jira/browse/SPARK-39225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39225: -- Affects Version/s: 3.4.0 (was: 3.1.2) (wa

[jira] [Updated] (SPARK-39225) History Server initial scan may block new eventlog update

[ https://issues.apache.org/jira/browse/SPARK-39225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39225: -- Target Version/s: (was: 3.0.3, 3.1.2, 3.2.1, 3.4.0, 3.3.1) > History Server initial scan may

[jira] [Updated] (SPARK-39214) Improve errors related to CAST

[ https://issues.apache.org/jira/browse/SPARK-39214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39214: - Fix Version/s: 3.3.1 > Improve errors related to CAST > -- > >

[jira] [Updated] (SPARK-39214) Improve errors related to CAST

[ https://issues.apache.org/jira/browse/SPARK-39214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39214: - Affects Version/s: 3.3.0 > Improve errors related to CAST > -- > >

[jira] [Updated] (SPARK-39227) Reach parity with pandas boolean cast

[ https://issues.apache.org/jira/browse/SPARK-39227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39227: - Description: There are pandas APIs that need boolean casts: all, any. Currently, pandas-on-Spar

[jira] [Created] (SPARK-39227) Reach parity with pandas boolean cast

Xinrong Meng created SPARK-39227: Summary: Reach parity with pandas boolean cast Key: SPARK-39227 URL: https://issues.apache.org/jira/browse/SPARK-39227 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-39226) Fix the precision of the return type of round-like functions

[ https://issues.apache.org/jira/browse/SPARK-39226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39226: Assignee: (was: Apache Spark) > Fix the precision of the return type of round-like fu

[jira] [Assigned] (SPARK-39226) Fix the precision of the return type of round-like functions

[ https://issues.apache.org/jira/browse/SPARK-39226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39226: Assignee: Apache Spark > Fix the precision of the return type of round-like functions > -

[jira] [Commented] (SPARK-39226) Fix the precision of the return type of round-like functions

[ https://issues.apache.org/jira/browse/SPARK-39226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538999#comment-17538999 ] Apache Spark commented on SPARK-39226: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-39226) Fix the precision of the return type of round-like functions

Wenchen Fan created SPARK-39226: --- Summary: Fix the precision of the return type of round-like functions Key: SPARK-39226 URL: https://issues.apache.org/jira/browse/SPARK-39226 Project: Spark I

[jira] [Assigned] (SPARK-39225) History Server initial scan may block new eventlog update

[ https://issues.apache.org/jira/browse/SPARK-39225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39225: Assignee: (was: Apache Spark) > History Server initial scan may block new eventlog up

[jira] [Assigned] (SPARK-39225) History Server initial scan may block new eventlog update

[ https://issues.apache.org/jira/browse/SPARK-39225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39225: Assignee: Apache Spark > History Server initial scan may block new eventlog update >

[jira] [Commented] (SPARK-39225) History Server initial scan may block new eventlog update

[ https://issues.apache.org/jira/browse/SPARK-39225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538970#comment-17538970 ] Apache Spark commented on SPARK-39225: -- User 'hai-tao-1' has created a pull request

[jira] [Updated] (SPARK-39225) History Server initial scan may block new eventlog update

[ https://issues.apache.org/jira/browse/SPARK-39225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hai Tao updated SPARK-39225: Target Version/s: 3.2.1, 3.1.2, 3.0.3, 3.4.0, 3.3.1 (was: 3.0.3, 3.1.2, 3.2.1, 3.4.0, 3.3.1)

[jira] [Commented] (SPARK-39225) History Server initial scan may block new eventlog update

[ https://issues.apache.org/jira/browse/SPARK-39225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538953#comment-17538953 ] Hai Tao commented on SPARK-39225: - Created PR https://github.com/apache/spark/pull/36597

[jira] [Created] (SPARK-39225) History Server initial scan may block new eventlog update

Hai Tao created SPARK-39225: --- Summary: History Server initial scan may block new eventlog update Key: SPARK-39225 URL: https://issues.apache.org/jira/browse/SPARK-39225 Project: Spark Issue Type: I

[jira] [Resolved] (SPARK-39212) Use double quotes for values of SQL configs/DS options in error messages

[ https://issues.apache.org/jira/browse/SPARK-39212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39212. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36579 [https://github.com

[jira] [Updated] (SPARK-39162) Jdbc dialect should decide which function could be pushed down.

[ https://issues.apache.org/jira/browse/SPARK-39162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-39162: Fix Version/s: 3.3.0 (was: 3.4.0) > Jdbc dialect should decide which functi

[jira] [Commented] (SPARK-39224) Ignore noisy. warning message in ProcfsMetricsGetter

[ https://issues.apache.org/jira/browse/SPARK-39224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538786#comment-17538786 ] Apache Spark commented on SPARK-39224: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-39224) Ignore noisy. warning message in ProcfsMetricsGetter

[ https://issues.apache.org/jira/browse/SPARK-39224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39224: Assignee: Apache Spark > Ignore noisy. warning message in ProcfsMetricsGetter > -

[jira] [Commented] (SPARK-39224) Ignore noisy. warning message in ProcfsMetricsGetter

[ https://issues.apache.org/jira/browse/SPARK-39224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538784#comment-17538784 ] Apache Spark commented on SPARK-39224: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-39224) Ignore noisy. warning message in ProcfsMetricsGetter

[ https://issues.apache.org/jira/browse/SPARK-39224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39224: Assignee: (was: Apache Spark) > Ignore noisy. warning message in ProcfsMetricsGetter

[jira] [Updated] (SPARK-39224) Ignore noisy. warning message in ProcfsMetricsGetter

[ https://issues.apache.org/jira/browse/SPARK-39224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-39224: -- Summary: Ignore noisy. warning message in ProcfsMetricsGetter (was: Ignore noisy. warning message in

[jira] [Created] (SPARK-39224) Ignore noisy. warning message in ProcessMetricsGetter

angerszhu created SPARK-39224: - Summary: Ignore noisy. warning message in ProcessMetricsGetter Key: SPARK-39224 URL: https://issues.apache.org/jira/browse/SPARK-39224 Project: Spark Issue Type: T

[jira] [Updated] (SPARK-39224) Ignore noisy. warning message in ProcessMetricsGetter

[ https://issues.apache.org/jira/browse/SPARK-39224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-39224: -- Description: There are many user complain about the noisy warning messages in ProcessMetricsGetter {

[jira] [Commented] (SPARK-39216) Issue with correlated subquery and Union

[ https://issues.apache.org/jira/browse/SPARK-39216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538753#comment-17538753 ] Apache Spark commented on SPARK-39216: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-39216) Issue with correlated subquery and Union

[ https://issues.apache.org/jira/browse/SPARK-39216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538751#comment-17538751 ] Apache Spark commented on SPARK-39216: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-39216) Issue with correlated subquery and Union

[ https://issues.apache.org/jira/browse/SPARK-39216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39216: Assignee: (was: Apache Spark) > Issue with correlated subquery and Union > --

[jira] [Assigned] (SPARK-39216) Issue with correlated subquery and Union

[ https://issues.apache.org/jira/browse/SPARK-39216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39216: Assignee: Apache Spark > Issue with correlated subquery and Union > -

[jira] [Resolved] (SPARK-39210) Provide query context of Decimal overflow in AVG when WSCG is off

[ https://issues.apache.org/jira/browse/SPARK-39210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39210. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36582 [https:

[jira] [Assigned] (SPARK-39223) implement skew and kurt in Rolling/RollingGroupby/Expanding/ExpandingGroupby

[ https://issues.apache.org/jira/browse/SPARK-39223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39223: Assignee: Apache Spark > implement skew and kurt in Rolling/RollingGroupby/Expanding/Expa

[jira] [Assigned] (SPARK-39223) implement skew and kurt in Rolling/RollingGroupby/Expanding/ExpandingGroupby

[ https://issues.apache.org/jira/browse/SPARK-39223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39223: Assignee: (was: Apache Spark) > implement skew and kurt in Rolling/RollingGroupby/Exp

[jira] [Assigned] (SPARK-39139) DS V2 push-down supports DS V2 UDF

[ https://issues.apache.org/jira/browse/SPARK-39139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39139: Assignee: Apache Spark > DS V2 push-down supports DS V2 UDF > ---

[jira] [Assigned] (SPARK-39139) DS V2 push-down supports DS V2 UDF

[ https://issues.apache.org/jira/browse/SPARK-39139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39139: Assignee: (was: Apache Spark) > DS V2 push-down supports DS V2 UDF >

[jira] [Commented] (SPARK-39223) implement skew and kurt in Rolling/RollingGroupby/Expanding/ExpandingGroupby

[ https://issues.apache.org/jira/browse/SPARK-39223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538709#comment-17538709 ] Apache Spark commented on SPARK-39223: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-39139) DS V2 push-down supports DS V2 UDF

[ https://issues.apache.org/jira/browse/SPARK-39139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538710#comment-17538710 ] Apache Spark commented on SPARK-39139: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-39139) DS V2 push-down supports DS V2 UDF

[ https://issues.apache.org/jira/browse/SPARK-39139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538708#comment-17538708 ] Apache Spark commented on SPARK-39139: -- User 'beliefer' has created a pull request

[jira] (SPARK-39139) DS V2 push-down supports DS V2 UDF

[ https://issues.apache.org/jira/browse/SPARK-39139 ] jiaan.geng deleted comment on SPARK-39139: was (Author: beliefer): I'm working on. > DS V2 push-down supports DS V2 UDF > -- > > Key: SPARK-39

[jira] [Created] (SPARK-39223) implement skew and kurt in Rolling/RollingGroupby/Expanding/ExpandingGroupby

zhengruifeng created SPARK-39223: Summary: implement skew and kurt in Rolling/RollingGroupby/Expanding/ExpandingGroupby Key: SPARK-39223 URL: https://issues.apache.org/jira/browse/SPARK-39223 Project:

[jira] [Created] (SPARK-39222) Add JvmPauseMonitor to Spark History Server

Miklos Szurap created SPARK-39222: - Summary: Add JvmPauseMonitor to Spark History Server Key: SPARK-39222 URL: https://issues.apache.org/jira/browse/SPARK-39222 Project: Spark Issue Type: Imp

[jira] [Updated] (SPARK-39139) DS V2 push-down supports DS V2 UDF

[ https://issues.apache.org/jira/browse/SPARK-39139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39139: --- Summary: DS V2 push-down supports DS V2 UDF (was: DS V2 push-down supports UDF V2) > DS V2 push-do

[jira] [Updated] (SPARK-39209) Error occurs when cast a big enough long to timestamp in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-39209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chong updated SPARK-39209: -- Description:   Got Error when cast a big enough long to a timestamp in ANSI mode, should get the max timestam

[jira] [Updated] (SPARK-39209) Error occurs when cast a big enough long to timestamp in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-39209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chong updated SPARK-39209: -- Description:   Got Error when cast a big enough long to a timestamp in ANSI mode, should get the max timestam

[jira] [Assigned] (SPARK-39215) Reduce Py4J calls in pyspark.sql.utils.is_timestamp_ntz_preferred

[ https://issues.apache.org/jira/browse/SPARK-39215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39215: Assignee: Hyukjin Kwon > Reduce Py4J calls in pyspark.sql.utils.is_timestamp_ntz_preferre

[jira] [Resolved] (SPARK-39215) Reduce Py4J calls in pyspark.sql.utils.is_timestamp_ntz_preferred

[ https://issues.apache.org/jira/browse/SPARK-39215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39215. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36587 [https://gi

[jira] [Commented] (SPARK-39221) sensitive information is not redacted correctly on thrift job/stage page

[ https://issues.apache.org/jira/browse/SPARK-39221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538653#comment-17538653 ] Apache Spark commented on SPARK-39221: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-39221) sensitive information is not redacted correctly on thrift job/stage page

[ https://issues.apache.org/jira/browse/SPARK-39221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39221: Assignee: Apache Spark > sensitive information is not redacted correctly on thrift job/st

[jira] [Assigned] (SPARK-39221) sensitive information is not redacted correctly on thrift job/stage page

[ https://issues.apache.org/jira/browse/SPARK-39221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39221: Assignee: (was: Apache Spark) > sensitive information is not redacted correctly on th

[jira] [Commented] (SPARK-39214) Improve errors related to CAST

[ https://issues.apache.org/jira/browse/SPARK-39214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538650#comment-17538650 ] Apache Spark commented on SPARK-39214: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-39221) sensitive information is not redacted correctly on thrift job/stage page

[ https://issues.apache.org/jira/browse/SPARK-39221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538652#comment-17538652 ] Apache Spark commented on SPARK-39221: -- User 'yaooqinn' has created a pull request

[jira] [Updated] (SPARK-39221) sensitive information is not redacted correctly on thrift job/stage page

[ https://issues.apache.org/jira/browse/SPARK-39221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-39221: - Summary: sensitive information is not redacted correctly on thrift job/stage page (was: sensitive infor

[jira] [Created] (SPARK-39221) sensitive information is not redacted correctly

Kent Yao created SPARK-39221: Summary: sensitive information is not redacted correctly Key: SPARK-39221 URL: https://issues.apache.org/jira/browse/SPARK-39221 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-39216) Issue with correlated subquery and Union

[ https://issues.apache.org/jira/browse/SPARK-39216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538640#comment-17538640 ] Wenchen Fan commented on SPARK-39216: - [~yumwang] can you take a look? > Issue with

  1   2   >