[jira] [Assigned] (SPARK-37733) Change log level of tests to WARN

[ https://issues.apache.org/jira/browse/SPARK-37733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37733: Assignee: Gengliang Wang (was: Apache Spark) > Change log level of tests to WARN >

[jira] [Assigned] (SPARK-37733) Change log level of tests to WARN

[ https://issues.apache.org/jira/browse/SPARK-37733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37733: Assignee: Apache Spark (was: Gengliang Wang) > Change log level of tests to WARN >

[jira] [Commented] (SPARK-37733) Change log level of tests to WARN

[ https://issues.apache.org/jira/browse/SPARK-37733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464919#comment-17464919 ] Apache Spark commented on SPARK-37733: -- User 'gengliangwang' has created a pull request for this

[jira] [Updated] (SPARK-37733) Change log level of tests to WARN

[ https://issues.apache.org/jira/browse/SPARK-37733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-37733: --- Component/s: Build (was: Project Infra) > Change log level of tests to

[jira] [Created] (SPARK-37733) Change log level of tests to WARN

Gengliang Wang created SPARK-37733: -- Summary: Change log level of tests to WARN Key: SPARK-37733 URL: https://issues.apache.org/jira/browse/SPARK-37733 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-37732) Improve the implement of JDBCV2Suite

[ https://issues.apache.org/jira/browse/SPARK-37732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464906#comment-17464906 ] Apache Spark commented on SPARK-37732: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37732) Improve the implement of JDBCV2Suite

[ https://issues.apache.org/jira/browse/SPARK-37732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37732: Assignee: Apache Spark > Improve the implement of JDBCV2Suite >

[jira] [Assigned] (SPARK-37732) Improve the implement of JDBCV2Suite

[ https://issues.apache.org/jira/browse/SPARK-37732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37732: Assignee: (was: Apache Spark) > Improve the implement of JDBCV2Suite >

[jira] [Updated] (SPARK-37732) Improve the implement of JDBCV2Suite

[ https://issues.apache.org/jira/browse/SPARK-37732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37732: --- Description: When I reading the implement of JDBCV2Suite, I find we can improve the code. (was:

[jira] [Updated] (SPARK-37732) Improve the implement of JDBCV2Suite

[ https://issues.apache.org/jira/browse/SPARK-37732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37732: --- Description: When I read the > Improve the implement of JDBCV2Suite >

[jira] [Created] (SPARK-37732) Improve the implement of JDBCV2Suite

jiaan.geng created SPARK-37732: -- Summary: Improve the implement of JDBCV2Suite Key: SPARK-37732 URL: https://issues.apache.org/jira/browse/SPARK-37732 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-37527) Translate more standard aggregate functions for pushdown

[ https://issues.apache.org/jira/browse/SPARK-37527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464902#comment-17464902 ] Apache Spark commented on SPARK-37527: -- User 'beliefer' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37727) Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-37727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37727. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35001

[jira] [Assigned] (SPARK-37727) Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-37727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37727: Assignee: Hyukjin Kwon > Show ignored confs & hide warnings for conf already set in >

[jira] [Commented] (SPARK-37478) Unify v1 and v2 DROP NAMESPACE tests

[ https://issues.apache.org/jira/browse/SPARK-37478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464877#comment-17464877 ] Apache Spark commented on SPARK-37478: -- User 'dchvn' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37720) /1624610690382/state/0/8/1272.delta does not exist at org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider.updateFromDeltaFile

[ https://issues.apache.org/jira/browse/SPARK-37720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37720. -- Resolution: Invalid This is likely a version mismatch somewhere in your environment between

[jira] [Commented] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh

[ https://issues.apache.org/jira/browse/SPARK-37302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464868#comment-17464868 ] Apache Spark commented on SPARK-37302: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-34648) Reading Parquet Files in Spark Extremely Slow for Large Number of Files?

[ https://issues.apache.org/jira/browse/SPARK-34648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464859#comment-17464859 ] vicviz commented on SPARK-34648: I also encountered this problem on 2.0.2; But it works well and read

[jira] [Updated] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37391: - Fix Version/s: 3.1.3 3.2.1 > SIGNIFICANT bottleneck introduced by fix for

[jira] [Resolved] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37391. Fix Version/s: 3.3.0 Assignee: Danny Guinther Resolution: Fixed Issue

[jira] [Resolved] (SPARK-37657) Support str and timestamp for (Series|DataFrame).describe()

[ https://issues.apache.org/jira/browse/SPARK-37657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37657. -- Fix Version/s: 3.3.0 Assignee: Haejoon Lee Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-37716) Allow LateralJoin node to host non-deterministic expressions when the outer query is a single row relation

[ https://issues.apache.org/jira/browse/SPARK-37716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-37716: - Description: After https://issues.apache.org/jira/browse/SPARK-37199, Analyzer will block

[jira] [Updated] (SPARK-37716) Allow LateralJoin node to host non-deterministic expressions when the outer query is a single row relation

[ https://issues.apache.org/jira/browse/SPARK-37716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-37716: - Description: After https://issues.apache.org/jira/browse/SPARK-37199, Analyzer will block

[jira] [Updated] (SPARK-37716) Allow LateralJoin node to host non-deterministic expressions when the outer query is a single row relation

[ https://issues.apache.org/jira/browse/SPARK-37716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-37716: - Summary: Allow LateralJoin node to host non-deterministic expressions when the outer query is a

[jira] [Assigned] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8582: --- Assignee: Apache Spark (was: Shixiong Zhu) > Optimize checkpointing to avoid computing an

[jira] [Commented] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464794#comment-17464794 ] Apache Spark commented on SPARK-8582: - User 'agrawaldevesh' has created a pull request for this

[jira] [Assigned] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8582: --- Assignee: Shixiong Zhu (was: Apache Spark) > Optimize checkpointing to avoid computing an

[jira] [Reopened] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devesh Agrawal reopened SPARK-8582: --- This issue hasn't been fixed satisfactorily and I am making one more attempt at it:

[jira] [Commented] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464790#comment-17464790 ] Apache Spark commented on SPARK-8582: - User 'agrawaldevesh' has created a pull request for this

[jira] [Resolved] (SPARK-37700) Add LoggingSuite and some improvements

[ https://issues.apache.org/jira/browse/SPARK-37700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-37700. - Resolution: Invalid > Add LoggingSuite and some improvements >

[jira] [Assigned] (SPARK-37729) SparkSession.setLogLevel not working in Spark Shell

[ https://issues.apache.org/jira/browse/SPARK-37729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-37729: --- Assignee: L. C. Hsieh > SparkSession.setLogLevel not working in Spark Shell >

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464750#comment-17464750 ] Apache Spark commented on SPARK-6305: - User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-37729) SparkSession.setLogLevel not working in Spark Shell

[ https://issues.apache.org/jira/browse/SPARK-37729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464729#comment-17464729 ] L. C. Hsieh commented on SPARK-37729: - [~hyukjin.kwon] Thanks. Let me check it. >

[jira] [Assigned] (SPARK-37731) refactor and cleanup function lookup in Analyzer

[ https://issues.apache.org/jira/browse/SPARK-37731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37731: Assignee: Apache Spark > refactor and cleanup function lookup in Analyzer >

[jira] [Commented] (SPARK-37731) refactor and cleanup function lookup in Analyzer

[ https://issues.apache.org/jira/browse/SPARK-37731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464643#comment-17464643 ] Apache Spark commented on SPARK-37731: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37731) refactor and cleanup function lookup in Analyzer

[ https://issues.apache.org/jira/browse/SPARK-37731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37731: Assignee: (was: Apache Spark) > refactor and cleanup function lookup in Analyzer >

[jira] [Resolved] (SPARK-37193) DynamicJoinSelection.shouldDemoteBroadcastHashJoin should not apply to outer joins

[ https://issues.apache.org/jira/browse/SPARK-37193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37193. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34464

[jira] [Assigned] (SPARK-37193) DynamicJoinSelection.shouldDemoteBroadcastHashJoin should not apply to outer joins

[ https://issues.apache.org/jira/browse/SPARK-37193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37193: --- Assignee: Eugene Koifman > DynamicJoinSelection.shouldDemoteBroadcastHashJoin should not

[jira] [Assigned] (SPARK-37644) Support datasource v2 complete aggregate pushdown

[ https://issues.apache.org/jira/browse/SPARK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37644: --- Assignee: jiaan.geng > Support datasource v2 complete aggregate pushdown >

[jira] [Resolved] (SPARK-37644) Support datasource v2 complete aggregate pushdown

[ https://issues.apache.org/jira/browse/SPARK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37644. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34904

[jira] [Created] (SPARK-37731) refactor and cleanup function lookup in Analyzer

Wenchen Fan created SPARK-37731: --- Summary: refactor and cleanup function lookup in Analyzer Key: SPARK-37731 URL: https://issues.apache.org/jira/browse/SPARK-37731 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-37718) Demo sql is incorrect

[ https://issues.apache.org/jira/browse/SPARK-37718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37718: Assignee: Peng > Demo sql is incorrect > - > > Key:

[jira] [Resolved] (SPARK-37718) Demo sql is incorrect

[ https://issues.apache.org/jira/browse/SPARK-37718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37718. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34992

[jira] [Commented] (SPARK-37659) Fix FsHistoryProvider race condition between list and delet log info

[ https://issues.apache.org/jira/browse/SPARK-37659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464582#comment-17464582 ] Apache Spark commented on SPARK-37659: -- User 'ulysses-you' has created a pull request for this

[jira] [Resolved] (SPARK-37462) Avoid unnecessary calculating the number of outstanding fetch requests and RPCS

[ https://issues.apache.org/jira/browse/SPARK-37462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37462. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34711

[jira] [Updated] (SPARK-37730) plot.hist throws AttributeError on pandas=1.3.5

[ https://issues.apache.org/jira/browse/SPARK-37730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michał Słapek updated SPARK-37730: -- Description: plot.hist from PySpark throws AttributeError exception when pyspark.pandas is

[jira] [Updated] (SPARK-37462) Avoid unnecessary calculating the number of outstanding fetch requests and RPCS

[ https://issues.apache.org/jira/browse/SPARK-37462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37462: - Priority: Trivial (was: Major) > Avoid unnecessary calculating the number of outstanding

[jira] [Assigned] (SPARK-37462) Avoid unnecessary calculating the number of outstanding fetch requests and RPCS

[ https://issues.apache.org/jira/browse/SPARK-37462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37462: Assignee: weixiuli > Avoid unnecessary calculating the number of outstanding fetch

[jira] [Resolved] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

[ https://issues.apache.org/jira/browse/SPARK-37668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37668. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34957

[jira] [Assigned] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

[ https://issues.apache.org/jira/browse/SPARK-37668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37668: Assignee: Haejoon Lee > 'Index' object has no attribute 'levels' in >

[jira] [Commented] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-37728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464554#comment-17464554 ] Apache Spark commented on SPARK-37728: -- User 'yym1995' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-37728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37728: Assignee: Apache Spark > reading nested columns with ORC vectorized reader can cause >

[jira] [Assigned] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-37728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37728: Assignee: (was: Apache Spark) > reading nested columns with ORC vectorized reader

[jira] [Commented] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-37728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464553#comment-17464553 ] Apache Spark commented on SPARK-37728: -- User 'yym1995' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37727) Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-37727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37727: Assignee: (was: Apache Spark) > Show ignored confs & hide warnings for conf already

[jira] [Assigned] (SPARK-37727) Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-37727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37727: Assignee: Apache Spark > Show ignored confs & hide warnings for conf already set in >

[jira] [Commented] (SPARK-37727) Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-37727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464529#comment-17464529 ] Apache Spark commented on SPARK-37727: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-37730) plot.hist throws AttributeError on pandas=1.3.5

[ https://issues.apache.org/jira/browse/SPARK-37730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464523#comment-17464523 ] Apache Spark commented on SPARK-37730: -- User 'mslapek' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37730) plot.hist throws AttributeError on pandas=1.3.5

[ https://issues.apache.org/jira/browse/SPARK-37730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37730: Assignee: (was: Apache Spark) > plot.hist throws AttributeError on pandas=1.3.5 >

[jira] [Assigned] (SPARK-37730) plot.hist throws AttributeError on pandas=1.3.5

[ https://issues.apache.org/jira/browse/SPARK-37730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37730: Assignee: Apache Spark > plot.hist throws AttributeError on pandas=1.3.5 >

[jira] [Commented] (SPARK-37730) plot.hist throws AttributeError on pandas=1.3.5

[ https://issues.apache.org/jira/browse/SPARK-37730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464522#comment-17464522 ] Apache Spark commented on SPARK-37730: -- User 'mslapek' has created a pull request for this issue:

[jira] [Created] (SPARK-37730) plot.hist throws AttributeError on pandas=1.3.5

Michał Słapek created SPARK-37730: - Summary: plot.hist throws AttributeError on pandas=1.3.5 Key: SPARK-37730 URL: https://issues.apache.org/jira/browse/SPARK-37730 Project: Spark Issue

[jira] [Resolved] (SPARK-37714) ANSI mode: allow casting between numeric type and timestamp type

[ https://issues.apache.org/jira/browse/SPARK-37714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-37714. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34985

[jira] [Updated] (SPARK-37727) Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-37727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37727: - Description: Currently, {{SparkSession.builder.getOrCreate()}} is too noisy even when

[jira] [Commented] (SPARK-37729) SparkSession.setLogLevel not working in Spark Shell

[ https://issues.apache.org/jira/browse/SPARK-37729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464510#comment-17464510 ] Hyukjin Kwon commented on SPARK-37729: -- cc [~viirya] FYI. I think this is a regression by upgrading

[jira] [Created] (SPARK-37729) SparkSession.setLogLevel not working in Spark Shell

Hyukjin Kwon created SPARK-37729: Summary: SparkSession.setLogLevel not working in Spark Shell Key: SPARK-37729 URL: https://issues.apache.org/jira/browse/SPARK-37729 Project: Spark Issue

[jira] [Updated] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-37728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yimin Yang updated SPARK-37728: --- Description: When spark.sql.orc.enableNestedColumnVectorizedReader is set to true, reading nested

[jira] [Updated] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException

A0 at org.apache.spark.scheduler.DAGScheduler.$anonfun$abortStage$2$adapted(DAGScheduler.scala:2403)   at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)   at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)   at

[jira] [Updated] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-37728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yimin Yang updated SPARK-37728: --- Description: When spark.sql.orc.enableNestedColumnVectorizedReader is set to true, reading nested

[jira] [Created] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException

Yimin Yang created SPARK-37728: -- Summary: reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException Key: SPARK-37728 URL: https://issues.apache.org/jira/browse/SPARK-37728

[jira] [Updated] (SPARK-37727) Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-37727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37727: - Description: Currently, {{SparkSession.builder.getOrCreate()}} is too noisy even when

[jira] [Created] (SPARK-37727) Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate

Hyukjin Kwon created SPARK-37727: Summary: Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate Key: SPARK-37727 URL: https://issues.apache.org/jira/browse/SPARK-37727

[jira] [Assigned] (SPARK-37721) Failed to execute pyspark test in Win WSL

[ https://issues.apache.org/jira/browse/SPARK-37721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37721: Assignee: Yikun Jiang > Failed to execute pyspark test in Win WSL >

[jira] [Resolved] (SPARK-37721) Failed to execute pyspark test in Win WSL

[ https://issues.apache.org/jira/browse/SPARK-37721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37721. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34993

[jira] [Assigned] (SPARK-37726) Add spill size metrics for sort merge join

[ https://issues.apache.org/jira/browse/SPARK-37726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37726: Assignee: (was: Apache Spark) > Add spill size metrics for sort merge join >

[jira] [Assigned] (SPARK-37726) Add spill size metrics for sort merge join

[ https://issues.apache.org/jira/browse/SPARK-37726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37726: Assignee: Apache Spark > Add spill size metrics for sort merge join >

[jira] [Commented] (SPARK-37726) Add spill size metrics for sort merge join

[ https://issues.apache.org/jira/browse/SPARK-37726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464411#comment-17464411 ] Apache Spark commented on SPARK-37726: -- User 'c21' has created a pull request for this issue:

[jira] [Created] (SPARK-37726) Add spill size metrics for sort merge join

Cheng Su created SPARK-37726: Summary: Add spill size metrics for sort merge join Key: SPARK-37726 URL: https://issues.apache.org/jira/browse/SPARK-37726 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-37725) Spark master UI behind reverse proxy app storage redirects to master home page

[ https://issues.apache.org/jira/browse/SPARK-37725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Paraschiv updated SPARK-37725: - Description: 1. Using a Spark v3.1.1 Cluster with haproxy as reverse proxy enabled, web

[jira] [Created] (SPARK-37725) Spark master UI behind reverse proxy app storage redirects to master home page

Adrian Paraschiv created SPARK-37725: Summary: Spark master UI behind reverse proxy app storage redirects to master home page Key: SPARK-37725 URL: https://issues.apache.org/jira/browse/SPARK-37725

[jira] [Commented] (SPARK-37496) Migrate ReplaceTableAsSelectStatement to v2 command

[ https://issues.apache.org/jira/browse/SPARK-37496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464356#comment-17464356 ] Apache Spark commented on SPARK-37496: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-37690) Recursive view `df` detected (cycle: `df` -> `df`)

[ https://issues.apache.org/jira/browse/SPARK-37690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464354#comment-17464354 ] Robin commented on SPARK-37690: --- Someone

[jira] [Assigned] (SPARK-37724) ANSI mode: disable ANSI reserved keywords by default

[ https://issues.apache.org/jira/browse/SPARK-37724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37724: Assignee: Gengliang Wang (was: Apache Spark) > ANSI mode: disable ANSI reserved

[jira] [Assigned] (SPARK-37724) ANSI mode: disable ANSI reserved keywords by default

[ https://issues.apache.org/jira/browse/SPARK-37724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37724: Assignee: Apache Spark (was: Gengliang Wang) > ANSI mode: disable ANSI reserved

[jira] [Commented] (SPARK-37724) ANSI mode: disable ANSI reserved keywords by default

[ https://issues.apache.org/jira/browse/SPARK-37724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464352#comment-17464352 ] Apache Spark commented on SPARK-37724: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-37724) ANSI mode: disable ANSI reserved keywords by default

[ https://issues.apache.org/jira/browse/SPARK-37724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464351#comment-17464351 ] Apache Spark commented on SPARK-37724: -- User 'gengliangwang' has created a pull request for this

[jira] [Updated] (SPARK-37724) ANSI mode: disable ANSI reserved keywords by default

[ https://issues.apache.org/jira/browse/SPARK-37724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-37724: --- Summary: ANSI mode: disable ANSI reserved keywords by default (was: ANSI mode: disable

[jira] [Created] (SPARK-37724) ANSI mode: disable ANSI reserved keyworks by default

Gengliang Wang created SPARK-37724: -- Summary: ANSI mode: disable ANSI reserved keyworks by default Key: SPARK-37724 URL: https://issues.apache.org/jira/browse/SPARK-37724 Project: Spark