[jira] [Comment Edited] (SPARK-36088) 'spark.archives' does not extract the archive file into the driver under client mode

[ https://issues.apache.org/jira/browse/SPARK-36088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461230#comment-17461230 ] jingxiong zhong edited comment on SPARK-36088 at 12/17/21, 6:53 AM:

[jira] [Commented] (SPARK-36088) 'spark.archives' does not extract the archive file into the driver under client mode

[ https://issues.apache.org/jira/browse/SPARK-36088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461230#comment-17461230 ] jingxiong zhong commented on SPARK-36088: - In cluster mode, I hava another question that when I

[jira] [Commented] (SPARK-37673) Implement `ps.timedelta_range` method

[ https://issues.apache.org/jira/browse/SPARK-37673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461221#comment-17461221 ] Apache Spark commented on SPARK-37673: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-37673) Implement `ps.timedelta_range` method

[ https://issues.apache.org/jira/browse/SPARK-37673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37673: Assignee: (was: Apache Spark) > Implement `ps.timedelta_range` method >

[jira] [Commented] (SPARK-37673) Implement `ps.timedelta_range` method

[ https://issues.apache.org/jira/browse/SPARK-37673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461220#comment-17461220 ] Apache Spark commented on SPARK-37673: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-37673) Implement `ps.timedelta_range` method

[ https://issues.apache.org/jira/browse/SPARK-37673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37673: Assignee: Apache Spark > Implement `ps.timedelta_range` method >

[jira] [Created] (SPARK-37673) Implement `ps.timedelta_range` method

Xinrong Meng created SPARK-37673: Summary: Implement `ps.timedelta_range` method Key: SPARK-37673 URL: https://issues.apache.org/jira/browse/SPARK-37673 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-37657) Support str and timestamp for (Series|DataFrame).describe()

[ https://issues.apache.org/jira/browse/SPARK-37657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37657: Assignee: (was: Apache Spark) > Support str and timestamp for

[jira] [Assigned] (SPARK-37657) Support str and timestamp for (Series|DataFrame).describe()

[ https://issues.apache.org/jira/browse/SPARK-37657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37657: Assignee: Apache Spark > Support str and timestamp for (Series|DataFrame).describe() >

[jira] [Commented] (SPARK-37657) Support str and timestamp for (Series|DataFrame).describe()

[ https://issues.apache.org/jira/browse/SPARK-37657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461205#comment-17461205 ] Apache Spark commented on SPARK-37657: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-37672) Support ANSI Aggregate Function: regr_sxx

[ https://issues.apache.org/jira/browse/SPARK-37672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461204#comment-17461204 ] jiaan.geng commented on SPARK-37672: I'm working on. > Support ANSI Aggregate Function: regr_sxx >

[jira] [Commented] (SPARK-37590) Unify v1 and v2 ALTER NAMESPACE ... SET PROPERTIES tests

[ https://issues.apache.org/jira/browse/SPARK-37590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461202#comment-17461202 ] Apache Spark commented on SPARK-37590: -- User 'imback82' has created a pull request for this issue:

[jira] [Commented] (SPARK-37590) Unify v1 and v2 ALTER NAMESPACE ... SET PROPERTIES tests

[ https://issues.apache.org/jira/browse/SPARK-37590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461201#comment-17461201 ] Apache Spark commented on SPARK-37590: -- User 'imback82' has created a pull request for this issue:

[jira] [Updated] (SPARK-37657) Support str and timestamp for (Series|DataFrame).describe()

[ https://issues.apache.org/jira/browse/SPARK-37657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-37657: Summary: Support str and timestamp for (Series|DataFrame).describe() (was: Fix the bug in

[jira] [Created] (SPARK-37672) Support ANSI Aggregate Function: regr_sxx

jiaan.geng created SPARK-37672: -- Summary: Support ANSI Aggregate Function: regr_sxx Key: SPARK-37672 URL: https://issues.apache.org/jira/browse/SPARK-37672 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-37641) Support ANSI Aggregate Function: regr_r2

[ https://issues.apache.org/jira/browse/SPARK-37641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37641: --- Parent: SPARK-37671 Issue Type: Sub-task (was: New Feature) > Support ANSI Aggregate

[jira] [Updated] (SPARK-37623) Support ANSI Aggregate Function: regr_slope & regr_intercept

[ https://issues.apache.org/jira/browse/SPARK-37623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37623: --- Parent: SPARK-37671 Issue Type: Sub-task (was: New Feature) > Support ANSI Aggregate

[jira] [Updated] (SPARK-37614) Support ANSI Aggregate Function: regr_avgx & regr_avgy

[ https://issues.apache.org/jira/browse/SPARK-37614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37614: --- Parent: SPARK-37671 Issue Type: Sub-task (was: New Feature) > Support ANSI Aggregate

[jira] [Updated] (SPARK-37613) Support ANSI Aggregate Function: regr_count

[ https://issues.apache.org/jira/browse/SPARK-37613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37613: --- Parent: SPARK-37671 Issue Type: Sub-task (was: New Feature) > Support ANSI Aggregate

[jira] [Created] (SPARK-37671) Support ANSI Aggregation Function of regression

jiaan.geng created SPARK-37671: -- Summary: Support ANSI Aggregation Function of regression Key: SPARK-37671 URL: https://issues.apache.org/jira/browse/SPARK-37671 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-37670) Support predicate pushdown and column pruning for de-duped CTEs

[ https://issues.apache.org/jira/browse/SPARK-37670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37670: Assignee: (was: Apache Spark) > Support predicate pushdown and column pruning for

[jira] [Assigned] (SPARK-37670) Support predicate pushdown and column pruning for de-duped CTEs

[ https://issues.apache.org/jira/browse/SPARK-37670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37670: Assignee: Apache Spark > Support predicate pushdown and column pruning for de-duped CTEs

[jira] [Commented] (SPARK-37670) Support predicate pushdown and column pruning for de-duped CTEs

[ https://issues.apache.org/jira/browse/SPARK-37670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461195#comment-17461195 ] Apache Spark commented on SPARK-37670: -- User 'maryannxue' has created a pull request for this

[jira] [Created] (SPARK-37670) Support predicate pushdown and column pruning for de-duped CTEs

Wei Xue created SPARK-37670: --- Summary: Support predicate pushdown and column pruning for de-duped CTEs Key: SPARK-37670 URL: https://issues.apache.org/jira/browse/SPARK-37670 Project: Spark Issue

[jira] [Resolved] (SPARK-37654) Regression - NullPointerException in Row.getSeq when field null

[ https://issues.apache.org/jira/browse/SPARK-37654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37654. -- Fix Version/s: 3.3.0 3.2.1 3.1.3 Resolution:

[jira] [Assigned] (SPARK-37654) Regression - NullPointerException in Row.getSeq when field null

[ https://issues.apache.org/jira/browse/SPARK-37654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37654: Assignee: Huaxin Gao > Regression - NullPointerException in Row.getSeq when field null >

[jira] [Assigned] (SPARK-37613) Support ANSI Aggregate Function: regr_count

[ https://issues.apache.org/jira/browse/SPARK-37613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37613: --- Assignee: jiaan.geng > Support ANSI Aggregate Function: regr_count >

[jira] [Resolved] (SPARK-37613) Support ANSI Aggregate Function: regr_count

[ https://issues.apache.org/jira/browse/SPARK-37613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37613. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34880

[jira] [Assigned] (SPARK-37669) Remove unnecessary usages of OrderedDict

[ https://issues.apache.org/jira/browse/SPARK-37669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37669: Assignee: Takuya Ueshin > Remove unnecessary usages of OrderedDict >

[jira] [Resolved] (SPARK-37669) Remove unnecessary usages of OrderedDict

[ https://issues.apache.org/jira/browse/SPARK-37669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37669. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34926

[jira] [Assigned] (SPARK-37654) Regression - NullPointerException in Row.getSeq when field null

[ https://issues.apache.org/jira/browse/SPARK-37654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37654: Assignee: (was: Apache Spark) > Regression - NullPointerException in Row.getSeq when

[jira] [Assigned] (SPARK-37654) Regression - NullPointerException in Row.getSeq when field null

[ https://issues.apache.org/jira/browse/SPARK-37654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37654: Assignee: Apache Spark > Regression - NullPointerException in Row.getSeq when field null

[jira] [Resolved] (SPARK-37666) Set `GCM` as the default mode in `aes_encrypt()`/`aes_decrypt()`

[ https://issues.apache.org/jira/browse/SPARK-37666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37666. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34925

[jira] [Commented] (SPARK-37654) Regression - NullPointerException in Row.getSeq when field null

[ https://issues.apache.org/jira/browse/SPARK-37654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461156#comment-17461156 ] Apache Spark commented on SPARK-37654: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

[ https://issues.apache.org/jira/browse/SPARK-37668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461143#comment-17461143 ] Haejoon Lee commented on SPARK-37668: - Thanks for the report! Let me take a look > 'Index' object

[jira] [Commented] (SPARK-34544) pyspark toPandas() should return pd.DataFrame

[ https://issues.apache.org/jira/browse/SPARK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461133#comment-17461133 ] Apache Spark commented on SPARK-34544: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34544) pyspark toPandas() should return pd.DataFrame

[ https://issues.apache.org/jira/browse/SPARK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34544: Assignee: Maciej Szymkiewicz (was: Apache Spark) > pyspark toPandas() should return

[jira] [Assigned] (SPARK-34544) pyspark toPandas() should return pd.DataFrame

[ https://issues.apache.org/jira/browse/SPARK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34544: Assignee: Apache Spark (was: Maciej Szymkiewicz) > pyspark toPandas() should return

[jira] [Assigned] (SPARK-37669) Remove unnecessary usages of OrderedDict

[ https://issues.apache.org/jira/browse/SPARK-37669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37669: Assignee: (was: Apache Spark) > Remove unnecessary usages of OrderedDict >

[jira] [Assigned] (SPARK-37669) Remove unnecessary usages of OrderedDict

[ https://issues.apache.org/jira/browse/SPARK-37669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37669: Assignee: Apache Spark > Remove unnecessary usages of OrderedDict >

[jira] [Commented] (SPARK-37669) Remove unnecessary usages of OrderedDict

[ https://issues.apache.org/jira/browse/SPARK-37669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461070#comment-17461070 ] Apache Spark commented on SPARK-37669: -- User 'ueshin' has created a pull request for this issue:

[jira] [Updated] (SPARK-36019) Cannot run leveldb related UTs on Mac OS of M1 architecture

[ https://issues.apache.org/jira/browse/SPARK-36019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36019: -- Parent: SPARK-35781 Issue Type: Sub-task (was: Bug) > Cannot run leveldb related UTs

[jira] [Closed] (SPARK-36019) Cannot run leveldb related UTs on Mac OS of M1 architecture

[ https://issues.apache.org/jira/browse/SPARK-36019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-36019. - > Cannot run leveldb related UTs on Mac OS of M1 architecture >

[jira] [Updated] (SPARK-37317) Reduce weights in GaussianMixtureSuite

[ https://issues.apache.org/jira/browse/SPARK-37317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37317: -- Parent Issue: SPARK-35781 (was: SPARK-33772) > Reduce weights in GaussianMixtureSuite >

[jira] [Updated] (SPARK-37522) Fix MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction

[ https://issues.apache.org/jira/browse/SPARK-37522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37522: -- Parent Issue: SPARK-35781 (was: SPARK-33772) > Fix

[jira] [Updated] (SPARK-37282) Add ExtendedLevelDBTest and disable LevelDB tests on Apple Silicon

[ https://issues.apache.org/jira/browse/SPARK-37282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37282: -- Parent Issue: SPARK-35781 (was: SPARK-33772) > Add ExtendedLevelDBTest and disable LevelDB

[jira] [Updated] (SPARK-37272) Add `ExtendedRocksDBTest` and disable RocksDB tests on Apple Silicon

[ https://issues.apache.org/jira/browse/SPARK-37272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37272: -- Parent Issue: SPARK-35781 (was: SPARK-33772) > Add `ExtendedRocksDBTest` and disable RocksDB

[jira] [Updated] (SPARK-37655) Add RocksDB Implementation for KVStore

[ https://issues.apache.org/jira/browse/SPARK-37655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37655: -- Parent: SPARK-35781 Issue Type: Sub-task (was: Improvement) > Add RocksDB

[jira] [Updated] (SPARK-37655) Add RocksDB Implementation for KVStore

[ https://issues.apache.org/jira/browse/SPARK-37655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37655: -- Parent: (was: SPARK-33772) Issue Type: Improvement (was: Sub-task) > Add RocksDB

[jira] [Updated] (SPARK-35781) Support Spark on Apple Silicon on macOS natively on Java 17

[ https://issues.apache.org/jira/browse/SPARK-35781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35781: -- Summary: Support Spark on Apple Silicon on macOS natively on Java 17 (was: Support Spark on

[jira] [Commented] (SPARK-37669) Remove unnecessary usages of OrderedDict

[ https://issues.apache.org/jira/browse/SPARK-37669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461057#comment-17461057 ] Takuya Ueshin commented on SPARK-37669: --- I'm working on this. > Remove unnecessary usages of

[jira] [Created] (SPARK-37669) Remove unnecessary usages of OrderedDict

Takuya Ueshin created SPARK-37669: - Summary: Remove unnecessary usages of OrderedDict Key: SPARK-37669 URL: https://issues.apache.org/jira/browse/SPARK-37669 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37667) Spark throws TreeNodeException ("Couldn't find gen_alias") during wildcard column expansion

[ https://issues.apache.org/jira/browse/SPARK-37667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellan B Cummings updated SPARK-37667: -- Description: I'm seeing a TreeNodeException ("Couldn't find {_}gen_alias{_}") when

[jira] [Updated] (SPARK-37667) Spark throws TreeNodeException ("Couldn't find gen_alias") during wildcard column expansion

[ https://issues.apache.org/jira/browse/SPARK-37667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellan B Cummings updated SPARK-37667: -- Summary: Spark throws TreeNodeException ("Couldn't find gen_alias") during wildcard

[jira] [Updated] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

[ https://issues.apache.org/jira/browse/SPARK-37668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37668: --- Summary: 'Index' object has no attribute 'levels' in

[jira] [Commented] (SPARK-37668) 'Index' object has no attribute 'levels'

[ https://issues.apache.org/jira/browse/SPARK-37668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461039#comment-17461039 ] Maciej Szymkiewicz commented on SPARK-37668: cc [~hyukjin.kwon], [~itholic], [~ueshin],

[jira] [Updated] (SPARK-37667) Spark throws TreeNodeException during wildcard column expansion

[ https://issues.apache.org/jira/browse/SPARK-37667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellan B Cummings updated SPARK-37667: -- Summary: Spark throws TreeNodeException during wildcard column expansion (was: Spark

[jira] [Created] (SPARK-37668) 'Index' object has no attribute 'levels'

Maciej Szymkiewicz created SPARK-37668: -- Summary: 'Index' object has no attribute 'levels' Key: SPARK-37668 URL: https://issues.apache.org/jira/browse/SPARK-37668 Project: Spark Issue

[jira] [Created] (SPARK-37667) Spark throws TreeNodeException during variable expansion

Kellan B Cummings created SPARK-37667: - Summary: Spark throws TreeNodeException during variable expansion Key: SPARK-37667 URL: https://issues.apache.org/jira/browse/SPARK-37667 Project: Spark

[jira] [Assigned] (SPARK-34521) spark.createDataFrame does not support Pandas StringDtype extension type

[ https://issues.apache.org/jira/browse/SPARK-34521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-34521: Assignee: Nicolas Azrak > spark.createDataFrame does not support Pandas StringDtype

[jira] [Assigned] (SPARK-37666) Set `GCM` as the default mode in `aes_encrypt()`/`aes_decrypt()`

[ https://issues.apache.org/jira/browse/SPARK-37666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37666: Assignee: Max Gekk (was: Apache Spark) > Set `GCM` as the default mode in

[jira] [Assigned] (SPARK-37666) Set `GCM` as the default mode in `aes_encrypt()`/`aes_decrypt()`

[ https://issues.apache.org/jira/browse/SPARK-37666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37666: Assignee: Apache Spark (was: Max Gekk) > Set `GCM` as the default mode in

[jira] [Commented] (SPARK-37666) Set `GCM` as the default mode in `aes_encrypt()`/`aes_decrypt()`

[ https://issues.apache.org/jira/browse/SPARK-37666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460984#comment-17460984 ] Apache Spark commented on SPARK-37666: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-37666) Set `GCM` as the default mode in `aes_encrypt()`/`aes_decrypt()`

Max Gekk created SPARK-37666: Summary: Set `GCM` as the default mode in `aes_encrypt()`/`aes_decrypt()` Key: SPARK-37666 URL: https://issues.apache.org/jira/browse/SPARK-37666 Project: Spark

[jira] [Updated] (SPARK-37664) Add InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark Java 11/17 result

[ https://issues.apache.org/jira/browse/SPARK-37664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37664: -- Parent: SPARK-33772 Issue Type: Sub-task (was: Task) > Add InMemoryColumnarBenchmark

[jira] [Updated] (SPARK-37664) Add InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark Java 11/17 result

[ https://issues.apache.org/jira/browse/SPARK-37664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37664: -- Summary: Add InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark Java 11/17

[jira] [Updated] (SPARK-37664) Add InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark Java 11/17 result

[ https://issues.apache.org/jira/browse/SPARK-37664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37664: -- Issue Type: Task (was: Improvement) > Add InMemoryColumnarBenchmark and

[jira] [Resolved] (SPARK-37664) Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17

[ https://issues.apache.org/jira/browse/SPARK-37664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37664. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34921

[jira] [Assigned] (SPARK-37664) Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17

[ https://issues.apache.org/jira/browse/SPARK-37664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37664: - Assignee: Yang Jie > Supplement benchmark result of InMemoryColumnarBenchmark and >

[jira] [Assigned] (SPARK-37145) Improvement for extending pod feature steps with KubernetesConf

[ https://issues.apache.org/jira/browse/SPARK-37145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37145: Assignee: (was: Apache Spark) > Improvement for extending pod feature steps with

[jira] [Assigned] (SPARK-37145) Improvement for extending pod feature steps with KubernetesConf

[ https://issues.apache.org/jira/browse/SPARK-37145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37145: Assignee: Apache Spark > Improvement for extending pod feature steps with KubernetesConf

[jira] [Commented] (SPARK-37145) Improvement for extending pod feature steps with KubernetesConf

[ https://issues.apache.org/jira/browse/SPARK-37145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460889#comment-17460889 ] Apache Spark commented on SPARK-37145: -- User 'Yikun' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-37630) Security issue from Log4j 1.X exploit

[ https://issues.apache.org/jira/browse/SPARK-37630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460832#comment-17460832 ] Ismail H edited comment on SPARK-37630 at 12/16/21, 4:06 PM: - to

[jira] [Commented] (SPARK-37630) Security issue from Log4j 1.X exploit

[ https://issues.apache.org/jira/browse/SPARK-37630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460832#comment-17460832 ] Ismail H commented on SPARK-37630: -- to [~divekarsc] , extract from

[jira] [Commented] (SPARK-35739) [Spark Sql] Add Java-comptable Dataset.join overloads

[ https://issues.apache.org/jira/browse/SPARK-35739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460777#comment-17460777 ] Apache Spark commented on SPARK-35739: -- User 'brandondahler' has created a pull request for this

[jira] [Commented] (SPARK-35739) [Spark Sql] Add Java-comptable Dataset.join overloads

[ https://issues.apache.org/jira/browse/SPARK-35739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460775#comment-17460775 ] Apache Spark commented on SPARK-35739: -- User 'brandondahler' has created a pull request for this

[jira] [Resolved] (SPARK-37483) Support push down top N to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37483. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34918

[jira] [Assigned] (SPARK-37483) Support push down top N to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37483: --- Assignee: jiaan.geng > Support push down top N to JDBC data source V2 >

[jira] [Created] (SPARK-37665) JDBC: Provide generic metadata functions

Daniel Haviv created SPARK-37665: Summary: JDBC: Provide generic metadata functions Key: SPARK-37665 URL: https://issues.apache.org/jira/browse/SPARK-37665 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37663) Mitigate ConcurrentModificationException thrown from tests in SparkContextSuite

[ https://issues.apache.org/jira/browse/SPARK-37663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460612#comment-17460612 ] Apache Spark commented on SPARK-37663: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37663) Mitigate ConcurrentModificationException thrown from tests in SparkContextSuite

[ https://issues.apache.org/jira/browse/SPARK-37663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37663: Assignee: Apache Spark (was: Kousuke Saruta) > Mitigate ConcurrentModificationException

[jira] [Assigned] (SPARK-37663) Mitigate ConcurrentModificationException thrown from tests in SparkContextSuite

[ https://issues.apache.org/jira/browse/SPARK-37663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37663: Assignee: Kousuke Saruta (was: Apache Spark) > Mitigate ConcurrentModificationException

[jira] [Commented] (SPARK-37664) Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17

[ https://issues.apache.org/jira/browse/SPARK-37664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460539#comment-17460539 ] Apache Spark commented on SPARK-37664: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-37664) Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17

[ https://issues.apache.org/jira/browse/SPARK-37664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37664: Assignee: (was: Apache Spark) > Supplement benchmark result of

[jira] [Assigned] (SPARK-37664) Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17

[ https://issues.apache.org/jira/browse/SPARK-37664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37664: Assignee: Apache Spark > Supplement benchmark result of InMemoryColumnarBenchmark and >

[jira] [Commented] (SPARK-37664) Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17

[ https://issues.apache.org/jira/browse/SPARK-37664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460536#comment-17460536 ] Apache Spark commented on SPARK-37664: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-37664) Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17

[ https://issues.apache.org/jira/browse/SPARK-37664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-37664: - Component/s: Tests (was: SQL) > Supplement benchmark result of

[jira] [Updated] (SPARK-9853) Optimize shuffle fetch of contiguous partition IDs

[ https://issues.apache.org/jira/browse/SPARK-9853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-9853: Priority: Major (was: Minor) > Optimize shuffle fetch of contiguous partition IDs >

[jira] [Created] (SPARK-37664) Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17

Yang Jie created SPARK-37664: Summary: Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17 Key: SPARK-37664 URL:

[jira] [Updated] (SPARK-37663) Mitigate ConcurrentModificationException thrown from tests in SparkContextSuite

[ https://issues.apache.org/jira/browse/SPARK-37663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37663: --- Summary: Mitigate ConcurrentModificationException thrown from tests in SparkContextSuite

[jira] [Created] (SPARK-37663) SPARK-37315][ML][TEST] Mitigate ConcurrentModificationException thrown from a test in SparkContextSuite

Kousuke Saruta created SPARK-37663: -- Summary: SPARK-37315][ML][TEST] Mitigate ConcurrentModificationException thrown from a test in SparkContextSuite Key: SPARK-37663 URL:

[jira] [Updated] (SPARK-37663) Mitigate ConcurrentModificationException thrown from a test in SparkContextSuite

[ https://issues.apache.org/jira/browse/SPARK-37663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37663: --- Summary: Mitigate ConcurrentModificationException thrown from a test in SparkContextSuite

[jira] [Assigned] (SPARK-37661) SparkSQLCLIDriver will use hive defaults to resolve warehouse dir

[ https://issues.apache.org/jira/browse/SPARK-37661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37661: Assignee: Apache Spark > SparkSQLCLIDriver will use hive defaults to resolve warehouse

[jira] [Commented] (SPARK-37661) SparkSQLCLIDriver will use hive defaults to resolve warehouse dir

[ https://issues.apache.org/jira/browse/SPARK-37661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460505#comment-17460505 ] Apache Spark commented on SPARK-37661: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37661) SparkSQLCLIDriver will use hive defaults to resolve warehouse dir

[ https://issues.apache.org/jira/browse/SPARK-37661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37661: Assignee: (was: Apache Spark) > SparkSQLCLIDriver will use hive defaults to resolve

[jira] [Created] (SPARK-37662) exception when handling late data with watermarking and window

luigi created SPARK-37662: - Summary: exception when handling late data with watermarking and window Key: SPARK-37662 URL: https://issues.apache.org/jira/browse/SPARK-37662 Project: Spark Issue

[jira] [Created] (SPARK-37661) SparkSQLCLIDriver will use hive defaults to resolve warehouse dir

Kent Yao created SPARK-37661: Summary: SparkSQLCLIDriver will use hive defaults to resolve warehouse dir Key: SPARK-37661 URL: https://issues.apache.org/jira/browse/SPARK-37661 Project: Spark