[jira] [Assigned] (SPARK-35182) Support driver-owned on-demand PVC

[ https://issues.apache.org/jira/browse/SPARK-35182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35182: Assignee: (was: Apache Spark) > Support driver-owned on-demand PVC >

[jira] [Created] (SPARK-35183) CombineConcats should call transformAllExpressions

Yingyi Bu created SPARK-35183: - Summary: CombineConcats should call transformAllExpressions Key: SPARK-35183 URL: https://issues.apache.org/jira/browse/SPARK-35183 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-35182) Support driver-owned on-demand PVC

[ https://issues.apache.org/jira/browse/SPARK-35182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327137#comment-17327137 ] Apache Spark commented on SPARK-35182: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-35182) Support driver-owned on-demand PVC

[ https://issues.apache.org/jira/browse/SPARK-35182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35182: Assignee: Apache Spark > Support driver-owned on-demand PVC > ---

[jira] [Created] (SPARK-35182) Support driver-owned on-demand PVC

Dongjoon Hyun created SPARK-35182: - Summary: Support driver-owned on-demand PVC Key: SPARK-35182 URL: https://issues.apache.org/jira/browse/SPARK-35182 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-34671) Support ZSTD compression in Parquet data sources

[ https://issues.apache.org/jira/browse/SPARK-34671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34671. --- Resolution: Duplicate > Support ZSTD compression in Parquet data sources > -

[jira] [Updated] (SPARK-35096) foreachBatch throws ArrayIndexOutOfBoundsException if schema is case Insensitive

[ https://issues.apache.org/jira/browse/SPARK-35096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35096: -- Fix Version/s: 3.0.3 > foreachBatch throws ArrayIndexOutOfBoundsException if schema is case >

[jira] [Assigned] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34674: - Assignee: Sergey Kotlov > Spark app on k8s doesn't terminate without call to sparkConte

[jira] [Resolved] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34674. --- Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pul

[jira] [Commented] (SPARK-27991) ShuffleBlockFetcherIterator should take Netty constant-factor overheads into account when limiting number of simultaneous block fetches

[ https://issues.apache.org/jira/browse/SPARK-27991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327118#comment-17327118 ] Apache Spark commented on SPARK-27991: -- User 'Ngone51' has created a pull request f

[jira] [Commented] (SPARK-27991) ShuffleBlockFetcherIterator should take Netty constant-factor overheads into account when limiting number of simultaneous block fetches

[ https://issues.apache.org/jira/browse/SPARK-27991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327119#comment-17327119 ] Apache Spark commented on SPARK-27991: -- User 'Ngone51' has created a pull request f

[jira] [Assigned] (SPARK-27991) ShuffleBlockFetcherIterator should take Netty constant-factor overheads into account when limiting number of simultaneous block fetches

[ https://issues.apache.org/jira/browse/SPARK-27991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27991: Assignee: (was: Apache Spark) > ShuffleBlockFetcherIterator should take Netty constan

[jira] [Assigned] (SPARK-27991) ShuffleBlockFetcherIterator should take Netty constant-factor overheads into account when limiting number of simultaneous block fetches

[ https://issues.apache.org/jira/browse/SPARK-27991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27991: Assignee: Apache Spark > ShuffleBlockFetcherIterator should take Netty constant-factor ov

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327109#comment-17327109 ] Apache Spark commented on SPARK-35181: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327108#comment-17327108 ] Apache Spark commented on SPARK-35181: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-35181) Use zstd for spark.io.compression.codec by default

[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35181: Assignee: (was: Apache Spark) > Use zstd for spark.io.compression.codec by default >

[jira] [Assigned] (SPARK-35181) Use zstd for spark.io.compression.codec by default

[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35181: Assignee: Apache Spark > Use zstd for spark.io.compression.codec by default > ---

[jira] [Created] (SPARK-35181) Use zstd for spark.io.compression.codec by default

Dongjoon Hyun created SPARK-35181: - Summary: Use zstd for spark.io.compression.codec by default Key: SPARK-35181 URL: https://issues.apache.org/jira/browse/SPARK-35181 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-35180) Allow to build SparkR with SBT

[ https://issues.apache.org/jira/browse/SPARK-35180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35180: Assignee: Kousuke Saruta (was: Apache Spark) > Allow to build SparkR with SBT >

[jira] [Commented] (SPARK-35180) Allow to build SparkR with SBT

[ https://issues.apache.org/jira/browse/SPARK-35180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327093#comment-17327093 ] Apache Spark commented on SPARK-35180: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-35180) Allow to build SparkR with SBT

[ https://issues.apache.org/jira/browse/SPARK-35180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35180: Assignee: Apache Spark (was: Kousuke Saruta) > Allow to build SparkR with SBT >

[jira] [Created] (SPARK-35180) Allow to build SparkR with SBT

Kousuke Saruta created SPARK-35180: -- Summary: Allow to build SparkR with SBT Key: SPARK-35180 URL: https://issues.apache.org/jira/browse/SPARK-35180 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-35096) foreachBatch throws ArrayIndexOutOfBoundsException if schema is case Insensitive

[ https://issues.apache.org/jira/browse/SPARK-35096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327088#comment-17327088 ] Apache Spark commented on SPARK-35096: -- User 'sandeep-katta' has created a pull req

[jira] [Commented] (SPARK-35096) foreachBatch throws ArrayIndexOutOfBoundsException if schema is case Insensitive

[ https://issues.apache.org/jira/browse/SPARK-35096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327089#comment-17327089 ] Apache Spark commented on SPARK-35096: -- User 'sandeep-katta' has created a pull req

[jira] [Updated] (SPARK-35096) foreachBatch throws ArrayIndexOutOfBoundsException if schema is case Insensitive

[ https://issues.apache.org/jira/browse/SPARK-35096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35096: -- Fix Version/s: (was: 3.0.3) > foreachBatch throws ArrayIndexOutOfBoundsException if schema

[jira] [Commented] (SPARK-35177) IntervalUtils.fromYearMonthString can't handle Int.MinValue correctly

[ https://issues.apache.org/jira/browse/SPARK-35177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327058#comment-17327058 ] Apache Spark commented on SPARK-35177: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-35177) IntervalUtils.fromYearMonthString can't handle Int.MinValue correctly

[ https://issues.apache.org/jira/browse/SPARK-35177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35177: Assignee: (was: Apache Spark) > IntervalUtils.fromYearMonthString can't handle Int.Mi

[jira] [Assigned] (SPARK-35177) IntervalUtils.fromYearMonthString can't handle Int.MinValue correctly

[ https://issues.apache.org/jira/browse/SPARK-35177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35177: Assignee: Apache Spark > IntervalUtils.fromYearMonthString can't handle Int.MinValue corr

[jira] [Commented] (SPARK-35177) IntervalUtils.fromYearMonthString can't handle Int.MinValue correctly

[ https://issues.apache.org/jira/browse/SPARK-35177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327057#comment-17327057 ] Apache Spark commented on SPARK-35177: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327054#comment-17327054 ] Apache Spark commented on SPARK-34674: -- User 'kotlovs' has created a pull request f

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327056#comment-17327056 ] Apache Spark commented on SPARK-34674: -- User 'kotlovs' has created a pull request f

[jira] [Commented] (SPARK-35178) maven autodownload failing

[ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327048#comment-17327048 ] Apache Spark commented on SPARK-35178: -- User 'dongjoon-hyun' has created a pull req

[jira] [Resolved] (SPARK-35178) maven autodownload failing

[ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35178. --- Fix Version/s: 3.2.0 3.1.2 3.0.3 Assignee: Sea

[jira] [Commented] (SPARK-35178) maven autodownload failing

[ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327046#comment-17327046 ] Apache Spark commented on SPARK-35178: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-31168) Upgrade Scala to 2.12.13

[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327035#comment-17327035 ] Jim Kleckner commented on SPARK-31168: -- It appears that this fix [1] for 12038 merg

[jira] [Commented] (SPARK-35110) Handle ANSI intervals in WindowExecBase

[ https://issues.apache.org/jira/browse/SPARK-35110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327034#comment-17327034 ] jiaan.geng commented on SPARK-35110: I'm working on. > Handle ANSI intervals in Win

[jira] [Commented] (SPARK-35161) Safe version SQL functions

[ https://issues.apache.org/jira/browse/SPARK-35161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327032#comment-17327032 ] jiaan.geng commented on SPARK-35161: I see. > Safe version SQL functions >

[jira] [Commented] (SPARK-35117) UI progress bar no longer highlights in progress tasks

[ https://issues.apache.org/jira/browse/SPARK-35117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327030#comment-17327030 ] Apache Spark commented on SPARK-35117: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-35078) Migrate to transformWithPruning or resolveWithPruning for expression rules

[ https://issues.apache.org/jira/browse/SPARK-35078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327027#comment-17327027 ] Apache Spark commented on SPARK-35078: -- User 'sigmod' has created a pull request fo

[jira] [Assigned] (SPARK-35078) Migrate to transformWithPruning or resolveWithPruning for expression rules

[ https://issues.apache.org/jira/browse/SPARK-35078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35078: Assignee: Apache Spark > Migrate to transformWithPruning or resolveWithPruning for expres

[jira] [Commented] (SPARK-35078) Migrate to transformWithPruning or resolveWithPruning for expression rules

[ https://issues.apache.org/jira/browse/SPARK-35078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327029#comment-17327029 ] Apache Spark commented on SPARK-35078: -- User 'sigmod' has created a pull request fo

[jira] [Assigned] (SPARK-35078) Migrate to transformWithPruning or resolveWithPruning for expression rules

[ https://issues.apache.org/jira/browse/SPARK-35078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35078: Assignee: (was: Apache Spark) > Migrate to transformWithPruning or resolveWithPruning

[jira] [Resolved] (SPARK-32027) EventLoggingListener threw java.util.ConcurrentModificationException

[ https://issues.apache.org/jira/browse/SPARK-32027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32027. -- Resolution: Duplicate > EventLoggingListener threw java.util.ConcurrentModificationException

[jira] [Commented] (SPARK-34897) Support reconcile schemas based on index after nested column pruning

[ https://issues.apache.org/jira/browse/SPARK-34897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327017#comment-17327017 ] Apache Spark commented on SPARK-34897: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-34897) Support reconcile schemas based on index after nested column pruning

[ https://issues.apache.org/jira/browse/SPARK-34897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327016#comment-17327016 ] Apache Spark commented on SPARK-34897: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-34692) Support Not(Int) and Not(InSet) propagate null

[ https://issues.apache.org/jira/browse/SPARK-34692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327010#comment-17327010 ] Apache Spark commented on SPARK-34692: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-34692) Support Not(Int) and Not(InSet) propagate null

[ https://issues.apache.org/jira/browse/SPARK-34692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327009#comment-17327009 ] Apache Spark commented on SPARK-34692: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-35179) Introduce hybrid join for sort merge join and shuffled hash join in AQE

[ https://issues.apache.org/jira/browse/SPARK-35179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326991#comment-17326991 ] Cheng Su commented on SPARK-35179: -- Thanks for [~cloud_fan] for the idea. Please commen

[jira] [Updated] (SPARK-32461) Shuffled hash join improvement

[ https://issues.apache.org/jira/browse/SPARK-32461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-32461: - Affects Version/s: 3.2.0 > Shuffled hash join improvement > -- > >

[jira] [Created] (SPARK-35179) Introduce hybrid join for sort merge join and shuffled hash join in AQE

Cheng Su created SPARK-35179: Summary: Introduce hybrid join for sort merge join and shuffled hash join in AQE Key: SPARK-35179 URL: https://issues.apache.org/jira/browse/SPARK-35179 Project: Spark

[jira] [Commented] (SPARK-35178) maven autodownload failing

[ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326924#comment-17326924 ] Apache Spark commented on SPARK-35178: -- User 'srowen' has created a pull request fo

[jira] [Assigned] (SPARK-35178) maven autodownload failing

[ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35178: Assignee: Bruce Robbins (was: Apache Spark) > maven autodownload failing > -

[jira] [Commented] (SPARK-35178) maven autodownload failing

[ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326921#comment-17326921 ] Apache Spark commented on SPARK-35178: -- User 'srowen' has created a pull request fo

[jira] [Assigned] (SPARK-35178) maven autodownload failing

[ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35178: Assignee: Apache Spark (was: Bruce Robbins) > maven autodownload failing > -

[jira] [Assigned] (SPARK-35178) maven autodownload failing

[ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-35178: Affects Version/s: 2.4.7 3.0.2 3.1.1

[jira] [Commented] (SPARK-35178) maven autodownload failing

[ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326910#comment-17326910 ] Bruce Robbins commented on SPARK-35178: --- In INFRA-21767, Daniel Gruno responded: {

[jira] [Commented] (SPARK-35178) maven autodownload failing

[ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326874#comment-17326874 ] Bruce Robbins commented on SPARK-35178: --- I also posted https://issues.apache.org/j

[jira] [Commented] (SPARK-35178) maven autodownload failing

[ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326770#comment-17326770 ] Sean R. Owen commented on SPARK-35178: -- I agree, it looks like the automatic redire

[jira] [Created] (SPARK-35178) maven autodownload failing

Bruce Robbins created SPARK-35178: - Summary: maven autodownload failing Key: SPARK-35178 URL: https://issues.apache.org/jira/browse/SPARK-35178 Project: Spark Issue Type: Bug Compon

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326716#comment-17326716 ] L. C. Hsieh commented on SPARK-34198: - The major issue is the additional rocksdb dep

[jira] [Assigned] (SPARK-34692) Support Not(Int) and Not(InSet) propagate null

[ https://issues.apache.org/jira/browse/SPARK-34692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34692: --- Assignee: ulysses you > Support Not(Int) and Not(InSet) propagate null > --

[jira] [Resolved] (SPARK-34692) Support Not(Int) and Not(InSet) propagate null

[ https://issues.apache.org/jira/browse/SPARK-34692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34692. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31797 [https://gith

[jira] [Created] (SPARK-35177) IntervalUtils.fromYearMonthString can't handle Int.MinValue correctly

angerszhu created SPARK-35177: - Summary: IntervalUtils.fromYearMonthString can't handle Int.MinValue correctly Key: SPARK-35177 URL: https://issues.apache.org/jira/browse/SPARK-35177 Project: Spark

[jira] [Commented] (SPARK-35177) IntervalUtils.fromYearMonthString can't handle Int.MinValue correctly

[ https://issues.apache.org/jira/browse/SPARK-35177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326643#comment-17326643 ] angerszhu commented on SPARK-35177: --- Raise a pr soon > IntervalUtils.fromYearMonthStr

[jira] [Commented] (SPARK-32027) EventLoggingListener threw java.util.ConcurrentModificationException

[ https://issues.apache.org/jira/browse/SPARK-32027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326639#comment-17326639 ] Seulki jake Han commented on SPARK-32027: - [~kristopherkane] Thank you. This pro

[jira] [Created] (SPARK-35176) Raise TypeError in inappropriate type case rather than ValueError

Yikun Jiang created SPARK-35176: --- Summary: Raise TypeError in inappropriate type case rather than ValueError Key: SPARK-35176 URL: https://issues.apache.org/jira/browse/SPARK-35176 Project: Spark

[jira] [Assigned] (SPARK-35173) Support columns batch adding in PySpark.dataframe

[ https://issues.apache.org/jira/browse/SPARK-35173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35173: Assignee: Apache Spark > Support columns batch adding in PySpark.dataframe >

[jira] [Assigned] (SPARK-35173) Support columns batch adding in PySpark.dataframe

[ https://issues.apache.org/jira/browse/SPARK-35173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35173: Assignee: (was: Apache Spark) > Support columns batch adding in PySpark.dataframe > -

[jira] [Commented] (SPARK-35173) Support columns batch adding in PySpark.dataframe

[ https://issues.apache.org/jira/browse/SPARK-35173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326574#comment-17326574 ] Apache Spark commented on SPARK-35173: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-35142) `OneVsRest` classifier uses incorrect data type for `rawPrediction` column

[ https://issues.apache.org/jira/browse/SPARK-35142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326518#comment-17326518 ] Apache Spark commented on SPARK-35142: -- User 'harupy' has created a pull request fo

[jira] [Commented] (SPARK-35142) `OneVsRest` classifier uses incorrect data type for `rawPrediction` column

[ https://issues.apache.org/jira/browse/SPARK-35142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326517#comment-17326517 ] Apache Spark commented on SPARK-35142: -- User 'harupy' has created a pull request fo

[jira] [Assigned] (SPARK-35175) Add linter for JavaScript source files

[ https://issues.apache.org/jira/browse/SPARK-35175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35175: Assignee: Kousuke Saruta (was: Apache Spark) > Add linter for JavaScript source files >

[jira] [Commented] (SPARK-35175) Add linter for JavaScript source files

[ https://issues.apache.org/jira/browse/SPARK-35175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326507#comment-17326507 ] Apache Spark commented on SPARK-35175: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-35175) Add linter for JavaScript source files

[ https://issues.apache.org/jira/browse/SPARK-35175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35175: Assignee: Apache Spark (was: Kousuke Saruta) > Add linter for JavaScript source files >

[jira] [Updated] (SPARK-35175) Add linter for JavaScript source files

[ https://issues.apache.org/jira/browse/SPARK-35175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35175: --- Summary: Add linter for JavaScript source files (was: Add linter for JavaScript sources) >

[jira] [Created] (SPARK-35175) Add linter for JavaScript sources

Kousuke Saruta created SPARK-35175: -- Summary: Add linter for JavaScript sources Key: SPARK-35175 URL: https://issues.apache.org/jira/browse/SPARK-35175 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-35143) Add default log config for spark-sql

[ https://issues.apache.org/jira/browse/SPARK-35143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326498#comment-17326498 ] Apache Spark commented on SPARK-35143: -- User 'ChenDou2021' has created a pull reque

[jira] [Commented] (SPARK-35143) Add default log config for spark-sql

[ https://issues.apache.org/jira/browse/SPARK-35143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326496#comment-17326496 ] Apache Spark commented on SPARK-35143: -- User 'ChenDou2021' has created a pull reque

[jira] [Commented] (SPARK-35143) Add default log config for spark-sql

[ https://issues.apache.org/jira/browse/SPARK-35143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326495#comment-17326495 ] Apache Spark commented on SPARK-35143: -- User 'ChenDou2021' has created a pull reque

[jira] [Assigned] (SPARK-35140) Establish error message guidelines

[ https://issues.apache.org/jira/browse/SPARK-35140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35140: Assignee: Karen Feng > Establish error message guidelines > -

[jira] [Resolved] (SPARK-35140) Establish error message guidelines

[ https://issues.apache.org/jira/browse/SPARK-35140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35140. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32241 [https://gi

[jira] [Updated] (SPARK-35154) Rpc env not shutdown when shutdown method call by endpoint onStop

[ https://issues.apache.org/jira/browse/SPARK-35154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LIU updated SPARK-35154: Description: when i use this code to work,  Rpc thread hangs up and not close gracefully. i think when rpc thread

[jira] [Updated] (SPARK-35154) Rpc env not shutdown when shutdown method call by endpoint onStop

[ https://issues.apache.org/jira/browse/SPARK-35154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LIU updated SPARK-35154: Issue Type: Improvement (was: Bug) > Rpc env not shutdown when shutdown method call by endpoint onStop >

[jira] [Updated] (SPARK-35154) Rpc env not shutdown when shutdown method call by endpoint onStop

[ https://issues.apache.org/jira/browse/SPARK-35154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LIU updated SPARK-35154: Priority: Minor (was: Major) > Rpc env not shutdown when shutdown method call by endpoint onStop > --

[jira] [Updated] (SPARK-35154) Rpc env not shutdown when shutdown method call by endpoint onStop

[ https://issues.apache.org/jira/browse/SPARK-35154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LIU updated SPARK-35154: Description: (was: when i use this code to work,  Rpc thread hangs up and not close gracefully. i think when r

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326460#comment-17326460 ] Jungtaek Lim commented on SPARK-34198: -- Please note that the decision was taken fro

[jira] [Resolved] (SPARK-35171) Declare the markdown package as a dependency of the SparkR package

[ https://issues.apache.org/jira/browse/SPARK-35171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35171. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32270 [https://gi

[jira] [Assigned] (SPARK-35171) Declare the markdown package as a dependency of the SparkR package

[ https://issues.apache.org/jira/browse/SPARK-35171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35171: Assignee: Yuanjian Li > Declare the markdown package as a dependency of the SparkR packag

[jira] [Assigned] (SPARK-35126) Execute jdbc cancellation method when jdbc load job is interrupted

[ https://issues.apache.org/jira/browse/SPARK-35126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35126: Assignee: (was: Apache Spark) > Execute jdbc cancellation method when jdbc load job i

[jira] [Assigned] (SPARK-35126) Execute jdbc cancellation method when jdbc load job is interrupted

[ https://issues.apache.org/jira/browse/SPARK-35126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35126: Assignee: Apache Spark > Execute jdbc cancellation method when jdbc load job is interrupt

[jira] [Created] (SPARK-35174) Avoid opening watch when waitAppCompletion is false

Jonathan Lafleche created SPARK-35174: - Summary: Avoid opening watch when waitAppCompletion is false Key: SPARK-35174 URL: https://issues.apache.org/jira/browse/SPARK-35174 Project: Spark

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326427#comment-17326427 ] Yuanjian Li commented on SPARK-34198: - [~viirya] Since the RocksDBStateStore can sol

[jira] [Commented] (SPARK-35143) Add default log config for spark-sql

[ https://issues.apache.org/jira/browse/SPARK-35143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326416#comment-17326416 ] Apache Spark commented on SPARK-35143: -- User 'ChenDou2021' has created a pull reque

[jira] [Commented] (SPARK-35172) The implementation of RocksDBCheckpointMetadata

[ https://issues.apache.org/jira/browse/SPARK-35172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326411#comment-17326411 ] Apache Spark commented on SPARK-35172: -- User 'xuanyuanking' has created a pull requ

[jira] [Commented] (SPARK-35172) The implementation of RocksDBCheckpointMetadata

[ https://issues.apache.org/jira/browse/SPARK-35172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326410#comment-17326410 ] Apache Spark commented on SPARK-35172: -- User 'xuanyuanking' has created a pull requ

[jira] [Assigned] (SPARK-35172) The implementation of RocksDBCheckpointMetadata

[ https://issues.apache.org/jira/browse/SPARK-35172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35172: Assignee: Apache Spark > The implementation of RocksDBCheckpointMetadata > --

[jira] [Assigned] (SPARK-35172) The implementation of RocksDBCheckpointMetadata

[ https://issues.apache.org/jira/browse/SPARK-35172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35172: Assignee: (was: Apache Spark) > The implementation of RocksDBCheckpointMetadata > ---

[jira] [Assigned] (SPARK-35172) The implementation of RocksDBCheckpointMetadata

[ https://issues.apache.org/jira/browse/SPARK-35172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35172: Assignee: Apache Spark > The implementation of RocksDBCheckpointMetadata > --

[jira] [Updated] (SPARK-35172) The implementation of RocksDBCheckpointMetadata

[ https://issues.apache.org/jira/browse/SPARK-35172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-35172: Summary: The implementation of RocksDBCheckpointMetadata (was: Implementation for RocksDBCheckpoi

[jira] [Updated] (SPARK-35172) Implementation for RocksDBCheckpointMetadata

[ https://issues.apache.org/jira/browse/SPARK-35172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-35172: Description: The RocksDBCheckpointMetadata persists the metadata for each committed batch in JSON

  1   2   >