[jira] [Created] (SPARK-30414) Optimizations for arrays and maps in ParquetRowConverter

Josh Rosen created SPARK-30414: -- Summary: Optimizations for arrays and maps in ParquetRowConverter Key: SPARK-30414 URL: https://issues.apache.org/jira/browse/SPARK-30414 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-30214) A new framework to resolve v2 commands with a case of COMMENT ON syntax implementation

[ https://issues.apache.org/jira/browse/SPARK-30214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30214. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26847 [https://gith

[jira] [Assigned] (SPARK-30214) A new framework to resolve v2 commands with a case of COMMENT ON syntax implementation

[ https://issues.apache.org/jira/browse/SPARK-30214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30214: --- Assignee: Kent Yao > A new framework to resolve v2 commands with a case of COMMENT ON synta

[jira] [Assigned] (SPARK-30225) "Stream is corrupted at" exception on reading disk-spilled data of a shuffle operation

[ https://issues.apache.org/jira/browse/SPARK-30225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30225: Assignee: Marcelo Masiero Vanzin > "Stream is corrupted at" exception on reading disk-spi

[jira] [Resolved] (SPARK-30225) "Stream is corrupted at" exception on reading disk-spilled data of a shuffle operation

[ https://issues.apache.org/jira/browse/SPARK-30225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30225. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27084 [https://gi

[jira] [Updated] (SPARK-30225) "Stream is corrupted at" exception on reading disk-spilled data of a shuffle operation

[ https://issues.apache.org/jira/browse/SPARK-30225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30225: - Fix Version/s: 2.4.5 > "Stream is corrupted at" exception on reading disk-spilled data of a shuf

[jira] [Commented] (SPARK-30332) When running sql query with limit catalyst throw StackOverFlow exception

[ https://issues.apache.org/jira/browse/SPARK-30332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007373#comment-17007373 ] Izek Greenfield commented on SPARK-30332: - Yes when removing the limit all works

[jira] [Updated] (SPARK-27604) Enhance constant and constraint propagation

[ https://issues.apache.org/jira/browse/SPARK-27604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-27604: --- Description: There is a bug in constant propagation due to null handling: {{SELECT * FROM t WHERE N

[jira] [Updated] (SPARK-27604) Enhance constant and constraint propagation

[ https://issues.apache.org/jira/browse/SPARK-27604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-27604: --- Issue Type: Bug (was: Improvement) > Enhance constant and constraint propagation >

[jira] [Commented] (SPARK-30377) Make Regressors extend abstract class Regressor

[ https://issues.apache.org/jira/browse/SPARK-30377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007407#comment-17007407 ] zhengruifeng commented on SPARK-30377: -- [~srowen]  There is no API difference, how

[jira] [Created] (SPARK-30415) Improve Readability of SQLConf Doc

Rakesh Raushan created SPARK-30415: -- Summary: Improve Readability of SQLConf Doc Key: SPARK-30415 URL: https://issues.apache.org/jira/browse/SPARK-30415 Project: Spark Issue Type: Improvemen

[jira] [Commented] (SPARK-29135) Flaky Test: o.a.s.streaming.StreamingContextSuite.SPARK-18560 Receiver data should be deserialized properly

[ https://issues.apache.org/jira/browse/SPARK-29135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007459#comment-17007459 ] Jungtaek Lim commented on SPARK-29135: -- Another occurrence:  [https://amplab.cs.ber

[jira] [Resolved] (SPARK-29947) Improve ResolveRelations performance

[ https://issues.apache.org/jira/browse/SPARK-29947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29947. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26589 [https://gith

[jira] [Assigned] (SPARK-29947) Improve ResolveRelations performance

[ https://issues.apache.org/jira/browse/SPARK-29947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29947: --- Assignee: Yuming Wang > Improve ResolveRelations performance >

[jira] [Commented] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures

[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007543#comment-17007543 ] fqaiser94 commented on SPARK-22231: --- Just to be complete, there is a third option here

[jira] [Assigned] (SPARK-30359) Do not clear executorsPendingToRemove in CoarseGrainedSchedulerBackend.reset

[ https://issues.apache.org/jira/browse/SPARK-30359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30359: --- Assignee: wuyi > Do not clear executorsPendingToRemove in CoarseGrainedSchedulerBackend.res

[jira] [Resolved] (SPARK-30359) Do not clear executorsPendingToRemove in CoarseGrainedSchedulerBackend.reset

[ https://issues.apache.org/jira/browse/SPARK-30359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30359. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27017 [https://gith

[jira] [Created] (SPARK-30416) Log a warning for deprecated SQL config in `set()` and `unset()`

Maxim Gekk created SPARK-30416: -- Summary: Log a warning for deprecated SQL config in `set()` and `unset()` Key: SPARK-30416 URL: https://issues.apache.org/jira/browse/SPARK-30416 Project: Spark

[jira] [Commented] (SPARK-30415) Improve Readability of SQLConf Doc

[ https://issues.apache.org/jira/browse/SPARK-30415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007644#comment-17007644 ] Sean R. Owen commented on SPARK-30415: -- This is too trivial for a JIRA. Just use a

[jira] [Resolved] (SPARK-30406) OneForOneStreamManager use AtomicLong

[ https://issues.apache.org/jira/browse/SPARK-30406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30406. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27071 [https://gi

[jira] [Assigned] (SPARK-30406) OneForOneStreamManager use AtomicLong

[ https://issues.apache.org/jira/browse/SPARK-30406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-30406: Assignee: Ajith S > OneForOneStreamManager use AtomicLong > -

[jira] [Commented] (SPARK-30377) Make Regressors extend abstract class Regressor

[ https://issues.apache.org/jira/browse/SPARK-30377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007657#comment-17007657 ] Sean R. Owen commented on SPARK-30377: -- Seems logical to extend Regressor consisten

[jira] [Resolved] (SPARK-30144) MLP param map missing

[ https://issues.apache.org/jira/browse/SPARK-30144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30144. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26838 [https://gi

[jira] [Assigned] (SPARK-30144) MLP param map missing

[ https://issues.apache.org/jira/browse/SPARK-30144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-30144: Assignee: Huaxin Gao > MLP param map missing > - > >

[jira] [Created] (SPARK-30417) SPARK-29976 calculation of slots wrong for Standalone Mode

Thomas Graves created SPARK-30417: - Summary: SPARK-29976 calculation of slots wrong for Standalone Mode Key: SPARK-30417 URL: https://issues.apache.org/jira/browse/SPARK-30417 Project: Spark

[jira] [Commented] (SPARK-30417) SPARK-29976 calculation of slots wrong for Standalone Mode

[ https://issues.apache.org/jira/browse/SPARK-30417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007694#comment-17007694 ] Thomas Graves commented on SPARK-30417: --- [~yuchen.huo] is this something you could

[jira] [Created] (SPARK-30418) make FM call super class method extractLabeledPoints

Huaxin Gao created SPARK-30418: -- Summary: make FM call super class method extractLabeledPoints Key: SPARK-30418 URL: https://issues.apache.org/jira/browse/SPARK-30418 Project: Spark Issue Type:

[jira] [Created] (SPARK-30419) Make IsotonicRegression extend Regressor

Huaxin Gao created SPARK-30419: -- Summary: Make IsotonicRegression extend Regressor Key: SPARK-30419 URL: https://issues.apache.org/jira/browse/SPARK-30419 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-30377) Make Regressors extend abstract class Regressor

[ https://issues.apache.org/jira/browse/SPARK-30377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007750#comment-17007750 ] Huaxin Gao commented on SPARK-30377: Currently, IsotonicRegression and AFTSurvivalRe

[jira] [Resolved] (SPARK-30267) avro deserializer: ArrayList cannot be cast to GenericData$Array

[ https://issues.apache.org/jira/browse/SPARK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-30267. Resolution: Fixed This issue is resolved in https://github.com/apache/spark/pull/26907 >

[jira] [Resolved] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23264. - Resolution: Later > Support interval values without INTERVAL clauses > -

[jira] [Reopened] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-23264: - > Support interval values without INTERVAL clauses > > >

[jira] [Assigned] (SPARK-30267) avro deserializer: ArrayList cannot be cast to GenericData$Array

[ https://issues.apache.org/jira/browse/SPARK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-30267: -- Assignee: Steven Aerts > avro deserializer: ArrayList cannot be cast to GenericData$A

[jira] [Created] (SPARK-30420) Commands involved with namespace go thru the new resolution framework.

Terry Kim created SPARK-30420: - Summary: Commands involved with namespace go thru the new resolution framework. Key: SPARK-30420 URL: https://issues.apache.org/jira/browse/SPARK-30420 Project: Spark