[jira] [Closed] (SPARK-12312) Support JDBC Kerberos w/ keytab

[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi closed SPARK-12312. - > Support JDBC Kerberos w/ keytab > --- > > Key:

[jira] [Resolved] (SPARK-12312) Support JDBC Kerberos w/ keytab

[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi resolved SPARK-12312. --- Fix Version/s: 3.1.0 Resolution: Fixed > Support JDBC Kerberos w/ keytab >

[jira] [Closed] (SPARK-31857) Support Azure SQLDB Kerberos login in JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-31857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi closed SPARK-31857. - > Support Azure SQLDB Kerberos login in JDBC connector >

[jira] [Resolved] (SPARK-31884) Support MongoDB Kerberos login in JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-31884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi resolved SPARK-31884. --- Resolution: Won't Do > Support MongoDB Kerberos login in JDBC connector >

[jira] [Closed] (SPARK-31884) Support MongoDB Kerberos login in JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-31884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi closed SPARK-31884. - > Support MongoDB Kerberos login in JDBC connector >

[jira] [Commented] (SPARK-31884) Support MongoDB Kerberos login in JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-31884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282280#comment-17282280 ] Gabor Somogyi commented on SPARK-31884: --- Since the API is implemented I think it's now possible to

[jira] [Resolved] (SPARK-31857) Support Azure SQLDB Kerberos login in JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-31857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi resolved SPARK-31857. --- Resolution: Won't Do > Support Azure SQLDB Kerberos login in JDBC connector >

[jira] [Closed] (SPARK-31815) Support Hive Kerberos login in JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-31815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi closed SPARK-31815. - > Support Hive Kerberos login in JDBC connector > - > >

[jira] [Commented] (SPARK-31857) Support Azure SQLDB Kerberos login in JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-31857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282279#comment-17282279 ] Gabor Somogyi commented on SPARK-31857: --- Since the API is implemented I think it's now possible to

[jira] [Resolved] (SPARK-31815) Support Hive Kerberos login in JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-31815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi resolved SPARK-31815. --- Resolution: Won't Do > Support Hive Kerberos login in JDBC connector >

[jira] [Commented] (SPARK-31815) Support Hive Kerberos login in JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-31815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282277#comment-17282277 ] Gabor Somogyi commented on SPARK-31815: --- Since the API is implemented I think it's now possible to

[jira] [Assigned] (SPARK-34414) OptimizeMetadataOnlyQuery should only apply for deterministic filters

[ https://issues.apache.org/jira/browse/SPARK-34414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34414: Assignee: (was: Apache Spark) > OptimizeMetadataOnlyQuery should only apply for

[jira] [Assigned] (SPARK-34414) OptimizeMetadataOnlyQuery should only apply for deterministic filters

[ https://issues.apache.org/jira/browse/SPARK-34414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34414: Assignee: Apache Spark > OptimizeMetadataOnlyQuery should only apply for deterministic

[jira] [Commented] (SPARK-34414) OptimizeMetadataOnlyQuery should only apply for deterministic filters

[ https://issues.apache.org/jira/browse/SPARK-34414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282273#comment-17282273 ] Apache Spark commented on SPARK-34414: -- User 'yeshengm' has created a pull request for this issue:

[jira] [Created] (SPARK-34414) OptimizeMetadataOnlyQuery should only apply for deterministic filters

Yesheng Ma created SPARK-34414: -- Summary: OptimizeMetadataOnlyQuery should only apply for deterministic filters Key: SPARK-34414 URL: https://issues.apache.org/jira/browse/SPARK-34414 Project: Spark

[jira] [Updated] (SPARK-34414) OptimizeMetadataOnlyQuery should only apply for deterministic filters

[ https://issues.apache.org/jira/browse/SPARK-34414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesheng Ma updated SPARK-34414: --- Issue Type: Bug (was: Improvement) > OptimizeMetadataOnlyQuery should only apply for deterministic

[jira] [Commented] (SPARK-34209) Allow multiple namespaces with session catalog

[ https://issues.apache.org/jira/browse/SPARK-34209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282259#comment-17282259 ] Apache Spark commented on SPARK-34209: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-34209) Allow multiple namespaces with session catalog

[ https://issues.apache.org/jira/browse/SPARK-34209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282258#comment-17282258 ] Apache Spark commented on SPARK-34209: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-34234) Remove TreeNodeException that didn't work

[ https://issues.apache.org/jira/browse/SPARK-34234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34234. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31337

[jira] [Assigned] (SPARK-34234) Remove TreeNodeException that didn't work

[ https://issues.apache.org/jira/browse/SPARK-34234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34234: --- Assignee: jiaan.geng > Remove TreeNodeException that didn't work >

[jira] [Resolved] (SPARK-34404) Support Avro datasource options to control datetime rebasing in read

[ https://issues.apache.org/jira/browse/SPARK-34404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34404. - Resolution: Fixed Issue resolved by pull request 31529

[jira] [Resolved] (SPARK-34347) CatalogImpl.uncacheTable should invalidate in cascade for temp views

[ https://issues.apache.org/jira/browse/SPARK-34347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34347. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31462

[jira] [Assigned] (SPARK-34347) CatalogImpl.uncacheTable should invalidate in cascade for temp views

[ https://issues.apache.org/jira/browse/SPARK-34347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-34347: --- Assignee: Chao Sun > CatalogImpl.uncacheTable should invalidate in cascade for temp views

[jira] [Resolved] (SPARK-31816) Create high level description about JDBC connection providers for users/developers

[ https://issues.apache.org/jira/browse/SPARK-31816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31816. -- Fix Version/s: 3.2.0 Assignee: Gabor Somogyi Resolution: Fixed

[jira] [Commented] (SPARK-33763) Add metrics for better tracking of dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-33763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282201#comment-17282201 ] Attila Zsolt Piros commented on SPARK-33763: I am not positive about the "stage re-submitted

[jira] [Comment Edited] (SPARK-33763) Add metrics for better tracking of dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-33763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282201#comment-17282201 ] Attila Zsolt Piros edited comment on SPARK-33763 at 2/10/21, 3:30 AM:

[jira] [Resolved] (SPARK-33995) Make datetime addition easier for years, weeks, hours, minutes, and seconds

[ https://issues.apache.org/jira/browse/SPARK-33995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33995. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31073

[jira] [Assigned] (SPARK-33995) Make datetime addition easier for years, weeks, hours, minutes, and seconds

[ https://issues.apache.org/jira/browse/SPARK-33995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33995: --- Assignee: Matthew Powers > Make datetime addition easier for years, weeks, hours, minutes,

[jira] [Resolved] (SPARK-34137) The tree string does not contain statistics for nested scalar sub queries

[ https://issues.apache.org/jira/browse/SPARK-34137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34137. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31485

[jira] [Assigned] (SPARK-34137) The tree string does not contain statistics for nested scalar sub queries

[ https://issues.apache.org/jira/browse/SPARK-34137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34137: --- Assignee: Yuming Wang > The tree string does not contain statistics for nested scalar sub

[jira] [Resolved] (SPARK-34240) Unify output of SHOW TBLPROPERTIES pass output attributes properly

[ https://issues.apache.org/jira/browse/SPARK-34240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34240. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31378

[jira] [Assigned] (SPARK-34240) Unify output of SHOW TBLPROPERTIES pass output attributes properly

[ https://issues.apache.org/jira/browse/SPARK-34240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34240: --- Assignee: angerszhu > Unify output of SHOW TBLPROPERTIES pass output attributes properly >

[jira] [Commented] (SPARK-34392) Invalid ID for offset-based ZoneId since Spark 3.0

[ https://issues.apache.org/jira/browse/SPARK-34392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282194#comment-17282194 ] Yuming Wang commented on SPARK-34392: - PostgreSQL: {noformat} postgres=# SELECT TIMESTAMP WITH TIME

[jira] [Created] (SPARK-34413) Clean up AnsiTypeCoercionSuite and TypeCoercionSuite

Gengliang Wang created SPARK-34413: -- Summary: Clean up AnsiTypeCoercionSuite and TypeCoercionSuite Key: SPARK-34413 URL: https://issues.apache.org/jira/browse/SPARK-34413 Project: Spark

[jira] [Resolved] (SPARK-34248) Allow implicit casting string literal to other data types under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-34248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-34248. Assignee: Gengliang Wang Resolution: Fixed > Allow implicit casting string literal

[jira] [Resolved] (SPARK-34250) Add rule WindowFrameCoercion into ANSI implicit cast rules

[ https://issues.apache.org/jira/browse/SPARK-34250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-34250. Assignee: Gengliang Wang Resolution: Fixed > Add rule WindowFrameCoercion into ANSI

[jira] [Resolved] (SPARK-34311) PostgresDialect can't treat arrays of some types

[ https://issues.apache.org/jira/browse/SPARK-34311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34311. -- Fix Version/s: 3.2.0 Resolution: Fixed Resolved by 

[jira] [Assigned] (SPARK-20977) NPE in CollectionAccumulator

[ https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20977: Assignee: (was: Apache Spark) > NPE in CollectionAccumulator >

[jira] [Assigned] (SPARK-20977) NPE in CollectionAccumulator

[ https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20977: Assignee: Apache Spark > NPE in CollectionAccumulator > > >

[jira] [Commented] (SPARK-20977) NPE in CollectionAccumulator

[ https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282157#comment-17282157 ] Apache Spark commented on SPARK-20977: -- User 'gerashegalov' has created a pull request for this

[jira] [Commented] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

[ https://issues.apache.org/jira/browse/SPARK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282111#comment-17282111 ] Ranju commented on SPARK-34389: --- Thanks for this information > Spark job on Kubernetes scheduled For Zero

[jira] [Commented] (SPARK-34105) In addition to killing exlcuded/flakey executors which should support decommissioning

[ https://issues.apache.org/jira/browse/SPARK-34105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282110#comment-17282110 ] Apache Spark commented on SPARK-34105: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34105) In addition to killing exlcuded/flakey executors which should support decommissioning

[ https://issues.apache.org/jira/browse/SPARK-34105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282109#comment-17282109 ] Apache Spark commented on SPARK-34105: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34104) Allow users to specify a maximum decommissioning time

[ https://issues.apache.org/jira/browse/SPARK-34104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282108#comment-17282108 ] Apache Spark commented on SPARK-34104: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34105) In addition to killing exlcuded/flakey executors which should support decommissioning

[ https://issues.apache.org/jira/browse/SPARK-34105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34105: Assignee: Apache Spark (was: Holden Karau) > In addition to killing exlcuded/flakey

[jira] [Assigned] (SPARK-34104) Allow users to specify a maximum decommissioning time

[ https://issues.apache.org/jira/browse/SPARK-34104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34104: Assignee: Holden Karau (was: Apache Spark) > Allow users to specify a maximum

[jira] [Assigned] (SPARK-34105) In addition to killing exlcuded/flakey executors which should support decommissioning

[ https://issues.apache.org/jira/browse/SPARK-34105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34105: Assignee: Holden Karau (was: Apache Spark) > In addition to killing exlcuded/flakey

[jira] [Assigned] (SPARK-34104) Allow users to specify a maximum decommissioning time

[ https://issues.apache.org/jira/browse/SPARK-34104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34104: Assignee: Apache Spark (was: Holden Karau) > Allow users to specify a maximum

[jira] [Updated] (SPARK-34104) Allow users to specify a maximum decommissioning time

[ https://issues.apache.org/jira/browse/SPARK-34104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34104: - Target Version/s: (was: 3.2.0) > Allow users to specify a maximum decommissioning time >

[jira] [Updated] (SPARK-34104) Allow users to specify a maximum decommissioning time

[ https://issues.apache.org/jira/browse/SPARK-34104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34104: - Fix Version/s: (was: 3.2.0) > Allow users to specify a maximum decommissioning time >

[jira] [Reopened] (SPARK-34104) Allow users to specify a maximum decommissioning time

[ https://issues.apache.org/jira/browse/SPARK-34104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-34104: -- Reverted in https://github.com/apache/spark/commit/c8628c943cd12bbad7561bdc297cea9ff23becc7 >

[jira] [Updated] (SPARK-34105) In addition to killing exlcuded/flakey executors which should support decommissioning

[ https://issues.apache.org/jira/browse/SPARK-34105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34105: - Fix Version/s: (was: 3.2.0) > In addition to killing exlcuded/flakey executors which should

[jira] [Reopened] (SPARK-34105) In addition to killing exlcuded/flakey executors which should support decommissioning

[ https://issues.apache.org/jira/browse/SPARK-34105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-34105: -- Reverted in https://github.com/apache/spark/commit/c8628c943cd12bbad7561bdc297cea9ff23becc7 >

[jira] [Updated] (SPARK-34105) In addition to killing exlcuded/flakey executors which should support decommissioning

[ https://issues.apache.org/jira/browse/SPARK-34105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34105: - Target Version/s: (was: 3.2.0) > In addition to killing exlcuded/flakey executors which

[jira] [Resolved] (SPARK-34411) Remove python2 support

[ https://issues.apache.org/jira/browse/SPARK-34411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34411. -- Resolution: Duplicate > Remove python2 support > -- > >

[jira] [Commented] (SPARK-34412) RemoveNoopOperators can remove non-trivial projects

[ https://issues.apache.org/jira/browse/SPARK-34412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282089#comment-17282089 ] Apache Spark commented on SPARK-34412: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-34412) RemoveNoopOperators can remove non-trivial projects

[ https://issues.apache.org/jira/browse/SPARK-34412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34412: Assignee: Apache Spark (was: Herman van Hövell) > RemoveNoopOperators can remove

[jira] [Assigned] (SPARK-34412) RemoveNoopOperators can remove non-trivial projects

[ https://issues.apache.org/jira/browse/SPARK-34412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34412: Assignee: Herman van Hövell (was: Apache Spark) > RemoveNoopOperators can remove

[jira] [Commented] (SPARK-34412) RemoveNoopOperators can remove non-trivial projects

[ https://issues.apache.org/jira/browse/SPARK-34412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282090#comment-17282090 ] Apache Spark commented on SPARK-34412: -- User 'hvanhovell' has created a pull request for this

[jira] [Commented] (SPARK-34063) Major slowdown in spark streaming after 6 days

[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282081#comment-17282081 ] Calvin Pietersen commented on SPARK-34063: -- So this happened consistently every 6 days about 8

[jira] [Resolved] (SPARK-34104) Allow users to specify a maximum decommissioning time

[ https://issues.apache.org/jira/browse/SPARK-34104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-34104. -- Fix Version/s: 3.2.0 Resolution: Fixed > Allow users to specify a maximum

[jira] [Resolved] (SPARK-34105) In addition to killing exlcuded/flakey executors which should support decommissioning

[ https://issues.apache.org/jira/browse/SPARK-34105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-34105. -- Fix Version/s: 3.2.0 Assignee: Holden Karau Resolution: Fixed > In addition

[jira] [Created] (SPARK-34412) RemoveNoopOperators can remove non-trivial projects

Herman van Hövell created SPARK-34412: - Summary: RemoveNoopOperators can remove non-trivial projects Key: SPARK-34412 URL: https://issues.apache.org/jira/browse/SPARK-34412 Project: Spark

[jira] [Resolved] (SPARK-34372) Speculation results in broken CSV files in Amazon S3

[ https://issues.apache.org/jira/browse/SPARK-34372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34372. -- Resolution: Invalid > Speculation results in broken CSV files in Amazon S3 >

[jira] [Resolved] (SPARK-34372) Speculation results in broken CSV files in Amazon S3

[ https://issues.apache.org/jira/browse/SPARK-34372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34372. -- Resolution: Won't Fix > Speculation results in broken CSV files in Amazon S3 >

[jira] [Reopened] (SPARK-34372) Speculation results in broken CSV files in Amazon S3

[ https://issues.apache.org/jira/browse/SPARK-34372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-34372: -- > Speculation results in broken CSV files in Amazon S3 >

[jira] [Created] (SPARK-34411) Remove python2 support

Björn Boschman created SPARK-34411: -- Summary: Remove python2 support Key: SPARK-34411 URL: https://issues.apache.org/jira/browse/SPARK-34411 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-27658) Catalog API to load functions

[ https://issues.apache.org/jira/browse/SPARK-27658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281984#comment-17281984 ] Thomas Graves commented on SPARK-27658: --- can we link the SPIP to this  > Catalog API to load

[jira] [Updated] (SPARK-33716) Decommissioning Race Condition during Pod Snapshot

[ https://issues.apache.org/jira/browse/SPARK-33716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-33716: - Fix Version/s: (was: 3.1.0) 3.2.0 > Decommissioning Race Condition

[jira] [Resolved] (SPARK-34209) Allow multiple namespaces with session catalog

[ https://issues.apache.org/jira/browse/SPARK-34209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-34209. -- Fix Version/s: 3.2.0 Assignee: Holden Karau Resolution: Fixed > Allow

[jira] [Updated] (SPARK-34334) ExecutorPodsAllocator fails to identify some excess requests during downscaling

[ https://issues.apache.org/jira/browse/SPARK-34334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-34334: - Affects Version/s: 3.1.2 3.1.1 3.0.0

[jira] [Resolved] (SPARK-34334) ExecutorPodsAllocator fails to identify some excess requests during downscaling

[ https://issues.apache.org/jira/browse/SPARK-34334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-34334. -- Fix Version/s: 3.1.2 3.2.0 Assignee: Attila Zsolt Piros

[jira] [Updated] (SPARK-34334) ExecutorPodsAllocator fails to identify some excess requests during downscaling

[ https://issues.apache.org/jira/browse/SPARK-34334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34334: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Bug) > ExecutorPodsAllocator fails to

[jira] [Commented] (SPARK-28344) fail the query if detect ambiguous self join

[ https://issues.apache.org/jira/browse/SPARK-28344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281852#comment-17281852 ] Apache Spark commented on SPARK-28344: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-27816) make TreeNode tag type safe

[ https://issues.apache.org/jira/browse/SPARK-27816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281850#comment-17281850 ] Apache Spark commented on SPARK-27816: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-28344) fail the query if detect ambiguous self join

[ https://issues.apache.org/jira/browse/SPARK-28344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281851#comment-17281851 ] Apache Spark commented on SPARK-28344: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-27816) make TreeNode tag type safe

[ https://issues.apache.org/jira/browse/SPARK-27816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281849#comment-17281849 ] Apache Spark commented on SPARK-27816: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-34392) Invalid ID for offset-based ZoneId since Spark 3.0

[ https://issues.apache.org/jira/browse/SPARK-34392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281838#comment-17281838 ] Maxim Gekk edited comment on SPARK-34392 at 2/9/21, 3:26 PM: - The "GMT+8:00"

[jira] [Commented] (SPARK-34392) Invalid ID for offset-based ZoneId since Spark 3.0

[ https://issues.apache.org/jira/browse/SPARK-34392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281838#comment-17281838 ] Maxim Gekk commented on SPARK-34392: The "GMT+8:00" string is unsupported format in 3.0, see docs

[jira] [Commented] (SPARK-34372) Speculation results in broken CSV files in Amazon S3

[ https://issues.apache.org/jira/browse/SPARK-34372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281815#comment-17281815 ] Attila Zsolt Piros commented on SPARK-34372: A Direct output committer with speculation

[jira] [Commented] (SPARK-34408) Refactor spark.udf.register to share the same path to generate UDF instance

[ https://issues.apache.org/jira/browse/SPARK-34408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281784#comment-17281784 ] Apache Spark commented on SPARK-34408: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-34408) Refactor spark.udf.register to share the same path to generate UDF instance

[ https://issues.apache.org/jira/browse/SPARK-34408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34408: Assignee: (was: Apache Spark) > Refactor spark.udf.register to share the same path

[jira] [Assigned] (SPARK-34408) Refactor spark.udf.register to share the same path to generate UDF instance

[ https://issues.apache.org/jira/browse/SPARK-34408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34408: Assignee: Apache Spark > Refactor spark.udf.register to share the same path to generate

[jira] [Updated] (SPARK-34409) haversine distance spark function

[ https://issues.apache.org/jira/browse/SPARK-34409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darshan Jani updated SPARK-34409: - Affects Version/s: (was: 3.1.2) 3.2.0 > haversine distance spark

[jira] [Updated] (SPARK-34410) Vincenty distance spark function

[ https://issues.apache.org/jira/browse/SPARK-34410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darshan Jani updated SPARK-34410: - Affects Version/s: (was: 3.1.2) 3.2.0 > Vincenty distance spark

[jira] [Created] (SPARK-34410) Vincenty distance spark function

Darshan Jani created SPARK-34410: Summary: Vincenty distance spark function Key: SPARK-34410 URL: https://issues.apache.org/jira/browse/SPARK-34410 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-34409) haversine distance spark function

Darshan Jani created SPARK-34409: Summary: haversine distance spark function Key: SPARK-34409 URL: https://issues.apache.org/jira/browse/SPARK-34409 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-34408) Refactor spark.udf.register to share the same path to generate UDF instance

[ https://issues.apache.org/jira/browse/SPARK-34408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34408: - Issue Type: Improvement (was: Documentation) > Refactor spark.udf.register to share the same

[jira] [Created] (SPARK-34408) Refactor spark.udf.register to share the same path to generate UDF instance

Hyukjin Kwon created SPARK-34408: Summary: Refactor spark.udf.register to share the same path to generate UDF instance Key: SPARK-34408 URL: https://issues.apache.org/jira/browse/SPARK-34408 Project:

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281677#comment-17281677 ] Ben Manes commented on SPARK-34309: --- FYI, your usage is with Guava’s default concurrency level (4)

[jira] [Commented] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

[ https://issues.apache.org/jira/browse/SPARK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281645#comment-17281645 ] Attila Zsolt Piros commented on SPARK-34389: > is it possible to get the available resources