[jira] [Updated] (SPARK-45698) Clean up the deprecated API usage related to `Buffer`

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45698: --- Labels: pull-request-available (was: ) > Clean up the deprecated API usage related to

[jira] [Updated] (SPARK-45685) Use `LazyList` instead of `Stream`

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45685: - Description: * class Stream in package immutable is deprecated (since 2.13.0) * object Stream in

[jira] [Updated] (SPARK-45699) Fix "Widening conversion from `TypeA` to `TypeB` is deprecated because it loses precision"

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45699: - Summary: Fix "Widening conversion from `TypeA` to `TypeB` is deprecated because it loses precision"

[jira] [Updated] (SPARK-45699) Fix "Widening conversion from `TypeA` to `TypeB` is deprecated because it loses precision. Write `.toTypeB` instead"

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45699: - Summary: Fix "Widening conversion from `TypeA` to `TypeB` is deprecated because it loses precision.

[jira] [Created] (SPARK-45704) Fix `legacy-binding`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45704: Summary: Fix `legacy-binding` Key: SPARK-45704 URL: https://issues.apache.org/jira/browse/SPARK-45704 Project: Spark Issue Type: Sub-task Components:

[jira] [Created] (SPARK-45703) Fix `abstract type TypeA in type pattern Some[TypeA] is unchecked since it is eliminated by erasure`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45703: Summary: Fix `abstract type TypeA in type pattern Some[TypeA] is unchecked since it is eliminated by erasure` Key: SPARK-45703 URL: https://issues.apache.org/jira/browse/SPARK-45703

[jira] [Created] (SPARK-45702) Fix `the type test for pattern TypeA cannot be checked at runtime`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45702: Summary: Fix `the type test for pattern TypeA cannot be checked at runtime` Key: SPARK-45702 URL: https://issues.apache.org/jira/browse/SPARK-45702 Project: Spark

[jira] [Created] (SPARK-45701) Clean up the deprecated API usage related to `SetOps`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45701: Summary: Clean up the deprecated API usage related to `SetOps` Key: SPARK-45701 URL: https://issues.apache.org/jira/browse/SPARK-45701 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45684) Clean up the deprecated API usage related to `SeqOps`

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45684: - Description: * method transform in trait SeqOps is deprecated (since 2.13.0) * method reverseMap in

[jira] [Created] (SPARK-45700) Fix `The outer reference in this type test cannot be checked at run time`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45700: Summary: Fix `The outer reference in this type test cannot be checked at run time` Key: SPARK-45700 URL: https://issues.apache.org/jira/browse/SPARK-45700 Project: Spark

[jira] [Created] (SPARK-45699) Fix "Widening conversion from `OType` to `NType` is deprecated because it loses precision. Write `.toXX` instead"

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45699: Summary: Fix "Widening conversion from `OType` to `NType` is deprecated because it loses precision. Write `.toXX` instead" Key: SPARK-45699 URL:

[jira] [Commented] (SPARK-45687) Fix `Passing an explicit array value to a Scala varargs method is deprecated`

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780150#comment-17780150 ] Yang Jie commented on SPARK-45687: -- We need to distinguish the situations, some need to be changed to

[jira] [Commented] (SPARK-45686) Fix `method copyArrayToImmutableIndexedSeq in class LowPriorityImplicits2 is deprecated`

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780149#comment-17780149 ] Yang Jie commented on SPARK-45686: -- We need to distinguish the situations, some need to be changed to

[jira] [Comment Edited] (SPARK-45686) Fix `method copyArrayToImmutableIndexedSeq in class LowPriorityImplicits2 is deprecated`

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780149#comment-17780149 ] Yang Jie edited comment on SPARK-45686 at 10/27/23 3:21 AM: We need to

[jira] [Commented] (SPARK-45314) Drop Scala 2.12 and make Scala 2.13 by default

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780148#comment-17780148 ] Yang Jie commented on SPARK-45314: -- Friendly ping [~ivoson] [~panbingkun] [~zhiyuan] [~laglangyue], I

[jira] [Created] (SPARK-45698) Clean up the deprecated API usage related to `Buffer`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45698: Summary: Clean up the deprecated API usage related to `Buffer` Key: SPARK-45698 URL: https://issues.apache.org/jira/browse/SPARK-45698 Project: Spark Issue Type:

[jira] [Created] (SPARK-45697) Fix `Unicode escapes in triple quoted strings are deprecated`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45697: Summary: Fix `Unicode escapes in triple quoted strings are deprecated` Key: SPARK-45697 URL: https://issues.apache.org/jira/browse/SPARK-45697 Project: Spark Issue

[jira] [Resolved] (SPARK-45667) Clean up the deprecated API usage related to `IterableOnceExtensionMethods`.

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45667. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43532

[jira] [Assigned] (SPARK-45667) Clean up the deprecated API usage related to `IterableOnceExtensionMethods`.

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45667: Assignee: Yang Jie > Clean up the deprecated API usage related to

[jira] [Resolved] (SPARK-45481) Introduce a mapper for parquet compression codecs

2023-10-26 Thread Jiaan Geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng resolved SPARK-45481. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43308

[jira] [Created] (SPARK-45696) Fix `method tryCompleteWith in trait Promise is deprecated`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45696: Summary: Fix `method tryCompleteWith in trait Promise is deprecated` Key: SPARK-45696 URL: https://issues.apache.org/jira/browse/SPARK-45696 Project: Spark Issue

[jira] [Created] (SPARK-45694) Fix `method signum in trait ScalaNumberProxy is deprecated`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45694: Summary: Fix `method signum in trait ScalaNumberProxy is deprecated` Key: SPARK-45694 URL: https://issues.apache.org/jira/browse/SPARK-45694 Project: Spark Issue

[jira] [Created] (SPARK-45691) Clean up the deprecated API usage related to `RightProjection/LeftProjection/Either`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45691: Summary: Clean up the deprecated API usage related to `RightProjection/LeftProjection/Either` Key: SPARK-45691 URL: https://issues.apache.org/jira/browse/SPARK-45691

[jira] [Created] (SPARK-45690) Clean up type use of `BufferedIterator/CanBuildFrom/Traversable`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45690: Summary: Clean up type use of `BufferedIterator/CanBuildFrom/Traversable` Key: SPARK-45690 URL: https://issues.apache.org/jira/browse/SPARK-45690 Project: Spark

[jira] [Created] (SPARK-45689) Clean up the deprecated API usage related to `StringContext/StringOps`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45689: Summary: Clean up the deprecated API usage related to `StringContext/StringOps` Key: SPARK-45689 URL: https://issues.apache.org/jira/browse/SPARK-45689 Project: Spark

[jira] [Created] (SPARK-45688) Clean up the deprecated API usage related to `MapOps`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45688: Summary: Clean up the deprecated API usage related to `MapOps` Key: SPARK-45688 URL: https://issues.apache.org/jira/browse/SPARK-45688 Project: Spark Issue Type:

[jira] [Created] (SPARK-45687) Fix `Passing an explicit array value to a Scala varargs method is deprecated`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45687: Summary: Fix `Passing an explicit array value to a Scala varargs method is deprecated` Key: SPARK-45687 URL: https://issues.apache.org/jira/browse/SPARK-45687 Project: Spark

[jira] [Created] (SPARK-45686) Fix `method copyArrayToImmutableIndexedSeq in class LowPriorityImplicits2 is deprecated`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45686: Summary: Fix `method copyArrayToImmutableIndexedSeq in class LowPriorityImplicits2 is deprecated` Key: SPARK-45686 URL: https://issues.apache.org/jira/browse/SPARK-45686

[jira] [Created] (SPARK-45685) Use `LazyList` instead of `Stream`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45685: Summary: Use `LazyList` instead of `Stream` Key: SPARK-45685 URL: https://issues.apache.org/jira/browse/SPARK-45685 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-45575) support time travel options for df read API

2023-10-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45575. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43403

[jira] [Assigned] (SPARK-45575) support time travel options for df read API

2023-10-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-45575: Assignee: Wenchen Fan > support time travel options for df read API >

[jira] [Created] (SPARK-45684) Clean up the deprecated API usage related to `SeqOps`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45684: Summary: Clean up the deprecated API usage related to `SeqOps` Key: SPARK-45684 URL: https://issues.apache.org/jira/browse/SPARK-45684 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45681) Clone a js version of UIUtils.errorMessageCell to for consistent error parsing on UI

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45681: --- Labels: pull-request-available (was: ) > Clone a js version of UIUtils.errorMessageCell to

[jira] [Updated] (SPARK-45682) Fix "method + in class Byte/Short/Char/Long/Double/Int is deprecated"

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45682: - Description: {code:java} [warn]

[jira] [Created] (SPARK-45683) Fix `method any2stringadd in object Predef is deprecated`

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45683: Summary: Fix `method any2stringadd in object Predef is deprecated` Key: SPARK-45683 URL: https://issues.apache.org/jira/browse/SPARK-45683 Project: Spark Issue

[jira] [Created] (SPARK-45682) Fix "method + in class Byte/Short/Char/Long/Double/Int is deprecated"

2023-10-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45682: Summary: Fix "method + in class Byte/Short/Char/Long/Double/Int is deprecated" Key: SPARK-45682 URL: https://issues.apache.org/jira/browse/SPARK-45682 Project: Spark

[jira] [Created] (SPARK-45681) Clone a js version of UIUtils.errorMessageCell to for consistent error parsing on UI

2023-10-26 Thread Kent Yao (Jira)
Kent Yao created SPARK-45681: Summary: Clone a js version of UIUtils.errorMessageCell to for consistent error parsing on UI Key: SPARK-45681 URL: https://issues.apache.org/jira/browse/SPARK-45681

[jira] [Resolved] (SPARK-45679) Add clusterBy in DataFrame API

2023-10-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45679. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43544

[jira] [Assigned] (SPARK-45679) Add clusterBy in DataFrame API

2023-10-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45679: Assignee: Zhen Li > Add clusterBy in DataFrame API > -- > >

[jira] [Reopened] (SPARK-45651) Snapshots of some packages are not published any more

2023-10-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-45651: -- Reverted in https://github.com/apache/spark/commit/df0262f29969fe40f53dee070a150f2bfe98484c >

[jira] [Resolved] (SPARK-45651) Snapshots of some packages are not published any more

2023-10-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45651. -- Fix Version/s: (was: 4.0.0) Assignee: (was: Enrico Minack) Resolution:

[jira] [Comment Edited] (SPARK-45651) Snapshots of some packages are not published any more

2023-10-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780127#comment-17780127 ] Hyukjin Kwon edited comment on SPARK-45651 at 10/27/23 12:48 AM: -

[jira] [Reopened] (SPARK-45651) Snapshots of some packages are not published any more

2023-10-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-45651: -- > Snapshots of some packages are not published any more >

[jira] [Resolved] (SPARK-45677) Observe API error logging

2023-10-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-45677. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43542

[jira] [Assigned] (SPARK-45677) Observe API error logging

2023-10-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-45677: Assignee: Wei Liu > Observe API error logging > - > >

[jira] [Updated] (SPARK-44386) Use PartitionEvaluator API in HashAggregateExec, ObjectHashAggregateExec, SortAggregateExec

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44386: --- Labels: pull-request-available (was: ) > Use PartitionEvaluator API in HashAggregateExec,

[jira] [Updated] (SPARK-32268) Bloom Filter Join

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-32268: --- Labels: pull-request-available (was: ) > Bloom Filter Join > - > >

[jira] [Updated] (SPARK-44447) Use PartitionEvaluator API in FlatMapGroupsInPandasExec, FlatMapCoGroupsInPandasExec

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-7: --- Labels: pull-request-available (was: ) > Use PartitionEvaluator API in

[jira] [Updated] (SPARK-44385) Use PartitionEvaluator API in MergingSessionsExec & UpdatingSessionsExec

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44385: --- Labels: pull-request-available (was: ) > Use PartitionEvaluator API in MergingSessionsExec

[jira] [Updated] (SPARK-44414) Fixed matching check for CharType/VarcharType

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44414: --- Labels: pull-request-available (was: ) > Fixed matching check for CharType/VarcharType >

[jira] [Updated] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec, AttachDistributedSequenceExec

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44362: --- Labels: pull-request-available (was: ) > Use PartitionEvaluator API in

[jira] [Updated] (SPARK-45680) ReleaseSession to close Spark Connect session

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45680: --- Labels: pull-request-available (was: ) > ReleaseSession to close Spark Connect session >

[jira] [Updated] (SPARK-43754) Spark Connect Session & Query lifecycle

2023-10-26 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-43754: -- Affects Version/s: 4.0.0 > Spark Connect Session & Query lifecycle >

[jira] [Created] (SPARK-45680) ReleaseSession to close Spark Connect session

2023-10-26 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45680: - Summary: ReleaseSession to close Spark Connect session Key: SPARK-45680 URL: https://issues.apache.org/jira/browse/SPARK-45680 Project: Spark

[jira] [Updated] (SPARK-45679) Add clusterBy in DataFrame API

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45679: --- Labels: pull-request-available (was: ) > Add clusterBy in DataFrame API >

[jira] [Created] (SPARK-45679) Add clusterBy in DataFrame API

2023-10-26 Thread Zhen Li (Jira)
Zhen Li created SPARK-45679: --- Summary: Add clusterBy in DataFrame API Key: SPARK-45679 URL: https://issues.apache.org/jira/browse/SPARK-45679 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45678) Cover BufferReleasingInputStream.available under tryOrFetchFailedException

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45678: --- Labels: pull-request-available (was: ) > Cover BufferReleasingInputStream.available under

[jira] [Created] (SPARK-45678) Cover BufferReleasingInputStream.available under tryOrFetchFailedException

2023-10-26 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-45678: --- Summary: Cover BufferReleasingInputStream.available under tryOrFetchFailedException Key: SPARK-45678 URL: https://issues.apache.org/jira/browse/SPARK-45678 Project:

[jira] [Updated] (SPARK-45652) SPJ: Handle empty input partitions after dynamic filtering

2023-10-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45652: -- Fix Version/s: 3.4.2 3.5.1 > SPJ: Handle empty input partitions after

[jira] [Updated] (SPARK-45677) Observe API error logging

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45677: --- Labels: pull-request-available (was: ) > Observe API error logging >

[jira] [Created] (SPARK-45677) Observe API error logging

2023-10-26 Thread Wei Liu (Jira)
Wei Liu created SPARK-45677: --- Summary: Observe API error logging Key: SPARK-45677 URL: https://issues.apache.org/jira/browse/SPARK-45677 Project: Spark Issue Type: Task Components:

[jira] [Updated] (SPARK-45544) [CORE] Integrate SSL support into TransportContext

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45544: --- Labels: pull-request-available (was: ) > [CORE] Integrate SSL support into

[jira] [Resolved] (SPARK-45652) SPJ: Handle empty input partitions after dynamic filtering

2023-10-26 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-45652. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43531

[jira] [Assigned] (SPARK-45652) SPJ: Handle empty input partitions after dynamic filtering

2023-10-26 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-45652: Assignee: Chao Sun > SPJ: Handle empty input partitions after dynamic filtering >

[jira] [Assigned] (SPARK-45596) Use java.lang.ref.Cleaner instead of org.apache.spark.sql.connect.client.util.Cleaner

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45596: Assignee: Min Zhao > Use java.lang.ref.Cleaner instead of >

[jira] [Resolved] (SPARK-45596) Use java.lang.ref.Cleaner instead of org.apache.spark.sql.connect.client.util.Cleaner

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45596. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43439

[jira] [Updated] (SPARK-45637) Time window aggregation in separate streams followed by stream-stream join not returning results

2023-10-26 Thread Andrzej Zera (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrzej Zera updated SPARK-45637: - Description: According to documentation update (SPARK-42591) resulting from SPARK-42376, Spark

[jira] [Resolved] (SPARK-45659) Add `since` field to Java API marked as `@Deprecated`.

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45659. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43522

[jira] [Assigned] (SPARK-45659) Add `since` field to Java API marked as `@Deprecated`.

2023-10-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45659: Assignee: Yang Jie > Add `since` field to Java API marked as `@Deprecated`. >

[jira] [Commented] (SPARK-38723) Test the error class: CONCURRENT_QUERY

2023-10-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779871#comment-17779871 ] Jungtaek Lim commented on SPARK-38723: -- The merge script will assign the PR author. We keep the

[jira] [Assigned] (SPARK-38723) Test the error class: CONCURRENT_QUERY

2023-10-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-38723: Assignee: Philip Dakin > Test the error class: CONCURRENT_QUERY >

[jira] [Commented] (SPARK-38723) Test the error class: CONCURRENT_QUERY

2023-10-26 Thread Philip Dakin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779869#comment-17779869 ] Philip Dakin commented on SPARK-38723: -- [~kabhwan] it's me.   BTW - do you know steps to get the

[jira] [Commented] (SPARK-45598) Delta table 3.0.0 not working with Spark Connect 3.5.0

2023-10-26 Thread Faiz Halde (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779843#comment-17779843 ] Faiz Halde commented on SPARK-45598: Hi, do we have any updates here? Happy to help > Delta table

[jira] [Assigned] (SPARK-45642) Fix `FileSystem.isFile & FileSystem.isDirectory is deprecated`

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45642: -- Assignee: (was: Apache Spark) > Fix `FileSystem.isFile & FileSystem.isDirectory

[jira] [Assigned] (SPARK-45642) Fix `FileSystem.isFile & FileSystem.isDirectory is deprecated`

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45642: -- Assignee: Apache Spark > Fix `FileSystem.isFile & FileSystem.isDirectory is

[jira] [Assigned] (SPARK-45368) Remove scala2.12 compatibility logic for DoubleType, FloatType, Decimal

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45368: -- Assignee: Apache Spark > Remove scala2.12 compatibility logic for DoubleType,

[jira] [Assigned] (SPARK-45481) Introduce a mapper for parquet compression codecs

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45481: -- Assignee: Jiaan Geng (was: Apache Spark) > Introduce a mapper for parquet

[jira] [Assigned] (SPARK-45368) Remove scala2.12 compatibility logic for DoubleType, FloatType, Decimal

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45368: -- Assignee: (was: Apache Spark) > Remove scala2.12 compatibility logic for

[jira] [Assigned] (SPARK-45481) Introduce a mapper for parquet compression codecs

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45481: -- Assignee: Apache Spark (was: Jiaan Geng) > Introduce a mapper for parquet

[jira] [Assigned] (SPARK-45368) Remove scala2.12 compatibility logic for DoubleType, FloatType, Decimal

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45368: -- Assignee: (was: Apache Spark) > Remove scala2.12 compatibility logic for

[jira] [Assigned] (SPARK-45481) Introduce a mapper for parquet compression codecs

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45481: -- Assignee: Apache Spark (was: Jiaan Geng) > Introduce a mapper for parquet

[jira] [Assigned] (SPARK-45481) Introduce a mapper for parquet compression codecs

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45481: -- Assignee: Jiaan Geng (was: Apache Spark) > Introduce a mapper for parquet

[jira] [Assigned] (SPARK-45368) Remove scala2.12 compatibility logic for DoubleType, FloatType, Decimal

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45368: -- Assignee: Apache Spark > Remove scala2.12 compatibility logic for DoubleType,

[jira] [Assigned] (SPARK-45481) Introduce a mapper for parquet compression codecs

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45481: -- Assignee: Jiaan Geng (was: Apache Spark) > Introduce a mapper for parquet

[jira] [Assigned] (SPARK-45481) Introduce a mapper for parquet compression codecs

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45481: -- Assignee: Apache Spark (was: Jiaan Geng) > Introduce a mapper for parquet

[jira] [Assigned] (SPARK-45481) Introduce a mapper for parquet compression codecs

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45481: -- Assignee: Jiaan Geng (was: Apache Spark) > Introduce a mapper for parquet

[jira] [Assigned] (SPARK-45481) Introduce a mapper for parquet compression codecs

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45481: -- Assignee: Apache Spark (was: Jiaan Geng) > Introduce a mapper for parquet

[jira] [Created] (SPARK-45676) Upgrade to PySpark 3.5.0 gives Class org.apache.hadoop.fs.s3a.S3AFileSystem not found

2023-10-26 Thread Miles Granger (Jira)
Miles Granger created SPARK-45676: - Summary: Upgrade to PySpark 3.5.0 gives Class org.apache.hadoop.fs.s3a.S3AFileSystem not found Key: SPARK-45676 URL: https://issues.apache.org/jira/browse/SPARK-45676

[jira] [Created] (SPARK-45675) Specify number of partitions when creating spark dataframe from pandas dataframe

2023-10-26 Thread Jelmer Kuperus (Jira)
Jelmer Kuperus created SPARK-45675: -- Summary: Specify number of partitions when creating spark dataframe from pandas dataframe Key: SPARK-45675 URL: https://issues.apache.org/jira/browse/SPARK-45675

[jira] [Updated] (SPARK-45674) Improve error message for JVM-dependent attributes on Spark Connect.

2023-10-26 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-45674: Summary: Improve error message for JVM-dependent attributes on Spark Connect. (was: Improve

[jira] [Updated] (SPARK-45674) Improve `NOT_IMPLEMENTED` error for `sparkContext` on Spark Connect.

2023-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45674: --- Labels: pull-request-available (was: ) > Improve `NOT_IMPLEMENTED` error for

[jira] [Created] (SPARK-45674) Improve `NOT_IMPLEMENTED` error for `sparkContext` on Spark Connect.

2023-10-26 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-45674: --- Summary: Improve `NOT_IMPLEMENTED` error for `sparkContext` on Spark Connect. Key: SPARK-45674 URL: https://issues.apache.org/jira/browse/SPARK-45674 Project: Spark

[jira] [Created] (SPARK-45673) Enhancing clarity and usability of PySpark error messages

2023-10-26 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-45673: --- Summary: Enhancing clarity and usability of PySpark error messages Key: SPARK-45673 URL: https://issues.apache.org/jira/browse/SPARK-45673 Project: Spark