[
https://issues.apache.org/jira/browse/SPARK-49050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-49050.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 47880
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-49050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim reassigned SPARK-49050:
Assignee: Eric Marnadi
> Enabling deleteIfExists operator in TWS with Virtual Column Fami
[
https://issues.apache.org/jira/browse/SPARK-49442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877256#comment-17877256
]
Jungtaek Lim commented on SPARK-49442:
--
Could you give a try with setting SQL confi
[
https://issues.apache.org/jira/browse/SPARK-49442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-49442:
-
Target Version/s: (was: 3.3.2)
> Complete Metadata requests on each micro batch causing Kafka
[
https://issues.apache.org/jira/browse/SPARK-49442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-49442:
-
Priority: Major (was: Blocker)
> Complete Metadata requests on each micro batch causing Kafka i
[
https://issues.apache.org/jira/browse/SPARK-49442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vipin Kumar updated SPARK-49442:
Target Version/s: 3.3.2
Labels: Kafka spark-streaming-kafka (was: )
Prio
[
https://issues.apache.org/jira/browse/SPARK-49412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-49412.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 47897
[https://
vipin Kumar created SPARK-49442:
---
Summary: Complete Metadata requests on each micro batch causing
Kafka issues
Key: SPARK-49442
URL: https://issues.apache.org/jira/browse/SPARK-49442
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-49069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877247#comment-17877247
]
Jungtaek Lim commented on SPARK-49069:
--
I changed this ticket to Wish. As commented
[
https://issues.apache.org/jira/browse/SPARK-49069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-49069:
-
Issue Type: Wish (was: Bug)
> Kafka Offsets Not Committed to Consumer Group in Spark Structured
[
https://issues.apache.org/jira/browse/SPARK-49441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-49441:
---
Labels: pull-request-available (was: )
> StringIndexer sort arrays in executors
> -
Ruifeng Zheng created SPARK-49441:
-
Summary: StringIndexer sort arrays in executors
Key: SPARK-49441
URL: https://issues.apache.org/jira/browse/SPARK-49441
Project: Spark
Issue Type: Improvem
[
https://issues.apache.org/jira/browse/SPARK-49440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-49440:
---
Labels: pull-request-available (was: )
> Clean up unused LogKey definitions
> -
Yang Jie created SPARK-49440:
Summary: Clean up unused LogKey definitions
Key: SPARK-49440
URL: https://issues.apache.org/jira/browse/SPARK-49440
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-49439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-49439:
---
Labels: pull-request-available (was: )
> Fix the pretty name of the `FromProtobuf` & `ToPro
BingKun Pan created SPARK-49439:
---
Summary: Fix the pretty name of the `FromProtobuf` & `ToProtobuf`
expression
Key: SPARK-49439
URL: https://issues.apache.org/jira/browse/SPARK-49439
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-49438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-49438:
---
Labels: pull-request-available (was: )
> Fix the pretty name of the `FromAvro` & `ToAvro`
[
https://issues.apache.org/jira/browse/SPARK-49050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Marnadi updated SPARK-49050:
-
Summary: Enabling deleteIfExists operator in TWS with Virtual Column
Families (was: nabling del
[
https://issues.apache.org/jira/browse/SPARK-49050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Marnadi updated SPARK-49050:
-
Description: Fully integrating the TransformWithState operator with Virtual
Column Families by a
[
https://issues.apache.org/jira/browse/SPARK-49357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-49357.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 47891
[https://
[
https://issues.apache.org/jira/browse/SPARK-49357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-49357:
-
Assignee: Changgyoo Park
> [PYTHON] SparkConnectClient._truncate is not effective on de
[
https://issues.apache.org/jira/browse/SPARK-49241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-49241:
--
Parent: SPARK-44111
Issue Type: Sub-task (was: Improvement)
> Add OpenTelemetryPush S
[
https://issues.apache.org/jira/browse/SPARK-49241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-49241:
-
Assignee: Qi Tan
> Add OpenTelemetryPush Sink
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-49241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-49241.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 47763
[https://
[
https://issues.apache.org/jira/browse/SPARK-49248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell reassigned SPARK-49248:
-
Assignee: Pengfei Xu
> Scala Client Parity with existing Dataset/DataFrame API
BingKun Pan created SPARK-49438:
---
Summary: Fix the pretty name of the `FromAvro` & `ToAvro`
expression
Key: SPARK-49438
URL: https://issues.apache.org/jira/browse/SPARK-49438
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-49419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell updated SPARK-49419:
--
Environment: (was: Not sure if we should do this. Connect and Classic
have differe
[
https://issues.apache.org/jira/browse/SPARK-49419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-49419:
---
Labels: pull-request-available (was: )
> Create a shared DataFrameStatFunctions interface
>
[
https://issues.apache.org/jira/browse/SPARK-49430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell updated SPARK-49430:
--
Description: Add collectResult() and the SparkResult class to classic. By
doing this t
Herman van Hövell created SPARK-49437:
-
Summary: Create interface implementation tests
Key: SPARK-49437
URL: https://issues.apache.org/jira/browse/SPARK-49437
Project: Spark
Issue Type: N
[
https://issues.apache.org/jira/browse/SPARK-49421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell reassigned SPARK-49421:
-
Assignee: (was: Herman van Hövell)
> Create a shared RelationalGroupedDatas
[
https://issues.apache.org/jira/browse/SPARK-49422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell reassigned SPARK-49422:
-
Assignee: (was: Herman van Hövell)
> Create a shared KeyValueGroupedDataset
[
https://issues.apache.org/jira/browse/SPARK-49419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell reassigned SPARK-49419:
-
Assignee: (was: Herman van Hövell)
> Create a shared DataFrameStatFunctions
[
https://issues.apache.org/jira/browse/SPARK-49420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell reassigned SPARK-49420:
-
Assignee: (was: Herman van Hövell)
> Create a shared DataFrameNaFunctions i
Herman van Hövell created SPARK-49436:
-
Summary: Consider adding shared SQLContext interface
Key: SPARK-49436
URL: https://issues.apache.org/jira/browse/SPARK-49436
Project: Spark
Issue T
Herman van Hövell created SPARK-49435:
-
Summary: Move ReduceAggregator to sql/api
Key: SPARK-49435
URL: https://issues.apache.org/jira/browse/SPARK-49435
Project: Spark
Issue Type: New Fe
Herman van Hövell created SPARK-49434:
-
Summary: Move
org.apache.spark.sql.expressions.javalang.typed/scalalang.type to sql/api
Key: SPARK-49434
URL: https://issues.apache.org/jira/browse/SPARK-49434
[
https://issues.apache.org/jira/browse/SPARK-49428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell updated SPARK-49428:
--
Description:
Move the actual client to connect/common in the package
org.apache.spark
[
https://issues.apache.org/jira/browse/SPARK-49428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell updated SPARK-49428:
--
Summary: Move Connect Scala Client to connect/common (was: Move Connect
implementatio
[
https://issues.apache.org/jira/browse/SPARK-49405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-49405.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 47887
[https://github.com
Herman van Hövell created SPARK-49433:
-
Summary: Consolidate a version of connect UdfUtils in sql/api
Key: SPARK-49433
URL: https://issues.apache.org/jira/browse/SPARK-49433
Project: Spark
Herman van Hövell created SPARK-49432:
-
Summary: Consolidate StreamingQuery in sql/api
Key: SPARK-49432
URL: https://issues.apache.org/jira/browse/SPARK-49432
Project: Spark
Issue Type: N
Herman van Hövell created SPARK-49431:
-
Summary: Consolidate ForeachWriter into sql/api
Key: SPARK-49431
URL: https://issues.apache.org/jira/browse/SPARK-49431
Project: Spark
Issue Type:
Herman van Hövell created SPARK-49430:
-
Summary: Add SparkResult to Classic
Key: SPARK-49430
URL: https://issues.apache.org/jira/browse/SPARK-49430
Project: Spark
Issue Type: New Feature
Herman van Hövell created SPARK-49429:
-
Summary: Create a shared DataStreamWriter interface
Key: SPARK-49429
URL: https://issues.apache.org/jira/browse/SPARK-49429
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-49415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell updated SPARK-49415:
--
Description: This includes DatasetHolder
> Create a shared interface for SQLImplicits
Herman van Hövell created SPARK-49428:
-
Summary: Move Connect implementation to connect/common
Key: SPARK-49428
URL: https://issues.apache.org/jira/browse/SPARK-49428
Project: Spark
Issue
Herman van Hövell created SPARK-49427:
-
Summary: Create a shared MergeIntoWriter interface
Key: SPARK-49427
URL: https://issues.apache.org/jira/browse/SPARK-49427
Project: Spark
Issue Typ
Herman van Hövell created SPARK-49426:
-
Summary: Create a shared DataFrameWriterV2 interface
Key: SPARK-49426
URL: https://issues.apache.org/jira/browse/SPARK-49426
Project: Spark
Issue T
Herman van Hövell created SPARK-49425:
-
Summary: Create a shared DataFrameWriter interface
Key: SPARK-49425
URL: https://issues.apache.org/jira/browse/SPARK-49425
Project: Spark
Issue Typ
Herman van Hövell created SPARK-49424:
-
Summary: Consolidate Encoders in sql/api
Key: SPARK-49424
URL: https://issues.apache.org/jira/browse/SPARK-49424
Project: Spark
Issue Type: New Fea
[
https://issues.apache.org/jira/browse/SPARK-49028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell reassigned SPARK-49028:
-
Assignee: Herman van Hövell
> Create a shared interface for SparkSession
>
Herman van Hövell created SPARK-49423:
-
Summary: Consolidate Observation into a single class in sql/api
Key: SPARK-49423
URL: https://issues.apache.org/jira/browse/SPARK-49423
Project: Spark
Herman van Hövell created SPARK-49420:
-
Summary: Create a shared DataFrameNaFunctions interface
Key: SPARK-49420
URL: https://issues.apache.org/jira/browse/SPARK-49420
Project: Spark
Issu
Herman van Hövell created SPARK-49422:
-
Summary: Create a shared KeyValueGroupedDataset interface
Key: SPARK-49422
URL: https://issues.apache.org/jira/browse/SPARK-49422
Project: Spark
Is
Herman van Hövell created SPARK-49421:
-
Summary: Create a shared RelationalGroupedDataset interface
Key: SPARK-49421
URL: https://issues.apache.org/jira/browse/SPARK-49421
Project: Spark
Herman van Hövell created SPARK-49419:
-
Summary: Create a shared DataFrameStatFunctions interface
Key: SPARK-49419
URL: https://issues.apache.org/jira/browse/SPARK-49419
Project: Spark
Is
Herman van Hövell created SPARK-49418:
-
Summary: Active/default ThreadLocals for shared SparkSession
Key: SPARK-49418
URL: https://issues.apache.org/jira/browse/SPARK-49418
Project: Spark
Herman van Hövell created SPARK-49417:
-
Summary: Create a shared interface for StreamingQueryManager
Key: SPARK-49417
URL: https://issues.apache.org/jira/browse/SPARK-49417
Project: Spark
Herman van Hövell created SPARK-49415:
-
Summary: Create a shared interface for SQLImplicits
Key: SPARK-49415
URL: https://issues.apache.org/jira/browse/SPARK-49415
Project: Spark
Issue Ty
Herman van Hövell created SPARK-49416:
-
Summary: Create a shared interface for DataStreamReader
Key: SPARK-49416
URL: https://issues.apache.org/jira/browse/SPARK-49416
Project: Spark
Issu
Herman van Hövell created SPARK-49414:
-
Summary: Create a shared DataFrameReader interface
Key: SPARK-49414
URL: https://issues.apache.org/jira/browse/SPARK-49414
Project: Spark
Issue Typ
Herman van Hövell created SPARK-49413:
-
Summary: Create shared RuntimeConf interface
Key: SPARK-49413
URL: https://issues.apache.org/jira/browse/SPARK-49413
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-49412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-49412:
---
Labels: pull-request-available (was: )
> Compute all box plot metrics in single job
> -
[
https://issues.apache.org/jira/browse/SPARK-49383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng updated SPARK-49383:
-
Description:
Support Transpose as Scala/Python DataFrame API in both Spark Connect and
Classic
Ruifeng Zheng created SPARK-49412:
-
Summary: Compute all box plot metrics in single job
Key: SPARK-49412
URL: https://issues.apache.org/jira/browse/SPARK-49412
Project: Spark
Issue Type: Sub-
[
https://issues.apache.org/jira/browse/SPARK-49374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated SPARK-49374:
Description:
h2. Design Doc:
[https://docs.google.com/document/d/1uWRMbN927cRXhSm5oeV3pbwb6o73am4
[
https://issues.apache.org/jira/browse/SPARK-49374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated SPARK-49374:
Description:
h2. Design Doc:
[https://docs.google.com/document/d/1uWRMbN927cRXhSm5oeV3pbwb6o73am4
[
https://issues.apache.org/jira/browse/SPARK-49393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-49393.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 47874
[https://
[
https://issues.apache.org/jira/browse/SPARK-49069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877190#comment-17877190
]
Anish Shrigondekar edited comment on SPARK-49069 at 8/27/24 9:27 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-49069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877190#comment-17877190
]
Anish Shrigondekar commented on SPARK-49069:
AFAIK - we don't support commit
[
https://issues.apache.org/jira/browse/SPARK-40706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins resolved SPARK-40706.
---
Resolution: Duplicate
> IllegalStateException when querying array values inside a nested str
[
https://issues.apache.org/jira/browse/SPARK-45745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877165#comment-17877165
]
Bruce Robbins commented on SPARK-45745:
---
I will close as a duplicate of SPARK-4507
[
https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877149#comment-17877149
]
Hendra Saputra commented on SPARK-45278:
Hi [~nishchal] I created new PR for thi
[
https://issues.apache.org/jira/browse/SPARK-49374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated SPARK-49374:
Description:
h2. Motivation
We expect the new checkpoint structure would be beneficial by establi
[
https://issues.apache.org/jira/browse/SPARK-49374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated SPARK-49374:
Description:
h2. Motivation
We expect the new checkpoint structure would be beneficial by establi
[
https://issues.apache.org/jira/browse/SPARK-49411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated SPARK-49411:
Description:
A incremental step to implement RocksDB state store checkpoint format V2.
Once conf
[
https://issues.apache.org/jira/browse/SPARK-49411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated SPARK-49411:
Summary: Communicate RocksDB State Store CheckpointID Between Driver and
Executor (was: Communica
[
https://issues.apache.org/jira/browse/SPARK-49411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated SPARK-49411:
Description: Once conf STATE_STORE_CHECKPOINT_FORMAT_VERSION is set to be
higher than version 2, t
[
https://issues.apache.org/jira/browse/SPARK-49374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siying Dong updated SPARK-49374:
Epic Name: RocksDB State Store Checkpoint Structure V2
> RocksDB State Store Checkpoint Structure
[
https://issues.apache.org/jira/browse/SPARK-49028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-49028:
---
Labels: pull-request-available (was: )
> Create a shared interface for SparkSession
> -
[
https://issues.apache.org/jira/browse/SPARK-49410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-49410:
---
Labels: pull-request-available (was: )
> Update collation benchmarks
>
Uroš Bojanić created SPARK-49410:
Summary: Update collation benchmarks
Key: SPARK-49410
URL: https://issues.apache.org/jira/browse/SPARK-49410
Project: Spark
Issue Type: Sub-task
Co
[
https://issues.apache.org/jira/browse/SPARK-49261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-49261:
--
Target Version/s: (was: 3.5.0)
> Correlation between lit and round during grouping
> ---
[
https://issues.apache.org/jira/browse/SPARK-49261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-49261:
--
Fix Version/s: (was: 3.5.0)
> Correlation between lit and round during grouping
>
Changgyoo Park created SPARK-49409:
--
Summary: CONNECT_SESSION_PLAN_CACHE_SIZE is too small for certain
programming patterns
Key: SPARK-49409
URL: https://issues.apache.org/jira/browse/SPARK-49409
Pro
[
https://issues.apache.org/jira/browse/SPARK-49404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-49404.
---
Fix Version/s: kubernetes-operator-0.1.0
Resolution: Fixed
Issue resolved by pull req
[
https://issues.apache.org/jira/browse/SPARK-49350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins resolved SPARK-49350.
---
Resolution: Duplicate
> FoldablePropagation rule and ConstantFolding rule leads to wrong agg
[
https://issues.apache.org/jira/browse/SPARK-49350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877052#comment-17877052
]
Bruce Robbins commented on SPARK-49350:
---
[~Wayne Guo] Thanks for the update. Closi
[
https://issues.apache.org/jira/browse/SPARK-49357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-49357:
---
Labels: pull-request-available (was: )
> [PYTHON] SparkConnectClient._truncate is not effec
Reporter: Frank Wong
>Priority: Major
> Labels: pull-request-available
> Attachments: 20240827-172739.html
>
>
> In {*}ProjectingInternalRow{*}, the *colOrdinals* is passed as a {_}List{_}.
> According to the Scala documentation, th
Components: SQL
>Affects Versions: 3.5.2
>Reporter: Frank Wong
>Priority: Major
> Attachments: 20240827-172739.html
>
>
> In {*}ProjectingInternalRow{*}, the *colOrdinals* is passed as a {_}List{_}.
> According to the Scala documentation
considerable amount of time was spent on {{{}List.apply{}}}. Changing this to
_{{IndexedSeq}}_ would improve the performance.
[^20240827-172739.html]
[https://docs.scala-lang.org/overviews/collections-2.13/performance-characteristics.html]
was:
In {*}ProjectingInternalRow{*}, the *colOrdinals* is
[
https://issues.apache.org/jira/browse/SPARK-49408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Frank Wong updated SPARK-49408:
---
Attachment: 20240827-172739.html
> Low performance in ProjectingInternal
[
https://issues.apache.org/jira/browse/SPARK-49408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Frank Wong updated SPARK-49408:
---
Description:
In {*}ProjectingInternalRow{*}, the *colOrdinals* is passed as a {_}List{_}.
According
Frank Wong created SPARK-49408:
--
Summary: Low performance in ProjectingInternalRow
Key: SPARK-49408
URL: https://issues.apache.org/jira/browse/SPARK-49408
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-49407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17876975#comment-17876975
]
melin commented on SPARK-49407:
---
cc [~dongjoon]
> Support Custom configuration of expose
[
https://issues.apache.org/jira/browse/SPARK-49407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
melin updated SPARK-49407:
--
Description:
The exposed rest service could be used to access the Spark’s Web UI，Similar to
flink kubernetes.
[
https://issues.apache.org/jira/browse/SPARK-49407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
melin updated SPARK-49407:
--
Fix Version/s: 4.0.0
> Support Custom configuration of exposed types: ClusterIP, Nodeport,
> LoadBalancer, In
[
https://issues.apache.org/jira/browse/SPARK-49392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot reassigned SPARK-49392:
--
Assignee: (was: Apache Spark)
> Catch errors when failing to write to external da
1 - 100 of 122 matches
Mail list logo
