Josh Rosen created SPARK-49898:
--
Summary: Correct documentation and default for event log task
metrics accumulator logging flag from SPARK-42204
Key: SPARK-49898
URL: https://issues.apache.org/jira/browse/SPARK-49898
Josh Rosen created SPARK-49650:
--
Summary: Don't use deprecated Hive JDBC client parameters in docs
/ tests
Key: SPARK-49650
URL: https://issues.apache.org/jira/browse/SPARK-49650
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-49647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-49647:
--
Assignee: Josh Rosen
> Pick up system property defaults in SharedSparkContext test suite mixi
Josh Rosen created SPARK-49647:
--
Summary: Pick up system property defaults in SharedSparkContext
test suite mixin
Key: SPARK-49647
URL: https://issues.apache.org/jira/browse/SPARK-49647
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-48628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-48628.
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 47776
[https://github
[
https://issues.apache.org/jira/browse/SPARK-48628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-48628:
--
Assignee: Ziqi Liu
> Add task peak on/off heap execution memory metrics
> ---
[
https://issues.apache.org/jira/browse/SPARK-48716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-48716.
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 47092
[https://github
[
https://issues.apache.org/jira/browse/SPARK-48716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-48716:
--
Assignee: Lingkai Kong
> Add JobGroupId to onSqlStart
>
>
>
Josh Rosen created SPARK-48837:
--
Summary: In CountVectorizer, only read binary parameter once per
transform, not once per row
Key: SPARK-48837
URL: https://issues.apache.org/jira/browse/SPARK-48837
Proje
Josh Rosen created SPARK-48686:
--
Summary: Improve performance of ParserUtils.unescapeSQLString
Key: SPARK-48686
URL: https://issues.apache.org/jira/browse/SPARK-48686
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-48541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-48541.
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46883
[https://github
[
https://issues.apache.org/jira/browse/SPARK-37448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-37448:
---
Description:
This PR / Jira proposes multiple optimizations related to
CurrentOrigin.withOrigin, in
[
https://issues.apache.org/jira/browse/SPARK-37448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-37448:
---
Affects Version/s: 4.0.0
(was: 3.2.0)
> Multiple optimizations related to
[
https://issues.apache.org/jira/browse/SPARK-37448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-37448:
---
Summary: Multiple optimizations related to CurrentOrigin.withOrigin (was:
Avoid CurrentOrigin.withO
[
https://issues.apache.org/jira/browse/SPARK-48547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-48547:
---
Description:
This PR proposes to add a new flag, `spark.submit.callSystemExitOnMainExit`
(default f
Josh Rosen created SPARK-48547:
--
Summary: Add opt-in flag to have SparkSubmit automatically call
System.exit after user code main method exits
Key: SPARK-48547
URL: https://issues.apache.org/jira/browse/SPARK-48547
Josh Rosen created SPARK-48150:
--
Summary: Fix nullability of try_parse_json
Key: SPARK-48150
URL: https://issues.apache.org/jira/browse/SPARK-48150
Project: Spark
Issue Type: Improvement
Josh Rosen created SPARK-48128:
--
Summary: BitwiseCount / bit_count generated code for boolean
inputs fails to compile
Key: SPARK-48128
URL: https://issues.apache.org/jira/browse/SPARK-48128
Project: Spar
[
https://issues.apache.org/jira/browse/SPARK-48128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-48128:
---
Description:
If the `BitwiseCount` / `bit_count` expresison is applied to a boolean type
column the
[
https://issues.apache.org/jira/browse/SPARK-48081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-48081:
---
Summary: Fix ClassCastException in NTile.checkInputDataTypes() when
argument is non-foldable or of w
[
https://issues.apache.org/jira/browse/SPARK-48081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-48081:
---
Summary: Fix ClassCastException in NTile.checkInputDataTypes() when input
data type is mismatched or
[
https://issues.apache.org/jira/browse/SPARK-48081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-48081:
---
Summary: Fix ClassCastException in NTile.checkInputDataTypes() when data
type is mismatched (was: F
Josh Rosen created SPARK-48081:
--
Summary: Fix ClassCastException in NTile.checkInputDataTypes()
Key: SPARK-48081
URL: https://issues.apache.org/jira/browse/SPARK-48081
Project: Spark
Issue Type:
Josh Rosen created SPARK-47734:
--
Summary: Fix flaky pyspark.sql.dataframe.DataFrame.writeStream
doctest by stopping streaming query
Key: SPARK-47734
URL: https://issues.apache.org/jira/browse/SPARK-47734
[
https://issues.apache.org/jira/browse/SPARK-47068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-47068.
Resolution: Fixed
Marking this issue as fixed.
> Recover -1 and 0 case for spark.sql.execution.ar
[
https://issues.apache.org/jira/browse/SPARK-46251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17826945#comment-17826945
]
Josh Rosen edited comment on SPARK-46251 at 3/14/24 5:34 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-46251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17826945#comment-17826945
]
Josh Rosen commented on SPARK-46251:
FYI, this looks like a duplicate of
https://is
Josh Rosen created SPARK-47121:
--
Summary: Avoid noisy RejectedExecutionExceptions during
StandaloneSchedulerBackend shutdown
Key: SPARK-47121
URL: https://issues.apache.org/jira/browse/SPARK-47121
Projec
[
https://issues.apache.org/jira/browse/SPARK-46862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-46862:
---
Labels: correctness pull-request-available (was: pull-request-available)
> Incorrect count() of a d
[
https://issues.apache.org/jira/browse/SPARK-46365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17796054#comment-17796054
]
Josh Rosen commented on SPARK-46365:
I think that this is a duplicate of SPARK-45543
[
https://issues.apache.org/jira/browse/SPARK-46365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17795932#comment-17795932
]
Josh Rosen commented on SPARK-46365:
This issue appears to be fixed in
[https://git
[
https://issues.apache.org/jira/browse/SPARK-46125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790751#comment-17790751
]
Josh Rosen commented on SPARK-46125:
I think that this issue relates specifically to
[
https://issues.apache.org/jira/browse/SPARK-46125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-46125:
---
Attachment: image-2023-11-28-12-55-58-461.png
> Memory leak when using createDataFrame with persist
[
https://issues.apache.org/jira/browse/SPARK-46105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790742#comment-17790742
]
Josh Rosen commented on SPARK-46105:
{quote}The reason for raising this as a bug is
[
https://issues.apache.org/jira/browse/SPARK-44641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-44641:
---
Labels: correctness (was: )
> SPJ: Results duplicated when SPJ partial-cluster and pushdown enabled
[
https://issues.apache.org/jira/browse/SPARK-42134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-42134:
---
Labels: correctness (was: )
> Fix getPartitionFiltersAndDataFilters() to handle filters without ref
[
https://issues.apache.org/jira/browse/SPARK-43760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-43760:
---
Labels: correctness (was: )
> Incorrect attribute nullability after RewriteCorrelatedScalarSubquery
[
https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-8:
---
Labels: correctness (was: )
> Wrong results for dense_rank() <= k from InferWindowGroupLimit and
>
[
https://issues.apache.org/jira/browse/SPARK-45920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-45920:
---
Labels: correctness pull-request-available (was: pull-request-available)
> group by ordinal should
[
https://issues.apache.org/jira/browse/SPARK-45507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-45507:
---
Labels: correctness pull-request-available (was: pull-request-available)
> Correctness bug in corre
[
https://issues.apache.org/jira/browse/SPARK-46092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-46092:
---
Labels: correctness pull-request-available (was: pull-request-available)
> Overflow in Parquet row
[
https://issues.apache.org/jira/browse/SPARK-45386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-45386:
---
Labels: correctness pull-request-available (was: pull-request-available)
> Correctness issue when p
[
https://issues.apache.org/jira/browse/SPARK-44871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-44871:
---
Labels: correctness (was: )
> Fix PERCENTILE_DISC behaviour
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-43393:
---
Labels: correctness pull-request-available (was: pull-request-available)
> Sequence expression can
[
https://issues.apache.org/jira/browse/SPARK-43240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-43240:
---
Labels: correctness (was: )
> df.describe() method may- return wrong result if the last RDD is
> R
[
https://issues.apache.org/jira/browse/SPARK-43098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-43098:
---
Labels: correctness (was: )
> Should not handle the COUNT bug when the GROUP BY clause of a correla
[
https://issues.apache.org/jira/browse/SPARK-45568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-45568:
---
Component/s: Tests
> WholeStageCodegenSparkSubmitSuite flakiness
> -
[
https://issues.apache.org/jira/browse/SPARK-45751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-45751:
---
Component/s: Documentation
> The default value of ‘spark.executor.logs.rolling.maxRetainedFiles' on
[
https://issues.apache.org/jira/browse/SPARK-45791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-45791:
---
Component/s: Tests
> Rename `SparkConnectSessionHodlerSuite.scala` to
> `SparkConnectSessionHolderS
[
https://issues.apache.org/jira/browse/SPARK-46037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-46037:
---
Labels: correctness pull-request-available (was: pull-request-available)
> When Left Join build Lef
[
https://issues.apache.org/jira/browse/SPARK-4836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reopened SPARK-4836:
---
> Web UI should display separate information for all stage attempts
> ---
[
https://issues.apache.org/jira/browse/SPARK-45508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-45508:
---
Description: We need to add
`--add-opens=java.base/jdk.internal.ref=ALL-UNNAMED` to our JVM options
[
https://issues.apache.org/jira/browse/SPARK-45508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-45508:
---
Summary: Add "--add-opens=java.base/jdk.internal.ref=ALL-UNNAMED" so
Platform can access cleaner on
[
https://issues.apache.org/jira/browse/SPARK-45508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-45508:
---
Summary: Add "--add-opens=java.base/jdk.internal.ref=ALL-UNNAMED" so
Platform can access cleaner on
[
https://issues.apache.org/jira/browse/SPARK-45508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-45508:
---
Description:
We need to update the
```
val f =
classOf[org.apache.spark.unsafe.Platform].getDec
[
https://issues.apache.org/jira/browse/SPARK-45508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-45508:
---
Summary: Add "--add-opens=java.base/jdk.internal.ref=ALL-UNNAMED" so
Platform can access cleaner on
[
https://issues.apache.org/jira/browse/SPARK-45508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-45508:
---
Description:
In JDK >= 9.b110, the code at
[https://github.com/apache/spark/blob/v3.5.0/common/unsa
[
https://issues.apache.org/jira/browse/SPARK-45508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-45508:
---
Description:
In JDK >= 9.b110, the code at
[https://github.com/apache/spark/blob/v3.5.0/common/unsa
Josh Rosen created SPARK-45508:
--
Summary: org.apache.spark.unsafe.Platform uses wrong cleaner class
name in JDK 11+
Key: SPARK-45508
URL: https://issues.apache.org/jira/browse/SPARK-45508
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-42205.
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 39767
[https://github
[
https://issues.apache.org/jira/browse/SPARK-44920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-44920:
--
Assignee: Josh Rosen
> Use await() instead of awaitUninterruptibly() in
> TransportClientFac
Josh Rosen created SPARK-44920:
--
Summary: Use await() instead of awaitUninterruptibly() in
TransportClientFactory.createClient()
Key: SPARK-44920
URL: https://issues.apache.org/jira/browse/SPARK-44920
P
[
https://issues.apache.org/jira/browse/SPARK-44818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-44818.
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42504
[https://github
[
https://issues.apache.org/jira/browse/SPARK-44818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-44818:
--
Assignee: Anish Shrigondekar
> Fix race for pending interrupt issued before taskThread is ini
[
https://issues.apache.org/jira/browse/SPARK-43300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-43300.
Fix Version/s: 3.5.0
Resolution: Fixed
> Cascade failure in Guava cache due to fate-sharing
[
https://issues.apache.org/jira/browse/SPARK-43300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722959#comment-17722959
]
Josh Rosen commented on SPARK-43300:
Fixed in https://github.com/apache/spark/pull/4
[
https://issues.apache.org/jira/browse/SPARK-43300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-43300:
--
Assignee: Ziqi Liu
> Cascade failure in Guava cache due to fate-sharing
> ---
Josh Rosen created SPARK-43414:
--
Summary: Fix flakiness in Kafka RDD suites due to port binding
configuration issue
Key: SPARK-43414
URL: https://issues.apache.org/jira/browse/SPARK-43414
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-42754:
---
Description:
In Spark 3.4.0 RC4, the Spark History Server's SQL tab incorrectly groups SQL
executio
Josh Rosen created SPARK-42754:
--
Summary: Spark 3.4 history server's SQL tab incorrectly groups SQL
executions when replaying event logs from Spark 3.3 and earlier
Key: SPARK-42754
URL: https://issues.apache.org/jira
[
https://issues.apache.org/jira/browse/SPARK-42754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-42754:
---
Attachment: example.png
> Spark 3.4 history server's SQL tab incorrectly groups SQL executions when
[
https://issues.apache.org/jira/browse/SPARK-42206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-42206:
--
Assignee: Josh Rosen
> Omit "Task Executor Metrics" field in JsonProtocol output if values ar
[
https://issues.apache.org/jira/browse/SPARK-42205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-42205:
--
Assignee: Josh Rosen
> Remove logging of Accumulables in Task/Stage start events in JsonProto
[
https://issues.apache.org/jira/browse/SPARK-42204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-42204:
--
Assignee: Josh Rosen
> Remove redundant logging of TaskMetrics internal accumulators in JsonP
Josh Rosen created SPARK-42206:
--
Summary: Omit "Task Executor Metrics" field in JsonProtocol output
if values are all zero
Key: SPARK-42206
URL: https://issues.apache.org/jira/browse/SPARK-42206
Project:
Josh Rosen created SPARK-42205:
--
Summary: Remove logging of Accumulables in Task/Stage start events
in JsonProtocol
Key: SPARK-42205
URL: https://issues.apache.org/jira/browse/SPARK-42205
Project: Spark
Josh Rosen created SPARK-42204:
--
Summary: Remove redundant logging of TaskMetrics internal
accumulators in JsonProtocol event logs
Key: SPARK-42204
URL: https://issues.apache.org/jira/browse/SPARK-42204
Josh Rosen created SPARK-42203:
--
Summary: JsonProtocol should skip logging of push-based shuffle
read metrics when push-based shuffle is disabled
Key: SPARK-42203
URL: https://issues.apache.org/jira/browse/SPARK-4220
[
https://issues.apache.org/jira/browse/SPARK-42203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-42203:
---
Description:
This is a followup to SPARK-36620:
When push-based shuffle is disabled (the default),
Josh Rosen created SPARK-41541:
--
Summary: Fix wrong child call in
SQLShuffleWriteMetricsReporter.decRecordsWritten()
Key: SPARK-41541
URL: https://issues.apache.org/jira/browse/SPARK-41541
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-38542:
---
Labels: correctness (was: )
> UnsafeHashedRelation should serialize numKeys out
> -
[
https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-40261:
--
Assignee: Ziqi Liu
> DirectTaskResult meta should not be counted into result size
> -
[
https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-40261.
Fix Version/s: 3.4.0
Resolution: Fixed
Fixed by https://github.com/apache/spark/pull/37713
[
https://issues.apache.org/jira/browse/SPARK-40235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-40235.
Fix Version/s: 3.4.0
Resolution: Fixed
Fixed by [https://github.com/apache/spark/pull/37681
Josh Rosen created SPARK-40263:
--
Summary: Use interruptible lock instead of synchronized in
TransportClientFactory.createClient()
Key: SPARK-40263
URL: https://issues.apache.org/jira/browse/SPARK-40263
P
[
https://issues.apache.org/jira/browse/SPARK-40211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-40211.
Fix Version/s: 3.4.0
Assignee: Ziqi Liu
Resolution: Fixed
Resolved by [https://git
[
https://issues.apache.org/jira/browse/SPARK-40235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-40235:
---
Description:
This patch modifies the synchronization in {{Executor.updateDependencies()}} in
order
Josh Rosen created SPARK-40235:
--
Summary: Use interruptible lock instead of synchronized in
Executor.updateDependencies()
Key: SPARK-40235
URL: https://issues.apache.org/jira/browse/SPARK-40235
Project:
[
https://issues.apache.org/jira/browse/SPARK-40106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-40106:
--
Assignee: Ryan Johnson
> Task failure handlers should always run if the task failed
> ---
[
https://issues.apache.org/jira/browse/SPARK-40106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-40106.
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37531
[https://github
[
https://issues.apache.org/jira/browse/SPARK-36176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-36176:
---
Fix Version/s: 3.3.0
(was: 3.2.0)
> Expose tableExists in pyspark.sql.catalog
[
https://issues.apache.org/jira/browse/SPARK-36176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578592#comment-17578592
]
Josh Rosen commented on SPARK-36176:
Changed the Fix Version on JIRA: this landed in
[
https://issues.apache.org/jira/browse/SPARK-39983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-39983.
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37413
[https://github
[
https://issues.apache.org/jira/browse/SPARK-39983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-39983:
--
Assignee: Alex Balikov
> Should not cache unserialized broadcast relations on the driver
> --
[
https://issues.apache.org/jira/browse/SPARK-39973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-39973:
---
Description:
If {{spark.scheduler.listenerbus.metrics.maxListenerClassesTimed}} has been set
to {{0
Josh Rosen created SPARK-39973:
--
Summary: Avoid noisy warnings logs when
spark.scheduler.listenerbus.metrics.maxListenerClassesTimed = 0
Key: SPARK-39973
URL: https://issues.apache.org/jira/browse/SPARK-39973
Josh Rosen created SPARK-39901:
--
Summary: Reconsider design of ignoreCorruptFiles feature
Key: SPARK-39901
URL: https://issues.apache.org/jira/browse/SPARK-39901
Project: Spark
Issue Type: Impro
Josh Rosen created SPARK-39864:
--
Summary: ExecutionListenerManager's registration of the
ExecutionListenerBus should be lazy
Key: SPARK-39864
URL: https://issues.apache.org/jira/browse/SPARK-39864
Projec
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-39833:
---
Labels: correctness (was: )
> Filtered parquet data frame count() and show() produce inconsistent r
Josh Rosen created SPARK-39847:
--
Summary: Race condition related to interruption of task threads
while they are in RocksDBLoader.loadLibrary()
Key: SPARK-39847
URL: https://issues.apache.org/jira/browse/SPARK-39847
1 - 100 of 2948 matches
Mail list logo