[jira] [Created] (SPARK-33316) Support nullable Avro schemas for non-nullable data in Avro writing

Bo Zhang created SPARK-33316: Summary: Support nullable Avro schemas for non-nullable data in Avro writing Key: SPARK-33316 URL: https://issues.apache.org/jira/browse/SPARK-33316 Project: Spark

[jira] [Created] (SPARK-35457) Update ANTLR runtime version to 4.8

Bo Zhang created SPARK-35457: Summary: Update ANTLR runtime version to 4.8 Key: SPARK-35457 URL: https://issues.apache.org/jira/browse/SPARK-35457 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-35227) Replace Bintray with the new repository service for the spark-packages resolver in SparkSubmit

Bo Zhang created SPARK-35227: Summary: Replace Bintray with the new repository service for the spark-packages resolver in SparkSubmit Key: SPARK-35227 URL: https://issues.apache.org/jira/browse/SPARK-35227

[jira] [Created] (SPARK-34757) Spark submit should ignore cache for SNAPSHOT dependencies

Bo Zhang created SPARK-34757: Summary: Spark submit should ignore cache for SNAPSHOT dependencies Key: SPARK-34757 URL: https://issues.apache.org/jira/browse/SPARK-34757 Project: Spark Issue

[jira] [Created] (SPARK-34471) Document DataStreamReader/Writer table APIs in Structured Streaming Programming Guide

Bo Zhang created SPARK-34471: Summary: Document DataStreamReader/Writer table APIs in Structured Streaming Programming Guide Key: SPARK-34471 URL: https://issues.apache.org/jira/browse/SPARK-34471

[jira] [Created] (SPARK-36533) Allow streaming queries with Trigger.Once run in multiple batches

Bo Zhang created SPARK-36533: Summary: Allow streaming queries with Trigger.Once run in multiple batches Key: SPARK-36533 URL: https://issues.apache.org/jira/browse/SPARK-36533 Project: Spark

[jira] [Created] (SPARK-37626) Upgrade libthrift to 1.15.0

Bo Zhang created SPARK-37626: Summary: Upgrade libthrift to 1.15.0 Key: SPARK-37626 URL: https://issues.apache.org/jira/browse/SPARK-37626 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-37626) Upgrade libthrift to 0.15.0

[ https://issues.apache.org/jira/browse/SPARK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang updated SPARK-37626: - Summary: Upgrade libthrift to 0.15.0 (was: Upgrade libthrift to 1.15.0) > Upgrade libthrift to 0.15.0

[jira] [Commented] (SPARK-37626) Upgrade libthrift to 0.15.0

[ https://issues.apache.org/jira/browse/SPARK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458178#comment-17458178 ] Bo Zhang commented on SPARK-37626: -- 0.16.0 is not release yet. Could we upgrade to 0.15.0 first? Here

[jira] [Comment Edited] (SPARK-37626) Upgrade libthrift to 0.15.0

[ https://issues.apache.org/jira/browse/SPARK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458178#comment-17458178 ] Bo Zhang edited comment on SPARK-37626 at 12/13/21, 7:26 AM: - 0.16.0 is not

[jira] [Resolved] (SPARK-38468) Use error classes in org.apache.spark.metrics

[ https://issues.apache.org/jira/browse/SPARK-38468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang resolved SPARK-38468. -- Resolution: Duplicate > Use error classes in org.apache.spark.metrics >

[jira] [Comment Edited] (SPARK-38468) Use error classes in org.apache.spark.metrics

[ https://issues.apache.org/jira/browse/SPARK-38468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506925#comment-17506925 ] Bo Zhang edited comment on SPARK-38468 at 3/15/22, 2:12 PM: Yes this is

[jira] [Commented] (SPARK-38468) Use error classes in org.apache.spark.metrics

[ https://issues.apache.org/jira/browse/SPARK-38468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506925#comment-17506925 ] Bo Zhang commented on SPARK-38468: -- Yes this is duplicated. Please close this one. Thanks [~Ngone51] !

[jira] [Created] (SPARK-38463) Use error classes in org.apache.spark.input

Bo Zhang created SPARK-38463: Summary: Use error classes in org.apache.spark.input Key: SPARK-38463 URL: https://issues.apache.org/jira/browse/SPARK-38463 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38462) Use error classes in org.apache.spark.executor

Bo Zhang created SPARK-38462: Summary: Use error classes in org.apache.spark.executor Key: SPARK-38462 URL: https://issues.apache.org/jira/browse/SPARK-38462 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38464) Use error classes in org.apache.spark.io

Bo Zhang created SPARK-38464: Summary: Use error classes in org.apache.spark.io Key: SPARK-38464 URL: https://issues.apache.org/jira/browse/SPARK-38464 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-38312) Use error classes in org.apache.spark.metrics

[ https://issues.apache.org/jira/browse/SPARK-38312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang updated SPARK-38312: - Summary: Use error classes in org.apache.spark.metrics (was: Use error classes in spark-core) > Use

[jira] [Created] (SPARK-38461) Use error classes in org.apache.spark.broadcast

Bo Zhang created SPARK-38461: Summary: Use error classes in org.apache.spark.broadcast Key: SPARK-38461 URL: https://issues.apache.org/jira/browse/SPARK-38461 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38470) Use error classes in org.apache.spark.partial

Bo Zhang created SPARK-38470: Summary: Use error classes in org.apache.spark.partial Key: SPARK-38470 URL: https://issues.apache.org/jira/browse/SPARK-38470 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38467) Use error classes in org.apache.spark.memory

Bo Zhang created SPARK-38467: Summary: Use error classes in org.apache.spark.memory Key: SPARK-38467 URL: https://issues.apache.org/jira/browse/SPARK-38467 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38468) Use error classes in org.apache.spark.metrics

Bo Zhang created SPARK-38468: Summary: Use error classes in org.apache.spark.metrics Key: SPARK-38468 URL: https://issues.apache.org/jira/browse/SPARK-38468 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38472) Use error classes in org.apache.spark.rpc

Bo Zhang created SPARK-38472: Summary: Use error classes in org.apache.spark.rpc Key: SPARK-38472 URL: https://issues.apache.org/jira/browse/SPARK-38472 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38471) Use error classes in org.apache.spark.rdd

Bo Zhang created SPARK-38471: Summary: Use error classes in org.apache.spark.rdd Key: SPARK-38471 URL: https://issues.apache.org/jira/browse/SPARK-38471 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38469) Use error classes in org.apache.spark.network

Bo Zhang created SPARK-38469: Summary: Use error classes in org.apache.spark.network Key: SPARK-38469 URL: https://issues.apache.org/jira/browse/SPARK-38469 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38465) Use error classes in org.apache.spark.launcher

Bo Zhang created SPARK-38465: Summary: Use error classes in org.apache.spark.launcher Key: SPARK-38465 URL: https://issues.apache.org/jira/browse/SPARK-38465 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38466) Use error classes in org.apache.spark.mapred

Bo Zhang created SPARK-38466: Summary: Use error classes in org.apache.spark.mapred Key: SPARK-38466 URL: https://issues.apache.org/jira/browse/SPARK-38466 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38478) Use error classes in org.apache.spark.ui

Bo Zhang created SPARK-38478: Summary: Use error classes in org.apache.spark.ui Key: SPARK-38478 URL: https://issues.apache.org/jira/browse/SPARK-38478 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38477) Use error classes in org.apache.spark.storage

Bo Zhang created SPARK-38477: Summary: Use error classes in org.apache.spark.storage Key: SPARK-38477 URL: https://issues.apache.org/jira/browse/SPARK-38477 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38474) Use error classes in org.apache.spark.security

Bo Zhang created SPARK-38474: Summary: Use error classes in org.apache.spark.security Key: SPARK-38474 URL: https://issues.apache.org/jira/browse/SPARK-38474 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38475) Use error classes in org.apache.spark.serializer

Bo Zhang created SPARK-38475: Summary: Use error classes in org.apache.spark.serializer Key: SPARK-38475 URL: https://issues.apache.org/jira/browse/SPARK-38475 Project: Spark Issue Type:

[jira] [Created] (SPARK-38476) Use error classes in org.apache.spark.shuffle

Bo Zhang created SPARK-38476: Summary: Use error classes in org.apache.spark.shuffle Key: SPARK-38476 URL: https://issues.apache.org/jira/browse/SPARK-38476 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38473) Use error classes in org.apache.spark.scheduler

Bo Zhang created SPARK-38473: Summary: Use error classes in org.apache.spark.scheduler Key: SPARK-38473 URL: https://issues.apache.org/jira/browse/SPARK-38473 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38312) Use error classes in spark-core

Bo Zhang created SPARK-38312: Summary: Use error classes in spark-core Key: SPARK-38312 URL: https://issues.apache.org/jira/browse/SPARK-38312 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38236) Absolute file paths specified in create/alter table are treated as relative

Bo Zhang created SPARK-38236: Summary: Absolute file paths specified in create/alter table are treated as relative Key: SPARK-38236 URL: https://issues.apache.org/jira/browse/SPARK-38236 Project: Spark

[jira] [Created] (SPARK-38202) Invalid URL in SparkContext.addedJars will constantly fails Executor.run()

Bo Zhang created SPARK-38202: Summary: Invalid URL in SparkContext.addedJars will constantly fails Executor.run() Key: SPARK-38202 URL: https://issues.apache.org/jira/browse/SPARK-38202 Project: Spark

[jira] [Created] (SPARK-40596) Populate ExecutorDecommission with more informative messages

Bo Zhang created SPARK-40596: Summary: Populate ExecutorDecommission with more informative messages Key: SPARK-40596 URL: https://issues.apache.org/jira/browse/SPARK-40596 Project: Spark Issue

[jira] [Created] (SPARK-40488) Do not wrap exceptions thrown in FileFormatWriter.write with SparkException

Bo Zhang created SPARK-40488: Summary: Do not wrap exceptions thrown in FileFormatWriter.write with SparkException Key: SPARK-40488 URL: https://issues.apache.org/jira/browse/SPARK-40488 Project: Spark

[jira] [Created] (SPARK-41463) Ensure error class (and subclass) names contain only capital letters, numbers and underscores

Bo Zhang created SPARK-41463: Summary: Ensure error class (and subclass) names contain only capital letters, numbers and underscores Key: SPARK-41463 URL: https://issues.apache.org/jira/browse/SPARK-41463

[jira] [Created] (SPARK-41099) Do not wrap exceptions thrown in SparkHadoopWriter.write with SparkException

Bo Zhang created SPARK-41099: Summary: Do not wrap exceptions thrown in SparkHadoopWriter.write with SparkException Key: SPARK-41099 URL: https://issues.apache.org/jira/browse/SPARK-41099 Project: Spark

[jira] [Resolved] (SPARK-41099) Do not wrap exceptions thrown in SparkHadoopWriter.write with SparkException

[ https://issues.apache.org/jira/browse/SPARK-41099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang resolved SPARK-41099. -- Resolution: Won't Fix To keep the exceptions exposed to users who use the RDD APIs, we will not

[jira] [Comment Edited] (SPARK-41099) Do not wrap exceptions thrown in SparkHadoopWriter.write with SparkException

[ https://issues.apache.org/jira/browse/SPARK-41099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632048#comment-17632048 ] Bo Zhang edited comment on SPARK-41099 at 11/11/22 3:08 AM: To keep the

[jira] [Closed] (SPARK-41099) Do not wrap exceptions thrown in SparkHadoopWriter.write with SparkException

[ https://issues.apache.org/jira/browse/SPARK-41099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang closed SPARK-41099. > Do not wrap exceptions thrown in SparkHadoopWriter.write with SparkException >

[jira] [Updated] (SPARK-42602) Provide more details in TaskEndReason s for tasks killed by TaskScheduler.cancelTasks

[ https://issues.apache.org/jira/browse/SPARK-42602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang updated SPARK-42602: - Summary: Provide more details in TaskEndReason s for tasks killed by TaskScheduler.cancelTasks (was:

[jira] [Created] (SPARK-42602) Add reason string as an argument to TaskScheduler.cancelTasks

Bo Zhang created SPARK-42602: Summary: Add reason string as an argument to TaskScheduler.cancelTasks Key: SPARK-42602 URL: https://issues.apache.org/jira/browse/SPARK-42602 Project: Spark Issue

[jira] [Created] (SPARK-43309) Extend INTERNAL_ERROR with category

Bo Zhang created SPARK-43309: Summary: Extend INTERNAL_ERROR with category Key: SPARK-43309 URL: https://issues.apache.org/jira/browse/SPARK-43309 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-38478) Use error classes in org.apache.spark.ui

[ https://issues.apache.org/jira/browse/SPARK-38478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707610#comment-17707610 ] Bo Zhang commented on SPARK-38478: -- Thanks! [~Wencong Liu] please feel free to submit a PR for this. >

[jira] [Created] (SPARK-42358) Provide more details in ExecutorUpdated sent in Master.removeWorker

Bo Zhang created SPARK-42358: Summary: Provide more details in ExecutorUpdated sent in Master.removeWorker Key: SPARK-42358 URL: https://issues.apache.org/jira/browse/SPARK-42358 Project: Spark

[jira] [Updated] (SPARK-38477) Use error classes in org.apache.spark.shuffle

[ https://issues.apache.org/jira/browse/SPARK-38477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang updated SPARK-38477: - Summary: Use error classes in org.apache.spark.shuffle (was: Use error classes in

[jira] [Updated] (SPARK-38476) Use error classes in org.apache.spark.storage

[ https://issues.apache.org/jira/browse/SPARK-38476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang updated SPARK-38476: - Summary: Use error classes in org.apache.spark.storage (was: Use error classes in

[jira] [Updated] (SPARK-44635) Handle shuffle fetch failures in decommissions

[ https://issues.apache.org/jira/browse/SPARK-44635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang updated SPARK-44635: - Description: Spark's decommission feature supports migration of shuffle data. However shuffle data

[jira] [Created] (SPARK-44635) Handle shuffle fetch failures in decommissions

Bo Zhang created SPARK-44635: Summary: Handle shuffle fetch failures in decommissions Key: SPARK-44635 URL: https://issues.apache.org/jira/browse/SPARK-44635 Project: Spark Issue Type:

[jira] [Commented] (SPARK-38471) Use error classes in org.apache.spark.rdd

[ https://issues.apache.org/jira/browse/SPARK-38471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720380#comment-17720380 ] Bo Zhang commented on SPARK-38471: -- Hi [~blindcat] , thanks for working on this! I don't have

[jira] [Created] (SPARK-47764) Cleanup shuffle dependencies for Spark Connect SQL executions

Bo Zhang created SPARK-47764: Summary: Cleanup shuffle dependencies for Spark Connect SQL executions Key: SPARK-47764 URL: https://issues.apache.org/jira/browse/SPARK-47764 Project: Spark Issue

[jira] [Created] (SPARK-48325) Always specify messages in ExecutorRunner.killProcess

Bo Zhang created SPARK-48325: Summary: Always specify messages in ExecutorRunner.killProcess Key: SPARK-48325 URL: https://issues.apache.org/jira/browse/SPARK-48325 Project: Spark Issue Type: