[jira] [Updated] (SPARK-36352) Spark should check result plan's output schema name

[ https://issues.apache.org/jira/browse/SPARK-36352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-36352: Fix Version/s: 3.1.3 > Spark should check result plan's output schema name >

[jira] [Comment Edited] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404187#comment-17404187 ] Yang Jie edited comment on SPARK-33772 at 8/25/21, 5:46 AM: [~dongjoon]

[jira] [Comment Edited] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404187#comment-17404187 ] Yang Jie edited comment on SPARK-33772 at 8/25/21, 5:45 AM: [~dongjoon]

[jira] [Issue Comment Deleted] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-35557: - Comment: was deleted (was: [~iemejia] I've been doing similar work recently:   * Scala 2.13 and JDK

[jira] [Commented] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404187#comment-17404187 ] Yang Jie commented on SPARK-33772: -- [~dongjoon] [~hyukjin.kwon] [~xkrogen] I've been doing some test

[jira] [Comment Edited] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404182#comment-17404182 ] Yang Jie edited comment on SPARK-35557 at 8/25/21, 5:43 AM: [~iemejia] I've

[jira] [Comment Edited] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404182#comment-17404182 ] Yang Jie edited comment on SPARK-35557 at 8/25/21, 5:40 AM: [~iemejia] I've

[jira] [Comment Edited] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404182#comment-17404182 ] Yang Jie edited comment on SPARK-35557 at 8/25/21, 5:40 AM: [~iemejia] I've

[jira] [Comment Edited] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404182#comment-17404182 ] Yang Jie edited comment on SPARK-35557 at 8/25/21, 5:40 AM: [~iemejia] I've

[jira] [Commented] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404182#comment-17404182 ] Yang Jie commented on SPARK-35557: -- Scala 2.13 and JDK 17-ea are easier to use together. We can pass

[jira] [Created] (SPARK-36581) Add back transformAllExpressions to AnalysisHelper

Yingyi Bu created SPARK-36581: - Summary: Add back transformAllExpressions to AnalysisHelper Key: SPARK-36581 URL: https://issues.apache.org/jira/browse/SPARK-36581 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-36537) Revisit disabled tests for CategoricalDtype

[ https://issues.apache.org/jira/browse/SPARK-36537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36537: Summary: Revisit disabled tests for CategoricalDtype (was: Take care of other tests disabled for

[jira] [Assigned] (SPARK-36580) Replace filter and contains with intersect

[ https://issues.apache.org/jira/browse/SPARK-36580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36580: Assignee: Apache Spark > Replace filter and contains with intersect >

[jira] [Commented] (SPARK-36580) Replace filter and contains with intersect

[ https://issues.apache.org/jira/browse/SPARK-36580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404161#comment-17404161 ] Apache Spark commented on SPARK-36580: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-36580) Replace filter and contains with intersect

[ https://issues.apache.org/jira/browse/SPARK-36580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36580: Assignee: (was: Apache Spark) > Replace filter and contains with intersect >

[jira] [Created] (SPARK-36580) Replace filter and contains with intersect

Yang Jie created SPARK-36580: Summary: Replace filter and contains with intersect Key: SPARK-36580 URL: https://issues.apache.org/jira/browse/SPARK-36580 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-36579) Make spark stagingDir can be congfigurable

[ https://issues.apache.org/jira/browse/SPARK-36579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404151#comment-17404151 ] Apache Spark commented on SPARK-36579: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-36579) Make spark stagingDir can be congfigurable

[ https://issues.apache.org/jira/browse/SPARK-36579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36579: Assignee: (was: Apache Spark) > Make spark stagingDir can be congfigurable >

[jira] [Assigned] (SPARK-36579) Make spark stagingDir can be congfigurable

[ https://issues.apache.org/jira/browse/SPARK-36579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36579: Assignee: Apache Spark > Make spark stagingDir can be congfigurable >

[jira] [Commented] (SPARK-36579) Make spark stagingDir can be congfigurable

[ https://issues.apache.org/jira/browse/SPARK-36579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404150#comment-17404150 ] Apache Spark commented on SPARK-36579: -- User 'AngersZh' has created a pull request for this

[jira] [Created] (SPARK-36579) Make spark stagingDir can be congfigurable

angerszhu created SPARK-36579: - Summary: Make spark stagingDir can be congfigurable Key: SPARK-36579 URL: https://issues.apache.org/jira/browse/SPARK-36579 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-36559) Allow column pruning on distributed sequence index (pandas API on Spark)

[ https://issues.apache.org/jira/browse/SPARK-36559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36559. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33807

[jira] [Assigned] (SPARK-36559) Allow column pruning on distributed sequence index (pandas API on Spark)

[ https://issues.apache.org/jira/browse/SPARK-36559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36559: Assignee: Hyukjin Kwon > Allow column pruning on distributed sequence index (pandas API

[jira] [Resolved] (SPARK-36336) Define the new exception that mix SparkThrowable for all base exe in QueryExecutionErrors

[ https://issues.apache.org/jira/browse/SPARK-36336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36336. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33573

[jira] [Assigned] (SPARK-36336) Define the new exception that mix SparkThrowable for all base exe in QueryExecutionErrors

[ https://issues.apache.org/jira/browse/SPARK-36336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36336: Assignee: PengLei > Define the new exception that mix SparkThrowable for all base exe in

[jira] [Commented] (SPARK-36578) Minor UnivariateFeatureSelector API doc improvement

[ https://issues.apache.org/jira/browse/SPARK-36578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404108#comment-17404108 ] Huaxin Gao commented on SPARK-36578: [~mengxr]I will work on this. Thanks for pinging me. > Minor

[jira] [Updated] (SPARK-36577) Spark on K8s: Driver pod keeps running when executor allocator terminates with Fatal exception

[ https://issues.apache.org/jira/browse/SPARK-36577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Garg updated SPARK-36577: --- Affects Version/s: 2.4.8 > Spark on K8s: Driver pod keeps running when executor allocator

[jira] [Assigned] (SPARK-36578) Minor UnivariateFeatureSelector API doc improvement

[ https://issues.apache.org/jira/browse/SPARK-36578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-36578: - Assignee: Huaxin Gao > Minor UnivariateFeatureSelector API doc improvement >

[jira] [Commented] (SPARK-36578) Minor UnivariateFeatureSelector API doc improvement

[ https://issues.apache.org/jira/browse/SPARK-36578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404095#comment-17404095 ] Xiangrui Meng commented on SPARK-36578: --- [~huaxingao] I saw some possible improvement to the API

[jira] [Created] (SPARK-36578) Minor UnivariateFeatureSelector API doc improvement

Xiangrui Meng created SPARK-36578: - Summary: Minor UnivariateFeatureSelector API doc improvement Key: SPARK-36578 URL: https://issues.apache.org/jira/browse/SPARK-36578 Project: Spark Issue

[jira] [Updated] (SPARK-36578) Minor UnivariateFeatureSelector API doc improvement

[ https://issues.apache.org/jira/browse/SPARK-36578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-36578: -- Affects Version/s: 3.1.1 > Minor UnivariateFeatureSelector API doc improvement >

[jira] [Updated] (SPARK-36578) Minor UnivariateFeatureSelector API doc improvement

[ https://issues.apache.org/jira/browse/SPARK-36578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-36578: -- Target Version/s: (was: 3.2.0) > Minor UnivariateFeatureSelector API doc improvement >

[jira] [Assigned] (SPARK-36576) Improve range split calculation for Kafka Source minPartitions option

[ https://issues.apache.org/jira/browse/SPARK-36576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36576: Assignee: (was: Apache Spark) > Improve range split calculation for Kafka Source

[jira] [Assigned] (SPARK-36576) Improve range split calculation for Kafka Source minPartitions option

[ https://issues.apache.org/jira/browse/SPARK-36576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36576: Assignee: Apache Spark > Improve range split calculation for Kafka Source minPartitions

[jira] [Updated] (SPARK-36576) Improve range split calculation for Kafka Source minPartitions option

[ https://issues.apache.org/jira/browse/SPARK-36576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated SPARK-36576: - Description: While the

[jira] [Resolved] (SPARK-36564) LiveRDDDistribution.toApi throws NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-36564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36564. --- Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution:

[jira] [Assigned] (SPARK-36564) LiveRDDDistribution.toApi throws NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-36564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36564: - Assignee: wuyi > LiveRDDDistribution.toApi throws NullPointerException >

[jira] [Resolved] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36573. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33821

[jira] [Assigned] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36573: - Assignee: Luca Canali > Add a default value to ORACLE_DOCKER_IMAGE >

[jira] [Updated] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36573: -- Affects Version/s: (was: 3.1.2) 3.3.0 > Add a default value to

[jira] [Updated] (SPARK-36577) Spark on K8s: Driver pod keeps running when executor allocator terminates with Fatal exception

[ https://issues.apache.org/jira/browse/SPARK-36577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Garg updated SPARK-36577: --- Description: In Spark on Kubernetes, the class ExecutorPodsSnapshotsStoreImpl creates a thread

[jira] [Updated] (SPARK-36577) Spark on K8s: Driver pod keeps running when executor allocator terminates with Fatal exception

[ https://issues.apache.org/jira/browse/SPARK-36577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Garg updated SPARK-36577: --- Description: In Spark on Kubernetes, the class ExecutorPodsSnapshotsStoreImpl creates a thread

[jira] [Created] (SPARK-36577) Spark on K8s: Driver pod keeps running when executor allocator terminates with Fatal exception

Vikas Garg created SPARK-36577: -- Summary: Spark on K8s: Driver pod keeps running when executor allocator terminates with Fatal exception Key: SPARK-36577 URL: https://issues.apache.org/jira/browse/SPARK-36577

[jira] [Commented] (SPARK-33349) ExecutorPodsWatchSnapshotSource: Kubernetes client has been closed

[ https://issues.apache.org/jira/browse/SPARK-33349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403987#comment-17403987 ] Mihir Kelkar commented on SPARK-33349: -- [~dongjoon], [~code_kr_dev_s] : is there an expected patch

[jira] [Created] (SPARK-36576) Improve range split calculation for Kafka Source minPartitions option

Andrew Olson created SPARK-36576: Summary: Improve range split calculation for Kafka Source minPartitions option Key: SPARK-36576 URL: https://issues.apache.org/jira/browse/SPARK-36576 Project: Spark

[jira] [Commented] (SPARK-35535) New data source V2 API: LocalScan

[ https://issues.apache.org/jira/browse/SPARK-35535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403891#comment-17403891 ] Apache Spark commented on SPARK-35535: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-35535) New data source V2 API: LocalScan

[ https://issues.apache.org/jira/browse/SPARK-35535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403887#comment-17403887 ] Apache Spark commented on SPARK-35535: -- User 'gengliangwang' has created a pull request for this

[jira] [Updated] (SPARK-35876) array_zip unexpected column names

[ https://issues.apache.org/jira/browse/SPARK-35876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-35876: Fix Version/s: 3.0.4 3.1.3 > array_zip unexpected column names >

[jira] [Commented] (SPARK-36568) Missed broadcast join in V2 plan

[ https://issues.apache.org/jira/browse/SPARK-36568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403866#comment-17403866 ] Apache Spark commented on SPARK-36568: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-36568) Missed broadcast join in V2 plan

[ https://issues.apache.org/jira/browse/SPARK-36568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36568: Assignee: Apache Spark > Missed broadcast join in V2 plan >

[jira] [Assigned] (SPARK-36568) Missed broadcast join in V2 plan

[ https://issues.apache.org/jira/browse/SPARK-36568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36568: Assignee: (was: Apache Spark) > Missed broadcast join in V2 plan >

[jira] [Commented] (SPARK-36568) Missed broadcast join in V2 plan

[ https://issues.apache.org/jira/browse/SPARK-36568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403863#comment-17403863 ] Apache Spark commented on SPARK-36568: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-36419) Move final aggregation in RDD.treeAggregate to executor

[ https://issues.apache.org/jira/browse/SPARK-36419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36419: --- Assignee: Aravind Patnam > Move final aggregation in RDD.treeAggregate to executor >

[jira] [Resolved] (SPARK-36419) Move final aggregation in RDD.treeAggregate to executor

[ https://issues.apache.org/jira/browse/SPARK-36419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36419. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33644

[jira] [Assigned] (SPARK-36457) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-36457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36457: Assignee: Apache Spark (was: Gengliang Wang) > Review and fix issues in API docs >

[jira] [Assigned] (SPARK-36457) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-36457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36457: Assignee: Gengliang Wang (was: Apache Spark) > Review and fix issues in API docs >

[jira] [Commented] (SPARK-36457) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-36457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403831#comment-17403831 ] Apache Spark commented on SPARK-36457: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-35236) Support archive files as resources for CREATE FUNCTION USING syntax

[ https://issues.apache.org/jira/browse/SPARK-35236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403824#comment-17403824 ] Apache Spark commented on SPARK-35236: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-36572) Removal of netty-3.9.9.Final.jar dependent code and use only netty-all-4.1.47.Final.jar in Spark 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-36572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403798#comment-17403798 ] Kousuke Saruta commented on SPARK-36572: [~sshukla05] Sorry, 2.4.8 is the last release of 2.4.x.

[jira] [Updated] (SPARK-36575) Executor lost may cause spark stage to hang

[ https://issues.apache.org/jira/browse/SPARK-36575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiahua updated SPARK-36575: - Description: When a executor finished a task of some stage, the driver will receive a `StatusUpdate`

[jira] [Updated] (SPARK-36575) Executor lost may cause spark stage to hang

[ https://issues.apache.org/jira/browse/SPARK-36575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiahua updated SPARK-36575: - Affects Version/s: 2.3.3 > Executor lost may cause spark stage to hang >

[jira] [Created] (SPARK-36575) Executor lost may cause spark stage to hang

hujiahua created SPARK-36575: Summary: Executor lost may cause spark stage to hang Key: SPARK-36575 URL: https://issues.apache.org/jira/browse/SPARK-36575 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34415: Assignee: Apache Spark (was: Phillip Henry) > Use randomization as a possibly better

[jira] [Reopened] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reopened SPARK-34415: -- Reverted from 3.2 for now > Use randomization as a possibly better technique than grid search in

[jira] [Updated] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34415: - Fix Version/s: (was: 3.2.0) > Use randomization as a possibly better technique than grid

[jira] [Updated] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34415: - External issue URL: (was: https://github.com/apache/spark/pull/31535) > Use randomization as

[jira] [Assigned] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34415: Assignee: Phillip Henry (was: Apache Spark) > Use randomization as a possibly better

[jira] [Updated] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34415: - Labels: (was: pull-request-available) > Use randomization as a possibly better technique than

[jira] [Commented] (SPARK-35289) Make CatalogString contains nullable information

[ https://issues.apache.org/jira/browse/SPARK-35289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403776#comment-17403776 ] jingpan xiong commented on SPARK-35289: --- i had meet this issue in my project, and my error message

[jira] [Updated] (SPARK-35289) Make CatalogString contains nullable information

[ https://issues.apache.org/jira/browse/SPARK-35289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jingpan xiong updated SPARK-35289: -- Attachment: screenshot-1.png > Make CatalogString contains nullable information >

[jira] [Assigned] (SPARK-36574) pushDownPredicate=false failed to prevent push down filters to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36574: Assignee: Apache Spark > pushDownPredicate=false failed to prevent push down filters to

[jira] [Assigned] (SPARK-36574) pushDownPredicate=false failed to prevent push down filters to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36574: Assignee: (was: Apache Spark) > pushDownPredicate=false failed to prevent push down

[jira] [Commented] (SPARK-36574) pushDownPredicate=false failed to prevent push down filters to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403738#comment-17403738 ] Apache Spark commented on SPARK-36574: -- User 'beliefer' has created a pull request for this issue:

[jira] [Updated] (SPARK-36574) pushDownPredicate=false failed to prevent push down filters to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36574: --- Summary: pushDownPredicate=false failed to prevent push down filters to JDBC data source (was:

[jira] [Updated] (SPARK-36574) pushDownPredicate=false failed to prevent push filters down to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36574: --- Summary: pushDownPredicate=false failed to prevent push filters down to JDBC data source (was:

[jira] [Updated] (SPARK-36574) pushDownPredicate failed to prevent push filters down to the data source.

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36574: --- Description: Spark SQL includes a data source that can read data from other databases using JDBC.

[jira] [Updated] (SPARK-36574) pushDownPredicate failed to prevent push filters down to the data source.

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36574: --- Description: Spark SQL includes a data source that can read data from other databases using JDBC.

[jira] [Created] (SPARK-36574) pushDownPredicate failed to prevent push filters down to the data source.

jiaan.geng created SPARK-36574: -- Summary: pushDownPredicate failed to prevent push filters down to the data source. Key: SPARK-36574 URL: https://issues.apache.org/jira/browse/SPARK-36574 Project: Spark

[jira] [Commented] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403718#comment-17403718 ] Apache Spark commented on SPARK-36573: -- User 'LucaCanali' has created a pull request for this

[jira] [Commented] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403717#comment-17403717 ] Apache Spark commented on SPARK-36573: -- User 'LucaCanali' has created a pull request for this

[jira] [Assigned] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36573: Assignee: Apache Spark > Add a default value to ORACLE_DOCKER_IMAGE >

[jira] [Assigned] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36573: Assignee: (was: Apache Spark) > Add a default value to ORACLE_DOCKER_IMAGE >

[jira] [Created] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

Luca Canali created SPARK-36573: --- Summary: Add a default value to ORACLE_DOCKER_IMAGE Key: SPARK-36573 URL: https://issues.apache.org/jira/browse/SPARK-36573 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36572) Removal of netty-3.9.9.Final.jar dependent code and use only netty-all-4.1.47.Final.jar in Spark 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-36572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SHOBHIT SHUKLA updated SPARK-36572: --- Description: Please remove netty-3.9.9.Final.jar from Spark 2.4.x because this jar was

[jira] [Updated] (SPARK-36572) Removal of netty-3.9.9.Final.jar dependent code and use only netty-all-4.1.47.Final.jar in Spark 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-36572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SHOBHIT SHUKLA updated SPARK-36572: --- Summary: Removal of netty-3.9.9.Final.jar dependent code and use only

[jira] [Created] (SPARK-36572) Upgrade version of io.netty to 4.1.44.Final to solve CVE-2019-20444 and CVE-2019-20445

SHOBHIT SHUKLA created SPARK-36572: -- Summary: Upgrade version of io.netty to 4.1.44.Final to solve CVE-2019-20444 and CVE-2019-20445 Key: SPARK-36572 URL: https://issues.apache.org/jira/browse/SPARK-36572

[jira] [Commented] (SPARK-22876) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

[ https://issues.apache.org/jira/browse/SPARK-22876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403630#comment-17403630 ] Pierre Gramme commented on SPARK-22876: --- If there is no plan to fix this, would it be possible to

[jira] [Commented] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403608#comment-17403608 ] Apache Spark commented on SPARK-34415: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-36558) Stage has all tasks finished but with ongoing finalization can cause job hang

[ https://issues.apache.org/jira/browse/SPARK-36558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403556#comment-17403556 ] wuyi commented on SPARK-36558: -- Discussed with [~vsowrirajan] offline. The issue won't happen in the

[jira] [Assigned] (SPARK-36509) Executors don't get rescheduled in standalone mode when worker dies

[ https://issues.apache.org/jira/browse/SPARK-36509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36509: Assignee: Apache Spark > Executors don't get rescheduled in standalone mode when worker

[jira] [Resolved] (SPARK-36558) Stage has all tasks finished but with ongoing finalization can cause job hang

[ https://issues.apache.org/jira/browse/SPARK-36558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-36558. -- Resolution: Won't Fix > Stage has all tasks finished but with ongoing finalization can cause job hang >

[jira] [Commented] (SPARK-36509) Executors don't get rescheduled in standalone mode when worker dies

[ https://issues.apache.org/jira/browse/SPARK-36509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403554#comment-17403554 ] Apache Spark commented on SPARK-36509: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36509) Executors don't get rescheduled in standalone mode when worker dies

[ https://issues.apache.org/jira/browse/SPARK-36509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36509: Assignee: (was: Apache Spark) > Executors don't get rescheduled in standalone mode

[jira] [Updated] (SPARK-36555) DS V2 Filter support

[ https://issues.apache.org/jira/browse/SPARK-36555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36555: --- Description: The motivation of adding DSV2 filters: The values in V1 filters are Scala types. When