[jira] [Resolved] (SPARK-36567) Support foldable special datetime values in CAST

[ https://issues.apache.org/jira/browse/SPARK-36567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36567. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33816 [https://gith

[jira] [Updated] (SPARK-36352) Spark should check result plan's output schema name

[ https://issues.apache.org/jira/browse/SPARK-36352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-36352: Fix Version/s: 3.1.3 > Spark should check result plan's output schema name > -

[jira] [Comment Edited] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404187#comment-17404187 ] Yang Jie edited comment on SPARK-33772 at 8/25/21, 5:46 AM:

[jira] [Comment Edited] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404187#comment-17404187 ] Yang Jie edited comment on SPARK-33772 at 8/25/21, 5:45 AM:

[jira] [Issue Comment Deleted] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-35557: - Comment: was deleted (was: [~iemejia] I've been doing similar work recently:   * Scala 2.13 and JDK 17

[jira] [Commented] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404187#comment-17404187 ] Yang Jie commented on SPARK-33772: -- [~dongjoon] [~hyukjin.kwon] [~xkrogen] I've been do

[jira] [Comment Edited] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404182#comment-17404182 ] Yang Jie edited comment on SPARK-35557 at 8/25/21, 5:43 AM:

[jira] [Comment Edited] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404182#comment-17404182 ] Yang Jie edited comment on SPARK-35557 at 8/25/21, 5:40 AM:

[jira] [Comment Edited] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404182#comment-17404182 ] Yang Jie edited comment on SPARK-35557 at 8/25/21, 5:40 AM:

[jira] [Comment Edited] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404182#comment-17404182 ] Yang Jie edited comment on SPARK-35557 at 8/25/21, 5:40 AM:

[jira] [Commented] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404182#comment-17404182 ] Yang Jie commented on SPARK-35557: -- Scala 2.13 and JDK 17-ea are easier to use together

[jira] [Created] (SPARK-36581) Add back transformAllExpressions to AnalysisHelper

Yingyi Bu created SPARK-36581: - Summary: Add back transformAllExpressions to AnalysisHelper Key: SPARK-36581 URL: https://issues.apache.org/jira/browse/SPARK-36581 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-36537) Revisit disabled tests for CategoricalDtype

[ https://issues.apache.org/jira/browse/SPARK-36537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36537: Summary: Revisit disabled tests for CategoricalDtype (was: Take care of other tests disabled for

[jira] [Assigned] (SPARK-36580) Replace filter and contains with intersect

[ https://issues.apache.org/jira/browse/SPARK-36580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36580: Assignee: Apache Spark > Replace filter and contains with intersect > ---

[jira] [Commented] (SPARK-36580) Replace filter and contains with intersect

[ https://issues.apache.org/jira/browse/SPARK-36580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404161#comment-17404161 ] Apache Spark commented on SPARK-36580: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-36580) Replace filter and contains with intersect

[ https://issues.apache.org/jira/browse/SPARK-36580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36580: Assignee: (was: Apache Spark) > Replace filter and contains with intersect >

[jira] [Created] (SPARK-36580) Replace filter and contains with intersect

Yang Jie created SPARK-36580: Summary: Replace filter and contains with intersect Key: SPARK-36580 URL: https://issues.apache.org/jira/browse/SPARK-36580 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-36579) Make spark stagingDir can be congfigurable

[ https://issues.apache.org/jira/browse/SPARK-36579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404151#comment-17404151 ] Apache Spark commented on SPARK-36579: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-36579) Make spark stagingDir can be congfigurable

[ https://issues.apache.org/jira/browse/SPARK-36579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36579: Assignee: (was: Apache Spark) > Make spark stagingDir can be congfigurable >

[jira] [Assigned] (SPARK-36579) Make spark stagingDir can be congfigurable

[ https://issues.apache.org/jira/browse/SPARK-36579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36579: Assignee: Apache Spark > Make spark stagingDir can be congfigurable > ---

[jira] [Commented] (SPARK-36579) Make spark stagingDir can be congfigurable

[ https://issues.apache.org/jira/browse/SPARK-36579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404150#comment-17404150 ] Apache Spark commented on SPARK-36579: -- User 'AngersZh' has created a pull requ

[jira] [Created] (SPARK-36579) Make spark stagingDir can be congfigurable

angerszhu created SPARK-36579: - Summary: Make spark stagingDir can be congfigurable Key: SPARK-36579 URL: https://issues.apache.org/jira/browse/SPARK-36579 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-36559) Allow column pruning on distributed sequence index (pandas API on Spark)

[ https://issues.apache.org/jira/browse/SPARK-36559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36559. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33807 [https://gi

[jira] [Assigned] (SPARK-36559) Allow column pruning on distributed sequence index (pandas API on Spark)

[ https://issues.apache.org/jira/browse/SPARK-36559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36559: Assignee: Hyukjin Kwon > Allow column pruning on distributed sequence index (pandas API o

[jira] [Resolved] (SPARK-36336) Define the new exception that mix SparkThrowable for all base exe in QueryExecutionErrors

[ https://issues.apache.org/jira/browse/SPARK-36336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36336. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33573 [https://gi

[jira] [Assigned] (SPARK-36336) Define the new exception that mix SparkThrowable for all base exe in QueryExecutionErrors

[ https://issues.apache.org/jira/browse/SPARK-36336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36336: Assignee: PengLei > Define the new exception that mix SparkThrowable for all base exe in

[jira] [Commented] (SPARK-36578) Minor UnivariateFeatureSelector API doc improvement

[ https://issues.apache.org/jira/browse/SPARK-36578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404108#comment-17404108 ] Huaxin Gao commented on SPARK-36578: [~mengxr]I will work on this. Thanks for pingin

[jira] [Updated] (SPARK-36577) Spark on K8s: Driver pod keeps running when executor allocator terminates with Fatal exception

[ https://issues.apache.org/jira/browse/SPARK-36577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Garg updated SPARK-36577: --- Affects Version/s: 2.4.8 > Spark on K8s: Driver pod keeps running when executor allocator terminates

[jira] [Assigned] (SPARK-36578) Minor UnivariateFeatureSelector API doc improvement

[ https://issues.apache.org/jira/browse/SPARK-36578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-36578: - Assignee: Huaxin Gao > Minor UnivariateFeatureSelector API doc improvement > --

[jira] [Commented] (SPARK-36578) Minor UnivariateFeatureSelector API doc improvement

[ https://issues.apache.org/jira/browse/SPARK-36578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404095#comment-17404095 ] Xiangrui Meng commented on SPARK-36578: --- [~huaxingao] I saw some possible improvem

[jira] [Created] (SPARK-36578) Minor UnivariateFeatureSelector API doc improvement

Xiangrui Meng created SPARK-36578: - Summary: Minor UnivariateFeatureSelector API doc improvement Key: SPARK-36578 URL: https://issues.apache.org/jira/browse/SPARK-36578 Project: Spark Issue T

[jira] [Updated] (SPARK-36578) Minor UnivariateFeatureSelector API doc improvement

[ https://issues.apache.org/jira/browse/SPARK-36578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-36578: -- Affects Version/s: 3.1.1 > Minor UnivariateFeatureSelector API doc improvement > -

[jira] [Updated] (SPARK-36578) Minor UnivariateFeatureSelector API doc improvement

[ https://issues.apache.org/jira/browse/SPARK-36578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-36578: -- Target Version/s: (was: 3.2.0) > Minor UnivariateFeatureSelector API doc improvement > -

[jira] [Assigned] (SPARK-36576) Improve range split calculation for Kafka Source minPartitions option

[ https://issues.apache.org/jira/browse/SPARK-36576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36576: Assignee: (was: Apache Spark) > Improve range split calculation for Kafka Source minP

[jira] [Assigned] (SPARK-36576) Improve range split calculation for Kafka Source minPartitions option

[ https://issues.apache.org/jira/browse/SPARK-36576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36576: Assignee: Apache Spark > Improve range split calculation for Kafka Source minPartitions o

[jira] [Updated] (SPARK-36576) Improve range split calculation for Kafka Source minPartitions option

[ https://issues.apache.org/jira/browse/SPARK-36576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated SPARK-36576: - Description: While the [documentation|https://spark.apache.org/docs/latest/structured-streaming

[jira] [Resolved] (SPARK-36564) LiveRDDDistribution.toApi throws NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-36564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36564. --- Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution: Fix

[jira] [Assigned] (SPARK-36564) LiveRDDDistribution.toApi throws NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-36564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36564: - Assignee: wuyi > LiveRDDDistribution.toApi throws NullPointerException > --

[jira] [Resolved] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36573. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33821 [https://

[jira] [Assigned] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36573: - Assignee: Luca Canali > Add a default value to ORACLE_DOCKER_IMAGE > -

[jira] [Updated] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36573: -- Affects Version/s: (was: 3.1.2) 3.3.0 > Add a default value to ORA

[jira] [Updated] (SPARK-36577) Spark on K8s: Driver pod keeps running when executor allocator terminates with Fatal exception

[ https://issues.apache.org/jira/browse/SPARK-36577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Garg updated SPARK-36577: --- Description: In Spark on Kubernetes, the class ExecutorPodsSnapshotsStoreImpl creates a thread whic

[jira] [Updated] (SPARK-36577) Spark on K8s: Driver pod keeps running when executor allocator terminates with Fatal exception

[ https://issues.apache.org/jira/browse/SPARK-36577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Garg updated SPARK-36577: --- Description: In Spark on Kubernetes, the class ExecutorPodsSnapshotsStoreImpl creates a thread whic

[jira] [Created] (SPARK-36577) Spark on K8s: Driver pod keeps running when executor allocator terminates with Fatal exception

Vikas Garg created SPARK-36577: -- Summary: Spark on K8s: Driver pod keeps running when executor allocator terminates with Fatal exception Key: SPARK-36577 URL: https://issues.apache.org/jira/browse/SPARK-36577

[jira] [Commented] (SPARK-33349) ExecutorPodsWatchSnapshotSource: Kubernetes client has been closed

[ https://issues.apache.org/jira/browse/SPARK-33349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403987#comment-17403987 ] Mihir Kelkar commented on SPARK-33349: -- [~dongjoon], [~code_kr_dev_s] : is there an

[jira] [Created] (SPARK-36576) Improve range split calculation for Kafka Source minPartitions option

Andrew Olson created SPARK-36576: Summary: Improve range split calculation for Kafka Source minPartitions option Key: SPARK-36576 URL: https://issues.apache.org/jira/browse/SPARK-36576 Project: Spark

[jira] [Commented] (SPARK-35535) New data source V2 API: LocalScan

[ https://issues.apache.org/jira/browse/SPARK-35535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403891#comment-17403891 ] Apache Spark commented on SPARK-35535: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-35535) New data source V2 API: LocalScan

[ https://issues.apache.org/jira/browse/SPARK-35535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403887#comment-17403887 ] Apache Spark commented on SPARK-35535: -- User 'gengliangwang' has created a pull req

[jira] [Updated] (SPARK-35876) array_zip unexpected column names

[ https://issues.apache.org/jira/browse/SPARK-35876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-35876: Fix Version/s: 3.0.4 3.1.3 > array_zip unexpected column names > --

[jira] [Commented] (SPARK-36568) Missed broadcast join in V2 plan

[ https://issues.apache.org/jira/browse/SPARK-36568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403866#comment-17403866 ] Apache Spark commented on SPARK-36568: -- User 'peter-toth' has created a pull reques

[jira] [Assigned] (SPARK-36568) Missed broadcast join in V2 plan

[ https://issues.apache.org/jira/browse/SPARK-36568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36568: Assignee: Apache Spark > Missed broadcast join in V2 plan > -

[jira] [Assigned] (SPARK-36568) Missed broadcast join in V2 plan

[ https://issues.apache.org/jira/browse/SPARK-36568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36568: Assignee: (was: Apache Spark) > Missed broadcast join in V2 plan > --

[jira] [Commented] (SPARK-36568) Missed broadcast join in V2 plan

[ https://issues.apache.org/jira/browse/SPARK-36568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403863#comment-17403863 ] Apache Spark commented on SPARK-36568: -- User 'peter-toth' has created a pull reques

[jira] [Assigned] (SPARK-36419) Move final aggregation in RDD.treeAggregate to executor

[ https://issues.apache.org/jira/browse/SPARK-36419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36419: --- Assignee: Aravind Patnam > Move final aggregation in RDD.treeAggregate to executor > --

[jira] [Resolved] (SPARK-36419) Move final aggregation in RDD.treeAggregate to executor

[ https://issues.apache.org/jira/browse/SPARK-36419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36419. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33644 [https://gith

[jira] [Assigned] (SPARK-36457) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-36457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36457: Assignee: Apache Spark (was: Gengliang Wang) > Review and fix issues in API docs > -

[jira] [Assigned] (SPARK-36457) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-36457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36457: Assignee: Gengliang Wang (was: Apache Spark) > Review and fix issues in API docs > -

[jira] [Commented] (SPARK-36457) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-36457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403831#comment-17403831 ] Apache Spark commented on SPARK-36457: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-35236) Support archive files as resources for CREATE FUNCTION USING syntax

[ https://issues.apache.org/jira/browse/SPARK-35236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403824#comment-17403824 ] Apache Spark commented on SPARK-35236: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-36572) Removal of netty-3.9.9.Final.jar dependent code and use only netty-all-4.1.47.Final.jar in Spark 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-36572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403798#comment-17403798 ] Kousuke Saruta commented on SPARK-36572: [~sshukla05] Sorry, 2.4.8 is the last r

[jira] [Updated] (SPARK-36575) Executor lost may cause spark stage to hang

[ https://issues.apache.org/jira/browse/SPARK-36575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiahua updated SPARK-36575: - Description: When a executor finished a task of some stage, the driver will receive a `StatusUpdate` ev

[jira] [Updated] (SPARK-36575) Executor lost may cause spark stage to hang

[ https://issues.apache.org/jira/browse/SPARK-36575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiahua updated SPARK-36575: - Affects Version/s: 2.3.3 > Executor lost may cause spark stage to hang > ---

[jira] [Created] (SPARK-36575) Executor lost may cause spark stage to hang

hujiahua created SPARK-36575: Summary: Executor lost may cause spark stage to hang Key: SPARK-36575 URL: https://issues.apache.org/jira/browse/SPARK-36575 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34415: Assignee: Apache Spark (was: Phillip Henry) > Use randomization as a possibly better tec

[jira] [Reopened] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reopened SPARK-34415: -- Reverted from 3.2 for now > Use randomization as a possibly better technique than grid search in

[jira] [Updated] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34415: - Fix Version/s: (was: 3.2.0) > Use randomization as a possibly better technique than grid sea

[jira] [Updated] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34415: - External issue URL: (was: https://github.com/apache/spark/pull/31535) > Use randomization as a

[jira] [Assigned] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34415: Assignee: Phillip Henry (was: Apache Spark) > Use randomization as a possibly better tec

[jira] [Updated] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34415: - Labels: (was: pull-request-available) > Use randomization as a possibly better technique than

[jira] [Commented] (SPARK-35289) Make CatalogString contains nullable information

[ https://issues.apache.org/jira/browse/SPARK-35289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403776#comment-17403776 ] jingpan xiong commented on SPARK-35289: --- i had meet this issue in my project, and

[jira] [Updated] (SPARK-35289) Make CatalogString contains nullable information

[ https://issues.apache.org/jira/browse/SPARK-35289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jingpan xiong updated SPARK-35289: -- Attachment: screenshot-1.png > Make CatalogString contains nullable information >

[jira] [Assigned] (SPARK-36574) pushDownPredicate=false failed to prevent push down filters to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36574: Assignee: Apache Spark > pushDownPredicate=false failed to prevent push down filters to J

[jira] [Assigned] (SPARK-36574) pushDownPredicate=false failed to prevent push down filters to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36574: Assignee: (was: Apache Spark) > pushDownPredicate=false failed to prevent push down f

[jira] [Commented] (SPARK-36574) pushDownPredicate=false failed to prevent push down filters to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403738#comment-17403738 ] Apache Spark commented on SPARK-36574: -- User 'beliefer' has created a pull request

[jira] [Updated] (SPARK-36574) pushDownPredicate=false failed to prevent push down filters to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36574: --- Summary: pushDownPredicate=false failed to prevent push down filters to JDBC data source (was: push

[jira] [Updated] (SPARK-36574) pushDownPredicate=false failed to prevent push filters down to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36574: --- Summary: pushDownPredicate=false failed to prevent push filters down to JDBC data source (was: push

[jira] [Updated] (SPARK-36574) pushDownPredicate failed to prevent push filters down to the data source.

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36574: --- Description: Spark SQL includes a data source that can read data from other databases using JDBC.

[jira] [Updated] (SPARK-36574) pushDownPredicate failed to prevent push filters down to the data source.

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36574: --- Description: Spark SQL includes a data source that can read data from other databases using JDBC.

[jira] [Created] (SPARK-36574) pushDownPredicate failed to prevent push filters down to the data source.

jiaan.geng created SPARK-36574: -- Summary: pushDownPredicate failed to prevent push filters down to the data source. Key: SPARK-36574 URL: https://issues.apache.org/jira/browse/SPARK-36574 Project: Spark

[jira] [Commented] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403718#comment-17403718 ] Apache Spark commented on SPARK-36573: -- User 'LucaCanali' has created a pull reques

[jira] [Commented] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403717#comment-17403717 ] Apache Spark commented on SPARK-36573: -- User 'LucaCanali' has created a pull reques

[jira] [Assigned] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36573: Assignee: Apache Spark > Add a default value to ORACLE_DOCKER_IMAGE > --

[jira] [Assigned] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

[ https://issues.apache.org/jira/browse/SPARK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36573: Assignee: (was: Apache Spark) > Add a default value to ORACLE_DOCKER_IMAGE > ---

[jira] [Created] (SPARK-36573) Add a default value to ORACLE_DOCKER_IMAGE

Luca Canali created SPARK-36573: --- Summary: Add a default value to ORACLE_DOCKER_IMAGE Key: SPARK-36573 URL: https://issues.apache.org/jira/browse/SPARK-36573 Project: Spark Issue Type: Improve

[jira] [Updated] (SPARK-36572) Removal of netty-3.9.9.Final.jar dependent code and use only netty-all-4.1.47.Final.jar in Spark 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-36572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SHOBHIT SHUKLA updated SPARK-36572: --- Description: Please remove netty-3.9.9.Final.jar from Spark 2.4.x because this jar was repor

[jira] [Updated] (SPARK-36572) Removal of netty-3.9.9.Final.jar dependent code and use only netty-all-4.1.47.Final.jar in Spark 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-36572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SHOBHIT SHUKLA updated SPARK-36572: --- Summary: Removal of netty-3.9.9.Final.jar dependent code and use only netty-all-4.1.47.Final

[jira] [Created] (SPARK-36572) Upgrade version of io.netty to 4.1.44.Final to solve CVE-2019-20444 and CVE-2019-20445

SHOBHIT SHUKLA created SPARK-36572: -- Summary: Upgrade version of io.netty to 4.1.44.Final to solve CVE-2019-20444 and CVE-2019-20445 Key: SPARK-36572 URL: https://issues.apache.org/jira/browse/SPARK-36572

[jira] [Commented] (SPARK-22876) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

[ https://issues.apache.org/jira/browse/SPARK-22876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403630#comment-17403630 ] Pierre Gramme commented on SPARK-22876: --- If there is no plan to fix this, would it

[jira] [Commented] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403608#comment-17403608 ] Apache Spark commented on SPARK-34415: -- User 'gengliangwang' has created a pull req