[jira] [Updated] (SPARK-33485) running spark application in kerbernetes,bug the application log shows yarn authentications

[ https://issues.apache.org/jira/browse/SPARK-33485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Jiao updated SPARK-33485: -- Attachment: application.log > running spark application in kerbernetes,bug the application log shows

[jira] [Updated] (SPARK-33485) running spark application in kerbernetes,bug the application log shows yarn authentications

[ https://issues.apache.org/jira/browse/SPARK-33485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Jiao updated SPARK-33485: -- Attachment: (was: application.log) > running spark application in kerbernetes,bug the application

[jira] [Updated] (SPARK-28103) Cannot infer filters from union table with empty local relation table properly

[ https://issues.apache.org/jira/browse/SPARK-28103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28103: Target Version/s: (was: 3.0.0) > Cannot infer filters from union table with empty local

[jira] [Updated] (SPARK-33485) running spark application in kerbernetes,bug the application log shows yarn authentications

[ https://issues.apache.org/jira/browse/SPARK-33485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Jiao updated SPARK-33485: -- Description: My spark application accessing kerberized HDFS is running in kubernetes cluster， but

[jira] [Updated] (SPARK-33485) running spark application in kerbernetes,bug the application log shows yarn authentications

[ https://issues.apache.org/jira/browse/SPARK-33485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Jiao updated SPARK-33485: -- Description: My spark application accessing kerberized hdfs is running in kubernetes cluster， but

[jira] [Updated] (SPARK-33485) running spark application in kerbernetes,bug the application log shows yarn authentications

[ https://issues.apache.org/jira/browse/SPARK-33485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Jiao updated SPARK-33485: -- Description: My spark application accessing kerberized hdfs is running in kubernetes cluster， but

[jira] [Updated] (SPARK-33485) running spark application in kerbernetes,bug the application log shows yarn authentications

[ https://issues.apache.org/jira/browse/SPARK-33485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Jiao updated SPARK-33485: -- Description: My spark application accessing kerberized hdfs is running in kubernetes cluster， but

[jira] [Updated] (SPARK-33485) running spark application in kerbernetes,bug the application log shows yarn authentications

[ https://issues.apache.org/jira/browse/SPARK-33485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Jiao updated SPARK-33485: -- Description: My spark application accessing kerberized hdfs is running in kubernetes cluster， but

[jira] [Commented] (SPARK-27421) RuntimeException when querying a view on a partitioned parquet table

[ https://issues.apache.org/jira/browse/SPARK-27421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235212#comment-17235212 ] Apache Spark commented on SPARK-27421: -- User 'wangyum' has created a pull request for this issue:

[jira] [Updated] (SPARK-27495) SPIP: Support Stage level resource configuration and scheduling

[ https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27495: - Target Version/s: 3.1.0 (was: 3.0.0) > SPIP: Support Stage level resource configuration and

[jira] [Updated] (SPARK-33485) running spark application in kerbernetes,bug the application log shows yarn authentications

[ https://issues.apache.org/jira/browse/SPARK-33485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Jiao updated SPARK-33485: -- Description: My spark application accessing kerberized hdfs is running in kubernetes cluster， but

[jira] [Updated] (SPARK-33485) running spark application in kerbernetes,bug the application log shows yarn authentications

[ https://issues.apache.org/jira/browse/SPARK-33485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Jiao updated SPARK-33485: -- Attachment: application.log > running spark application in kerbernetes,bug the application log shows

[jira] [Updated] (SPARK-33485) running spark application in kerbernetes,bug the application log shows yarn authentications

[ https://issues.apache.org/jira/browse/SPARK-33485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Jiao updated SPARK-33485: -- Attachment: project.rar > running spark application in kerbernetes,bug the application log shows yarn

[jira] [Created] (SPARK-33485) running spark application in kerbernetes,bug the application log shows yarn authentications

Yuan Jiao created SPARK-33485: - Summary: running spark application in kerbernetes,bug the application log shows yarn authentications Key: SPARK-33485 URL: https://issues.apache.org/jira/browse/SPARK-33485

[jira] [Updated] (SPARK-27421) RuntimeException when querying a view on a partitioned parquet table

[ https://issues.apache.org/jira/browse/SPARK-27421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27421: Fix Version/s: 3.1.0 3.0.2 > RuntimeException when querying a view on a

[jira] [Updated] (SPARK-33400) Normalize sameOrderExpressions in SortOrder

[ https://issues.apache.org/jira/browse/SPARK-33400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33400: Fix Version/s: (was: 3.2.0) 3.1.0 > Normalize sameOrderExpressions in

[jira] [Assigned] (SPARK-33400) Normalize sameOrderExpressions in SortOrder

[ https://issues.apache.org/jira/browse/SPARK-33400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33400: --- Assignee: Prakhar Jain > Normalize sameOrderExpressions in SortOrder >

[jira] [Resolved] (SPARK-33400) Normalize sameOrderExpressions in SortOrder

[ https://issues.apache.org/jira/browse/SPARK-33400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33400. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30302

[jira] [Assigned] (SPARK-33474) Incorrect value when inserting into date type partition table with date type value

[ https://issues.apache.org/jira/browse/SPARK-33474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33474: Assignee: Apache Spark > Incorrect value when inserting into date type partition table

[jira] [Assigned] (SPARK-33474) Incorrect value when inserting into date type partition table with date type value

[ https://issues.apache.org/jira/browse/SPARK-33474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33474: Assignee: (was: Apache Spark) > Incorrect value when inserting into date type

[jira] [Commented] (SPARK-33474) Incorrect value when inserting into date type partition table with date type value

[ https://issues.apache.org/jira/browse/SPARK-33474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235202#comment-17235202 ] Apache Spark commented on SPARK-33474: -- User 'AngersZh' has created a pull request for this

[jira] [Resolved] (SPARK-27421) RuntimeException when querying a view on a partitioned parquet table

[ https://issues.apache.org/jira/browse/SPARK-27421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-27421. - Assignee: Yuming Wang Resolution: Fixed Issue resolved by pull request 30380

[jira] [Updated] (SPARK-33464) Add/remove (un)necessary cache and restructure GitHub Actions yaml

[ https://issues.apache.org/jira/browse/SPARK-33464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33464: - Fix Version/s: 2.4.8 > Add/remove (un)necessary cache and restructure GitHub Actions yaml >

[jira] [Resolved] (SPARK-33441) Add "unused-import" compile arg to scalac and remove all unused imports in Scala code

[ https://issues.apache.org/jira/browse/SPARK-33441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33441. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30351

[jira] [Assigned] (SPARK-33441) Add "unused-import" compile arg to scalac and remove all unused imports in Scala code

[ https://issues.apache.org/jira/browse/SPARK-33441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33441: Assignee: Yang Jie > Add "unused-import" compile arg to scalac and remove all unused

[jira] [Created] (SPARK-33484) Kafka flatMapGroupsWithState not always ordered.

Kevin Flansburg created SPARK-33484: --- Summary: Kafka flatMapGroupsWithState not always ordered. Key: SPARK-33484 URL: https://issues.apache.org/jira/browse/SPARK-33484 Project: Spark Issue

[jira] [Commented] (SPARK-33183) Bug in optimizer rule EliminateSorts

[ https://issues.apache.org/jira/browse/SPARK-33183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235176#comment-17235176 ] Apache Spark commented on SPARK-33183: -- User 'allisonwang-db' has created a pull request for this

[jira] [Updated] (SPARK-33464) Add/remove (un)necessary cache and restructure GitHub Actions yaml

[ https://issues.apache.org/jira/browse/SPARK-33464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33464: -- Fix Version/s: 3.0.2 > Add/remove (un)necessary cache and restructure GitHub Actions yaml >

[jira] [Commented] (SPARK-33278) Improve the performance for FIRST_VALUE

[ https://issues.apache.org/jira/browse/SPARK-33278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235167#comment-17235167 ] Apache Spark commented on SPARK-33278: -- User 'beliefer' has created a pull request for this issue:

[jira] [Issue Comment Deleted] (SPARK-33483) Fix rat exclusion patterns and add a LICENSE

[ https://issues.apache.org/jira/browse/SPARK-33483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33483: -- Comment: was deleted (was: User 'dongjoon-hyun' has created a pull request for this issue:

[jira] [Commented] (SPARK-33483) Fix rat exclusion patterns and add a LICENSE

[ https://issues.apache.org/jira/browse/SPARK-33483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235161#comment-17235161 ] Apache Spark commented on SPARK-33483: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-33483) Fix rat exclusion patterns and add a LICENSE

[ https://issues.apache.org/jira/browse/SPARK-33483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235160#comment-17235160 ] Apache Spark commented on SPARK-33483: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33483) Fix rat exclusion patterns and add a LICENSE

[ https://issues.apache.org/jira/browse/SPARK-33483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33483: Assignee: Apache Spark > Fix rat exclusion patterns and add a LICENSE >

[jira] [Assigned] (SPARK-33483) Fix rat exclusion patterns and add a LICENSE

[ https://issues.apache.org/jira/browse/SPARK-33483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33483: Assignee: (was: Apache Spark) > Fix rat exclusion patterns and add a LICENSE >

[jira] [Updated] (SPARK-33483) Fix rat exclusion patterns and add a LICENSE

[ https://issues.apache.org/jira/browse/SPARK-33483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33483: -- Summary: Fix rat exclusion patterns and add a LICENSE (was: Fix rat exclusion patterns) >

[jira] [Updated] (SPARK-33483) Fix rat exclusion patterns

[ https://issues.apache.org/jira/browse/SPARK-33483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33483: -- Summary: Fix rat exclusion patterns (was: Fix rat exclusion not to exclude `catalog`) > Fix

[jira] [Created] (SPARK-33483) Fix rat exclusion not to exclude `catalog`

Dongjoon Hyun created SPARK-33483: - Summary: Fix rat exclusion not to exclude `catalog` Key: SPARK-33483 URL: https://issues.apache.org/jira/browse/SPARK-33483 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-33464) Add/remove (un)necessary cache and restructure GitHub Actions yaml

[ https://issues.apache.org/jira/browse/SPARK-33464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235140#comment-17235140 ] Apache Spark commented on SPARK-33464: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-33482) V2 Datasources that extend FileScan preclude exchange reuse

Bruce Robbins created SPARK-33482: - Summary: V2 Datasources that extend FileScan preclude exchange reuse Key: SPARK-33482 URL: https://issues.apache.org/jira/browse/SPARK-33482 Project: Spark

[jira] [Updated] (SPARK-33473) Extend interpreted subexpression elimination to other interpreted projection

[ https://issues.apache.org/jira/browse/SPARK-33473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33473: -- Fix Version/s: (was: 3.2.0) 3.1.0 > Extend interpreted subexpression

[jira] [Resolved] (SPARK-33473) Extend interpreted subexpression elimination to other interpreted projection

[ https://issues.apache.org/jira/browse/SPARK-33473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33473. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30406

[jira] [Commented] (SPARK-33464) Add/remove (un)necessary cache and restructure GitHub Actions yaml

[ https://issues.apache.org/jira/browse/SPARK-33464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235130#comment-17235130 ] Apache Spark commented on SPARK-33464: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-31255) DataSourceV2: Add metadata columns

[ https://issues.apache.org/jira/browse/SPARK-31255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235123#comment-17235123 ] Apache Spark commented on SPARK-31255: -- User 'rdblue' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33479) Make apiKey of docsearch configurable

[ https://issues.apache.org/jira/browse/SPARK-33479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33479. -- Fix Version/s: 3.1.0 Resolution: Fixed Resolved by 

[jira] [Commented] (SPARK-33427) Interpreted subexpression elimination

[ https://issues.apache.org/jira/browse/SPARK-33427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235086#comment-17235086 ] Apache Spark commented on SPARK-33427: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33304) Add from_avro and to_avro functions to SparkR

[ https://issues.apache.org/jira/browse/SPARK-33304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33304: Assignee: Maciej Szymkiewicz > Add from_avro and to_avro functions to SparkR >

[jira] [Resolved] (SPARK-33304) Add from_avro and to_avro functions to SparkR

[ https://issues.apache.org/jira/browse/SPARK-33304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33304. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30216

[jira] [Assigned] (SPARK-32085) Migrate to NumPy documentation style

[ https://issues.apache.org/jira/browse/SPARK-32085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32085: Assignee: Maciej Szymkiewicz > Migrate to NumPy documentation style >

[jira] [Resolved] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33445. -- Resolution: Duplicate > Can't parse decimal type from csv file >

[jira] [Comment Edited] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235079#comment-17235079 ] Hyukjin Kwon edited comment on SPARK-33445 at 11/19/20, 12:45 AM: --

[jira] [Updated] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33445: - Fix Version/s: (was: 3.0.0) > Can't parse decimal type from csv file >

[jira] [Reopened] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-33445: -- > Can't parse decimal type from csv file > -- > >

[jira] [Commented] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235079#comment-17235079 ] Hyukjin Kwon commented on SPARK-33445: -- Okay, I thought this is not PySpark specific issue too but

[jira] [Resolved] (SPARK-33354) New explicit cast syntax rules in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-33354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33354. -- Fix Version/s: 3.1.0 Resolution: Fixed Resolved by 

[jira] [Assigned] (SPARK-33252) Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

[ https://issues.apache.org/jira/browse/SPARK-33252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33252: Assignee: (was: Apache Spark) > Migration to NumPy documentation style in MLlib

[jira] [Assigned] (SPARK-33252) Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

[ https://issues.apache.org/jira/browse/SPARK-33252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33252: Assignee: Apache Spark > Migration to NumPy documentation style in MLlib

[jira] [Commented] (SPARK-33252) Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

[ https://issues.apache.org/jira/browse/SPARK-33252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235074#comment-17235074 ] Apache Spark commented on SPARK-33252: -- User 'zero323' has created a pull request for this issue:

[jira] [Updated] (SPARK-33464) Add/remove (un)necessary cache and restructure GitHub Actions yaml

[ https://issues.apache.org/jira/browse/SPARK-33464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33464: -- Fix Version/s: (was: 3.2.0) 3.1.0 > Add/remove (un)necessary cache and

[jira] [Assigned] (SPARK-33464) Add/remove (un)necessary cache and restructure GitHub Actions yaml

[ https://issues.apache.org/jira/browse/SPARK-33464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33464: - Assignee: Hyukjin Kwon > Add/remove (un)necessary cache and restructure GitHub Actions

[jira] [Resolved] (SPARK-33464) Add/remove (un)necessary cache and restructure GitHub Actions yaml

[ https://issues.apache.org/jira/browse/SPARK-33464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33464. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30391

[jira] [Resolved] (SPARK-31255) DataSourceV2: Add metadata columns

[ https://issues.apache.org/jira/browse/SPARK-31255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-31255. - Fix Version/s: 3.1.0 Assignee: Ryan Blue Resolution: Done Resolved by 

[jira] [Commented] (SPARK-21738) Thriftserver doesn't cancel jobs when session is closed

[ https://issues.apache.org/jira/browse/SPARK-21738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235025#comment-17235025 ] Apache Spark commented on SPARK-21738: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Commented] (SPARK-19256) Hive bucketing write support

[ https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234957#comment-17234957 ] Cheng Su commented on SPARK-19256: -- > Should i assume this is a simplification and it will be actually

[jira] [Assigned] (SPARK-31018) Deprecate support of multiple workers on the same host in Standalone

[ https://issues.apache.org/jira/browse/SPARK-31018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31018: Assignee: Apache Spark > Deprecate support of multiple workers on the same host in

[jira] [Assigned] (SPARK-31018) Deprecate support of multiple workers on the same host in Standalone

[ https://issues.apache.org/jira/browse/SPARK-31018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31018: Assignee: (was: Apache Spark) > Deprecate support of multiple workers on the same

[jira] [Updated] (SPARK-22231) Support of map, filter, withField, dropFields in nested list of structures

[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22231: -- Target Version/s: 3.2.0 (was: 3.1.0) > Support of map, filter, withField, dropFields in

[jira] [Updated] (SPARK-33091) Avoid using map instead of foreach to avoid potential side effect at callers of OrcUtils.readCatalystSchema

[ https://issues.apache.org/jira/browse/SPARK-33091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33091: -- Fix Version/s: (was: 3.02) 3.0.2 > Avoid using map instead of foreach

[jira] [Commented] (SPARK-24941) Add RDDBarrier.coalesce() function

[ https://issues.apache.org/jira/browse/SPARK-24941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234936#comment-17234936 ] Dongjoon Hyun commented on SPARK-24941: --- Gentle ping, [~jiangxb1987], because this has `Target

[jira] [Commented] (SPARK-25383) Image data source supports sample pushdown

[ https://issues.apache.org/jira/browse/SPARK-25383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234934#comment-17234934 ] Dongjoon Hyun commented on SPARK-25383: --- Hi, [~mengxr]. Is there any update for this issue? >

[jira] [Commented] (SPARK-24942) Improve cluster resource management with jobs containing barrier stage

[ https://issues.apache.org/jira/browse/SPARK-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234935#comment-17234935 ] Dongjoon Hyun commented on SPARK-24942: --- Gentle ping, [~jiangxb1987], because this has `Target

[jira] [Commented] (SPARK-25752) Add trait to easily whitelist logical operators that produce named output from CleanupAliases

[ https://issues.apache.org/jira/browse/SPARK-25752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234932#comment-17234932 ] Dongjoon Hyun commented on SPARK-25752: --- Gentle ping, [~tdas], because this has `Target Version:

[jira] [Commented] (SPARK-27780) Shuffle server & client should be versioned to enable smoother upgrade

[ https://issues.apache.org/jira/browse/SPARK-27780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234930#comment-17234930 ] Dongjoon Hyun commented on SPARK-27780: --- Gentle ping, [~irashid], because this has `Target

[jira] [Commented] (SPARK-28629) Capture the missing rules in HiveSessionStateBuilder

[ https://issues.apache.org/jira/browse/SPARK-28629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234928#comment-17234928 ] Dongjoon Hyun commented on SPARK-28629: --- Hi, [~smilegator]. Is this a QA task for 3.1 because this

[jira] [Commented] (SPARK-28704) Test backward compatibility on JDK9+ once we have a version supports JDK9+

[ https://issues.apache.org/jira/browse/SPARK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234926#comment-17234926 ] Dongjoon Hyun commented on SPARK-28704: --- Gentle ping, [~yumwang], because this has `Target

[jira] [Commented] (SPARK-31018) Deprecate support of multiple workers on the same host in Standalone

[ https://issues.apache.org/jira/browse/SPARK-31018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234924#comment-17234924 ] Dongjoon Hyun commented on SPARK-31018: --- Could you resolve this, [~Ngone51]? > Deprecate support

[jira] [Commented] (SPARK-31555) Improve cache block migration

[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234923#comment-17234923 ] Dongjoon Hyun commented on SPARK-31555: --- Gentle ping because the target version is `3.1.0` in this

[jira] [Updated] (SPARK-27936) Support local dependency uploading from --py-files

[ https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27936: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Support local

[jira] [Assigned] (SPARK-27936) Support local dependency uploading from --py-files

[ https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-27936: - Assignee: Stavros Kontopoulos > Support local dependency uploading from --py-files >

[jira] [Resolved] (SPARK-27936) Support local dependency uploading from --py-files

[ https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27936. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 25870

[jira] [Commented] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234919#comment-17234919 ] Punit Shah commented on SPARK-33445: Thank you very much [~dongjoon] > Can't parse decimal type

[jira] [Created] (SPARK-33481) Better heuristics to compute number of shuffle mergers required for a ShuffleMapStage

Venkata krishnan Sowrirajan created SPARK-33481: --- Summary: Better heuristics to compute number of shuffle mergers required for a ShuffleMapStage Key: SPARK-33481 URL:

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234883#comment-17234883 ] Shane Knapp commented on SPARK-33044: - this is going to have to wait, as i'm in the process of

[jira] [Commented] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234864#comment-17234864 ] Dongjoon Hyun commented on SPARK-33445: --- Currently, I'm looking for that JIRA for you. That's the

[jira] [Commented] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234863#comment-17234863 ] Dongjoon Hyun commented on SPARK-33445: --- [~bullsoverbears]. In general, in this case, we need to

[jira] [Commented] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234851#comment-17234851 ] Punit Shah commented on SPARK-33445: My apologies [~dongjoon] for the incorrect tags.  Please let me

[jira] [Commented] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234804#comment-17234804 ] Dongjoon Hyun commented on SPARK-33445: --- [~hyukjin.kwon]. Is there an existing PySpark-specific

[jira] [Assigned] (SPARK-33480) support char/varchar type

[ https://issues.apache.org/jira/browse/SPARK-33480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33480: Assignee: Wenchen Fan (was: Apache Spark) > support char/varchar type >

[jira] [Updated] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33445: -- Component/s: (was: SQL) PySpark > Can't parse decimal type from csv file

[jira] [Commented] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234787#comment-17234787 ] Dongjoon Hyun commented on SPARK-33445: --- Also, this is `PySpark` only issue because Scala works

[jira] [Assigned] (SPARK-33480) support char/varchar type

[ https://issues.apache.org/jira/browse/SPARK-33480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33480: Assignee: Apache Spark (was: Wenchen Fan) > support char/varchar type >

[jira] [Updated] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33445: -- Affects Version/s: 2.1.3 > Can't parse decimal type from csv file >

[jira] [Commented] (SPARK-33480) support char/varchar type

[ https://issues.apache.org/jira/browse/SPARK-33480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234782#comment-17234782 ] Apache Spark commented on SPARK-33480: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33445: -- Affects Version/s: 2.2.3 > Can't parse decimal type from csv file >

[jira] [Updated] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33445: -- Affects Version/s: (was: 2.4.6) 2.3.4 > Can't parse decimal type

[jira] [Resolved] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33445. --- Fix Version/s: 3.0.0 Resolution: Fixed Since this is fixed at 3.0.0, I'll mark this

[jira] [Reopened] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-33445: --- > Can't parse decimal type from csv file > -- > >

[jira] [Updated] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33445: -- Affects Version/s: (was: 3.0.0) > Can't parse decimal type from csv file >

[jira] [Commented] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234779#comment-17234779 ] Dongjoon Hyun commented on SPARK-33445: --- Got it. [~bullsoverbears]. The reported Affected Version

[jira] [Issue Comment Deleted] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33445: -- Comment: was deleted (was: [~bullsoverbears]. If you don't mind, it would be great if you can

[jira] [Commented] (SPARK-33445) Can't parse decimal type from csv file

[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234774#comment-17234774 ] Dongjoon Hyun commented on SPARK-33445: --- [~bullsoverbears]. If you don't mind, it would be great

  1   2   >