[jira] [Resolved] (SPARK-34371) Run datetime rebasing tests for parquet DSv1 and DSv2

[ https://issues.apache.org/jira/browse/SPARK-34371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34371. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31478

[jira] [Assigned] (SPARK-34371) Run datetime rebasing tests for parquet DSv1 and DSv2

[ https://issues.apache.org/jira/browse/SPARK-34371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34371: --- Assignee: Maxim Gekk > Run datetime rebasing tests for parquet DSv1 and DSv2 >

[jira] [Assigned] (SPARK-34374) Use standard methods to extract keys or values from a Map.

[ https://issues.apache.org/jira/browse/SPARK-34374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34374: Assignee: (was: Apache Spark) > Use standard methods to extract keys or values from

[jira] [Assigned] (SPARK-34374) Use standard methods to extract keys or values from a Map.

[ https://issues.apache.org/jira/browse/SPARK-34374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34374: Assignee: Apache Spark > Use standard methods to extract keys or values from a Map. >

[jira] [Commented] (SPARK-34374) Use standard methods to extract keys or values from a Map.

[ https://issues.apache.org/jira/browse/SPARK-34374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279401#comment-17279401 ] Apache Spark commented on SPARK-34374: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-33434) Document spark.conf.isModifiable()

[ https://issues.apache.org/jira/browse/SPARK-33434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279398#comment-17279398 ] Apache Spark commented on SPARK-33434: -- User 'Eric-Lemmon' has created a pull request for this

[jira] [Assigned] (SPARK-33434) Document spark.conf.isModifiable()

[ https://issues.apache.org/jira/browse/SPARK-33434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33434: Assignee: (was: Apache Spark) > Document spark.conf.isModifiable() >

[jira] [Assigned] (SPARK-33434) Document spark.conf.isModifiable()

[ https://issues.apache.org/jira/browse/SPARK-33434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33434: Assignee: Apache Spark > Document spark.conf.isModifiable() >

[jira] [Commented] (SPARK-33434) Document spark.conf.isModifiable()

[ https://issues.apache.org/jira/browse/SPARK-33434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279397#comment-17279397 ] Apache Spark commented on SPARK-33434: -- User 'Eric-Lemmon' has created a pull request for this

[jira] [Created] (SPARK-34374) Use standard methods to extract keys or values from a Map.

Yang Jie created SPARK-34374: Summary: Use standard methods to extract keys or values from a Map. Key: SPARK-34374 URL: https://issues.apache.org/jira/browse/SPARK-34374 Project: Spark Issue

[jira] [Commented] (SPARK-34346) io.file.buffer.size set by spark.buffer.size will override by hive-site.xml may cause perf regression

[ https://issues.apache.org/jira/browse/SPARK-34346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279367#comment-17279367 ] Apache Spark commented on SPARK-34346: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Resolved] (SPARK-34343) Add missing test for some non-array types in PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-34343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34343. -- Fix Version/s: 3.2.0 Resolution: Fixed Resolved by 

[jira] [Updated] (SPARK-26399) Add new stage-level REST APIs and parameters

[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-26399: --- Description: Add the peak values for the metrics to the stages REST API. Also add a new executorSummary

[jira] [Resolved] (SPARK-34359) add a legacy config to restore the output schema of SHOW DATABASES

[ https://issues.apache.org/jira/browse/SPARK-34359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34359. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31474

[jira] [Updated] (SPARK-34359) add a legacy config to restore the output schema of SHOW DATABASES

[ https://issues.apache.org/jira/browse/SPARK-34359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-34359: --- Parent: SPARK-34156 Issue Type: Sub-task (was: Improvement) > add a legacy config to

[jira] [Resolved] (SPARK-34330) Literal constructor support UTFString

[ https://issues.apache.org/jira/browse/SPARK-34330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-34330. --- Resolution: Won't Fix > Literal constructor support UTFString >

[jira] [Commented] (SPARK-32384) repartitionAndSortWithinPartitions avoid shuffle with same partitioner

[ https://issues.apache.org/jira/browse/SPARK-32384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279293#comment-17279293 ] Apache Spark commented on SPARK-32384: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-32384) repartitionAndSortWithinPartitions avoid shuffle with same partitioner

[ https://issues.apache.org/jira/browse/SPARK-32384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279292#comment-17279292 ] Apache Spark commented on SPARK-32384: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-34373) HiveThriftServer2 startWithContext may hang with a race issue

[ https://issues.apache.org/jira/browse/SPARK-34373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279280#comment-17279280 ] Apache Spark commented on SPARK-34373: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34373) HiveThriftServer2 startWithContext may hang with a race issue

[ https://issues.apache.org/jira/browse/SPARK-34373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34373: Assignee: Apache Spark > HiveThriftServer2 startWithContext may hang with a race issue

[jira] [Commented] (SPARK-34373) HiveThriftServer2 startWithContext may hang with a race issue

[ https://issues.apache.org/jira/browse/SPARK-34373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279279#comment-17279279 ] Apache Spark commented on SPARK-34373: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34373) HiveThriftServer2 startWithContext may hang with a race issue

[ https://issues.apache.org/jira/browse/SPARK-34373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34373: Assignee: (was: Apache Spark) > HiveThriftServer2 startWithContext may hang with a

[jira] [Created] (SPARK-34373) HiveThriftServer2 startWithContext may hang with a race issue

Kent Yao created SPARK-34373: Summary: HiveThriftServer2 startWithContext may hang with a race issue Key: SPARK-34373 URL: https://issues.apache.org/jira/browse/SPARK-34373 Project: Spark

[jira] [Updated] (SPARK-34372) Speculation results in broken CSV files in Amazon S3

[ https://issues.apache.org/jira/browse/SPARK-34372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daehee Han updated SPARK-34372: --- Description: Hi, we've been experiencing some rows get corrupted while partitioned CSV files were

[jira] [Created] (SPARK-34372) Speculation results in broken CSV files in Amazon S3

Daehee Han created SPARK-34372: -- Summary: Speculation results in broken CSV files in Amazon S3 Key: SPARK-34372 URL: https://issues.apache.org/jira/browse/SPARK-34372 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34372) Speculation results in broken CSV files in Amazon S3

[ https://issues.apache.org/jira/browse/SPARK-34372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daehee Han updated SPARK-34372: --- Description: Hi, we've been experiencing some rows get corrupted while partitioned CSV files were

[jira] [Assigned] (SPARK-34339) Expose the number of truncated paths in Utils.buildLocationMetadata()

[ https://issues.apache.org/jira/browse/SPARK-34339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34339: Assignee: Jungtaek Lim > Expose the number of truncated paths in

[jira] [Resolved] (SPARK-34339) Expose the number of truncated paths in Utils.buildLocationMetadata()

[ https://issues.apache.org/jira/browse/SPARK-34339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34339. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31464

[jira] [Assigned] (SPARK-34371) Run datetime rebasing tests for parquet DSv1 and DSv2

[ https://issues.apache.org/jira/browse/SPARK-34371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34371: Assignee: Apache Spark > Run datetime rebasing tests for parquet DSv1 and DSv2 >

[jira] [Assigned] (SPARK-34371) Run datetime rebasing tests for parquet DSv1 and DSv2

[ https://issues.apache.org/jira/browse/SPARK-34371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34371: Assignee: (was: Apache Spark) > Run datetime rebasing tests for parquet DSv1 and

[jira] [Commented] (SPARK-34371) Run datetime rebasing tests for parquet DSv1 and DSv2

[ https://issues.apache.org/jira/browse/SPARK-34371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279207#comment-17279207 ] Apache Spark commented on SPARK-34371: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34370: --- Description: This came up in

[jira] [Updated] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34370: --- Description: This came up in

[jira] [Updated] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34370: --- Description: This came up in

[jira] [Updated] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34370: --- Description: This came up in

[jira] [Created] (SPARK-34371) Run datetime rebasing tests for parquet DSv1 and DSv2

Maxim Gekk created SPARK-34371: -- Summary: Run datetime rebasing tests for parquet DSv1 and DSv2 Key: SPARK-34371 URL: https://issues.apache.org/jira/browse/SPARK-34371 Project: Spark Issue

[jira] [Commented] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279156#comment-17279156 ] Attila Zsolt Piros commented on SPARK-34370: I am working on this. > Supporting Avro schema

[jira] [Updated] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34370: --- Description: This came up in

[jira] [Created] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

Attila Zsolt Piros created SPARK-34370: -- Summary: Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url" Key: SPARK-34370 URL: https://issues.apache.org/jira/browse/SPARK-34370

[jira] [Commented] (SPARK-34351) Running into "Py4JJavaError" while counting to text file or list using Pyspark, Jupyter notebook

[ https://issues.apache.org/jira/browse/SPARK-34351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279128#comment-17279128 ] Huseyin Elci commented on SPARK-34351: -- I used StackOverflow for this issue but I didn't find

[jira] [Commented] (SPARK-34369) Track number of pairs processed out of Join

[ https://issues.apache.org/jira/browse/SPARK-34369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279126#comment-17279126 ] Apache Spark commented on SPARK-34369: -- User 'sririshindra' has created a pull request for this

[jira] [Assigned] (SPARK-34369) Track number of pairs processed out of Join

[ https://issues.apache.org/jira/browse/SPARK-34369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34369: Assignee: Apache Spark > Track number of pairs processed out of Join >

[jira] [Assigned] (SPARK-34369) Track number of pairs processed out of Join

[ https://issues.apache.org/jira/browse/SPARK-34369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34369: Assignee: (was: Apache Spark) > Track number of pairs processed out of Join >

[jira] [Commented] (SPARK-34369) Track number of pairs processed out of Join

[ https://issues.apache.org/jira/browse/SPARK-34369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279125#comment-17279125 ] Apache Spark commented on SPARK-34369: -- User 'sririshindra' has created a pull request for this

[jira] [Commented] (SPARK-34366) Add metric interfaces to DS v2

[ https://issues.apache.org/jira/browse/SPARK-34366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279114#comment-17279114 ] Apache Spark commented on SPARK-34366: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34366) Add metric interfaces to DS v2

[ https://issues.apache.org/jira/browse/SPARK-34366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34366: Assignee: L. C. Hsieh (was: Apache Spark) > Add metric interfaces to DS v2 >

[jira] [Assigned] (SPARK-34366) Add metric interfaces to DS v2

[ https://issues.apache.org/jira/browse/SPARK-34366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34366: Assignee: Apache Spark (was: L. C. Hsieh) > Add metric interfaces to DS v2 >

[jira] [Updated] (SPARK-34365) Support configurable Avro schema field matching for positional or by-name

[ https://issues.apache.org/jira/browse/SPARK-34365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-34365: Description: When reading an Avro dataset (using the dataset's schema or by overriding it with

[jira] [Updated] (SPARK-34369) Track number of pairs processed out of Join

[ https://issues.apache.org/jira/browse/SPARK-34369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-34369: -- Description: Often users face a scenario where even a modest

[jira] [Commented] (SPARK-34369) Track number of pairs processed out of Join

[ https://issues.apache.org/jira/browse/SPARK-34369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279098#comment-17279098 ] Srinivas Rishindra Pothireddi commented on SPARK-34369: --- I am working on this >

[jira] [Created] (SPARK-34369) Track number of pairs processed out of Join

Srinivas Rishindra Pothireddi created SPARK-34369: - Summary: Track number of pairs processed out of Join Key: SPARK-34369 URL: https://issues.apache.org/jira/browse/SPARK-34369

[jira] [Created] (SPARK-34368) Streaming implementation for metrics from Datasource v2 scan

L. C. Hsieh created SPARK-34368: --- Summary: Streaming implementation for metrics from Datasource v2 scan Key: SPARK-34368 URL: https://issues.apache.org/jira/browse/SPARK-34368 Project: Spark

[jira] [Updated] (SPARK-34367) Batch implementation for metrics from Datasource v2 scan

[ https://issues.apache.org/jira/browse/SPARK-34367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-34367: Description: Using metrics interface of DS v2 to report metrics for batch scan. > Batch

[jira] [Created] (SPARK-34367) Batch implementation for metrics from Datasource v2 scan

L. C. Hsieh created SPARK-34367: --- Summary: Batch implementation for metrics from Datasource v2 scan Key: SPARK-34367 URL: https://issues.apache.org/jira/browse/SPARK-34367 Project: Spark Issue

[jira] [Created] (SPARK-34366) Add metric interfaces to DS v2

L. C. Hsieh created SPARK-34366: --- Summary: Add metric interfaces to DS v2 Key: SPARK-34366 URL: https://issues.apache.org/jira/browse/SPARK-34366 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34365) Support configurable Avro schema field matching for positional or by-name

Erik Krogen created SPARK-34365: --- Summary: Support configurable Avro schema field matching for positional or by-name Key: SPARK-34365 URL: https://issues.apache.org/jira/browse/SPARK-34365 Project:

[jira] [Commented] (SPARK-34365) Support configurable Avro schema field matching for positional or by-name

[ https://issues.apache.org/jira/browse/SPARK-34365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279073#comment-17279073 ] Erik Krogen commented on SPARK-34365: - I plan to post a PR for this in the next few days, unless I

[jira] [Updated] (SPARK-34033) SparkR Daemon Initialization

[ https://issues.apache.org/jira/browse/SPARK-34033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Howland updated SPARK-34033: Description: Provide a way for users to initialize the sparkR daemon before it forks. I'm a

[jira] [Created] (SPARK-34364) Monitor disk usage and use to reject blocks when under disk pressure

Holden Karau created SPARK-34364: Summary: Monitor disk usage and use to reject blocks when under disk pressure Key: SPARK-34364 URL: https://issues.apache.org/jira/browse/SPARK-34364 Project: Spark

[jira] [Commented] (SPARK-34298) SaveMode.Overwrite not usable when using s3a root paths

[ https://issues.apache.org/jira/browse/SPARK-34298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279006#comment-17279006 ] cornel creanga commented on SPARK-34298: Thanks for the answer. In this wouldn't be better to

[jira] [Commented] (SPARK-34337) Reject disk blocks when out of disk space

[ https://issues.apache.org/jira/browse/SPARK-34337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279000#comment-17279000 ] Holden Karau commented on SPARK-34337: -- Initially we should allow the user to configure a maximum

[jira] [Assigned] (SPARK-33888) JDBC SQL TIME type represents incorrectly as TimestampType, it should be physical Int in millis

[ https://issues.apache.org/jira/browse/SPARK-33888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33888: --- Assignee: Duc Hoa Nguyen (was: Apache Spark) > JDBC SQL TIME type represents incorrectly

[jira] [Assigned] (SPARK-34357) Map JDBC SQL TIME type to TimestampType with time portion fixed regardless of timezone

[ https://issues.apache.org/jira/browse/SPARK-34357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34357: --- Assignee: Duc Hoa Nguyen > Map JDBC SQL TIME type to TimestampType with time portion fixed

[jira] [Resolved] (SPARK-34357) Map JDBC SQL TIME type to TimestampType with time portion fixed regardless of timezone

[ https://issues.apache.org/jira/browse/SPARK-34357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34357. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31473

[jira] [Commented] (SPARK-34362) scala.MatchError: 2.3 (of class java.lang.String) for Hive on Google Dataproc 1.4

[ https://issues.apache.org/jira/browse/SPARK-34362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278954#comment-17278954 ] Svitlana Ponomarova commented on SPARK-34362: - According to Google Dataproc 1.4

[jira] [Comment Edited] (SPARK-34362) scala.MatchError: 2.3 (of class java.lang.String) for Hive on Google Dataproc 1.4

[ https://issues.apache.org/jira/browse/SPARK-34362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278938#comment-17278938 ] Svitlana Ponomarova edited comment on SPARK-34362 at 2/4/21, 4:33 PM:

[jira] [Updated] (SPARK-34362) scala.MatchError: 2.3 (of class java.lang.String) for Hive on Google Dataproc 1.4

[ https://issues.apache.org/jira/browse/SPARK-34362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Svitlana Ponomarova updated SPARK-34362: Description: According to Google Dataproc 1.4 release notes:

[jira] [Commented] (SPARK-34362) scala.MatchError: 2.3 (of class java.lang.String) for Hive on Google Dataproc 1.4

[ https://issues.apache.org/jira/browse/SPARK-34362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278938#comment-17278938 ] Svitlana Ponomarova commented on SPARK-34362: - Maybe "Components" field was filled wrong.

[jira] [Created] (SPARK-34362) scala.MatchError: 2.3 (of class java.lang.String) for Hive on Google Dataproc 1.4

Svitlana Ponomarova created SPARK-34362: --- Summary: scala.MatchError: 2.3 (of class java.lang.String) for Hive on Google Dataproc 1.4 Key: SPARK-34362 URL: https://issues.apache.org/jira/browse/SPARK-34362

[jira] [Commented] (SPARK-34361) Dynamic allocation on K8s kills executors with running tasks

[ https://issues.apache.org/jira/browse/SPARK-34361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278932#comment-17278932 ] Attila Zsolt Piros commented on SPARK-34361: I am working on this. > Dynamic allocation on

[jira] [Created] (SPARK-34361) Dynamic allocation on K8s kills executors with running tasks

Attila Zsolt Piros created SPARK-34361: -- Summary: Dynamic allocation on K8s kills executors with running tasks Key: SPARK-34361 URL: https://issues.apache.org/jira/browse/SPARK-34361 Project:

[jira] [Commented] (SPARK-34360) Support table truncation by v2 Table Catalogs

[ https://issues.apache.org/jira/browse/SPARK-34360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278878#comment-17278878 ] Apache Spark commented on SPARK-34360: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34360) Support table truncation by v2 Table Catalogs

[ https://issues.apache.org/jira/browse/SPARK-34360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34360: Assignee: Apache Spark (was: Maxim Gekk) > Support table truncation by v2 Table

[jira] [Assigned] (SPARK-34360) Support table truncation by v2 Table Catalogs

[ https://issues.apache.org/jira/browse/SPARK-34360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34360: Assignee: Maxim Gekk (was: Apache Spark) > Support table truncation by v2 Table

[jira] [Commented] (SPARK-34360) Support table truncation by v2 Table Catalogs

[ https://issues.apache.org/jira/browse/SPARK-34360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278877#comment-17278877 ] Apache Spark commented on SPARK-34360: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-34360) Support table truncation by v2 Table Catalogs

[ https://issues.apache.org/jira/browse/SPARK-34360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34360: --- Description: Add new method `truncateTable` to the TableCatalog interface with default

[jira] [Created] (SPARK-34360) Support table truncation by v2 Table Catalogs

Maxim Gekk created SPARK-34360: -- Summary: Support table truncation by v2 Table Catalogs Key: SPARK-34360 URL: https://issues.apache.org/jira/browse/SPARK-34360 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-34359) add a legacy config to restore the output schema of SHOW DATABASES

[ https://issues.apache.org/jira/browse/SPARK-34359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34359: Assignee: Wenchen Fan (was: Apache Spark) > add a legacy config to restore the output

[jira] [Commented] (SPARK-34359) add a legacy config to restore the output schema of SHOW DATABASES

[ https://issues.apache.org/jira/browse/SPARK-34359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278863#comment-17278863 ] Apache Spark commented on SPARK-34359: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34359) add a legacy config to restore the output schema of SHOW DATABASES

[ https://issues.apache.org/jira/browse/SPARK-34359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34359: Assignee: Apache Spark (was: Wenchen Fan) > add a legacy config to restore the output

[jira] [Created] (SPARK-34359) add a legacy config to restore the output schema of SHOW DATABASES

Wenchen Fan created SPARK-34359: --- Summary: add a legacy config to restore the output schema of SHOW DATABASES Key: SPARK-34359 URL: https://issues.apache.org/jira/browse/SPARK-34359 Project: Spark

[jira] [Updated] (SPARK-34359) add a legacy config to restore the output schema of SHOW DATABASES

[ https://issues.apache.org/jira/browse/SPARK-34359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-34359: Issue Type: Improvement (was: Bug) > add a legacy config to restore the output schema of SHOW

[jira] [Commented] (SPARK-34298) SaveMode.Overwrite not usable when using s3a root paths

[ https://issues.apache.org/jira/browse/SPARK-34298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278846#comment-17278846 ] Steve Loughran commented on SPARK-34298: root dirs are special in that they always exist.

[jira] [Created] (SPARK-34358) Add API for all built-in expresssion functions

Malthe Borch created SPARK-34358: Summary: Add API for all built-in expresssion functions Key: SPARK-34358 URL: https://issues.apache.org/jira/browse/SPARK-34358 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34357) Map JDBC SQL TIME type to TimestampType with time portion fixed regardless of timezone

[ https://issues.apache.org/jira/browse/SPARK-34357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duc Hoa Nguyen updated SPARK-34357: --- Summary: Map JDBC SQL TIME type to TimestampType with time portion fixed regardless of

[jira] [Resolved] (SPARK-34351) Running into "Py4JJavaError" while counting to text file or list using Pyspark, Jupyter notebook

[ https://issues.apache.org/jira/browse/SPARK-34351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski resolved SPARK-34351. - Resolution: Invalid Please use StackOverflow or the user@spark.a.o mailing list to ask

[jira] [Commented] (SPARK-34357) Revert JDBC SQL TIME type to TimestampType with time portion fixed regardless of timezone

[ https://issues.apache.org/jira/browse/SPARK-34357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278776#comment-17278776 ] Apache Spark commented on SPARK-34357: -- User 'saikocat' has created a pull request for this issue:

[jira] [Commented] (SPARK-34357) Revert JDBC SQL TIME type to TimestampType with time portion fixed regardless of timezone

[ https://issues.apache.org/jira/browse/SPARK-34357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278775#comment-17278775 ] Apache Spark commented on SPARK-34357: -- User 'saikocat' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34357) Revert JDBC SQL TIME type to TimestampType with time portion fixed regardless of timezone

[ https://issues.apache.org/jira/browse/SPARK-34357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34357: Assignee: (was: Apache Spark) > Revert JDBC SQL TIME type to TimestampType with time

[jira] [Assigned] (SPARK-34357) Revert JDBC SQL TIME type to TimestampType with time portion fixed regardless of timezone

[ https://issues.apache.org/jira/browse/SPARK-34357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34357: Assignee: Apache Spark > Revert JDBC SQL TIME type to TimestampType with time portion

[jira] [Created] (SPARK-34357) Revert JDBC SQL TIME type to TimestampType with time portion fixed regardless of timezone

Duc Hoa Nguyen created SPARK-34357: -- Summary: Revert JDBC SQL TIME type to TimestampType with time portion fixed regardless of timezone Key: SPARK-34357 URL: https://issues.apache.org/jira/browse/SPARK-34357

[jira] [Commented] (SPARK-34356) OVR transform fix potential column conflict

[ https://issues.apache.org/jira/browse/SPARK-34356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278750#comment-17278750 ] Apache Spark commented on SPARK-34356: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-34356) OVR transform fix potential column conflict

[ https://issues.apache.org/jira/browse/SPARK-34356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34356: Assignee: Apache Spark (was: zhengruifeng) > OVR transform fix potential column

[jira] [Assigned] (SPARK-34356) OVR transform fix potential column conflict

[ https://issues.apache.org/jira/browse/SPARK-34356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34356: Assignee: zhengruifeng (was: Apache Spark) > OVR transform fix potential column

[jira] [Commented] (SPARK-34356) OVR transform fix potential column conflict

[ https://issues.apache.org/jira/browse/SPARK-34356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278749#comment-17278749 ] Apache Spark commented on SPARK-34356: -- User 'zhengruifeng' has created a pull request for this

[jira] [Updated] (SPARK-34356) OVR transform fix potential column conflict

[ https://issues.apache.org/jira/browse/SPARK-34356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-34356: - Summary: OVR transform fix potential column conflict (was: OVR transform avoid potential

[jira] [Assigned] (SPARK-34356) OVR transform avoid potential column conflict

[ https://issues.apache.org/jira/browse/SPARK-34356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-34356: Assignee: zhengruifeng > OVR transform avoid potential column conflict >

[jira] [Created] (SPARK-34356) OVR transform avoid potential column conflict

zhengruifeng created SPARK-34356: Summary: OVR transform avoid potential column conflict Key: SPARK-34356 URL: https://issues.apache.org/jira/browse/SPARK-34356 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-34355) Add log and time cost for commit job

[ https://issues.apache.org/jira/browse/SPARK-34355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34355: Assignee: (was: Apache Spark) > Add log and time cost for commit job >

[jira] [Assigned] (SPARK-34355) Add log and time cost for commit job

[ https://issues.apache.org/jira/browse/SPARK-34355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34355: Assignee: Apache Spark > Add log and time cost for commit job >

  1   2   >