[jira] [Updated] (SPARK-42478) Make a serializable jobTrackerId instead of a non-serializable JobID in FileWriterFactory

2023-02-17 Thread Yi kaifei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-42478: -- Description: https://issues.apache.org/jira/browse/SPARK-41448 make consistent MR job IDs in FileBatch

[jira] [Created] (SPARK-42478) Make a serializable jobTrackerId instead of a non-serializable JobID in FileWriterFactory

2023-02-17 Thread Yi kaifei (Jira)
Yi kaifei created SPARK-42478: - Summary: Make a serializable jobTrackerId instead of a non-serializable JobID in FileWriterFactory Key: SPARK-42478 URL: https://issues.apache.org/jira/browse/SPARK-42478 P

[jira] [Updated] (SPARK-42288) Expose file path if reading failed

2023-02-01 Thread Yi kaifei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-42288: -- Description: `MalformedInputException` may be thrown because the decompression failed when reading th

[jira] [Updated] (SPARK-42288) Expose file path if reading failed

2023-02-01 Thread Yi kaifei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-42288: -- Description: `MalformedInputException` may be thrown because the decompression failed when reading th

[jira] [Created] (SPARK-42288) Expose file path if reading failed

2023-02-01 Thread Yi kaifei (Jira)
Yi kaifei created SPARK-42288: - Summary: Expose file path if reading failed Key: SPARK-42288 URL: https://issues.apache.org/jira/browse/SPARK-42288 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-41259) Spark-sql cli query results should correspond to schema

2022-11-24 Thread Yi kaifei (Jira)
Yi kaifei created SPARK-41259: - Summary: Spark-sql cli query results should correspond to schema Key: SPARK-41259 URL: https://issues.apache.org/jira/browse/SPARK-41259 Project: Spark Issue Type:

[jira] [Updated] (SPARK-40207) Specify the column name when the data type is not supported by datasource

2022-08-24 Thread Yi kaifei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-40207: -- Description: Currently, If the data type is not supported by the data source, the exception message th

[jira] [Created] (SPARK-40207) Specify the column name when the data type is not supported by datasource

2022-08-24 Thread Yi kaifei (Jira)
Yi kaifei created SPARK-40207: - Summary: Specify the column name when the data type is not supported by datasource Key: SPARK-40207 URL: https://issues.apache.org/jira/browse/SPARK-40207 Project: Spark

[jira] [Updated] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

2022-08-16 Thread Yi kaifei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-40102: -- Description: This pr aims to use SparkException instead of IllegalStateException in SparkPlan, for det

[jira] [Updated] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

2022-08-16 Thread Yi kaifei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-40102: -- Description: This pr aims to  > Use SparkException instead of IllegalStateException in SparkPlan > ---

[jira] [Created] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

2022-08-16 Thread Yi kaifei (Jira)
Yi kaifei created SPARK-40102: - Summary: Use SparkException instead of IllegalStateException in SparkPlan Key: SPARK-40102 URL: https://issues.apache.org/jira/browse/SPARK-40102 Project: Spark I

[jira] [Updated] (SPARK-39841) Simplify conflict binary comparison

2022-07-22 Thread Yi kaifei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-39841: -- Description: Currently, We do not handle conflicting binary comparison expressions, Let's say have a

[jira] [Updated] (SPARK-39841) Simplify conflict binary comparison

2022-07-22 Thread Yi kaifei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-39841: -- Attachment: image-2022-07-22-19-24-46-068.png > Simplify conflict binary comparison >

[jira] [Updated] (SPARK-39841) Simplify conflict binary comparison

2022-07-22 Thread Yi kaifei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-39841: -- Description: Currently, We do not handle conflicting binary comparison expressions, such as follow:

[jira] [Created] (SPARK-39841) Simplify conflict binary comparison

2022-07-22 Thread Yi kaifei (Jira)
Yi kaifei created SPARK-39841: - Summary: Simplify conflict binary comparison Key: SPARK-39841 URL: https://issues.apache.org/jira/browse/SPARK-39841 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-39841) Simplify conflict binary comparison

2022-07-22 Thread Yi kaifei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-39841: -- Attachment: image-2022-07-22-19-23-55-452.png > Simplify conflict binary comparison >

[jira] [Commented] (SPARK-39797) Add v2 implementation for hive table

2022-07-17 Thread Yi kaifei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567639#comment-17567639 ] Yi kaifei commented on SPARK-39797: --- kindly ping [~cloud_fan] , Do we plan to implemen

[jira] [Created] (SPARK-39797) Add v2 implementation for hive table

2022-07-17 Thread Yi kaifei (Jira)
Yi kaifei created SPARK-39797: - Summary: Add v2 implementation for hive table Key: SPARK-39797 URL: https://issues.apache.org/jira/browse/SPARK-39797 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-39765) Logging the exception of detect jdbc table exist

2022-07-13 Thread Yi kaifei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-39765: -- Description: Logging the exception of detect jdbc table exist in `JdbcUtils.tableExists` (was: This m

[jira] [Created] (SPARK-39765) Logging the exception of detect jdbc table exist

2022-07-13 Thread Yi kaifei (Jira)
Yi kaifei created SPARK-39765: - Summary: Logging the exception of detect jdbc table exist Key: SPARK-39765 URL: https://issues.apache.org/jira/browse/SPARK-39765 Project: Spark Issue Type: Improv

[jira] [Created] (SPARK-39741) Support url encode/decode as built-in function

2022-07-11 Thread Yi kaifei (Jira)
Yi kaifei created SPARK-39741: - Summary: Support url encode/decode as built-in function Key: SPARK-39741 URL: https://issues.apache.org/jira/browse/SPARK-39741 Project: Spark Issue Type: New Feat