[jira] [Comment Edited] (SPARK-48286) Analyze 'exists' default expression instead of 'current' default expression in structField to v2 column conversion

2024-06-11 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852984#comment-17852984 ] melin edited comment on SPARK-48286 at 6/11/24 2:51 PM:

[jira] [Comment Edited] (SPARK-48286) Analyze 'exists' default expression instead of 'current' default expression in structField to v2 column conversion

2024-06-11 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852984#comment-17852984 ] melin edited comment on SPARK-48286 at 6/11/24 2:51 PM:

[jira] [Commented] (SPARK-48286) Analyze 'exists' default expression instead of 'current' default expression in structField to v2 column conversion

2024-06-06 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852984#comment-17852984 ] melin commented on SPARK-48286: --- defaultValueNotConstantError method not exists > Analyze 'exists'

[jira] [Updated] (SPARK-48450) Support Jdbc datasource custom data partitioning

2024-05-28 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-48450: -- Description: "partitionColumn, lowerBound, upperBound" is not an efficient table partitioning scheme for

[jira] [Updated] (SPARK-48450) Support Jdbc datasource custom data partitioning

2024-05-28 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-48450: -- Description: "partitionColumn, lowerBound, upperBound" is not an efficient table partitioning scheme for

[jira] [Created] (SPARK-48404) Driver and Executor support merge and run in a single jvm

2024-05-23 Thread melin (Jira)
melin created SPARK-48404: - Summary: Driver and Executor support merge and run in a single jvm Key: SPARK-48404 URL: https://issues.apache.org/jira/browse/SPARK-48404 Project: Spark Issue Type:

[jira] [Created] (SPARK-47389) spark jdbc one insert with multiple values

2024-03-14 Thread melin (Jira)
melin created SPARK-47389: - Summary: spark jdbc one insert with multiple values Key: SPARK-47389 URL: https://issues.apache.org/jira/browse/SPARK-47389 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-47198) Is it possible to dynamically add backend service to ingress with Kubernetes?

2024-02-29 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47198: -- Description: spark on k8s runs multiple spark apps at the same time. proxy/[sparkappid] path, forwarding to

[jira] [Updated] (SPARK-47198) Is it possible to dynamically add backend service to ingress with Kubernetes?

2024-02-27 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47198: -- Description: spark on k8s runs multiple spark apps at the same time. proxy/[sparkappid] path, forwarding to

[jira] [Created] (SPARK-47198) Is it possible to dynamically add backend service to ingress with Kubernetes?

2024-02-27 Thread melin (Jira)
melin created SPARK-47198: - Summary: Is it possible to dynamically add backend service to ingress with Kubernetes? Key: SPARK-47198 URL: https://issues.apache.org/jira/browse/SPARK-47198 Project: Spark

[jira] [Resolved] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

2024-02-27 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin resolved SPARK-47114. --- Resolution: Resolved > In the spark driver pod. Failed to access the krb5 file >

[jira] [Commented] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

2024-02-27 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821469#comment-17821469 ] melin commented on SPARK-47114: --- 默认jre17 不支持kerberos,换成jdk  > In the spark driver pod. Failed to access

[jira] [Updated] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

2024-02-21 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47114: -- Description: spark runs in kubernetes and accesses an external hdfs cluster (kerberos),pod error logs

[jira] [Updated] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

2024-02-20 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47114: -- Description: spark runs in kubernetes and accesses an external hdfs cluster (kerberos),pod error logs

[jira] [Updated] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

2024-02-20 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47114: -- Description: spark runs in kubernetes and accesses an external hdfs cluster (kerberos),pod error logs

[jira] [Updated] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

2024-02-20 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47114: -- Description: spark runs in kubernetes and accesses an external hdfs cluster (kerberos),pod error logs

[jira] [Created] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

2024-02-20 Thread melin (Jira)
melin created SPARK-47114: - Summary: In the spark driver pod. Failed to access the krb5 file Key: SPARK-47114 URL: https://issues.apache.org/jira/browse/SPARK-47114 Project: Spark Issue Type: New

[jira] [Created] (SPARK-46572) [SQL][Enhancement] hint enhancement

2024-01-02 Thread melin (Jira)
melin created SPARK-46572: - Summary: [SQL][Enhancement] hint enhancement Key: SPARK-46572 URL: https://issues.apache.org/jira/browse/SPARK-46572 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-12-26 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43338: -- Description: {code:java} private[sql] object CatalogManager { val SESSION_CATALOG_NAME: String =

[jira] [Updated] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-12-26 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43338: -- Attachment: image-2023-12-27-09-55-55-693.png > Support modify the SESSION_CATALOG_NAME value >

[jira] [Updated] (SPARK-46518) Support for copy from write compatible postgresql databases (pg, redshift, snowflake, gauss)

2023-12-26 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-46518: -- Description: Now many databases are compatible with pg syntax and support copy from syntax. The copy form

[jira] [Updated] (SPARK-46518) Support for copy from write compatible postgresql databases (pg, redshift, snowflake, gauss)

2023-12-26 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-46518: -- Attachment: image-2023-12-27-09-44-19-292.png > Support for copy from write compatible postgresql databases

[jira] [Created] (SPARK-46518) Support for copy from write compatible postgresql databases (pg, redshift, snowflake, gauss)

2023-12-26 Thread melin (Jira)
melin created SPARK-46518: - Summary: Support for copy from write compatible postgresql databases (pg, redshift, snowflake, gauss) Key: SPARK-46518 URL: https://issues.apache.org/jira/browse/SPARK-46518

[jira] [Resolved] (SPARK-46511) Optimize spark jdbc write speed with Multi-Row Inserts

2023-12-26 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin resolved SPARK-46511. --- Resolution: Fixed > Optimize spark jdbc write speed with Multi-Row Inserts >

[jira] [Updated] (SPARK-46511) Optimize spark jdbc write speed with Multi-Row Inserts

2023-12-25 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-46511: -- Description: [https://brian.pontarelli.com/2011/06/21/jdbc-batch-vs-multi-row-inserts/] mysql, pg、Oracle

[jira] [Updated] (SPARK-46511) Optimize spark jdbc write speed with Multi-Row Inserts

2023-12-25 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-46511: -- Description: [https://brian.pontarelli.com/2011/06/21/jdbc-batch-vs-multi-row-inserts/] mysql, pg、Oracle

[jira] [Created] (SPARK-46511) Optimize spark jdbc write speed with Multi-Row Inserts

2023-12-25 Thread melin (Jira)
melin created SPARK-46511: - Summary: Optimize spark jdbc write speed with Multi-Row Inserts Key: SPARK-46511 URL: https://issues.apache.org/jira/browse/SPARK-46511 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-12-14 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17796975#comment-17796975 ] melin commented on SPARK-43338: --- [~yao]   databricks support change:   

[jira] [Created] (SPARK-46195) Supports parse multiple sql statements

2023-11-30 Thread melin (Jira)
melin created SPARK-46195: - Summary: Supports parse multiple sql statements Key: SPARK-46195 URL: https://issues.apache.org/jira/browse/SPARK-46195 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-45818) Support columnar/vectorized evaluation engine JDK17/21

2023-11-07 Thread melin (Jira)
melin created SPARK-45818: - Summary: Support columnar/vectorized evaluation engine JDK17/21 Key: SPARK-45818 URL: https://issues.apache.org/jira/browse/SPARK-45818 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-45140) Support ddl output json format

2023-09-12 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764488#comment-17764488 ] melin commented on SPARK-45140: --- We have a product that uses jdbc to collect metadata from various

[jira] [Updated] (SPARK-45140) Support ddl output json format

2023-09-12 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-45140: -- Description: hive supports ddl output json format. set hive.ddl.output.format=json; hive table metadata is

[jira] [Updated] (SPARK-45140) Support ddl output json format

2023-09-12 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-45140: -- Description: hive supports ddl output json format. set hive.ddl.output.format=json; hive table metadata is

[jira] [Updated] (SPARK-45140) Support ddl output json format

2023-09-12 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-45140: -- Environment:         was: hive supports ddl output json format. set hive.ddl.output.format=json; hive

[jira] [Created] (SPARK-45140) Support ddl output json format

2023-09-12 Thread melin (Jira)
melin created SPARK-45140: - Summary: Support ddl output json format Key: SPARK-45140 URL: https://issues.apache.org/jira/browse/SPARK-45140 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-07-17 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17743701#comment-17743701 ] melin commented on SPARK-43338: --- [~yao] Would consider setting a custom catalog name?  example:

[jira] [Created] (SPARK-44015) Support SIMILAR TO operator

2023-06-09 Thread melin (Jira)
melin created SPARK-44015: - Summary: Support SIMILAR TO operator Key: SPARK-44015 URL: https://issues.apache.org/jira/browse/SPARK-44015 Project: Spark Issue Type: New Feature Components:

[jira] [Created] (SPARK-44014) Support BETWEEN SYMMETRIC operator

2023-06-09 Thread melin (Jira)
melin created SPARK-44014: - Summary: Support BETWEEN SYMMETRIC operator Key: SPARK-44014 URL: https://issues.apache.org/jira/browse/SPARK-44014 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-43776) [BUG] MySQL jdbc cursor has not taken effect

2023-05-29 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727226#comment-17727226 ] melin commented on SPARK-43776: --- mysql jdbc stream read data, need to set

[jira] [Updated] (SPARK-43805) Support SELECT * EXCEPT AND SELECT * REPLACE

2023-05-25 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43805: -- Description: ref: [https://cloud.google.com/bigquery/docs/reference/standard-sql/query-syntax#select_except]

[jira] [Updated] (SPARK-43805) Support SELECT * EXCEPT AND SELECT * REPLACE

2023-05-25 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43805: -- Description: ref: [https://cloud.google.com/bigquery/docs/reference/standard-sql/query-syntax#select_except]

[jira] [Created] (SPARK-43805) Support SELECT * EXCEPT AND SELECT * REPLACE

2023-05-25 Thread melin (Jira)
melin created SPARK-43805: - Summary: Support SELECT * EXCEPT AND SELECT * REPLACE Key: SPARK-43805 URL: https://issues.apache.org/jira/browse/SPARK-43805 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-43776) [BUG] MySQL jdbc cursor has not taken effect

2023-05-24 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43776: -- Description: JDBCRDD.scala:  stmt.setFetchSize(options.fetchSize)   JdbcRDD.scala: {code:java} if

[jira] [Created] (SPARK-43776) [BUG] MySQL jdbc cursor has not taken effect

2023-05-24 Thread melin (Jira)
melin created SPARK-43776: - Summary: [BUG] MySQL jdbc cursor has not taken effect Key: SPARK-43776 URL: https://issues.apache.org/jira/browse/SPARK-43776 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-43776) [BUG] MySQL jdbc cursor has not taken effect

2023-05-24 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43776: -- Description: JDBCRDD.scala:  stmt.setFetchSize(options.fetchSize)   JdbcRDD.scala: {code:java} if

[jira] [Created] (SPARK-43748) Support DISTINCT ON

2023-05-23 Thread melin (Jira)
melin created SPARK-43748: - Summary: Support DISTINCT ON Key: SPARK-43748 URL: https://issues.apache.org/jira/browse/SPARK-43748 Project: Spark Issue Type: New Feature Components: SQL

[jira] [Commented] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-05-22 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724942#comment-17724942 ] melin commented on SPARK-43338: --- kyuubi verified it:

[jira] [Commented] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-05-22 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724933#comment-17724933 ] melin commented on SPARK-43338: --- I don't need to access multiple hms in the same sparksession, I only need

[jira] [Updated] (SPARK-37351) Supports write data flow control

2023-05-22 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-37351: -- Description: The hive table data is written to a relational database, generally an online production

[jira] [Updated] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-05-22 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43338: -- Description: {code:java} private[sql] object CatalogManager { val SESSION_CATALOG_NAME: String =

[jira] [Created] (SPARK-43521) Support CREATE TABLE LIKE FILE for PARQUET

2023-05-16 Thread melin (Jira)
melin created SPARK-43521: - Summary: Support CREATE TABLE LIKE FILE for PARQUET Key: SPARK-43521 URL: https://issues.apache.org/jira/browse/SPARK-43521 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-43400) Add Primary Key syntax support

2023-05-10 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43400: -- Summary: Add Primary Key syntax support (was: create table support the PRIMARY KEY keyword) > Add Primary

[jira] [Comment Edited] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-05-09 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720831#comment-17720831 ] melin edited comment on SPARK-43338 at 5/9/23 7:38 AM: --- If the same hive database

[jira] [Commented] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-05-09 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720831#comment-17720831 ] melin commented on SPARK-43338: --- If the same hive database has parquet and hudi table, does

[jira] [Commented] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-05-09 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720794#comment-17720794 ] melin commented on SPARK-43338: --- You understand a big feature. Only one hms is accessed in a sparksession.

[jira] [Updated] (SPARK-43400) create table support the PRIMARY KEY keyword

2023-05-08 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43400: -- Description: apache paimon and hudi support primary key definitions. It is necessary to support the primary

[jira] [Updated] (SPARK-43400) create table support the PRIMARY KEY keyword

2023-05-08 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43400: -- Description: apache paimon and hudi support primary key definitions. It is necessary to support the primary

[jira] [Created] (SPARK-43400) create table support the PRIMARY KEY keyword

2023-05-07 Thread melin (Jira)
melin created SPARK-43400: - Summary: create table support the PRIMARY KEY keyword Key: SPARK-43400 URL: https://issues.apache.org/jira/browse/SPARK-43400 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-43382) Read and write csv and json files. Archive files such as zip or gz are supported

2023-05-07 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720110#comment-17720110 ] melin edited comment on SPARK-43382 at 5/7/23 8:35 AM: --- There is an idea to

[jira] [Comment Edited] (SPARK-43382) Read and write csv and json files. Archive files such as zip or gz are supported

2023-05-07 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720110#comment-17720110 ] melin edited comment on SPARK-43382 at 5/7/23 8:34 AM: --- There is an idea to

[jira] [Updated] (SPARK-43382) Read and write csv and json files. Archive files such as zip or gz are supported

2023-05-07 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43382: -- Description: snowflake data import and export, support fixed files. For example:   {code:java} COPY INTO

[jira] [Comment Edited] (SPARK-43382) Read and write csv and json files. Archive files such as zip or gz are supported

2023-05-06 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720110#comment-17720110 ] melin edited comment on SPARK-43382 at 5/6/23 3:57 PM: --- There is an idea to

[jira] [Comment Edited] (SPARK-43382) Read and write csv and json files. Archive files such as zip or gz are supported

2023-05-06 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720110#comment-17720110 ] melin edited comment on SPARK-43382 at 5/6/23 3:57 PM: --- There is an idea to

[jira] [Commented] (SPARK-43382) Read and write csv and json files. Archive files such as zip or gz are supported

2023-05-06 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720110#comment-17720110 ] melin commented on SPARK-43382: --- There is an idea to customize the hadoop filesystem based on common vfs.

[jira] [Updated] (SPARK-43382) Read and write csv and json files. Archive files such as zip or gz are supported

2023-05-05 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43382: -- Description: snowflake data import and export, support fixed files. For example:   {code:java} COPY INTO

[jira] [Updated] (SPARK-43382) Read and write csv and json files. Archive files such as zip or gz are supported

2023-05-05 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43382: -- Description: snowflake data import and export, support fixed files. For example:   {code:java} COPY INTO

[jira] [Updated] (SPARK-43382) Read and write csv and json files. Archive files such as zip or gz are supported

2023-05-05 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43382: -- Environment: (was: snowflake data import and export, support fixed files. For example:   {code:java}

[jira] [Created] (SPARK-43382) Read and write csv and json files. Archive files such as zip or gz are supported

2023-05-05 Thread melin (Jira)
melin created SPARK-43382: - Summary: Read and write csv and json files. Archive files such as zip or gz are supported Key: SPARK-43382 URL: https://issues.apache.org/jira/browse/SPARK-43382 Project: Spark

[jira] [Updated] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-05-04 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43338: -- Description: {code:java} private[sql] object CatalogManager { val SESSION_CATALOG_NAME: String =

[jira] [Updated] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-05-02 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43338: -- Description: {code:java} private[sql] object CatalogManager { val SESSION_CATALOG_NAME: String =

[jira] [Created] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-05-02 Thread melin (Jira)
melin created SPARK-43338: - Summary: Support modify the SESSION_CATALOG_NAME value Key: SPARK-43338 URL: https://issues.apache.org/jira/browse/SPARK-43338 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-43318) spark reader csv and json support wholetext parameters

2023-04-28 Thread melin (Jira)
melin created SPARK-43318: - Summary: spark reader csv and json support wholetext parameters Key: SPARK-43318 URL: https://issues.apache.org/jira/browse/SPARK-43318 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-43101) Add CREATE/DROP catalog

2023-04-12 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43101: -- Description: Convenient registration of the catalog, in sts ref:

[jira] [Updated] (SPARK-43101) Dynamic Catalogs

2023-04-12 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43101: -- Summary: Dynamic Catalogs (was: Add CREATE/DROP catalog ) > Dynamic Catalogs > > >

[jira] [Updated] (SPARK-43101) Add CREATE/DROP catalog

2023-04-12 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-43101: -- Description: Convenient registration of the catalog, in sts ref:

[jira] [Created] (SPARK-43101) Add CREATE/DROP catalog

2023-04-11 Thread melin (Jira)
melin created SPARK-43101: - Summary: Add CREATE/DROP catalog Key: SPARK-43101 URL: https://issues.apache.org/jira/browse/SPARK-43101 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert

2023-04-06 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17709588#comment-17709588 ] melin commented on SPARK-38200: --- [~beliefer]  MERGE INTO is a standard sql:

[jira] [Created] (SPARK-43060) [SQL] Spark JDBC rate limitation

2023-04-06 Thread melin (Jira)
melin created SPARK-43060: - Summary: [SQL] Spark JDBC rate limitation Key: SPARK-43060 URL: https://issues.apache.org/jira/browse/SPARK-43060 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert

2023-04-06 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-38200: -- Description: upsert sql for different databases, Most databases support merge sql: sqlserver merge into sql

[jira] [Updated] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert

2023-04-06 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-38200: -- Description: upsert sql for different databases, Most databases support merge sql: sqlserver merge into sql

[jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-04-06 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-42627: -- Description:   {code:java} Exception in thread "main" org.apache.spark.SparkSQLException: Unrecognized SQL

[jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-04-02 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-42627: -- Description:   {code:java} Exception in thread "main" org.apache.spark.SparkSQLException: Unrecognized SQL

[jira] [Comment Edited] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-04-02 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707619#comment-17707619 ] melin edited comment on SPARK-42627 at 4/2/23 6:50 AM: --- not support type:

[jira] [Commented] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-04-02 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707619#comment-17707619 ] melin commented on SPARK-42627: --- not support type: TIMESTAMP (3) WITH LOCAL TIME ZONE NOT NULL ENABLE  

[jira] [Updated] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert

2023-04-02 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-38200: -- Description: upsert sql for different databases, Most databases support merge sql: sqlserver merge into sql

[jira] [Updated] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert

2023-03-27 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-38200: -- Description: upsert sql for different databases, Most databases support merge sql: sqlserver merge into sql

[jira] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert

2023-03-27 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200 ] melin deleted comment on SPARK-38200: --- was (Author: melin): upsert sql for different databases, Most databases support merge sql: sqlserver merge into sql :

[jira] [Updated] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert

2023-03-27 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-38200: -- Summary: [SQL] Spark JDBC Savemode Supports Upsert (was: [SQL] Spark JDBC Savemode Supports replace) >

[jira] [Comment Edited] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

2023-03-27 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705765#comment-17705765 ] melin edited comment on SPARK-38200 at 3/28/23 3:00 AM: upsert sql for different

[jira] [Commented] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

2023-03-27 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705765#comment-17705765 ] melin commented on SPARK-38200: --- upsert sql for different databases, Most databases support merge sql:

[jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-02-28 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-42627: -- Description:   {code:java} Exception in thread "main" org.apache.spark.SparkSQLException: Unrecognized SQL

[jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-02-28 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-42627: -- Description:   {code:java} Exception in thread "main" org.apache.spark.SparkSQLException: Unrecognized SQL

[jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-02-28 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-42627: -- Description:   {code:java} Exception in thread "main" org.apache.spark.SparkSQLException: Unrecognized SQL

[jira] [Created] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-02-28 Thread melin (Jira)
melin created SPARK-42627: - Summary: Spark: Getting SQLException: Unsupported type -102 reading from Oracle Key: SPARK-42627 URL: https://issues.apache.org/jira/browse/SPARK-42627 Project: Spark

[jira] [Created] (SPARK-40568) Spark Streaming support Debezium

2022-09-26 Thread melin (Jira)
melin created SPARK-40568: - Summary: Spark Streaming support Debezium Key: SPARK-40568 URL: https://issues.apache.org/jira/browse/SPARK-40568 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-40189) Support json_array_get/json_array_length function

2022-08-23 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17583473#comment-17583473 ] melin commented on SPARK-40189: --- [~maxgekk]  > Support json_array_get/json_array_length function >

[jira] [Resolved] (SPARK-40190) Support json_array_get and json_array_length function

2022-08-23 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin resolved SPARK-40190. --- Resolution: Duplicate > Support json_array_get and json_array_length function >

[jira] [Created] (SPARK-40190) Support json_array_get and json_array_length function

2022-08-23 Thread melin (Jira)
melin created SPARK-40190: - Summary: Support json_array_get and json_array_length function Key: SPARK-40190 URL: https://issues.apache.org/jira/browse/SPARK-40190 Project: Spark Issue Type:

[jira] [Created] (SPARK-40189) Support json_array_get/json_array_length function

2022-08-23 Thread melin (Jira)
melin created SPARK-40189: - Summary: Support json_array_get/json_array_length function Key: SPARK-40189 URL: https://issues.apache.org/jira/browse/SPARK-40189 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-40184) Support modify the comment of a partitioned column

2022-08-22 Thread melin (Jira)
melin created SPARK-40184: - Summary: Support modify the comment of a partitioned column Key: SPARK-40184 URL: https://issues.apache.org/jira/browse/SPARK-40184 Project: Spark Issue Type: Improvement

  1   2   >