[jira] [Updated] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-36494: Description: Create two tables in spark like this: {code:java} CREATE TABLE catalog_sales (

[jira] [Updated] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-36494: Description: Create two tables in spark like this: {code:java} CREATE TABLE catalog_sales (

[jira] [Created] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread zengrui (Jira)
zengrui created SPARK-36494: --- Summary: SortMergeJoin do unnecessary shuffle for tables whose provider is hive Key: SPARK-36494 URL: https://issues.apache.org/jira/browse/SPARK-36494 Project: Spark

[jira] [Updated] (SPARK-27396) SPIP: Public APIs for extended Columnar Processing Support

2021-07-11 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-27396: Description: *strong text**SPIP: Columnar Processing Without Arrow Formatting Guarantees.*   *Q1.* What

[jira] [Created] (SPARK-35893) No Unit Test case for MySQLDialect.getCatalystType

2021-06-25 Thread zengrui (Jira)
zengrui created SPARK-35893: --- Summary: No Unit Test case for MySQLDialect.getCatalystType Key: SPARK-35893 URL: https://issues.apache.org/jira/browse/SPARK-35893 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-35892) numPartitions does not work when saves the RDD to database

2021-06-25 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-35892: Description: When use SQL to insert data in spark to database, suppose the original RDD's partition num

[jira] [Created] (SPARK-35892) numPartitions does not work when saves the RDD to database

2021-06-25 Thread zengrui (Jira)
zengrui created SPARK-35892: --- Summary: numPartitions does not work when saves the RDD to database Key: SPARK-35892 URL: https://issues.apache.org/jira/browse/SPARK-35892 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-35067) Test case for function COALESCE() does not cover the CodeGen support

2021-06-24 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui resolved SPARK-35067. - Resolution: Won't Fix > Test case for function COALESCE() does not cover the CodeGen support >

[jira] [Created] (SPARK-35851) Wrong variable used in function GraphGenerators.sampleLogNormal

2021-06-21 Thread zengrui (Jira)
zengrui created SPARK-35851: --- Summary: Wrong variable used in function GraphGenerators.sampleLogNormal Key: SPARK-35851 URL: https://issues.apache.org/jira/browse/SPARK-35851 Project: Spark Issue

[jira] [Updated] (SPARK-35067) Test case for function COALESCE() does not coverage the CodeGen support

2021-04-14 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-35067: Description: The test case in org.apache.spark.sql.SQLQuerySuite named "Add Parser of SQL COALESCE" does

[jira] [Updated] (SPARK-35067) Test case for function COALESCE() does not cover the CodeGen support

2021-04-14 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-35067: Summary: Test case for function COALESCE() does not cover the CodeGen support (was: Test case for

[jira] [Created] (SPARK-35067) Test case for function COALESCE() does not coverage the CodeGen support

2021-04-14 Thread zengrui (Jira)
zengrui created SPARK-35067: --- Summary: Test case for function COALESCE() does not coverage the CodeGen support Key: SPARK-35067 URL: https://issues.apache.org/jira/browse/SPARK-35067 Project: Spark

[jira] [Updated] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-34760: Description: run JavaSparkSQLExample failed with Exception in runBasicDataSourceExample(). when excecute

[jira] [Updated] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-34760: Summary: run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample(). (was: run

[jira] [Created] (SPARK-34760) run JavaSparkSQLExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread zengrui (Jira)
zengrui created SPARK-34760: --- Summary: run JavaSparkSQLExample failed with Exception in runBasicDataSourceExample(). Key: SPARK-34760 URL: https://issues.apache.org/jira/browse/SPARK-34760 Project: Spark

[jira] [Created] (SPARK-34759) run JavaSparkSQLExample failed with Exception.

2021-03-16 Thread zengrui (Jira)
zengrui created SPARK-34759: --- Summary: run JavaSparkSQLExample failed with Exception. Key: SPARK-34759 URL: https://issues.apache.org/jira/browse/SPARK-34759 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29799) Split a kafka partition into multiple KafkaRDD partitions in the kafka external plugin for Spark Streaming

2019-11-09 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-29799: Attachment: 0001-add-implementation-for-issue-SPARK-29799.patch > Split a kafka partition into multiple

[jira] [Updated] (SPARK-29791) Add a spark config to allow user to use executor cores virtually.

2019-11-09 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-29791: Attachment: 0001-add-implementation-for-issue-SPARK-29791.patch > Add a spark config to allow user to use

[jira] [Created] (SPARK-29799) Split a kafka partition into multiple KafkaRDD partitions in the kafka external plugin for Spark Streaming

2019-11-07 Thread zengrui (Jira)
zengrui created SPARK-29799: --- Summary: Split a kafka partition into multiple KafkaRDD partitions in the kafka external plugin for Spark Streaming Key: SPARK-29799 URL: https://issues.apache.org/jira/browse/SPARK-29799

[jira] [Updated] (SPARK-29791) Add a spark config to allow user to use executor cores virtually.

2019-11-07 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-29791: Description: We can config the executor cores by "spark.executor.cores". For example, if we config 8

[jira] [Created] (SPARK-29791) Add a spark config to allow user to use executor cores virtually.

2019-11-07 Thread zengrui (Jira)
zengrui created SPARK-29791: --- Summary: Add a spark config to allow user to use executor cores virtually. Key: SPARK-29791 URL: https://issues.apache.org/jira/browse/SPARK-29791 Project: Spark