[jira] [Created] (SPARK-48277) Improve error message for ErrorClassesJsonReader.getErrorMessage
Rui Wang created SPARK-48277: Summary: Improve error message for ErrorClassesJsonReader.getErrorMessage Key: SPARK-48277 URL: https://issues.apache.org/jira/browse/SPARK-48277 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47176) Have a ResolveAllExpressionsUpWithPruning helper function
Rui Wang created SPARK-47176: Summary: Have a ResolveAllExpressionsUpWithPruning helper function Key: SPARK-47176 URL: https://issues.apache.org/jira/browse/SPARK-47176 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-46740) Only convert to ParquetFileScan for normal Hive Parquet table
Rui Wang created SPARK-46740: Summary: Only convert to ParquetFileScan for normal Hive Parquet table Key: SPARK-46740 URL: https://issues.apache.org/jira/browse/SPARK-46740 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-46610) Create table should throw exception when no value for a key in options
Rui Wang created SPARK-46610: Summary: Create table should throw exception when no value for a key in options Key: SPARK-46610 URL: https://issues.apache.org/jira/browse/SPARK-46610 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-46600) Move shared code between SqlConf and SqlApiConf to another object
Rui Wang created SPARK-46600: Summary: Move shared code between SqlConf and SqlApiConf to another object Key: SPARK-46600 URL: https://issues.apache.org/jira/browse/SPARK-46600 Project: Spark Issue Type: Improvement Components: Connect, SQL Affects Versions: 4.0.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-46448) InlineTable column should be nullable when converted to Decimal might cause null
[ https://issues.apache.org/jira/browse/SPARK-46448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-46448: - Summary: InlineTable column should be nullable when converted to Decimal might cause null (was: InlineTable column should be nullable when converted to Decimal and overflow) > InlineTable column should be nullable when converted to Decimal might cause > null > > > Key: SPARK-46448 > URL: https://issues.apache.org/jira/browse/SPARK-46448 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 4.0.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-46448) InlineTable column should be nullable when converted to Decimal and overflow
Rui Wang created SPARK-46448: Summary: InlineTable column should be nullable when converted to Decimal and overflow Key: SPARK-46448 URL: https://issues.apache.org/jira/browse/SPARK-46448 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 4.0.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-46285) Add foreachWithSubqueries
Rui Wang created SPARK-46285: Summary: Add foreachWithSubqueries Key: SPARK-46285 URL: https://issues.apache.org/jira/browse/SPARK-46285 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-46145) spark.catalog.listTables does not throw exception when the table or view is not found
Rui Wang created SPARK-46145: Summary: spark.catalog.listTables does not throw exception when the table or view is not found Key: SPARK-46145 URL: https://issues.apache.org/jira/browse/SPARK-46145 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-45752) Unreferenced CTE should all be checked by CheckAnalysis0
Rui Wang created SPARK-45752: Summary: Unreferenced CTE should all be checked by CheckAnalysis0 Key: SPARK-45752 URL: https://issues.apache.org/jira/browse/SPARK-45752 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 4.0.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-45421) Catch AnalysisException over InlineCTE
Rui Wang created SPARK-45421: Summary: Catch AnalysisException over InlineCTE Key: SPARK-45421 URL: https://issues.apache.org/jira/browse/SPARK-45421 Project: Spark Issue Type: Task Components: SQL Affects Versions: 4.0.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-45242) Use DataFrame ID to semantically validate CollectMetrics
[ https://issues.apache.org/jira/browse/SPARK-45242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-45242. -- Fix Version/s: 4.0.0 Resolution: Fixed https://github.com/apache/spark/pull/43010 > Use DataFrame ID to semantically validate CollectMetrics > - > > Key: SPARK-45242 > URL: https://issues.apache.org/jira/browse/SPARK-45242 > Project: Spark > Issue Type: Task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-45242) Use DataFrame ID to semantically validate CollectMetrics
Rui Wang created SPARK-45242: Summary: Use DataFrame ID to semantically validate CollectMetrics Key: SPARK-45242 URL: https://issues.apache.org/jira/browse/SPARK-45242 Project: Spark Issue Type: Task Components: SQL Affects Versions: 4.0.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45012) CheckAnalysis should throw inlined plan in AnalysisException
[ https://issues.apache.org/jira/browse/SPARK-45012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-45012: - Affects Version/s: 4.0.0 (was: 3.5.0) > CheckAnalysis should throw inlined plan in AnalysisException > > > Key: SPARK-45012 > URL: https://issues.apache.org/jira/browse/SPARK-45012 > Project: Spark > Issue Type: Task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-45012) CheckAnalysis should throw inlined plan in AnalysisException
Rui Wang created SPARK-45012: Summary: CheckAnalysis should throw inlined plan in AnalysisException Key: SPARK-45012 URL: https://issues.apache.org/jira/browse/SPARK-45012 Project: Spark Issue Type: Task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44921) Remove SqlBaseLexer.tokens from codebase
Rui Wang created SPARK-44921: Summary: Remove SqlBaseLexer.tokens from codebase Key: SPARK-44921 URL: https://issues.apache.org/jira/browse/SPARK-44921 Project: Spark Issue Type: Task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-44258) Move Metadata to sql/api
[ https://issues.apache.org/jira/browse/SPARK-44258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-44258. -- Resolution: Fixed > Move Metadata to sql/api > > > Key: SPARK-44258 > URL: https://issues.apache.org/jira/browse/SPARK-44258 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-42887) Simple DataType interface
[ https://issues.apache.org/jira/browse/SPARK-42887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-42887. -- Resolution: Fixed > Simple DataType interface > - > > Key: SPARK-42887 > URL: https://issues.apache.org/jira/browse/SPARK-42887 > Project: Spark > Issue Type: Task > Components: SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > > This JIRA proposes to move non public API from existing DataType class to > make DataType become a simple interface. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44574) Errors that moved into sq/api should also use Analysis
Rui Wang created SPARK-44574: Summary: Errors that moved into sq/api should also use Analysis Key: SPARK-44574 URL: https://issues.apache.org/jira/browse/SPARK-44574 Project: Spark Issue Type: Sub-task Components: Connect, SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-44507) SCSC does not depend on AnalysisException
[ https://issues.apache.org/jira/browse/SPARK-44507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-44507. -- Resolution: Won't Fix > SCSC does not depend on AnalysisException > - > > Key: SPARK-44507 > URL: https://issues.apache.org/jira/browse/SPARK-44507 > Project: Spark > Issue Type: Sub-task > Components: Connect, SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44507) SCSC does not depend on AnalysisException
Rui Wang created SPARK-44507: Summary: SCSC does not depend on AnalysisException Key: SPARK-44507 URL: https://issues.apache.org/jira/browse/SPARK-44507 Project: Spark Issue Type: Sub-task Components: Connect, SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44496) Move Interfaces needed by SCSC to sql/api
Rui Wang created SPARK-44496: Summary: Move Interfaces needed by SCSC to sql/api Key: SPARK-44496 URL: https://issues.apache.org/jira/browse/SPARK-44496 Project: Spark Issue Type: Sub-task Components: Connect, SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44475) Relocate DataType and Parser to sql/api
Rui Wang created SPARK-44475: Summary: Relocate DataType and Parser to sql/api Key: SPARK-44475 URL: https://issues.apache.org/jira/browse/SPARK-44475 Project: Spark Issue Type: Sub-task Components: Connect, SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44326) Move utils that are used from Scala client to the common modules
Rui Wang created SPARK-44326: Summary: Move utils that are used from Scala client to the common modules Key: SPARK-44326 URL: https://issues.apache.org/jira/browse/SPARK-44326 Project: Spark Issue Type: Sub-task Components: Connect, SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44324) Move CaseInsensitiveMap to sql/api
Rui Wang created SPARK-44324: Summary: Move CaseInsensitiveMap to sql/api Key: SPARK-44324 URL: https://issues.apache.org/jira/browse/SPARK-44324 Project: Spark Issue Type: Sub-task Components: Connect, SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44315) Move DefinedByConstructorParams to sql/api
Rui Wang created SPARK-44315: Summary: Move DefinedByConstructorParams to sql/api Key: SPARK-44315 URL: https://issues.apache.org/jira/browse/SPARK-44315 Project: Spark Issue Type: Sub-task Components: Connect, SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-44281) Move QueryCompilation error that used by DataType to sql/api as DataTypeErrors
[ https://issues.apache.org/jira/browse/SPARK-44281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-44281. -- Resolution: Fixed > Move QueryCompilation error that used by DataType to sql/api as DataTypeErrors > -- > > Key: SPARK-44281 > URL: https://issues.apache.org/jira/browse/SPARK-44281 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-44281) Move QueryCompilation error that used by DataType to sql/api as DataTypeErrors
[ https://issues.apache.org/jira/browse/SPARK-44281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-44281: - Summary: Move QueryCompilation error that used by DataType to sql/api as DataTypeErrors (was: Move QueryCompilcation error that used by DataType to sql/api as DataTypeErrors) > Move QueryCompilation error that used by DataType to sql/api as DataTypeErrors > -- > > Key: SPARK-44281 > URL: https://issues.apache.org/jira/browse/SPARK-44281 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44281) Move QueryCompilcation error that used by DataType to sql/api as DataTypeErrors
Rui Wang created SPARK-44281: Summary: Move QueryCompilcation error that used by DataType to sql/api as DataTypeErrors Key: SPARK-44281 URL: https://issues.apache.org/jira/browse/SPARK-44281 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44274) Move out util functions used by ArtifactManager to common/utils
Rui Wang created SPARK-44274: Summary: Move out util functions used by ArtifactManager to common/utils Key: SPARK-44274 URL: https://issues.apache.org/jira/browse/SPARK-44274 Project: Spark Issue Type: Sub-task Components: Connect Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44273) Spark Connect Scala Client do not depend on Spark
Rui Wang created SPARK-44273: Summary: Spark Connect Scala Client do not depend on Spark Key: SPARK-44273 URL: https://issues.apache.org/jira/browse/SPARK-44273 Project: Spark Issue Type: Task Components: Connect Affects Versions: 3.5.0 Reporter: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44271) Move util functions from DataType to ResolveDefaultColumns
Rui Wang created SPARK-44271: Summary: Move util functions from DataType to ResolveDefaultColumns Key: SPARK-44271 URL: https://issues.apache.org/jira/browse/SPARK-44271 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-44261) Move QueryCompilationErrors to sql/api
[ https://issues.apache.org/jira/browse/SPARK-44261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739248#comment-17739248 ] Rui Wang commented on SPARK-44261: -- probably wait a bit for https://github.com/apache/spark/pull/41794 to be merged. > Move QueryCompilationErrors to sql/api > -- > > Key: SPARK-44261 > URL: https://issues.apache.org/jira/browse/SPARK-44261 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.5.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-44261) Move QueryCompilationErrors to sql/api
[ https://issues.apache.org/jira/browse/SPARK-44261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739247#comment-17739247 ] Rui Wang commented on SPARK-44261: -- I probably need to work on this one. I got a chance to talk to Wenchen how to deal with the LogicalPlan in the constructor. We do not want the logical plan to be moved. > Move QueryCompilationErrors to sql/api > -- > > Key: SPARK-44261 > URL: https://issues.apache.org/jira/browse/SPARK-44261 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.5.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-44266) Move Util.truncatedString to sql/api
[ https://issues.apache.org/jira/browse/SPARK-44266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-44266: - Summary: Move Util.truncatedString to sql/api (was: Move Util.truncatedString) > Move Util.truncatedString to sql/api > > > Key: SPARK-44266 > URL: https://issues.apache.org/jira/browse/SPARK-44266 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44266) Move Util.truncatedString
Rui Wang created SPARK-44266: Summary: Move Util.truncatedString Key: SPARK-44266 URL: https://issues.apache.org/jira/browse/SPARK-44266 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-44160) Extract shared code from StructType
[ https://issues.apache.org/jira/browse/SPARK-44160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-44160. -- Resolution: Won't Fix > Extract shared code from StructType > --- > > Key: SPARK-44160 > URL: https://issues.apache.org/jira/browse/SPARK-44160 > Project: Spark > Issue Type: Sub-task > Components: Connect, SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > > The StructType has some methods that require CatalystParser and Catalyst > expression. We are not planning to move the parser and expression to the > shared module thus needs to do code split to share as much as code as > possible between Scala client and Catalyst. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-42887) Simple DataType interface
[ https://issues.apache.org/jira/browse/SPARK-42887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739245#comment-17739245 ] Rui Wang commented on SPARK-42887: -- [~panbingkun] yes please! any help is very welcome! Basically I have been refactoring source code without thinking about tests. Are are a bunch of test cases should be moved as well. For example SparkThrowableSuite given that we have moved SparkThrowable to common/util. If you are interested, can you help move out those test case to the right modules? > Simple DataType interface > - > > Key: SPARK-42887 > URL: https://issues.apache.org/jira/browse/SPARK-42887 > Project: Spark > Issue Type: Task > Components: SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > > This JIRA proposes to move non public API from existing DataType class to > make DataType become a simple interface. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44258) Move Metadata to sql/api
Rui Wang created SPARK-44258: Summary: Move Metadata to sql/api Key: SPARK-44258 URL: https://issues.apache.org/jira/browse/SPARK-44258 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44255) Relocate StorageLevel to common/utils
Rui Wang created SPARK-44255: Summary: Relocate StorageLevel to common/utils Key: SPARK-44255 URL: https://issues.apache.org/jira/browse/SPARK-44255 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-44255) Relocate StorageLevel to common/utils
[ https://issues.apache.org/jira/browse/SPARK-44255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-44255: - Issue Type: Task (was: Bug) > Relocate StorageLevel to common/utils > - > > Key: SPARK-44255 > URL: https://issues.apache.org/jira/browse/SPARK-44255 > Project: Spark > Issue Type: Task > Components: SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44254) Move QueryExecutionErrors to sql/api
Rui Wang created SPARK-44254: Summary: Move QueryExecutionErrors to sql/api Key: SPARK-44254 URL: https://issues.apache.org/jira/browse/SPARK-44254 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44227) Extract SchemaUtils from StructField
Rui Wang created SPARK-44227: Summary: Extract SchemaUtils from StructField Key: SPARK-44227 URL: https://issues.apache.org/jira/browse/SPARK-44227 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44220) Move StringConcat to sql/api
Rui Wang created SPARK-44220: Summary: Move StringConcat to sql/api Key: SPARK-44220 URL: https://issues.apache.org/jira/browse/SPARK-44220 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44205) Extract catalyst code from DecimalType
Rui Wang created SPARK-44205: Summary: Extract catalyst code from DecimalType Key: SPARK-44205 URL: https://issues.apache.org/jira/browse/SPARK-44205 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44164) Extract toAttribute method from StructField to Util class
Rui Wang created SPARK-44164: Summary: Extract toAttribute method from StructField to Util class Key: SPARK-44164 URL: https://issues.apache.org/jira/browse/SPARK-44164 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-44160) Extract shared code from StructType
[ https://issues.apache.org/jira/browse/SPARK-44160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-44160: - Description: The StructType has some methods that require CatalystParser and Catalyst expression. We are not planning to move the parser and expression to the shared module thus needs to do code split to share as much as code as possible between Scala client and Catalyst. > Extract shared code from StructType > --- > > Key: SPARK-44160 > URL: https://issues.apache.org/jira/browse/SPARK-44160 > Project: Spark > Issue Type: Sub-task > Components: Connect, SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > > The StructType has some methods that require CatalystParser and Catalyst > expression. We are not planning to move the parser and expression to the > shared module thus needs to do code split to share as much as code as > possible between Scala client and Catalyst. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44160) Extract shared code from StructType
Rui Wang created SPARK-44160: Summary: Extract shared code from StructType Key: SPARK-44160 URL: https://issues.apache.org/jira/browse/SPARK-44160 Project: Spark Issue Type: Sub-task Components: Connect, SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-43891) Support SHOW VIEWS IN . when not is not the current selected catalog
[ https://issues.apache.org/jira/browse/SPARK-43891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735348#comment-17735348 ] Rui Wang commented on SPARK-43891: -- Sorry I am bit busy recently and will follow up on this ticket. > Support SHOW VIEWS IN . when not is not the > current selected catalog > --- > > Key: SPARK-43891 > URL: https://issues.apache.org/jira/browse/SPARK-43891 > Project: Spark > Issue Type: Task > Components: SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44082) Generate operator does not update reference set properly
Rui Wang created SPARK-44082: Summary: Generate operator does not update reference set properly Key: SPARK-44082 URL: https://issues.apache.org/jira/browse/SPARK-44082 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang Before ``` == Optimized Logical Plan == Project [col1#2, col2#19] +- Generate replicaterows(sum#17L, col1#2, col2#3), [2], false, [col1#2, col2#3] +- Filter (isnotnull(sum#17L) AND (sum#17L > 0)) +- Aggregate [col1#2, col2#19], [col1#2, col2#19, sum(vcol#14L) AS sum#17L] +- Union false, false :- Aggregate [col1#2], [1 AS vcol#14L, col1#2, first(col2#3, false) AS col2#19] : +- LogicalRDD [col1#2, col2#3], false +- Project [-1 AS vcol#15L, col1#8, col2#9] +- LogicalRDD [col1#8, col2#9], false ``` Couldn't find col2#3 in [col1#2,col2#19,sum#17L] after ``` == Optimized Logical Plan == Project [col1#2, col2#19] +- Generate replicaterows(sum#17L, col1#2, col2#19), [2], false, [col1#2, col2#19] +- Filter (isnotnull(sum#17L) AND (sum#17L > 0)) +- Aggregate [col1#2, col2#19], [col1#2, col2#19, sum(vcol#14L) AS sum#17L] +- Union false, false :- Aggregate [col1#2], [1 AS vcol#14L, col1#2, first(col2#3, false) AS col2#19] : +- LogicalRDD [col1#2, col2#3], false +- Project [-1 AS vcol#15L, col1#8, col2#9] +- LogicalRDD [col1#8, col2#9], false ``` -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-44030) Move out json and expression private methods from DataType
Rui Wang created SPARK-44030: Summary: Move out json and expression private methods from DataType Key: SPARK-44030 URL: https://issues.apache.org/jira/browse/SPARK-44030 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43979) CollectedMetrics should be treated as the same one for self-join
Rui Wang created SPARK-43979: Summary: CollectedMetrics should be treated as the same one for self-join Key: SPARK-43979 URL: https://issues.apache.org/jira/browse/SPARK-43979 Project: Spark Issue Type: Task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-43920) Create sql/api module
[ https://issues.apache.org/jira/browse/SPARK-43920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-43920: - Description: We need a sql/api module to host public API like DataType, Row, etc. This module can be shared between Catalyst and Spark Connect client so that client do not need to depend on Catalyst anymore. > Create sql/api module > - > > Key: SPARK-43920 > URL: https://issues.apache.org/jira/browse/SPARK-43920 > Project: Spark > Issue Type: Task > Components: Connect, SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > > We need a sql/api module to host public API like DataType, Row, etc. This > module can be shared between Catalyst and Spark Connect client so that client > do not need to depend on Catalyst anymore. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43920) Create sql/api module
Rui Wang created SPARK-43920: Summary: Create sql/api module Key: SPARK-43920 URL: https://issues.apache.org/jira/browse/SPARK-43920 Project: Spark Issue Type: Task Components: Connect, SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-43919) Extract JSON functionality out of Row
[ https://issues.apache.org/jira/browse/SPARK-43919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-43919: - Summary: Extract JSON functionality out of Row (was: Extract JSON functionality to Row) > Extract JSON functionality out of Row > -- > > Key: SPARK-43919 > URL: https://issues.apache.org/jira/browse/SPARK-43919 > Project: Spark > Issue Type: Task > Components: SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43919) Extract JSON functionality to Row
Rui Wang created SPARK-43919: Summary: Extract JSON functionality to Row Key: SPARK-43919 URL: https://issues.apache.org/jira/browse/SPARK-43919 Project: Spark Issue Type: Task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43891) Support SHOW VIEWS IN . when not is not the current selected catalog
Rui Wang created SPARK-43891: Summary: Support SHOW VIEWS IN . when not is not the current selected catalog Key: SPARK-43891 URL: https://issues.apache.org/jira/browse/SPARK-43891 Project: Spark Issue Type: Task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43888) Relocate Logging to common/utils
Rui Wang created SPARK-43888: Summary: Relocate Logging to common/utils Key: SPARK-43888 URL: https://issues.apache.org/jira/browse/SPARK-43888 Project: Spark Issue Type: Task Components: Spark Core Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43779) To_date should load the EvalMode in main thread
Rui Wang created SPARK-43779: Summary: To_date should load the EvalMode in main thread Key: SPARK-43779 URL: https://issues.apache.org/jira/browse/SPARK-43779 Project: Spark Issue Type: Task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-43779) ParseToDate should load the EvalMode in main thread
[ https://issues.apache.org/jira/browse/SPARK-43779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-43779: - Summary: ParseToDate should load the EvalMode in main thread (was: To_date should load the EvalMode in main thread) > ParseToDate should load the EvalMode in main thread > --- > > Key: SPARK-43779 > URL: https://issues.apache.org/jira/browse/SPARK-43779 > Project: Spark > Issue Type: Task > Components: SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-43265) Move Error framework to a common utils module
[ https://issues.apache.org/jira/browse/SPARK-43265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721850#comment-17721850 ] Rui Wang commented on SPARK-43265: -- [~LuciferYang] The eventual goal is that Spark Connect Scala client should not depend on Catalyst and Spark Core, etc. The reason we are moving stuff is those are what the Scala client needs. Because there too many dependencies at class/method level, it is hard to give a full list of stuff that we want to remove. I can just name a few like error framework, some utils, etc. > Move Error framework to a common utils module > - > > Key: SPARK-43265 > URL: https://issues.apache.org/jira/browse/SPARK-43265 > Project: Spark > Issue Type: Task > Components: SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43431) Spark Connect Scala Client should not expose `collectResult`
Rui Wang created SPARK-43431: Summary: Spark Connect Scala Client should not expose `collectResult` Key: SPARK-43431 URL: https://issues.apache.org/jira/browse/SPARK-43431 Project: Spark Issue Type: Task Components: Connect Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43428) Move some class utils to common/utils
Rui Wang created SPARK-43428: Summary: Move some class utils to common/utils Key: SPARK-43428 URL: https://issues.apache.org/jira/browse/SPARK-43428 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43265) Move Error framework to a common utils module
Rui Wang created SPARK-43265: Summary: Move Error framework to a common utils module Key: SPARK-43265 URL: https://issues.apache.org/jira/browse/SPARK-43265 Project: Spark Issue Type: Task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-43165) Move canWrite to DataTypeUtils
[ https://issues.apache.org/jira/browse/SPARK-43165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-43165: - Affects Version/s: 3.5.0 (was: 3.4.0) > Move canWrite to DataTypeUtils > -- > > Key: SPARK-43165 > URL: https://issues.apache.org/jira/browse/SPARK-43165 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.5.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43168) Remove get PhysicalDataType method from Datatype class
Rui Wang created SPARK-43168: Summary: Remove get PhysicalDataType method from Datatype class Key: SPARK-43168 URL: https://issues.apache.org/jira/browse/SPARK-43168 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43165) Move canWrite to DataTypeUtils
Rui Wang created SPARK-43165: Summary: Move canWrite to DataTypeUtils Key: SPARK-43165 URL: https://issues.apache.org/jira/browse/SPARK-43165 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43130) Move InternalType to PhysicalDataType
Rui Wang created SPARK-43130: Summary: Move InternalType to PhysicalDataType Key: SPARK-43130 URL: https://issues.apache.org/jira/browse/SPARK-43130 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43110) Move asIntegral to PhysicalDataType
Rui Wang created SPARK-43110: Summary: Move asIntegral to PhysicalDataType Key: SPARK-43110 URL: https://issues.apache.org/jira/browse/SPARK-43110 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43103) Move Integral to PhysicalDataType
Rui Wang created SPARK-43103: Summary: Move Integral to PhysicalDataType Key: SPARK-43103 URL: https://issues.apache.org/jira/browse/SPARK-43103 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43058) Move Numeric to PhysicalDataType
Rui Wang created SPARK-43058: Summary: Move Numeric to PhysicalDataType Key: SPARK-43058 URL: https://issues.apache.org/jira/browse/SPARK-43058 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-43019) Move Ordering to PhysicalDataType
Rui Wang created SPARK-43019: Summary: Move Ordering to PhysicalDataType Key: SPARK-43019 URL: https://issues.apache.org/jira/browse/SPARK-43019 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-42895) ValueError when invoking any session operations on a stopped Spark session
[
https://issues.apache.org/jira/browse/SPARK-42895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703815#comment-17703815
]
Rui Wang commented on SPARK-42895:
--
Of course though it probably need a better error message locally.
> ValueError when invoking any session operations on a stopped Spark session
> --
>
> Key: SPARK-42895
> URL: https://issues.apache.org/jira/browse/SPARK-42895
> Project: Spark
> Issue Type: Bug
> Components: Connect
>Affects Versions: 3.5.0
>Reporter: Allison Wang
>Priority: Major
>
> If a remote Spark session is stopped, trying to invoke any session operations
> will result in a ValueError. For example:
>
> {code:java}
> spark.stop()
> spark.sql("select 1")
> ValueError: Cannot invoke RPC: Channel closed!
> During handling of the above exception, another exception occurred:
> Traceback (most recent call last):
> ...
> return e.code() == grpc.StatusCode.UNAVAILABLE
> AttributeError: 'ValueError' object has no attribute 'code'{code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-42895) ValueError when invoking any session operations on a stopped Spark session
[
https://issues.apache.org/jira/browse/SPARK-42895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703814#comment-17703814
]
Rui Wang commented on SPARK-42895:
--
In fact spark.stop() does not stop the remote spark session but just local
session and the gRPC channel. This error is expected.
> ValueError when invoking any session operations on a stopped Spark session
> --
>
> Key: SPARK-42895
> URL: https://issues.apache.org/jira/browse/SPARK-42895
> Project: Spark
> Issue Type: Bug
> Components: Connect
>Affects Versions: 3.5.0
>Reporter: Allison Wang
>Priority: Major
>
> If a remote Spark session is stopped, trying to invoke any session operations
> will result in a ValueError. For example:
>
> {code:java}
> spark.stop()
> spark.sql("select 1")
> ValueError: Cannot invoke RPC: Channel closed!
> During handling of the above exception, another exception occurred:
> Traceback (most recent call last):
> ...
> return e.code() == grpc.StatusCode.UNAVAILABLE
> AttributeError: 'ValueError' object has no attribute 'code'{code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42892) Move sameType and relevant methods out of DataType
Rui Wang created SPARK-42892: Summary: Move sameType and relevant methods out of DataType Key: SPARK-42892 URL: https://issues.apache.org/jira/browse/SPARK-42892 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42887) Simple DataType interface
Rui Wang created SPARK-42887: Summary: Simple DataType interface Key: SPARK-42887 URL: https://issues.apache.org/jira/browse/SPARK-42887 Project: Spark Issue Type: Task Components: SQL Affects Versions: 3.5.0 Reporter: Rui Wang Assignee: Rui Wang This JIRA proposes to move non public API from existing DataType class to make DataType become a simple interface. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42878) Named Table should support options
Rui Wang created SPARK-42878: Summary: Named Table should support options Key: SPARK-42878 URL: https://issues.apache.org/jira/browse/SPARK-42878 Project: Spark Issue Type: Task Components: Connect Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42876) DataType's physicalDataType should be private[sql]
Rui Wang created SPARK-42876: Summary: DataType's physicalDataType should be private[sql] Key: SPARK-42876 URL: https://issues.apache.org/jira/browse/SPARK-42876 Project: Spark Issue Type: Task Components: SQL Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42722) Python Connect def schema() should not cache the schema
Rui Wang created SPARK-42722: Summary: Python Connect def schema() should not cache the schema Key: SPARK-42722 URL: https://issues.apache.org/jira/browse/SPARK-42722 Project: Spark Issue Type: Improvement Components: Connect Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-42688) Rename Connect proto Request client_id to session_id
[ https://issues.apache.org/jira/browse/SPARK-42688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang reassigned SPARK-42688: Assignee: (was: Rui Wang) > Rename Connect proto Request client_id to session_id > > > Key: SPARK-42688 > URL: https://issues.apache.org/jira/browse/SPARK-42688 > Project: Spark > Issue Type: Task > Components: Connect >Affects Versions: 3.4.0 >Reporter: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-42688) Rename Connect proto Request client_id to session_id
[ https://issues.apache.org/jira/browse/SPARK-42688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-42688: - Summary: Rename Connect proto Request client_id to session_id (was: Rename client_id to session_id) > Rename Connect proto Request client_id to session_id > > > Key: SPARK-42688 > URL: https://issues.apache.org/jira/browse/SPARK-42688 > Project: Spark > Issue Type: Task > Components: Connect >Affects Versions: 3.4.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42688) Rename client_id to session_id
Rui Wang created SPARK-42688: Summary: Rename client_id to session_id Key: SPARK-42688 URL: https://issues.apache.org/jira/browse/SPARK-42688 Project: Spark Issue Type: Task Components: Connect Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42667) Spark Connect: newSession API
Rui Wang created SPARK-42667: Summary: Spark Connect: newSession API Key: SPARK-42667 URL: https://issues.apache.org/jira/browse/SPARK-42667 Project: Spark Issue Type: Task Components: Connect Affects Versions: 3.4.1 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42640) Remove stale entries from the excluding rules for CompabilitySuite
Rui Wang created SPARK-42640: Summary: Remove stale entries from the excluding rules for CompabilitySuite Key: SPARK-42640 URL: https://issues.apache.org/jira/browse/SPARK-42640 Project: Spark Issue Type: Task Components: Connect Affects Versions: 3.4.1 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42609) Support Grouping/Grouping_Set
Rui Wang created SPARK-42609: Summary: Support Grouping/Grouping_Set Key: SPARK-42609 URL: https://issues.apache.org/jira/browse/SPARK-42609 Project: Spark Issue Type: Sub-task Components: Connect Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-42542) Support Pivot without providing pivot column values
[ https://issues.apache.org/jira/browse/SPARK-42542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang reassigned SPARK-42542: Assignee: Rui Wang > Support Pivot without providing pivot column values > --- > > Key: SPARK-42542 > URL: https://issues.apache.org/jira/browse/SPARK-42542 > Project: Spark > Issue Type: Sub-task > Components: Connect >Affects Versions: 3.4.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-42576) Add 2nd groupBy method to Dataset
[
https://issues.apache.org/jira/browse/SPARK-42576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang reassigned SPARK-42576:
Assignee: Rui Wang
> Add 2nd groupBy method to Dataset
> -
>
> Key: SPARK-42576
> URL: https://issues.apache.org/jira/browse/SPARK-42576
> Project: Spark
> Issue Type: New Feature
> Components: Connect
>Affects Versions: 3.4.0
>Reporter: Herman van Hövell
>Assignee: Rui Wang
>Priority: Major
>
> Dataset is missing a groupBy method:
> {code:java}
> /**
> * Groups the Dataset using the specified columns, so that we can run
> aggregation on them.
> * See [[RelationalGroupedDataset]] for all the available aggregate functions.
> *
> * This is a variant of groupBy that can only group by existing columns using
> column names
> * (i.e. cannot construct expressions).
> *
> * {{{
> * // Compute the average for all numeric columns grouped by department.
> * ds.groupBy("department").avg()
> *
> * // Compute the max age and average salary, grouped by department and
> gender.
> * ds.groupBy($"department", $"gender").agg(Map(
> * "salary" -> "avg",
> * "age" -> "max"
> * ))
> * }}}
> * @group untypedrel
> * @since 3.4.0
> */
> @scala.annotation.varargs
> def groupBy(col1: String, cols: String*): RelationalGroupedDataset {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-42561) Add TempView APIs to Dataset
[
https://issues.apache.org/jira/browse/SPARK-42561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang reassigned SPARK-42561:
Assignee: Rui Wang
> Add TempView APIs to Dataset
>
>
> Key: SPARK-42561
> URL: https://issues.apache.org/jira/browse/SPARK-42561
> Project: Spark
> Issue Type: New Feature
> Components: Connect
>Affects Versions: 3.4.0
>Reporter: Herman van Hövell
>Assignee: Rui Wang
>Priority: Major
>
> Add all temp view APIs to connect's Dataset.
> {code:java}
> /**
> * Registers this Dataset as a temporary table using the given name. The
> lifetime of this
> * temporary table is tied to the [[SparkSession]] that was used to create
> this Dataset.
> *
> * @group basic
> * @since 1.6.0
> */
> @deprecated("Use createOrReplaceTempView(viewName) instead.", "2.0.0")
> def registerTempTable(tableName: String): Unit
> /**
> * Creates a local temporary view using the given name. The lifetime of this
> * temporary view is tied to the [[SparkSession]] that was used to create this
> Dataset.
> *
> * Local temporary view is session-scoped. Its lifetime is the lifetime of the
> session that
> * created it, i.e. it will be automatically dropped when the session
> terminates. It's not
> * tied to any databases, i.e. we can't use `db1.view1` to reference a local
> temporary view.
> *
> * @throws AnalysisException if the view name is invalid or already exists
> *
> * @group basic
> * @since 2.0.0
> */
> @throws[AnalysisException]
> def createTempView(viewName: String): Unit
> /**
> * Creates a local temporary view using the given name. The lifetime of this
> * temporary view is tied to the [[SparkSession]] that was used to create this
> Dataset.
> *
> * @group basic
> * @since 2.0.0
> */
> def createOrReplaceTempView(viewName: String): Unit
> /**
> * Creates a global temporary view using the given name. The lifetime of this
> * temporary view is tied to this Spark application.
> *
> * Global temporary view is cross-session. Its lifetime is the lifetime of the
> Spark application,
> * i.e. it will be automatically dropped when the application terminates. It's
> tied to a system
> * preserved database `global_temp`, and we must use the qualified name to
> refer a global temp
> * view, e.g. `SELECT * FROM global_temp.view1`.
> *
> * @throws AnalysisException if the view name is invalid or already exists
> *
> * @group basic
> * @since 2.1.0
> */
> @throws[AnalysisException]
> def createGlobalTempView(viewName: String): Unit
> /**
> * Creates or replaces a global temporary view using the given name. The
> lifetime of this
> * temporary view is tied to this Spark application.
> *
> * Global temporary view is cross-session. Its lifetime is the lifetime of the
> Spark application,
> * i.e. it will be automatically dropped when the application terminates. It's
> tied to a system
> * preserved database `global_temp`, and we must use the qualified name to
> refer a global temp
> * view, e.g. `SELECT * FROM global_temp.view1`.
> *
> * @group basic
> * @since 2.2.0
> */
> def createOrReplaceGlobalTempView(viewName: String): Unit {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42569) Throw unsupported exceptions for non-supported API
Rui Wang created SPARK-42569: Summary: Throw unsupported exceptions for non-supported API Key: SPARK-42569 URL: https://issues.apache.org/jira/browse/SPARK-42569 Project: Spark Issue Type: Task Components: Connect Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42544) Spark Connect Scala Client: support parameterized SQL
Rui Wang created SPARK-42544: Summary: Spark Connect Scala Client: support parameterized SQL Key: SPARK-42544 URL: https://issues.apache.org/jira/browse/SPARK-42544 Project: Spark Issue Type: Task Components: Connect Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42542) Support Pivot without providing pivot column values
Rui Wang created SPARK-42542: Summary: Support Pivot without providing pivot column values Key: SPARK-42542 URL: https://issues.apache.org/jira/browse/SPARK-42542 Project: Spark Issue Type: Sub-task Components: Connect Affects Versions: 3.4.0 Reporter: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42541) Support Pivot with provided pivot column values
Rui Wang created SPARK-42541: Summary: Support Pivot with provided pivot column values Key: SPARK-42541 URL: https://issues.apache.org/jira/browse/SPARK-42541 Project: Spark Issue Type: Sub-task Components: Connect Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-42529) Support Cube and Rollup
[ https://issues.apache.org/jira/browse/SPARK-42529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-42529: - Summary: Support Cube and Rollup (was: Support Cube,Rollup,Pivot) > Support Cube and Rollup > --- > > Key: SPARK-42529 > URL: https://issues.apache.org/jira/browse/SPARK-42529 > Project: Spark > Issue Type: Sub-task > Components: Connect >Affects Versions: 3.4.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42529) Support Cube,Rollup,Pivot
Rui Wang created SPARK-42529: Summary: Support Cube,Rollup,Pivot Key: SPARK-42529 URL: https://issues.apache.org/jira/browse/SPARK-42529 Project: Spark Issue Type: Sub-task Components: Connect Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42520) Spark Connect Scala Client: Window
Rui Wang created SPARK-42520: Summary: Spark Connect Scala Client: Window Key: SPARK-42520 URL: https://issues.apache.org/jira/browse/SPARK-42520 Project: Spark Issue Type: Task Components: Connect Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-42467) Spark Connect Scala Client: GroupBy and Aggregation
[ https://issues.apache.org/jira/browse/SPARK-42467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691264#comment-17691264 ] Rui Wang commented on SPARK-42467: -- Yes we gonna need to support cube/rollup/groupingsets along with others necessary bits in Aggregation. > Spark Connect Scala Client: GroupBy and Aggregation > --- > > Key: SPARK-42467 > URL: https://issues.apache.org/jira/browse/SPARK-42467 > Project: Spark > Issue Type: Task > Components: Connect >Affects Versions: 3.4.0 >Reporter: Rui Wang >Assignee: Rui Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42481) Implement agg.{max,min,mean,count,avg,sum}
Rui Wang created SPARK-42481:
Summary: Implement agg.{max,min,mean,count,avg,sum}
Key: SPARK-42481
URL: https://issues.apache.org/jira/browse/SPARK-42481
Project: Spark
Issue Type: Sub-task
Components: Connect
Affects Versions: 3.4.0
Reporter: Rui Wang
Assignee: Rui Wang
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42468) Implement agg by (String, String)*
Rui Wang created SPARK-42468: Summary: Implement agg by (String, String)* Key: SPARK-42468 URL: https://issues.apache.org/jira/browse/SPARK-42468 Project: Spark Issue Type: Sub-task Components: Connect Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42467) Spark Connect Scala Client: GroupBy and Aggregation
Rui Wang created SPARK-42467: Summary: Spark Connect Scala Client: GroupBy and Aggregation Key: SPARK-42467 URL: https://issues.apache.org/jira/browse/SPARK-42467 Project: Spark Issue Type: Task Components: Connect Affects Versions: 3.4.0 Reporter: Rui Wang Assignee: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42453) Implement function max in Scala client
Rui Wang created SPARK-42453: Summary: Implement function max in Scala client Key: SPARK-42453 URL: https://issues.apache.org/jira/browse/SPARK-42453 Project: Spark Issue Type: Task Components: Connect Affects Versions: 3.4.0 Reporter: Rui Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
