[jira] [Resolved] (SPARK-44290) Session-based files and archives in Spark Connect

2023-07-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44290. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41495

[jira] [Assigned] (SPARK-44290) Session-based files and archives in Spark Connect

2023-07-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44290: Assignee: Hyukjin Kwon > Session-based files and archives in Spark Connect >

[jira] [Resolved] (SPARK-44061) Add assert_df_equality util function

2023-07-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44061. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41606

[jira] [Assigned] (SPARK-44061) Add assert_df_equality util function

2023-07-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44061: Assignee: Amanda Liu > Add assert_df_equality util function >

[jira] [Commented] (SPARK-44340) Define the computing logic through PartitionEvaluator API and use it in WindowGroupLimitExec

2023-07-07 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741242#comment-17741242 ] jiaan.geng commented on SPARK-44340: I'm working on. > Define the computing logic through

[jira] [Updated] (SPARK-44340) Define the computing logic through PartitionEvaluator API and use it in WindowGroupLimitExec

2023-07-07 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-44340: --- Description: Define the computing logic through PartitionEvaluator API and use it in

[jira] [Created] (SPARK-44340) Define the computing logic through PartitionEvaluator API and use it in WindowGroupLimitExec

2023-07-07 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-44340: -- Summary: Define the computing logic through PartitionEvaluator API and use it in WindowGroupLimitExec Key: SPARK-44340 URL: https://issues.apache.org/jira/browse/SPARK-44340

[jira] [Commented] (SPARK-43964) Support arrow-optimized Python UDTFs

2023-07-07 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741241#comment-17741241 ] Snoot.io commented on SPARK-43964: -- User 'allisonwang-db' has created a pull request for this issue:

[jira] [Commented] (SPARK-44328) Assign names to the error class _LEGACY_ERROR_TEMP_[2325-2328]

2023-07-07 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741240#comment-17741240 ] Snoot.io commented on SPARK-44328: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-44301) Add Support for TPCH Micro Benchmark

2023-07-07 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741238#comment-17741238 ] Snoot.io commented on SPARK-44301: -- User 'oss-maker' has created a pull request for this issue:

[jira] [Commented] (SPARK-44301) Add Support for TPCH Micro Benchmark

2023-07-07 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741237#comment-17741237 ] Snoot.io commented on SPARK-44301: -- User 'oss-maker' has created a pull request for this issue:

[jira] [Updated] (SPARK-44339) spark3-shell fails with error org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table . Permission denied: user [AD user] does not have

2023-07-07 Thread Amar Gurung (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Gurung updated SPARK-44339: Priority: Critical (was: Blocker) > spark3-shell fails with error >

[jira] [Updated] (SPARK-44339) spark3-shell fails with error org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table . Permission denied: user [AD user] does not have

2023-07-07 Thread Amar Gurung (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Gurung updated SPARK-44339: Affects Version/s: 3.3.0 (was: 3.0.3) > spark3-shell fails with error

[jira] [Updated] (SPARK-44339) spark3-shell fails with error org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table . Permission denied: user [AD user] does not have

2023-07-07 Thread Amar Gurung (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Gurung updated SPARK-44339: Description: *Problem statement*  A hive view is created using beeline to restrict the users

[jira] [Updated] (SPARK-44339) spark3-shell fails with error org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table . Permission denied: user [AD user] does not have

2023-07-07 Thread Amar Gurung (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Gurung updated SPARK-44339: Summary: spark3-shell fails with error org.apache.hadoop.hive.ql.metadata.HiveException: Unable

[jira] [Updated] (SPARK-44339) spark3-shell fails with error org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table . Permission denied: user [AD user] does not have

2023-07-07 Thread Amar Gurung (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Gurung updated SPARK-44339: Summary: spark3-shell fails with error org.apache.hadoop.hive.ql.metadata.HiveException: Unable

[jira] [Created] (SPARK-44339) spark3-shell fails with error org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table provdatatypeall. Permission denied: user [AD user] does not have [S

2023-07-07 Thread Amar Gurung (Jira)
Amar Gurung created SPARK-44339: --- Summary: spark3-shell fails with error org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table provdatatypeall. Permission denied: user [AD user] does not have [SELECT] privilege on [/] to read

[jira] [Created] (SPARK-44338) fix view schema mismatch error message

2023-07-07 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-44338: --- Summary: fix view schema mismatch error message Key: SPARK-44338 URL: https://issues.apache.org/jira/browse/SPARK-44338 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-44337) Any fields set to Any.getDefaultInstance cause exceptions.

2023-07-07 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-44337: Summary: Any fields set to Any.getDefaultInstance cause exceptions. Key: SPARK-44337 URL: https://issues.apache.org/jira/browse/SPARK-44337 Project: Spark

[jira] [Assigned] (SPARK-44287) Define the computing logic through PartitionEvaluator API and use it in RowToColumnarExec & ColumnarToRowExec SQL operators.

2023-07-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44287: --- Assignee: Vinod KC > Define the computing logic through PartitionEvaluator API and

[jira] [Resolved] (SPARK-44287) Define the computing logic through PartitionEvaluator API and use it in RowToColumnarExec & ColumnarToRowExec SQL operators.

2023-07-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44287. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41839

[jira] [Created] (SPARK-44336) Add Python inbuilt functions to DataFrame for ease of use for Python developers

2023-07-07 Thread Stephen Offer (Jira)
Stephen Offer created SPARK-44336: - Summary: Add Python inbuilt functions to DataFrame for ease of use for Python developers Key: SPARK-44336 URL: https://issues.apache.org/jira/browse/SPARK-44336

[jira] [Created] (SPARK-44335) SQL parser should have a SQLConf parameter instead of relying on the active conf

2023-07-07 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-44335: --- Summary: SQL parser should have a SQLConf parameter instead of relying on the active conf Key: SPARK-44335 URL: https://issues.apache.org/jira/browse/SPARK-44335

[jira] [Resolved] (SPARK-44326) Move utils that are used from Scala client to the common modules

2023-07-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44326. --- Fix Version/s: 3.5.0 Resolution: Fixed > Move utils that are used from Scala

[jira] [Resolved] (SPARK-44333) Move EnhancedLogicalPlan out of ParserUtils

2023-07-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44333. --- Fix Version/s: 3.5.0 Resolution: Fixed > Move EnhancedLogicalPlan out of

[jira] [Resolved] (SPARK-44322) Make parser use SqlApiConf

2023-07-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44322. --- Fix Version/s: 3.5.0 Resolution: Fixed > Make parser use SqlApiConf >

[jira] [Commented] (SPARK-44263) Allow ChannelBuilder extensions -- Scala

2023-07-07 Thread GridGain Integration (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740973#comment-17740973 ] GridGain Integration commented on SPARK-44263: -- User 'cdkrot' has created a pull request

[jira] [Created] (SPARK-44334) Status of execution w/ error and w/o jobs shall be FAILED not COMPLETED

2023-07-07 Thread Kent Yao (Jira)
Kent Yao created SPARK-44334: Summary: Status of execution w/ error and w/o jobs shall be FAILED not COMPLETED Key: SPARK-44334 URL: https://issues.apache.org/jira/browse/SPARK-44334 Project: Spark

[jira] [Commented] (SPARK-44332) The Executor ID should start with 1 when running on Spark cluster of [N, cores, memory] locally mode

2023-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740956#comment-17740956 ] ASF GitHub Bot commented on SPARK-44332: User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-44309) Display Add/Remove Time of Executors on ExecutorsTab

2023-07-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-44309: Assignee: Kent Yao > Display Add/Remove Time of Executors on ExecutorsTab >

[jira] [Resolved] (SPARK-44309) Display Add/Remove Time of Executors on ExecutorsTab

2023-07-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-44309. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41861

[jira] [Created] (SPARK-44333) Move EnhancedLogicalPlan out of ParserUtils

2023-07-07 Thread Jira
Herman van Hövell created SPARK-44333: - Summary: Move EnhancedLogicalPlan out of ParserUtils Key: SPARK-44333 URL: https://issues.apache.org/jira/browse/SPARK-44333 Project: Spark Issue

[jira] [Resolved] (SPARK-44327) Add functions any and len to Scala

2023-07-07 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44327. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41886

[jira] [Created] (SPARK-44332) The Executor ID should start with 1 when running on Spark cluster of [N, cores, memory] locally mode

2023-07-07 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44332: --- Summary: The Executor ID should start with 1 when running on Spark cluster of [N, cores, memory] locally mode Key: SPARK-44332 URL: