[jira] [Commented] (SPARK-44349) Add math functions to SparkR

2023-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741512#comment-17741512 ] ASF GitHub Bot commented on SPARK-44349: User 'zhengruifeng' has created a pull

[jira] [Updated] (SPARK-43628) Enable SparkContext-related tests with Spark Connect

2023-07-10 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43628: Summary: Enable SparkContext-related tests with Spark Connect (was: Enable SparkContext with Spar

[jira] [Assigned] (SPARK-44131) Add call_function and deprecate call_udf for Scala API

2023-07-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44131: - Assignee: jiaan.geng > Add call_function and deprecate call_udf for Scala API > ---

[jira] [Resolved] (SPARK-44131) Add call_function and deprecate call_udf for Scala API

2023-07-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44131. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41687 [https://

[jira] [Resolved] (SPARK-44271) Move util functions from DataType to ResolveDefaultColumns

2023-07-10 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44271. --- Fix Version/s: 3.5.0 Resolution: Fixed > Move util functions from DataType to

[jira] [Updated] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2023-07-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39375: - Description: Please find the full document for discussion here: [Spark Connect SPIP|https://doc

[jira] [Created] (SPARK-44352) Move sameType back to DataType

2023-07-10 Thread Jira
Herman van Hövell created SPARK-44352: - Summary: Move sameType back to DataType Key: SPARK-44352 URL: https://issues.apache.org/jira/browse/SPARK-44352 Project: Spark Issue Type: New Feat

[jira] [Commented] (SPARK-44352) Move sameType back to DataType

2023-07-10 Thread Nikita Awasthi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741579#comment-17741579 ] Nikita Awasthi commented on SPARK-44352: User 'hvanhovell' has created a pull re

[jira] [Created] (SPARK-44353) Remove toAttributes from StructType

2023-07-10 Thread Jira
Herman van Hövell created SPARK-44353: - Summary: Remove toAttributes from StructType Key: SPARK-44353 URL: https://issues.apache.org/jira/browse/SPARK-44353 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-38477) Use error classes in org.apache.spark.shuffle

2023-07-10 Thread Bo Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang updated SPARK-38477: - Summary: Use error classes in org.apache.spark.shuffle (was: Use error classes in org.apache.spark.stor

[jira] [Updated] (SPARK-38476) Use error classes in org.apache.spark.storage

2023-07-10 Thread Bo Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang updated SPARK-38476: - Summary: Use error classes in org.apache.spark.storage (was: Use error classes in org.apache.spark.shuf

[jira] [Created] (SPARK-44354) Cannot create dataframe with CharType/VarcharType column

2023-07-10 Thread Kai-Michael Roesner (Jira)
Kai-Michael Roesner created SPARK-44354: --- Summary: Cannot create dataframe with CharType/VarcharType column Key: SPARK-44354 URL: https://issues.apache.org/jira/browse/SPARK-44354 Project: Spark

[jira] [Updated] (SPARK-44354) Cannot create dataframe with CharType/VarcharType column

2023-07-10 Thread Kai-Michael Roesner (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai-Michael Roesner updated SPARK-44354: Description: When trying to create a dataframe with a CharType or VarcharType colu

[jira] [Updated] (SPARK-44354) Cannot create dataframe with CharType/VarcharType column

2023-07-10 Thread Kai-Michael Roesner (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai-Michael Roesner updated SPARK-44354: Component/s: SQL > Cannot create dataframe with CharType/VarcharType column >

[jira] [Updated] (SPARK-44354) Cannot create dataframe with CharType/VarcharType column

2023-07-10 Thread Kai-Michael Roesner (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai-Michael Roesner updated SPARK-44354: Description: When trying to create a dataframe with a CharType or VarcharType colu

[jira] [Resolved] (SPARK-44351) Make some syntactic simplification

2023-07-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44351. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41915 [https://github.com

[jira] [Assigned] (SPARK-44351) Make some syntactic simplification

2023-07-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44351: Assignee: Yang Jie > Make some syntactic simplification > -- > >

[jira] [Created] (SPARK-44355) Move commands to CTEDef code path and deprecate CTE inline path

2023-07-10 Thread Max Gekk (Jira)
Max Gekk created SPARK-44355: Summary: Move commands to CTEDef code path and deprecate CTE inline path Key: SPARK-44355 URL: https://issues.apache.org/jira/browse/SPARK-44355 Project: Spark Issu

[jira] [Created] (SPARK-44356) Move INSERT INTO to CTEDef code path

2023-07-10 Thread Max Gekk (Jira)
Max Gekk created SPARK-44356: Summary: Move INSERT INTO to CTEDef code path Key: SPARK-44356 URL: https://issues.apache.org/jira/browse/SPARK-44356 Project: Spark Issue Type: Sub-task C

[jira] [Created] (SPARK-44357) Add pyspark_testing module for GHA tests

2023-07-10 Thread Amanda Liu (Jira)
Amanda Liu created SPARK-44357: -- Summary: Add pyspark_testing module for GHA tests Key: SPARK-44357 URL: https://issues.apache.org/jira/browse/SPARK-44357 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-44350) Upgrade sbt to 1.9.2

2023-07-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44350. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41916 [https://gi

[jira] [Assigned] (SPARK-44350) Upgrade sbt to 1.9.2

2023-07-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44350: Assignee: BingKun Pan > Upgrade sbt to 1.9.2 > > > K

[jira] [Updated] (SPARK-44350) Upgrade sbt to 1.9.2

2023-07-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-44350: - Priority: Trivial (was: Minor) > Upgrade sbt to 1.9.2 > > >

[jira] [Commented] (SPARK-44330) Define the computing logic through PartitionEvaluator API and use it in BroadcastNestedLoopJoinExec & BroadcastHashJoinExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741734#comment-17741734 ] Vinod KC commented on SPARK-44330: -- PR raised : https://github.com/apache/spark/pull/41

[jira] [Commented] (SPARK-44359) Define the computing logic through PartitionEvaluator API and use it in SQL aggregate operators

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741736#comment-17741736 ] Vinod KC commented on SPARK-44359: -- Im working on this > Define the computing logic th

[jira] [Created] (SPARK-44359) Define the computing logic through PartitionEvaluator API and use it in SQL aggregate operators

2023-07-10 Thread Vinod KC (Jira)
Vinod KC created SPARK-44359: Summary: Define the computing logic through PartitionEvaluator API and use it in SQL aggregate operators Key: SPARK-44359 URL: https://issues.apache.org/jira/browse/SPARK-44359

[jira] [Assigned] (SPARK-44353) Remove toAttributes from StructType

2023-07-10 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-44353: - Assignee: Herman van Hövell > Remove toAttributes from StructType > ---

[jira] [Resolved] (SPARK-44343) Separate encoder inference from expression encoder generation in ScalaReflection

2023-07-10 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44343. --- Fix Version/s: 3.5.0 Resolution: Fixed > Separate encoder inference from expr

[jira] [Resolved] (SPARK-44352) Move sameType back to DataType

2023-07-10 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44352. --- Fix Version/s: 3.5.0 Resolution: Fixed > Move sameType back to DataType > ---

[jira] [Created] (SPARK-44360) Support schema pruning in delta-based MERGE operations

2023-07-10 Thread Anton Okolnychyi (Jira)
Anton Okolnychyi created SPARK-44360: Summary: Support schema pruning in delta-based MERGE operations Key: SPARK-44360 URL: https://issues.apache.org/jira/browse/SPARK-44360 Project: Spark

[jira] [Created] (SPARK-44361) Use PartitionEvaluator API in BatchEvalPythonUDTFExec, FlatMapGroupsInPandasExec, MapInBatchExec, FlatMapCoGroupsInPandasExec

2023-07-10 Thread Vinod KC (Jira)
Vinod KC created SPARK-44361: Summary: Use PartitionEvaluator API in BatchEvalPythonUDTFExec, FlatMapGroupsInPandasExec, MapInBatchExec, FlatMapCoGroupsInPandasExec Key: SPARK-44361 URL: https://issues.apache.org/jir

[jira] [Created] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec

2023-07-10 Thread Vinod KC (Jira)
Vinod KC created SPARK-44362: Summary: Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec Key: SPARK-44362 URL: https://issues.apache.org/jira/browse/

[jira] [Created] (SPARK-44363) Display percent of unequal rows in dataframe comparison

2023-07-10 Thread Amanda Liu (Jira)
Amanda Liu created SPARK-44363: -- Summary: Display percent of unequal rows in dataframe comparison Key: SPARK-44363 URL: https://issues.apache.org/jira/browse/SPARK-44363 Project: Spark Issue Typ

[jira] [Created] (SPARK-44364) Support List[Row] data type for expected DataFrame argument

2023-07-10 Thread Amanda Liu (Jira)
Amanda Liu created SPARK-44364: -- Summary: Support List[Row] data type for expected DataFrame argument Key: SPARK-44364 URL: https://issues.apache.org/jira/browse/SPARK-44364 Project: Spark Issu

[jira] [Updated] (SPARK-44061) Add assertDataFrameEquality util function

2023-07-10 Thread Amanda Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amanda Liu updated SPARK-44061: --- Summary: Add assertDataFrameEquality util function (was: Add assert_df_equality util function) > A

[jira] [Updated] (SPARK-44363) Display percent of unequal rows in DataFrame comparison

2023-07-10 Thread Amanda Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amanda Liu updated SPARK-44363: --- Summary: Display percent of unequal rows in DataFrame comparison (was: Display percent of unequal r

[jira] [Created] (SPARK-44365) Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec

2023-07-10 Thread Vinod KC (Jira)
Vinod KC created SPARK-44365: Summary: Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec Key: SPARK-44365 URL: https://issues.apache.org/jira/browse/

[jira] [Updated] (SPARK-44365) Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44365: - Description: InMemoryTableScanExec (was: `BatchEvalPythonUDTFExec` `FlatMapGroupsInPandasExec` `MapInBat

[jira] [Updated] (SPARK-44365) Define the computing logic through PartitionEvaluator API and use it in SQL operators InMemoryTableScanExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44365: - Summary: Define the computing logic through PartitionEvaluator API and use it in SQL operators InMemoryT

[jira] [Updated] (SPARK-44365) Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44365: - Description: Define the computing logic through PartitionEvaluator API and use it in SQL operators `InMe

[jira] [Updated] (SPARK-44216) Add assertSchemaEqual API with ignore_nullable optional flag

2023-07-10 Thread Amanda Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amanda Liu updated SPARK-44216: --- Summary: Add assertSchemaEqual API with ignore_nullable optional flag (was: Add improved error mess

[jira] [Updated] (SPARK-44216) Make assertSchemaEqual API with ignore_nullable optional flag

2023-07-10 Thread Amanda Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amanda Liu updated SPARK-44216: --- Summary: Make assertSchemaEqual API with ignore_nullable optional flag (was: Add assertSchemaEqual

[jira] [Resolved] (SPARK-43983) Implement cross validator estimator

2023-07-10 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-43983. Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41881 [https://github

[jira] [Assigned] (SPARK-44332) Fix the sorting error of Executor ID Column on Executors UI Page

2023-07-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44332: Assignee: BingKun Pan > Fix the sorting error of Executor ID Column on Executors UI Page

[jira] [Resolved] (SPARK-44332) Fix the sorting error of Executor ID Column on Executors UI Page

2023-07-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44332. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41887 [https://gi

[jira] [Created] (SPARK-44366) Migrate antlr4 from 4.9 to 4.10+

2023-07-10 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44366: --- Summary: Migrate antlr4 from 4.9 to 4.10+ Key: SPARK-44366 URL: https://issues.apache.org/jira/browse/SPARK-44366 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-43974) Upgrade buf to v1.23.1

2023-07-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43974. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41469 [https://

[jira] [Updated] (SPARK-42264) Test Parity: pyspark.sql.tests.test_udf and pyspark.sql.tests.pandas.test_pandas_udf

2023-07-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42264: - Shepherd: Hyukjin Kwon > Test Parity: pyspark.sql.tests.test_udf and > pyspark.sql.tests.pandas

[jira] [Assigned] (SPARK-41997) Test parity: pyspark.sql.tests.test_readwriter

2023-07-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41997: Assignee: Hyukjin Kwon > Test parity: pyspark.sql.tests.test_readwriter > ---

[jira] [Created] (SPARK-44367) Show error message on UI for each query

2023-07-10 Thread Kent Yao (Jira)
Kent Yao created SPARK-44367: Summary: Show error message on UI for each query Key: SPARK-44367 URL: https://issues.apache.org/jira/browse/SPARK-44367 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

2023-07-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44251: --- Assignee: Bruce Robbins > Potential for incorrect results or NPE when full outer USING join

[jira] [Resolved] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

2023-07-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44251. - Fix Version/s: 3.3.3 4.0.0 3.4.2 Resolution: Fixed

[jira] [Updated] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

2023-07-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44251: Fix Version/s: 3.5.0 (was: 4.0.0) > Potential for incorrect results or NPE

[jira] [Created] (SPARK-44368) Support partition operation on dataframe in Spark Connect Go Client

2023-07-10 Thread BoYang (Jira)
BoYang created SPARK-44368: -- Summary: Support partition operation on dataframe in Spark Connect Go Client Key: SPARK-44368 URL: https://issues.apache.org/jira/browse/SPARK-44368 Project: Spark Issu

[jira] [Assigned] (SPARK-44363) Display percent of unequal rows in DataFrame comparison

2023-07-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44363: Assignee: Amanda Liu > Display percent of unequal rows in DataFrame comparison >

[jira] [Resolved] (SPARK-44363) Display percent of unequal rows in DataFrame comparison

2023-07-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44363. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41926 [https://gi

[jira] [Assigned] (SPARK-44357) Add pyspark_testing module for GHA tests

2023-07-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44357: Assignee: Amanda Liu > Add pyspark_testing module for GHA tests > ---

[jira] [Resolved] (SPARK-44357) Add pyspark_testing module for GHA tests

2023-07-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44357. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41896 [https://gi

[jira] [Commented] (SPARK-44361) Use PartitionEvaluator API in BatchEvalPythonUDTFExec, FlatMapGroupsInPandasExec, MapInBatchExec, FlatMapCoGroupsInPandasExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741836#comment-17741836 ] Vinod KC commented on SPARK-44361: -- Im working on it > Use PartitionEvaluator API in

[jira] [Commented] (SPARK-44365) Define the computing logic through PartitionEvaluator API and use it in SQL operators InMemoryTableScanExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741837#comment-17741837 ] Vinod KC commented on SPARK-44365: -- Im working on it > Define the computing logic thro

[jira] [Commented] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741838#comment-17741838 ] Vinod KC commented on SPARK-44362: -- Im working on it > Use PartitionEvaluator API in

[jira] [Created] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTableScanExec, DataSourceScanExec

2023-07-10 Thread Vinod KC (Jira)
Vinod KC created SPARK-44369: Summary: Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTableScanExec, DataSourceScanExec Key: SPARK-44369 URL: https://issues.apache.org/jira/

[jira] [Commented] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTableScanExec, DataSourceScanExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741839#comment-17741839 ] Vinod KC commented on SPARK-44369: -- I'm working on it > Use PartitionEvaluator API in

[jira] [Updated] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTableScanExec, DataSourceScanExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44369: - Description: Use PartitionEvaluator API in  CollectMetricsExec GenerateExec ExpandExec DebugExec HiveTa

[jira] [Updated] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTableScanExec, DataSourceScanExec, SortExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44369: - Summary: Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTabl

[jira] [Updated] (SPARK-44365) Define the computing logic through PartitionEvaluator API and use it in SQL operators InMemoryTableScanExec, DataSourceScanExec, MergeRowsExec , ReferenceSort

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44365: - Description: Define the computing logic through PartitionEvaluator API and use it in SQL operators  In

[jira] [Updated] (SPARK-44365) Define the computing logic through PartitionEvaluator API and use it in SQL operators InMemoryTableScanExec, DataSourceScanExec, MergeRowsExec , ReferenceSort

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44365: - Summary: Define the computing logic through PartitionEvaluator API and use it in SQL operators InMemoryT

[jira] [Created] (SPARK-44370) Migrate Buf remote generation alpha to remote plugins

2023-07-10 Thread Jia Fan (Jira)
Jia Fan created SPARK-44370: --- Summary: Migrate Buf remote generation alpha to remote plugins Key: SPARK-44370 URL: https://issues.apache.org/jira/browse/SPARK-44370 Project: Spark Issue Type: Bug