[jira] [Updated] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec

2023-07-21 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44369: - Summary: Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec (was: Use

[jira] [Updated] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, HiveTableScanExec, SortExec

2023-07-21 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44369: - Description: Use PartitionEvaluator API in  CollectMetricsExec GenerateExec ExpandExec   was: Use

[jira] [Updated] (SPARK-44359) Define the computing logic through PartitionEvaluator API and use it in BaseScriptTransformationExec, InMemoryTableScanExec, ReferenceSort, HiveTableScanExec, SortExec

2023-07-21 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44359: - Description: Define the computing logic through PartitionEvaluator API and use it in SQL aggregate

[jira] [Updated] (SPARK-44359) Define the computing logic through PartitionEvaluator API and use it in BaseScriptTransformationExec, InMemoryTableScanExec, ReferenceSort, HiveTableScanExec, SortExec

2023-07-21 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44359: - Summary: Define the computing logic through PartitionEvaluator API and use it in

[jira] [Updated] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, HiveTableScanExec, SortExec

2023-07-21 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44369: - Summary: Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, HiveTableScanExec,

[jira] [Updated] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTableScanExec, SortExec

2023-07-21 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44369: - Description: Use PartitionEvaluator API in  CollectMetricsExec GenerateExec ExpandExec

[jira] [Commented] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec, AttachDistributedSequenceExec

2023-07-21 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17745658#comment-17745658 ] Vinod KC commented on SPARK-44362: -- PR raised : https://github.com/apache/spark/pull/42029 > Use

[jira] [Comment Edited] (SPARK-44365) Use PartitionEvaluator API in FileSourceScanExec, RowDataSourceScanExec, MergeRowsExec

2023-07-21 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741837#comment-17741837 ] Vinod KC edited comment on SPARK-44365 at 7/21/23 4:06 PM: --- PR raised:

[jira] [Comment Edited] (SPARK-44365) Use PartitionEvaluator API in FileSourceScanExec, RowDataSourceScanExec, MergeRowsExec

2023-07-20 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741837#comment-17741837 ] Vinod KC edited comment on SPARK-44365 at 7/21/23 4:15 AM: --- Raise PR :

[jira] [Updated] (SPARK-44359) Define the computing logic through PartitionEvaluator API and use it in BaseScriptTransformationExec, InMemoryTableScanExec, ReferenceSort

2023-07-20 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44359: - Summary: Define the computing logic through PartitionEvaluator API and use it in

[jira] [Updated] (SPARK-44359) Define the computing logic through PartitionEvaluator API and use it in BaseScriptTransformationExec, InMemoryTableScanExec, ReferenceSort

2023-07-20 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44359: - Description: Define the computing logic through PartitionEvaluator API and use it in SQL aggregate

[jira] [Updated] (SPARK-44365) Use PartitionEvaluator API in FileSourceScanExec, RowDataSourceScanExec, MergeRowsExec

2023-07-20 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44365: - Description: Define the computing logic through PartitionEvaluator API and use it in SQL operators 

[jira] [Updated] (SPARK-44365) Use PartitionEvaluator API in FileSourceScanExec, RowDataSourceScanExec, MergeRowsExec

2023-07-20 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44365: - Summary: Use PartitionEvaluator API in FileSourceScanExec, RowDataSourceScanExec, MergeRowsExec (was:

[jira] [Updated] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec, AttachDistributedSequenceExec

2023-07-16 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44362: - Description: Use  PartitionEvaluator API in `AggregateInPandasExec` `AttachDistributedSequenceExec`

[jira] [Updated] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec, AttachDistributedSequenceExec

2023-07-16 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44362: - Summary: Use PartitionEvaluator API in AggregateInPandasExec, AttachDistributedSequenceExec (was: Use

[jira] [Comment Edited] (SPARK-44447) Use PartitionEvaluator API in FlatMapGroupsInPandasExec, FlatMapCoGroupsInPandasExec

2023-07-16 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17743572#comment-17743572 ] Vinod KC edited comment on SPARK-7 at 7/16/23 9:56 PM: --- Raised PR :

[jira] [Comment Edited] (SPARK-44361) Use PartitionEvaluator API in MapInBatchExec

2023-07-16 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741836#comment-17741836 ] Vinod KC edited comment on SPARK-44361 at 7/16/23 9:48 PM: --- PR raised :

[jira] [Created] (SPARK-44447) Use PartitionEvaluator API in FlatMapGroupsInPandasExec, FlatMapCoGroupsInPandasExec

2023-07-16 Thread Vinod KC (Jira)
Vinod KC created SPARK-7: Summary: Use PartitionEvaluator API in FlatMapGroupsInPandasExec, FlatMapCoGroupsInPandasExec Key: SPARK-7 URL: https://issues.apache.org/jira/browse/SPARK-7

[jira] [Commented] (SPARK-44447) Use PartitionEvaluator API in FlatMapGroupsInPandasExec, FlatMapCoGroupsInPandasExec

2023-07-16 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17743572#comment-17743572 ] Vinod KC commented on SPARK-7: -- I'm working on it > Use PartitionEvaluator API in

[jira] [Updated] (SPARK-44361) Use PartitionEvaluator API in MapInBatchExec

2023-07-16 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44361: - Summary: Use PartitionEvaluator API in MapInBatchExec (was: Use PartitionEvaluator API in

[jira] [Updated] (SPARK-44361) Use PartitionEvaluator API in MapInBatchExec

2023-07-16 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44361: - Description: Use  PartitionEvaluator API in `MapInBatchExec` was: Use  PartitionEvaluator API in

[jira] (SPARK-44412) Use PartitionEvaluator API in ArrowEvalPythonUDTFExec & BatchEvalPythonUDTFExec

2023-07-14 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44412 ] Vinod KC deleted comment on SPARK-44412: -- was (Author: vinodkc): I'm working on this > Use PartitionEvaluator API in ArrowEvalPythonUDTFExec & > BatchEvalPythonUDTFExec >

[jira] [Commented] (SPARK-44412) Use PartitionEvaluator API in ArrowEvalPythonUDTFExec & BatchEvalPythonUDTFExec

2023-07-14 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17743335#comment-17743335 ] Vinod KC commented on SPARK-44412: -- Raised PR : https://github.com/apache/spark/pull/42014 > Use

[jira] [Updated] (SPARK-44412) Use PartitionEvaluator API in ArrowEvalPythonUDTFExec & BatchEvalPythonUDTFExec

2023-07-14 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44412: - Description: Use PartitionEvaluator API in `ArrowEvalPythonUDTFExec` `BatchEvalPythonUDTFExec`

[jira] [Updated] (SPARK-44412) Use PartitionEvaluator API in ArrowEvalPythonUDTFExec & BatchEvalPythonUDTFExec

2023-07-14 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44412: - Summary: Use PartitionEvaluator API in ArrowEvalPythonUDTFExec & BatchEvalPythonUDTFExec (was: Use

[jira] [Updated] (SPARK-44411) Use PartitionEvaluator API in ArrowEvalPythonExec, BatchEvalPythonExec

2023-07-13 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44411: - Description: Use PartitionEvaluator API in `ArrowEvalPythonExec` `BatchEvalPythonExec` was: Use

[jira] [Commented] (SPARK-44411) Use PartitionEvaluator API in EvalPythonExec,ArrowEvalPythonExec, BatchEvalPythonExec

2023-07-13 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17743011#comment-17743011 ] Vinod KC commented on SPARK-44411: -- PR raised : https://github.com/apache/spark/pull/41998 > Use

[jira] [Updated] (SPARK-44411) Use PartitionEvaluator API in ArrowEvalPythonExec, BatchEvalPythonExec

2023-07-13 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44411: - Summary: Use PartitionEvaluator API in ArrowEvalPythonExec, BatchEvalPythonExec (was: Use

[jira] [Commented] (SPARK-44412) Use PartitionEvaluator API in EvalPythonUDTFExec,ArrowEvalPythonUDTFExec, BatchEvalPythonUDTFExec

2023-07-13 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742965#comment-17742965 ] Vinod KC commented on SPARK-44412: -- I'm working on this > Use PartitionEvaluator API in

[jira] [Updated] (SPARK-44361) Use PartitionEvaluator API in FlatMapGroupsInPandasExec, MapInBatchExec, FlatMapCoGroupsInPandasExec

2023-07-13 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44361: - Description: Use  PartitionEvaluator API in `FlatMapGroupsInPandasExec` `MapInBatchExec`

[jira] [Updated] (SPARK-44361) Use PartitionEvaluator API in FlatMapGroupsInPandasExec, MapInBatchExec, FlatMapCoGroupsInPandasExec

2023-07-13 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44361: - Summary: Use PartitionEvaluator API in FlatMapGroupsInPandasExec, MapInBatchExec,

[jira] [Created] (SPARK-44412) Use PartitionEvaluator API in EvalPythonUDTFExec,ArrowEvalPythonUDTFExec, BatchEvalPythonUDTFExec

2023-07-13 Thread Vinod KC (Jira)
Vinod KC created SPARK-44412: Summary: Use PartitionEvaluator API in EvalPythonUDTFExec,ArrowEvalPythonUDTFExec, BatchEvalPythonUDTFExec Key: SPARK-44412 URL: https://issues.apache.org/jira/browse/SPARK-44412

[jira] [Updated] (SPARK-44361) Use PartitionEvaluator API in BatchEvalPythonUDTFExec, FlatMapGroupsInPandasExec, MapInBatchExec, FlatMapCoGroupsInPandasExec

2023-07-13 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44361: - Description: Use  PartitionEvaluator API in EvalPythonUDTFExec BatchEvalPythonUDTFExec,

[jira] [Updated] (SPARK-44361) Use PartitionEvaluator API in EvalPythonUDTFExec, BatchEvalPythonUDTFExec, FlatMapGroupsInPandasExec, MapInBatchExec, FlatMapCoGroupsInPandasExec

2023-07-13 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44361: - Summary: Use PartitionEvaluator API in EvalPythonUDTFExec, BatchEvalPythonUDTFExec,

[jira] [Updated] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec, AttachDistributedSequenceExec, DeserializeToObjectExec

2023-07-13 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44362: - Summary: Use PartitionEvaluator API in AggregateInPandasExec, AttachDistributedSequenceExec,

[jira] [Updated] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec,EvalPythonExec,AttachDistributedSequenceExec, DeserializeToObjectExec

2023-07-13 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44362: - Description: Use  PartitionEvaluator API in AggregateInPandasExec AttachDistributedSequenceExec

[jira] [Commented] (SPARK-44411) Use PartitionEvaluator API in EvalPythonExec,ArrowEvalPythonExec, BatchEvalPythonExec

2023-07-13 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742944#comment-17742944 ] Vinod KC commented on SPARK-44411: -- I'm working on this > Use PartitionEvaluator API in

[jira] [Created] (SPARK-44411) Use PartitionEvaluator API in EvalPythonExec,ArrowEvalPythonExec, BatchEvalPythonExec

2023-07-13 Thread Vinod KC (Jira)
Vinod KC created SPARK-44411: Summary: Use PartitionEvaluator API in EvalPythonExec,ArrowEvalPythonExec, BatchEvalPythonExec Key: SPARK-44411 URL: https://issues.apache.org/jira/browse/SPARK-44411

[jira] [Updated] (SPARK-44359) Define the computing logic through PartitionEvaluator API and use it in BaseScriptTransformationExec

2023-07-12 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44359: - Summary: Define the computing logic through PartitionEvaluator API and use it in

[jira] [Updated] (SPARK-44359) Define the computing logic through PartitionEvaluator API and use it in SQL aggregate operators

2023-07-12 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44359: - Description: Define the computing logic through PartitionEvaluator API and use it in SQL aggregate

[jira] [Updated] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec,EvalPythonExec,AttachDistributedSequenceExec, DeserializeToObjectExec

2023-07-12 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44362: - Description: Use  PartitionEvaluator API in AggregateInPandasExec EvalPythonExec

[jira] [Updated] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec,EvalPythonExec,AttachDistributedSequenceExec, DeserializeToObjectExec

2023-07-12 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44362: - Summary: Use PartitionEvaluator API in

[jira] [Updated] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTableScanExec, SortExec

2023-07-12 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44369: - Summary: Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec,

[jira] [Updated] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTableScanExec, DataSourceScanExec, SortExec

2023-07-12 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44369: - Description: Use PartitionEvaluator API in  CollectMetricsExec GenerateExec ExpandExec DebugExec

[jira] [Updated] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec,EvalPythonExec,AttachDistributedSequenceExec

2023-07-11 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44362: - Summary: Use PartitionEvaluator API in

[jira] [Updated] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec

2023-07-11 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44362: - Description: Use  PartitionEvaluator API in AggregateInPandasExec EvalPythonExec

[jira] [Commented] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec

2023-07-11 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742099#comment-17742099 ] Vinod KC commented on SPARK-44362: -- yes, please go ahead > Use PartitionEvaluator API in

[jira] [Updated] (SPARK-44365) Define the computing logic through PartitionEvaluator API and use it in SQL operators InMemoryTableScanExec, DataSourceScanExec, MergeRowsExec , ReferenceSort

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44365: - Description: Define the computing logic through PartitionEvaluator API and use it in SQL operators 

[jira] [Updated] (SPARK-44365) Define the computing logic through PartitionEvaluator API and use it in SQL operators InMemoryTableScanExec, DataSourceScanExec, MergeRowsExec , ReferenceSort

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44365: - Summary: Define the computing logic through PartitionEvaluator API and use it in SQL operators

[jira] [Updated] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTableScanExec, DataSourceScanExec, SortExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44369: - Summary: Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec,

[jira] [Updated] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTableScanExec, DataSourceScanExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44369: - Description: Use PartitionEvaluator API in  CollectMetricsExec GenerateExec ExpandExec DebugExec

[jira] [Commented] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTableScanExec, DataSourceScanExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741839#comment-17741839 ] Vinod KC commented on SPARK-44369: -- I'm working on it > Use PartitionEvaluator API in

[jira] [Created] (SPARK-44369) Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTableScanExec, DataSourceScanExec

2023-07-10 Thread Vinod KC (Jira)
Vinod KC created SPARK-44369: Summary: Use PartitionEvaluator API in CollectMetricsExec, GenerateExec, ExpandExec, DebugExec, HiveTableScanExec, DataSourceScanExec Key: SPARK-44369 URL:

[jira] [Commented] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741838#comment-17741838 ] Vinod KC commented on SPARK-44362: -- Im working on it > Use PartitionEvaluator API in

[jira] [Commented] (SPARK-44365) Define the computing logic through PartitionEvaluator API and use it in SQL operators InMemoryTableScanExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741837#comment-17741837 ] Vinod KC commented on SPARK-44365: -- Im working on it > Define the computing logic through

[jira] [Commented] (SPARK-44361) Use PartitionEvaluator API in BatchEvalPythonUDTFExec, FlatMapGroupsInPandasExec, MapInBatchExec, FlatMapCoGroupsInPandasExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741836#comment-17741836 ] Vinod KC commented on SPARK-44361: -- Im working on it > Use PartitionEvaluator API in

[jira] [Updated] (SPARK-44365) Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44365: - Description: Define the computing logic through PartitionEvaluator API and use it in SQL operators

[jira] [Updated] (SPARK-44365) Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44365: - Description: InMemoryTableScanExec (was: `BatchEvalPythonUDTFExec` `FlatMapGroupsInPandasExec`

[jira] [Updated] (SPARK-44365) Define the computing logic through PartitionEvaluator API and use it in SQL operators InMemoryTableScanExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44365: - Summary: Define the computing logic through PartitionEvaluator API and use it in SQL operators

[jira] [Created] (SPARK-44365) Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec

2023-07-10 Thread Vinod KC (Jira)
Vinod KC created SPARK-44365: Summary: Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec Key: SPARK-44365 URL:

[jira] [Created] (SPARK-44362) Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec

2023-07-10 Thread Vinod KC (Jira)
Vinod KC created SPARK-44362: Summary: Use PartitionEvaluator API in AggregateInPandasExec, WindowInPandasExec,EvalPythonExec,AttachDistributedSequenceExec Key: SPARK-44362 URL:

[jira] [Created] (SPARK-44361) Use PartitionEvaluator API in BatchEvalPythonUDTFExec, FlatMapGroupsInPandasExec, MapInBatchExec, FlatMapCoGroupsInPandasExec

2023-07-10 Thread Vinod KC (Jira)
Vinod KC created SPARK-44361: Summary: Use PartitionEvaluator API in BatchEvalPythonUDTFExec, FlatMapGroupsInPandasExec, MapInBatchExec, FlatMapCoGroupsInPandasExec Key: SPARK-44361 URL:

[jira] [Commented] (SPARK-44359) Define the computing logic through PartitionEvaluator API and use it in SQL aggregate operators

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741736#comment-17741736 ] Vinod KC commented on SPARK-44359: -- Im working on this > Define the computing logic through

[jira] [Created] (SPARK-44359) Define the computing logic through PartitionEvaluator API and use it in SQL aggregate operators

2023-07-10 Thread Vinod KC (Jira)
Vinod KC created SPARK-44359: Summary: Define the computing logic through PartitionEvaluator API and use it in SQL aggregate operators Key: SPARK-44359 URL: https://issues.apache.org/jira/browse/SPARK-44359

[jira] [Commented] (SPARK-44330) Define the computing logic through PartitionEvaluator API and use it in BroadcastNestedLoopJoinExec & BroadcastHashJoinExec

2023-07-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741734#comment-17741734 ] Vinod KC commented on SPARK-44330: -- PR raised : https://github.com/apache/spark/pull/41888 > Define

[jira] [Created] (SPARK-44330) Define the computing logic through PartitionEvaluator API and use it in BroadcastNestedLoopJoinExec & BroadcastHashJoinExec

2023-07-06 Thread Vinod KC (Jira)
Vinod KC created SPARK-44330: Summary: Define the computing logic through PartitionEvaluator API and use it in BroadcastNestedLoopJoinExec & BroadcastHashJoinExec Key: SPARK-44330 URL:

[jira] [Created] (SPARK-44325) Define the computing logic through PartitionEvaluator API and use it in SortMergeJoinExec

2023-07-06 Thread Vinod KC (Jira)
Vinod KC created SPARK-44325: Summary: Define the computing logic through PartitionEvaluator API and use it in SortMergeJoinExec Key: SPARK-44325 URL: https://issues.apache.org/jira/browse/SPARK-44325

[jira] [Created] (SPARK-44317) Define the computing logic through PartitionEvaluator API and use it in ShuffledHashJoinExec

2023-07-05 Thread Vinod KC (Jira)
Vinod KC created SPARK-44317: Summary: Define the computing logic through PartitionEvaluator API and use it in ShuffledHashJoinExec Key: SPARK-44317 URL: https://issues.apache.org/jira/browse/SPARK-44317

[jira] [Updated] (SPARK-44286) Define the computing logic through PartitionEvaluator API and use it in SQL operators

2023-07-03 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44286: - Description: Define the computing logic through PartitionEvaluator API and use it in SQL operators.

[jira] [Comment Edited] (SPARK-44287) Define the computing logic through PartitionEvaluator API and use it in RowToColumnarExec & ColumnarToRowExec SQL operators.

2023-07-03 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739755#comment-17739755 ] Vinod KC edited comment on SPARK-44287 at 7/4/23 12:55 AM: --- PR raised:

[jira] [Commented] (SPARK-44287) Define the computing logic through PartitionEvaluator API and use it in RowToColumnarExec & ColumnarToRowExec SQL operators.

2023-07-03 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739755#comment-17739755 ] Vinod KC commented on SPARK-44287: -- PR raised : https://github.com/apache/spark/pull/41839/files >

[jira] [Updated] (SPARK-44287) Define the computing logic through PartitionEvaluator API and use it in RowToColumnarExec & ColumnarToRowExec SQL operators.

2023-07-03 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44287: - Summary: Define the computing logic through PartitionEvaluator API and use it in RowToColumnarExec

[jira] [Updated] (SPARK-44286) Define the computing logic through PartitionEvaluator API and use it in SQL operators

2023-07-03 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44286: - Issue Type: Umbrella (was: Improvement) > Define the computing logic through PartitionEvaluator API

[jira] [Created] (SPARK-44287) Define the computing logic though PartitionEvaluator API and use it in RowToColumnarExec & ColumnarToRowExec SQL operators.

2023-07-03 Thread Vinod KC (Jira)
Vinod KC created SPARK-44287: Summary: Define the computing logic though PartitionEvaluator API and use it in RowToColumnarExec & ColumnarToRowExec SQL operators. Key: SPARK-44287 URL:

[jira] [Created] (SPARK-44286) Define the computing logic through PartitionEvaluator API and use it in SQL operators

2023-07-03 Thread Vinod KC (Jira)
Vinod KC created SPARK-44286: Summary: Define the computing logic through PartitionEvaluator API and use it in SQL operators Key: SPARK-44286 URL: https://issues.apache.org/jira/browse/SPARK-44286

[jira] [Updated] (SPARK-44198) Support propagation of the log level to the executors

2023-07-02 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44198: - Summary: Support propagation of the log level to the executors (was: Inconsistent Log Level Setting

[jira] [Commented] (SPARK-44198) Inconsistent Log Level Setting between Spark Driver and Executors

2023-06-26 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737308#comment-17737308 ] Vinod KC commented on SPARK-44198: -- Raised PR : https://github.com/apache/spark/pull/41746 >

[jira] [Updated] (SPARK-44198) Inconsistent Log Level Setting between Spark Driver and Executors

2023-06-26 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44198: - Description: Currently, the *sc.setLogLevel()* method only sets the log level on the Spark driver,

[jira] [Created] (SPARK-44198) Inconsistent Log Level Setting between Spark Driver and Executors

2023-06-26 Thread Vinod KC (Jira)
Vinod KC created SPARK-44198: Summary: Inconsistent Log Level Setting between Spark Driver and Executors Key: SPARK-44198 URL: https://issues.apache.org/jira/browse/SPARK-44198 Project: Spark

[jira] [Commented] (SPARK-43470) Add operating system ,Java, Python version information to application log

2023-05-11 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721885#comment-17721885 ] Vinod KC commented on SPARK-43470: -- https://github.com/apache/spark/pull/41144 > Add operating system

[jira] [Created] (SPARK-43470) Add operating system ,Java, Python version information to application log

2023-05-11 Thread Vinod KC (Jira)
Vinod KC created SPARK-43470: Summary: Add operating system ,Java, Python version information to application log Key: SPARK-43470 URL: https://issues.apache.org/jira/browse/SPARK-43470 Project: Spark

[jira] [Updated] (SPARK-42191) Support udf luhn_check

2023-01-25 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-42191: - Description: Support UDF to check if a given number string is a valid Luhn number. It shall return

[jira] [Created] (SPARK-42191) Support udf luhn_check

2023-01-25 Thread Vinod KC (Jira)
Vinod KC created SPARK-42191: Summary: Support udf luhn_check Key: SPARK-42191 URL: https://issues.apache.org/jira/browse/SPARK-42191 Project: Spark Issue Type: Sub-task Components:

[jira] [Comment Edited] (SPARK-40687) Support data masking built-in Function 'mask'

2023-01-17 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677988#comment-17677988 ] Vinod KC edited comment on SPARK-40687 at 1/17/23 9:29 PM: --- Note: In the udf

[jira] [Commented] (SPARK-40687) Support data masking built-in Function 'mask'

2023-01-17 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677988#comment-17677988 ] Vinod KC commented on SPARK-40687: -- Note: Please refer

[jira] [Updated] (SPARK-42070) Change the default value of argument of Mask udf from -1 to NULL

2023-01-17 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-42070: - Description: In the udf 'mask', using -1 as ignore parameter in String type argument is not a standard

[jira] [Created] (SPARK-42070) Change the default value of argument of Mask udf from -1 to NULL

2023-01-14 Thread Vinod KC (Jira)
Vinod KC created SPARK-42070: Summary: Change the default value of argument of Mask udf from -1 to NULL Key: SPARK-42070 URL: https://issues.apache.org/jira/browse/SPARK-42070 Project: Spark

[jira] [Updated] (SPARK-41079) Support Bit manipulation built-in functions to perform bitwise operations

2022-11-09 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-41079: - Summary: Support Bit manipulation built-in functions to perform bitwise operations (was: Support Bit

[jira] [Commented] (SPARK-41085) Support Bit manipulation function COUNTSET

2022-11-09 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631356#comment-17631356 ] Vinod KC commented on SPARK-41085: -- I'm working on this  > Support Bit manipulation function COUNTSET

[jira] [Commented] (SPARK-41084) Support Bit manipulation function SHIFTRIGHT

2022-11-09 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631355#comment-17631355 ] Vinod KC commented on SPARK-41084: -- I'm working on this  > Support Bit manipulation function

[jira] [Commented] (SPARK-41083) Support Bit manipulation function SHIFTLEFT

2022-11-09 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631353#comment-17631353 ] Vinod KC commented on SPARK-41083: -- I'm working on this  > Support Bit manipulation function SHIFTLEFT

[jira] [Updated] (SPARK-41083) Support Bit manipulation function SHIFTLEFT

2022-11-09 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-41083: - Description: The function shall shift an integer value left by a specified number of bits. As the most

[jira] [Commented] (SPARK-41082) Support Bit manipulation function ROTATERIGHT

2022-11-09 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631352#comment-17631352 ] Vinod KC commented on SPARK-41082: -- I'm working on this  > Support Bit manipulation function

[jira] [Updated] (SPARK-41082) Support Bit manipulation function ROTATERIGHT

2022-11-09 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-41082: - Description: Support Bit manipulation function ROTATERIGHT The function shall rotate an integer value

[jira] [Updated] (SPARK-41081) Support Bit manipulation function ROTATELEFT

2022-11-09 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-41081: - Description: Support Bit manipulation function ROTATELEFT The function shall rotate an integer value

[jira] [Commented] (SPARK-41081) Support Bit manipulation function ROTATELEFT

2022-11-09 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631351#comment-17631351 ] Vinod KC commented on SPARK-41081: -- I'm working on this  > Support Bit manipulation function

[jira] [Commented] (SPARK-41080) Support Bit manipulation function SETBIT

2022-11-09 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631349#comment-17631349 ] Vinod KC commented on SPARK-41080: -- Im working on this  > Support Bit manipulation function SETBIT >

[jira] [Updated] (SPARK-41080) Support Bit manipulation function SETBIT

2022-11-09 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-41080: - Description: Support function to change a bit at a specified position. It shall change a bit at a

[jira] [Created] (SPARK-41085) Support Bit manipulation function COUNTSET

2022-11-09 Thread Vinod KC (Jira)
Vinod KC created SPARK-41085: Summary: Support Bit manipulation function COUNTSET Key: SPARK-41085 URL: https://issues.apache.org/jira/browse/SPARK-41085 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-41079) Support Bit manipulation functions to perform bitwise operations

2022-11-09 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-41079: - Summary: Support Bit manipulation functions to perform bitwise operations (was: Support Bit

  1   2   3   >