[jira] [Commented] (SPARK-36818) Fix filtering a Series by a boolean Series

2021-09-21 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418446#comment-17418446 ] L. C. Hsieh commented on SPARK-36818: - For JIRA, it is better to fill some descripti

[jira] [Updated] (SPARK-36818) Fix filtering a Series by a boolean Series

2021-09-21 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36818: Description: There is an error when filtering a Series using a condition from a DataFrame (https:

[jira] [Assigned] (SPARK-36823) Support broadcast nested loop join hint for equi-join

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36823: Assignee: Apache Spark > Support broadcast nested loop join hint for equi-join >

[jira] [Commented] (SPARK-36823) Support broadcast nested loop join hint for equi-join

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418443#comment-17418443 ] Apache Spark commented on SPARK-36823: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-36823) Support broadcast nested loop join hint for equi-join

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36823: Assignee: (was: Apache Spark) > Support broadcast nested loop join hint for equi-join

[jira] [Commented] (SPARK-36823) Support broadcast nested loop join hint for equi-join

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418444#comment-17418444 ] Apache Spark commented on SPARK-36823: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-36815) Found duplicate rewrite attributes

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418429#comment-17418429 ] Apache Spark commented on SPARK-36815: -- User 'gaoyajun02' has created a pull reques

[jira] [Assigned] (SPARK-36815) Found duplicate rewrite attributes

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36815: Assignee: (was: Apache Spark) > Found duplicate rewrite attributes >

[jira] [Assigned] (SPARK-36815) Found duplicate rewrite attributes

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36815: Assignee: Apache Spark > Found duplicate rewrite attributes > ---

[jira] [Commented] (SPARK-36815) Found duplicate rewrite attributes

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418427#comment-17418427 ] Apache Spark commented on SPARK-36815: -- User 'gaoyajun02' has created a pull reques

[jira] [Commented] (SPARK-33272) prune the attributes mapping in QueryPlan.transformUpWithNewOutput

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418426#comment-17418426 ] Apache Spark commented on SPARK-33272: -- User 'gaoyajun02' has created a pull reques

[jira] [Commented] (SPARK-36824) Add sec and csc as R functions

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418423#comment-17418423 ] Apache Spark commented on SPARK-36824: -- User 'yutoacts' has created a pull request

[jira] [Assigned] (SPARK-36824) Add sec and csc as R functions

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36824: Assignee: Apache Spark > Add sec and csc as R functions > --

[jira] [Assigned] (SPARK-36824) Add sec and csc as R functions

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36824: Assignee: (was: Apache Spark) > Add sec and csc as R functions >

[jira] [Commented] (SPARK-36824) Add sec and csc as R functions

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418421#comment-17418421 ] Apache Spark commented on SPARK-36824: -- User 'yutoacts' has created a pull request

[jira] [Updated] (SPARK-36823) Support broadcast nested loop join hint for equi-join

2021-09-21 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-36823: -- Description: For the join if one side is small and other side is large, the shuffle overhead is also

[jira] [Created] (SPARK-36824) Add sec and csc as R functions

2021-09-21 Thread Yuto Akutsu (Jira)
Yuto Akutsu created SPARK-36824: --- Summary: Add sec and csc as R functions Key: SPARK-36824 URL: https://issues.apache.org/jira/browse/SPARK-36824 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-36815) Found duplicate rewrite attributes

2021-09-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-36815: Fix Version/s: (was: 3.0.2) > Found duplicate rewrite attributes > ---

[jira] [Created] (SPARK-36823) Support broadcast nested loop join hint for equi-join

2021-09-21 Thread XiDuo You (Jira)
XiDuo You created SPARK-36823: - Summary: Support broadcast nested loop join hint for equi-join Key: SPARK-36823 URL: https://issues.apache.org/jira/browse/SPARK-36823 Project: Spark Issue Type: I

[jira] [Commented] (SPARK-36820) Disable LZ4 test for Hadoop 2.7 profile

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418402#comment-17418402 ] Apache Spark commented on SPARK-36820: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-36820) Disable LZ4 test for Hadoop 2.7 profile

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418401#comment-17418401 ] Apache Spark commented on SPARK-36820: -- User 'sunchao' has created a pull request f

[jira] [Updated] (SPARK-36781) The log could not get the correct line number

2021-09-21 Thread chenxusheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenxusheng updated SPARK-36781: Affects Version/s: 3.1.2 > The log could not get the correct line number > ---

[jira] [Commented] (SPARK-36763) Pull out ordering expressions

2021-09-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418386#comment-17418386 ] Yuming Wang commented on SPARK-36763: - Benchmark and benchmark result: {code:scala}

[jira] [Updated] (SPARK-36771) Fix `pop` of Categorical Series

2021-09-21 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36771: -- Fix Version/s: 3.2.0 > Fix `pop` of Categorical Series > > >

[jira] [Commented] (SPARK-36822) BroadcastNestedLoopJoinExec should use all condition instead of non-equi condition

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418373#comment-17418373 ] Apache Spark commented on SPARK-36822: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-36822) BroadcastNestedLoopJoinExec should use all condition instead of non-equi condition

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36822: Assignee: Apache Spark > BroadcastNestedLoopJoinExec should use all condition instead of

[jira] [Assigned] (SPARK-36822) BroadcastNestedLoopJoinExec should use all condition instead of non-equi condition

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36822: Assignee: (was: Apache Spark) > BroadcastNestedLoopJoinExec should use all condition

[jira] [Commented] (SPARK-36822) BroadcastNestedLoopJoinExec should use all condition instead of non-equi condition

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418372#comment-17418372 ] Apache Spark commented on SPARK-36822: -- User 'ulysses-you' has created a pull reque

[jira] [Created] (SPARK-36822) BroadcastNestedLoopJoinExec should use all condition instead of non-equi condition

2021-09-21 Thread XiDuo You (Jira)
XiDuo You created SPARK-36822: - Summary: BroadcastNestedLoopJoinExec should use all condition instead of non-equi condition Key: SPARK-36822 URL: https://issues.apache.org/jira/browse/SPARK-36822 Project:

[jira] [Comment Edited] (SPARK-31646) Remove unused registeredConnections counter from ShuffleMetrics

2021-09-21 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418366#comment-17418366 ] Yongjun Zhang edited comment on SPARK-31646 at 9/22/21, 1:04 AM: -

[jira] [Commented] (SPARK-31646) Remove unused registeredConnections counter from ShuffleMetrics

2021-09-21 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418366#comment-17418366 ] Yongjun Zhang commented on SPARK-31646: --- HI [~mauzhang], Thanks a lot for your an

[jira] [Created] (SPARK-36821) Create a test to extend ColumnarBatch

2021-09-21 Thread Yufei Gu (Jira)
Yufei Gu created SPARK-36821: Summary: Create a test to extend ColumnarBatch Key: SPARK-36821 URL: https://issues.apache.org/jira/browse/SPARK-36821 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-36820) Disable LZ4 test for Hadoop 2.7 profile

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418340#comment-17418340 ] Apache Spark commented on SPARK-36820: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-36820) Disable LZ4 test for Hadoop 2.7 profile

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36820: Assignee: Apache Spark > Disable LZ4 test for Hadoop 2.7 profile > --

[jira] [Assigned] (SPARK-36820) Disable LZ4 test for Hadoop 2.7 profile

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36820: Assignee: (was: Apache Spark) > Disable LZ4 test for Hadoop 2.7 profile > ---

[jira] [Commented] (SPARK-36820) Disable LZ4 test for Hadoop 2.7 profile

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418339#comment-17418339 ] Apache Spark commented on SPARK-36820: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-36771) Fix `pop` of Categorical Series

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418338#comment-17418338 ] Apache Spark commented on SPARK-36771: -- User 'xinrong-databricks' has created a pul

[jira] [Created] (SPARK-36820) Disable LZ4 test for Hadoop 2.7 profile

2021-09-21 Thread Chao Sun (Jira)
Chao Sun created SPARK-36820: Summary: Disable LZ4 test for Hadoop 2.7 profile Key: SPARK-36820 URL: https://issues.apache.org/jira/browse/SPARK-36820 Project: Spark Issue Type: Bug Com

[jira] [Updated] (SPARK-36820) Disable LZ4 test for Hadoop 2.7 profile

2021-09-21 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-36820: - Issue Type: Test (was: Bug) > Disable LZ4 test for Hadoop 2.7 profile > ---

[jira] [Resolved] (SPARK-36771) Fix `pop` of Categorical Series

2021-09-21 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36771. --- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Issue resolved

[jira] [Updated] (SPARK-36819) DPP: Don't insert redundant filters in case static partition pruning can be done

2021-09-21 Thread Swinky Mann (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swinky Mann updated SPARK-36819: Description: Don't insert dynamic partition pruning filters in case the filters already referred

[jira] [Commented] (SPARK-36819) DPP: Don't insert redundant filters in case static partition pruning can be done

2021-09-21 Thread Swinky Mann (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418300#comment-17418300 ] Swinky Mann commented on SPARK-36819: - https://github.com/apache/spark/pull/34062 >

[jira] [Commented] (SPARK-36819) DPP: Don't insert redundant filters in case static partition pruning can be done

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418301#comment-17418301 ] Apache Spark commented on SPARK-36819: -- User 'Swinky' has created a pull request fo

[jira] [Assigned] (SPARK-36819) DPP: Don't insert redundant filters in case static partition pruning can be done

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36819: Assignee: Apache Spark > DPP: Don't insert redundant filters in case static partition pru

[jira] [Assigned] (SPARK-36819) DPP: Don't insert redundant filters in case static partition pruning can be done

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36819: Assignee: (was: Apache Spark) > DPP: Don't insert redundant filters in case static pa

[jira] [Created] (SPARK-36819) DPP: Don't insert redundant filters in case static partition pruning can be done

2021-09-21 Thread Swinky Mann (Jira)
Swinky Mann created SPARK-36819: --- Summary: DPP: Don't insert redundant filters in case static partition pruning can be done Key: SPARK-36819 URL: https://issues.apache.org/jira/browse/SPARK-36819 Projec

[jira] [Commented] (SPARK-36818) Fix filtering a Series by a boolean Series

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418271#comment-17418271 ] Apache Spark commented on SPARK-36818: -- User 'xinrong-databricks' has created a pul

[jira] [Commented] (SPARK-36818) Fix filtering a Series by a boolean Series

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418269#comment-17418269 ] Apache Spark commented on SPARK-36818: -- User 'xinrong-databricks' has created a pul

[jira] [Assigned] (SPARK-36818) Fix filtering a Series by a boolean Series

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36818: Assignee: Apache Spark > Fix filtering a Series by a boolean Series > ---

[jira] [Assigned] (SPARK-36818) Fix filtering a Series by a boolean Series

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36818: Assignee: (was: Apache Spark) > Fix filtering a Series by a boolean Series >

[jira] [Created] (SPARK-36818) Fix filtering a Series by a boolean Series

2021-09-21 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-36818: Summary: Fix filtering a Series by a boolean Series Key: SPARK-36818 URL: https://issues.apache.org/jira/browse/SPARK-36818 Project: Spark Issue Type: Sub-ta

[jira] [Resolved] (SPARK-36615) SparkContext should register shutdown hook earlier

2021-09-21 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-36615. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 338

[jira] [Assigned] (SPARK-36615) SparkContext should register shutdown hook earlier

2021-09-21 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-36615: --- Assignee: angerszhu > SparkContext should register shutdown hook earlier >

[jira] [Created] (SPARK-36817) Does Apache Spark 3 support GPU usage for Spark RDDs?

2021-09-21 Thread Abhishek Shakya (Jira)
Abhishek Shakya created SPARK-36817: --- Summary: Does Apache Spark 3 support GPU usage for Spark RDDs? Key: SPARK-36817 URL: https://issues.apache.org/jira/browse/SPARK-36817 Project: Spark I

[jira] [Resolved] (SPARK-36769) Improve `filter` of single-indexed DataFrame

2021-09-21 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36769. --- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Issue resolved

[jira] [Assigned] (SPARK-36814) Make class ColumnarBatch extendable

2021-09-21 Thread DB Tsai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-36814: --- Assignee: Yufei Gu > Make class ColumnarBatch extendable > --- > >

[jira] [Resolved] (SPARK-36814) Make class ColumnarBatch extendable

2021-09-21 Thread DB Tsai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-36814. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34054 [https://github.com/a

[jira] [Commented] (SPARK-36670) Add end-to-end codec test cases for main datasources

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418167#comment-17418167 ] Apache Spark commented on SPARK-36670: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-36811) Add bitwise functions for the BINARY data type

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418162#comment-17418162 ] Apache Spark commented on SPARK-36811: -- User 'mkaravel' has created a pull request

[jira] [Assigned] (SPARK-36811) Add bitwise functions for the BINARY data type

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36811: Assignee: Apache Spark > Add bitwise functions for the BINARY data type > ---

[jira] [Assigned] (SPARK-36811) Add bitwise functions for the BINARY data type

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36811: Assignee: (was: Apache Spark) > Add bitwise functions for the BINARY data type >

[jira] [Updated] (SPARK-36816) Introduce a config variable for the incrementalCollects row batch size

2021-09-21 Thread Ole (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ole updated SPARK-36816: Description: After enabling *_spark.sql.thriftServer.incrementalCollects_* Thrift will execute queries in batches

[jira] [Updated] (SPARK-36816) Introduce a config variable for the incrementalCollects row batch size

2021-09-21 Thread Ole (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ole updated SPARK-36816: Description: After enabling *_spark.sql.thriftServer.incrementalCollects_* Thrift will execute queries in batches

[jira] [Created] (SPARK-36816) Introduce a config variable for the incrementalCollects row batch size

2021-09-21 Thread Ole (Jira)
Ole created SPARK-36816: --- Summary: Introduce a config variable for the incrementalCollects row batch size Key: SPARK-36816 URL: https://issues.apache.org/jira/browse/SPARK-36816 Project: Spark Issue T

[jira] [Assigned] (SPARK-36711) Support multi-index in new syntax

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36711: Assignee: Apache Spark > Support multi-index in new syntax >

[jira] [Assigned] (SPARK-36711) Support multi-index in new syntax

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36711: Assignee: (was: Apache Spark) > Support multi-index in new syntax > -

[jira] [Commented] (SPARK-36711) Support multi-index in new syntax

2021-09-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418150#comment-17418150 ] Apache Spark commented on SPARK-36711: -- User 'dgd-contributor' has created a pull r

[jira] [Comment Edited] (SPARK-36815) Found duplicate rewrite attributes

2021-09-21 Thread gaoyajun02 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418064#comment-17418064 ] gaoyajun02 edited comment on SPARK-36815 at 9/21/21, 2:19 PM:

[jira] [Comment Edited] (SPARK-36815) Found duplicate rewrite attributes

2021-09-21 Thread gaoyajun02 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418064#comment-17418064 ] gaoyajun02 edited comment on SPARK-36815 at 9/21/21, 12:17 PM: ---

[jira] [Commented] (SPARK-36815) Found duplicate rewrite attributes

2021-09-21 Thread gaoyajun02 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418064#comment-17418064 ] gaoyajun02 commented on SPARK-36815: https://issues.apache.org/jira/browse/SPARK-332

[jira] [Updated] (SPARK-36815) Found duplicate rewrite attributes

2021-09-21 Thread gaoyajun02 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyajun02 updated SPARK-36815: --- Description: We are using Spark version 3.0.2 in production and some ETLs contain multi-level CETs

[jira] [Commented] (SPARK-36600) reduces memory consumption win Pyspark CreateDataFrame

2021-09-21 Thread Anton Kholodkov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418052#comment-17418052 ] Anton Kholodkov commented on SPARK-36600: - Hello! I would like to help with the

[jira] [Created] (SPARK-36815) Found duplicate rewrite attributes

2021-09-21 Thread gaoyajun02 (Jira)
gaoyajun02 created SPARK-36815: -- Summary: Found duplicate rewrite attributes Key: SPARK-36815 URL: https://issues.apache.org/jira/browse/SPARK-36815 Project: Spark Issue Type: Bug Comp

[jira] [Resolved] (SPARK-36807) Merge ANSI interval types to a tightest common type

2021-09-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36807. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34049 [https://github.com