[jira] [Commented] (SPARK-38066) evaluateEquality should ignore attribute without min/max ColumnStat

2022-01-29 Thread Fencheng Mei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484098#comment-17484098 ] Fencheng Mei commented on SPARK-38066: -- [~will86] please pay attention > evaluateE

[jira] [Updated] (SPARK-38037) Spark MLlib FPGrowth not working with 40+ items in Frequent Item set

2022-01-29 Thread RJ (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RJ updated SPARK-38037: --- Description: We have been using Spark FPGrowth and it works well with millions of transactions (records) when the f

[jira] [Created] (SPARK-38067) Pandas on spark deletes columns with all None as default.

2022-01-29 Thread Jira
Bjørn Jørgensen created SPARK-38067: --- Summary: Pandas on spark deletes columns with all None as default. Key: SPARK-38067 URL: https://issues.apache.org/jira/browse/SPARK-38067 Project: Spark

[jira] [Assigned] (SPARK-38067) Pandas on spark deletes columns with all None as default.

2022-01-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38067: Assignee: Apache Spark > Pandas on spark deletes columns with all None as default. >

[jira] [Assigned] (SPARK-38067) Pandas on spark deletes columns with all None as default.

2022-01-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38067: Assignee: (was: Apache Spark) > Pandas on spark deletes columns with all None as defa

[jira] [Commented] (SPARK-38067) Pandas on spark deletes columns with all None as default.

2022-01-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484232#comment-17484232 ] Apache Spark commented on SPARK-38067: -- User 'bjornjorgensen' has created a pull re

[jira] [Created] (SPARK-38068) Persist() and cache() methods shorten LogicalPlan

2022-01-29 Thread Arip Abdullaev (Jira)
Arip Abdullaev created SPARK-38068: -- Summary: Persist() and cache() methods shorten LogicalPlan Key: SPARK-38068 URL: https://issues.apache.org/jira/browse/SPARK-38068 Project: Spark Issue T

[jira] [Created] (SPARK-38069) improve structured streaming window of calculated

2022-01-29 Thread nyingping (Jira)
nyingping created SPARK-38069: - Summary: improve structured streaming window of calculated Key: SPARK-38069 URL: https://issues.apache.org/jira/browse/SPARK-38069 Project: Spark Issue Type: Impro

[jira] [Created] (SPARK-38070) improve structured streaming window of calculated

2022-01-29 Thread nyingping (Jira)
nyingping created SPARK-38070: - Summary: improve structured streaming window of calculated Key: SPARK-38070 URL: https://issues.apache.org/jira/browse/SPARK-38070 Project: Spark Issue Type: Impro

[jira] [Assigned] (SPARK-38069) improve structured streaming window of calculated

2022-01-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38069: Assignee: Apache Spark > improve structured streaming window of calculated >

[jira] [Commented] (SPARK-38069) improve structured streaming window of calculated

2022-01-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484255#comment-17484255 ] Apache Spark commented on SPARK-38069: -- User 'nyingping' has created a pull request

[jira] [Assigned] (SPARK-38069) improve structured streaming window of calculated

2022-01-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38069: Assignee: (was: Apache Spark) > improve structured streaming window of calculated > -

[jira] [Updated] (SPARK-38070) delete

2022-01-29 Thread nyingping (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nyingping updated SPARK-38070: -- Summary: delete (was: improve structured streaming window of calculated) > delete > -- > >

[jira] [Updated] (SPARK-38070) delete

2022-01-29 Thread nyingping (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nyingping updated SPARK-38070: -- Description: Sorry, network problem, duplicate submission (was: Structed Streaming computes window by

[jira] [Resolved] (SPARK-38070) delete

2022-01-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38070. -- Resolution: Invalid > delete > -- > > Key: SPARK-38070 > U

[jira] [Commented] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

2022-01-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484280#comment-17484280 ] Hyukjin Kwon commented on SPARK-38061: -- [~sujitbiswas], so do you propose to upgrad

[jira] [Comment Edited] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

2022-01-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484280#comment-17484280 ] Hyukjin Kwon edited comment on SPARK-38061 at 1/30/22, 1:22 AM: --

[jira] [Commented] (SPARK-38057) Log4j remediation on spark binary files

2022-01-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484282#comment-17484282 ] Hyukjin Kwon commented on SPARK-38057: -- Please ask dev mailing list. > Log4j remed

[jira] [Commented] (SPARK-38058) Writing a spark dataframe to Azure Sql Server is causing duplicate records intermittently

2022-01-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484281#comment-17484281 ] Hyukjin Kwon commented on SPARK-38058: -- Is this an issue from Spark, Azure SQL Serv

[jira] [Resolved] (SPARK-38057) Log4j remediation on spark binary files

2022-01-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38057. -- Resolution: Invalid > Log4j remediation on spark binary files > --

[jira] [Resolved] (SPARK-38055) KBS Training

2022-01-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38055. -- Resolution: Invalid > KBS Training > > > Key: SPARK-38055 >

[jira] [Commented] (SPARK-38066) evaluateEquality should ignore attribute without min/max ColumnStat

2022-01-29 Thread Fencheng Mei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484291#comment-17484291 ] Fencheng Mei commented on SPARK-38066: -- [[SPARK-23445][FOLLOWUP] evaluateEquality s

[jira] [Comment Edited] (SPARK-38066) evaluateEquality should ignore attribute without min/max ColumnStat

2022-01-29 Thread Fencheng Mei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484291#comment-17484291 ] Fencheng Mei edited comment on SPARK-38066 at 1/30/22, 2:50 AM: --

[jira] [Comment Edited] (SPARK-38066) evaluateEquality should ignore attribute without min/max ColumnStat

2022-01-29 Thread Fencheng Mei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484291#comment-17484291 ] Fencheng Mei edited comment on SPARK-38066 at 1/30/22, 2:51 AM: --

[jira] [Commented] (SPARK-23445) ColumnStat refactoring

2022-01-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484292#comment-17484292 ] Apache Spark commented on SPARK-23445: -- User 'Stove-hust' has created a pull reques

[jira] [Created] (SPARK-38071) Support K8s namespace parameter in SBT K8s IT

2022-01-29 Thread William Hyun (Jira)
William Hyun created SPARK-38071: Summary: Support K8s namespace parameter in SBT K8s IT Key: SPARK-38071 URL: https://issues.apache.org/jira/browse/SPARK-38071 Project: Spark Issue Type: Tes

[jira] [Commented] (SPARK-38071) Support K8s namespace parameter in SBT K8s IT

2022-01-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484300#comment-17484300 ] Apache Spark commented on SPARK-38071: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-38071) Support K8s namespace parameter in SBT K8s IT

2022-01-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38071: Assignee: (was: Apache Spark) > Support K8s namespace parameter in SBT K8s IT > -

[jira] [Assigned] (SPARK-38071) Support K8s namespace parameter in SBT K8s IT

2022-01-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38071: Assignee: Apache Spark > Support K8s namespace parameter in SBT K8s IT >

[jira] [Commented] (SPARK-38071) Support K8s namespace parameter in SBT K8s IT

2022-01-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484301#comment-17484301 ] Apache Spark commented on SPARK-38071: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-38071) Support K8s namespace parameter in SBT K8s IT

2022-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38071: - Assignee: William Hyun > Support K8s namespace parameter in SBT K8s IT > --

[jira] [Resolved] (SPARK-38071) Support K8s namespace parameter in SBT K8s IT

2022-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38071. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35364 [https://