[jira] [Assigned] (SPARK-40133) Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40133: Assignee: (was: Apache Spark) > Regenerate excludedTpcdsQueries's golden files if

[jira] [Commented] (SPARK-40133) Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581160#comment-17581160 ] Apache Spark commented on SPARK-40133: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40133) Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40133: Assignee: Apache Spark > Regenerate excludedTpcdsQueries's golden files if

[jira] [Commented] (SPARK-40133) Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581159#comment-17581159 ] Apache Spark commented on SPARK-40133: -- User 'wangyum' has created a pull request for this issue:

[jira] [Created] (SPARK-40133) Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true

2022-08-17 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40133: --- Summary: Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true Key: SPARK-40133 URL: https://issues.apache.org/jira/browse/SPARK-40133

[jira] [Resolved] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

2022-08-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40132. -- Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-40123) Security Vulnerability CVE-2018-11793 due to mesos-1.4.3-shaded-protobuf.jar

2022-08-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40123: - Fix Version/s: (was: 3.3.1) > Security Vulnerability CVE-2018-11793 due to

[jira] [Resolved] (SPARK-40115) Pin Arrow version to 8.0.0 in AppVeyor

2022-08-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40115. -- Resolution: Invalid > Pin Arrow version to 8.0.0 in AppVeyor >

[jira] [Assigned] (SPARK-38946) Generates a new dataframe instead of operating inplace in setitem

2022-08-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38946: Assignee: Yikun Jiang > Generates a new dataframe instead of operating inplace in

[jira] [Resolved] (SPARK-38946) Generates a new dataframe instead of operating inplace in setitem

2022-08-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38946. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36353

[jira] [Resolved] (SPARK-40121) Initialize projection used for Python UDF

2022-08-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40121. -- Fix Version/s: 3.3.1 3.1.4 3.2.3

[jira] [Assigned] (SPARK-40121) Initialize projection used for Python UDF

2022-08-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40121: Assignee: Hyukjin Kwon > Initialize projection used for Python UDF >

[jira] [Commented] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1758#comment-1758 ] Apache Spark commented on SPARK-40132: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40132: Assignee: Apache Spark (was: Sean R. Owen) > MultilayerPerceptronClassifier

[jira] [Assigned] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40132: Assignee: Sean R. Owen (was: Apache Spark) > MultilayerPerceptronClassifier

[jira] [Commented] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581110#comment-17581110 ] Apache Spark commented on SPARK-40132: -- User 'srowen' has created a pull request for this issue:

[jira] [Created] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

2022-08-17 Thread Sean R. Owen (Jira)
Sean R. Owen created SPARK-40132: Summary: MultilayerPerceptronClassifier rawPredictionCol param missing from setParams Key: SPARK-40132 URL: https://issues.apache.org/jira/browse/SPARK-40132

[jira] [Created] (SPARK-40131) Support NumPy ndarray in built-in functions

2022-08-17 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-40131: Summary: Support NumPy ndarray in built-in functions Key: SPARK-40131 URL: https://issues.apache.org/jira/browse/SPARK-40131 Project: Spark Issue Type:

[jira] [Commented] (SPARK-40130) Support NumPy scalars in built-in functions

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581090#comment-17581090 ] Apache Spark commented on SPARK-40130: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-40130) Support NumPy scalars in built-in functions

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40130: Assignee: (was: Apache Spark) > Support NumPy scalars in built-in functions >

[jira] [Commented] (SPARK-40130) Support NumPy scalars in built-in functions

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581091#comment-17581091 ] Apache Spark commented on SPARK-40130: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-40130) Support NumPy scalars in built-in functions

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40130: Assignee: Apache Spark > Support NumPy scalars in built-in functions >

[jira] [Created] (SPARK-40130) Support NumPy scalars in built-in functions

2022-08-17 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-40130: Summary: Support NumPy scalars in built-in functions Key: SPARK-40130 URL: https://issues.apache.org/jira/browse/SPARK-40130 Project: Spark Issue Type:

[jira] [Commented] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

2022-08-17 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581077#comment-17581077 ] L. C. Hsieh commented on SPARK-40128: - Added [~dennishuo] as Spark contributor and assigned this

[jira] [Assigned] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

2022-08-17 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-40128: --- Assignee: Dennis Huo > Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in

[jira] [Commented] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

2022-08-17 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581073#comment-17581073 ] Chao Sun commented on SPARK-40128: -- Seems we need to add [~dennishuo] as Spark contributor in order to

[jira] [Resolved] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

2022-08-17 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-40128. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37557

[jira] [Commented] (SPARK-37544) sequence over dates with month interval is producing incorrect results

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581068#comment-17581068 ] Apache Spark commented on SPARK-37544: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-40110) Add JDBCWithAQESuite

2022-08-17 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-40110: Assignee: Kazuyuki Tanimura > Add JDBCWithAQESuite > > >

[jira] [Resolved] (SPARK-40110) Add JDBCWithAQESuite

2022-08-17 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-40110. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37544

[jira] [Resolved] (SPARK-40109) New SQL function: get()

2022-08-17 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40109. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37541

[jira] [Created] (SPARK-40129) Decimal multiply can produce the wrong answer because it rounds twice

2022-08-17 Thread Robert Joseph Evans (Jira)
Robert Joseph Evans created SPARK-40129: --- Summary: Decimal multiply can produce the wrong answer because it rounds twice Key: SPARK-40129 URL: https://issues.apache.org/jira/browse/SPARK-40129

[jira] [Commented] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581011#comment-17581011 ] Apache Spark commented on SPARK-38954: -- User 'parthchandra' has created a pull request for this

[jira] [Assigned] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38954: Assignee: Apache Spark > Implement sharing of cloud credentials among driver and

[jira] [Commented] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581009#comment-17581009 ] Apache Spark commented on SPARK-38954: -- User 'parthchandra' has created a pull request for this

[jira] [Assigned] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38954: Assignee: (was: Apache Spark) > Implement sharing of cloud credentials among driver

[jira] [Updated] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

2022-08-17 Thread Dennis Huo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated SPARK-40128: --- Docs Text: Added support for keeping vectorized reads enabled for Parquet files using the

[jira] [Comment Edited] (SPARK-40063) pyspark.pandas .apply() changing rows ordering

2022-08-17 Thread Marcelo Rossini Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580971#comment-17580971 ] Marcelo Rossini Castro edited comment on SPARK-40063 at 8/17/22 7:36 PM:

[jira] [Commented] (SPARK-40063) pyspark.pandas .apply() changing rows ordering

2022-08-17 Thread Marcelo Rossini Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580971#comment-17580971 ] Marcelo Rossini Castro commented on SPARK-40063: Normally I use the default,

[jira] [Commented] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

2022-08-17 Thread Parth Chandra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580929#comment-17580929 ] Parth Chandra commented on SPARK-38954: --- Sorry about the delay, should have updated the JIRA. I

[jira] [Updated] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

2022-08-17 Thread Dennis Huo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated SPARK-40128: --- Description: Even though https://issues.apache.org/jira/browse/SPARK-36879 added implementations

[jira] [Commented] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580899#comment-17580899 ] Apache Spark commented on SPARK-40128: -- User 'sfc-gh-dhuo' has created a pull request for this

[jira] [Assigned] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40128: Assignee: (was: Apache Spark) > Add DELTA_LENGTH_BYTE_ARRAY as a recognized

[jira] [Commented] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580898#comment-17580898 ] Apache Spark commented on SPARK-40128: -- User 'sfc-gh-dhuo' has created a pull request for this

[jira] [Assigned] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40128: Assignee: Apache Spark > Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding

[jira] [Updated] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

2022-08-17 Thread Dennis Huo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated SPARK-40128: --- Attachment: delta_length_byte_array.parquet > Add DELTA_LENGTH_BYTE_ARRAY as a recognized

[jira] [Created] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

2022-08-17 Thread Dennis Huo (Jira)
Dennis Huo created SPARK-40128: -- Summary: Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader Key: SPARK-40128 URL: https://issues.apache.org/jira/browse/SPARK-40128

[jira] [Created] (SPARK-40127) FaultToleranceTest should in test dir

2022-08-17 Thread Yang Jie (Jira)
Yang Jie created SPARK-40127: Summary: FaultToleranceTest should in test dir Key: SPARK-40127 URL: https://issues.apache.org/jira/browse/SPARK-40127 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-39799) DataSourceV2: View catalog interface

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580873#comment-17580873 ] Apache Spark commented on SPARK-39799: -- User 'jzhuge' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39799) DataSourceV2: View catalog interface

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39799: Assignee: Apache Spark > DataSourceV2: View catalog interface >

[jira] [Assigned] (SPARK-39799) DataSourceV2: View catalog interface

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39799: Assignee: (was: Apache Spark) > DataSourceV2: View catalog interface >

[jira] [Commented] (SPARK-39799) DataSourceV2: View catalog interface

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580872#comment-17580872 ] Apache Spark commented on SPARK-39799: -- User 'jzhuge' has created a pull request for this issue:

[jira] [Updated] (SPARK-40126) Security scanning spark v3.3.0 docker image results in DSA-5169-1 critical vulnerability

2022-08-17 Thread Jason Tan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Tan updated SPARK-40126: -- Description: Dear Spark Team, Whilst security scanning the docker image:

[jira] [Updated] (SPARK-40126) Security scanning spark v3.3.0 docker image results in DSA-5169-1 critical vulnerability

2022-08-17 Thread Jason Tan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Tan updated SPARK-40126: -- Summary: Security scanning spark v3.3.0 docker image results in DSA-5169-1 critical vulnerability

[jira] [Created] (SPARK-40126) Security scanning spark v3.3.0 results in DSA-5169-1 critical vulnerability

2022-08-17 Thread Jason Tan (Jira)
Jason Tan created SPARK-40126: - Summary: Security scanning spark v3.3.0 results in DSA-5169-1 critical vulnerability Key: SPARK-40126 URL: https://issues.apache.org/jira/browse/SPARK-40126 Project: Spark

[jira] [Assigned] (SPARK-40119) Add reason for cancelJobGroup

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40119: Assignee: (was: Apache Spark) > Add reason for cancelJobGroup >

[jira] [Assigned] (SPARK-40119) Add reason for cancelJobGroup

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40119: Assignee: Apache Spark > Add reason for cancelJobGroup > --

[jira] [Commented] (SPARK-40119) Add reason for cancelJobGroup

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580835#comment-17580835 ] Apache Spark commented on SPARK-40119: -- User 'santosh-d3vpl3x' has created a pull request for this

[jira] [Resolved] (SPARK-39623) partitionng by datestamp leads to wrong query on backend?

2022-08-17 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco resolved SPARK-39623. Resolution: Not A Problem > partitionng by datestamp leads to wrong query on

[jira] [Resolved] (SPARK-40114) Arrow 9.0.0 support with SparkR

2022-08-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40114. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37553

[jira] [Assigned] (SPARK-40114) Arrow 9.0.0 support with SparkR

2022-08-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40114: - Assignee: Hyukjin Kwon > Arrow 9.0.0 support with SparkR >

[jira] [Commented] (SPARK-40125) Add separate infra image for lint job

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580806#comment-17580806 ] Apache Spark commented on SPARK-40125: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40125) Add separate infra image for lint job

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40125: Assignee: (was: Apache Spark) > Add separate infra image for lint job >

[jira] [Commented] (SPARK-40125) Add separate infra image for lint job

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580805#comment-17580805 ] Apache Spark commented on SPARK-40125: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40125) Add separate infra image for lint job

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40125: Assignee: Apache Spark > Add separate infra image for lint job >

[jira] [Created] (SPARK-40125) Add separate infra image for lint job

2022-08-17 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40125: --- Summary: Add separate infra image for lint job Key: SPARK-40125 URL: https://issues.apache.org/jira/browse/SPARK-40125 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-40124) Update TPCDS v1.4 q32 for Plan Stability tests

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580791#comment-17580791 ] Apache Spark commented on SPARK-40124: -- User 'mskapilks' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40124) Update TPCDS v1.4 q32 for Plan Stability tests

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40124: Assignee: Apache Spark > Update TPCDS v1.4 q32 for Plan Stability tests >

[jira] [Assigned] (SPARK-40124) Update TPCDS v1.4 q32 for Plan Stability tests

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40124: Assignee: (was: Apache Spark) > Update TPCDS v1.4 q32 for Plan Stability tests >

[jira] [Updated] (SPARK-40124) Update TPCDS v1.4 q32 for Plan Stability tests

2022-08-17 Thread Kapil Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kapil Singh updated SPARK-40124: Summary: Update TPCDS v1.4 q32 for Plan Stability tests (was: Update TPCDS v1.4 query32) >

[jira] [Created] (SPARK-40124) Update TPCDS v1.4 query32

2022-08-17 Thread Kapil Singh (Jira)
Kapil Singh created SPARK-40124: --- Summary: Update TPCDS v1.4 query32 Key: SPARK-40124 URL: https://issues.apache.org/jira/browse/SPARK-40124 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-40123) Security Vulnerability CVE-2018-11793 due to mesos-1.4.3-shaded-protobuf.jar

2022-08-17 Thread manohar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] manohar updated SPARK-40123: Flags: Patch Labels: security-issue (was: ) > Security Vulnerability CVE-2018-11793 due to

[jira] [Created] (SPARK-40123) Security Vulnerability CVE-2018-11793 due to mesos-1.4.3-shaded-protobuf.jar

2022-08-17 Thread manohar (Jira)
manohar created SPARK-40123: --- Summary: Security Vulnerability CVE-2018-11793 due to mesos-1.4.3-shaded-protobuf.jar Key: SPARK-40123 URL: https://issues.apache.org/jira/browse/SPARK-40123 Project: Spark

[jira] [Updated] (SPARK-40087) Support multiple Column drop in R

2022-08-17 Thread Santosh Pingale (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santosh Pingale updated SPARK-40087: Description: This is a followup on SPARK-39895. The PR previously attempted to adjust

[jira] [Comment Edited] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-08-17 Thread Maksim Grinman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580762#comment-17580762 ] Maksim Grinman edited comment on SPARK-38330 at 8/17/22 12:28 PM: --

[jira] [Comment Edited] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-08-17 Thread Maksim Grinman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580762#comment-17580762 ] Maksim Grinman edited comment on SPARK-38330 at 8/17/22 12:23 PM: --

[jira] [Comment Edited] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-08-17 Thread Maksim Grinman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580762#comment-17580762 ] Maksim Grinman edited comment on SPARK-38330 at 8/17/22 12:22 PM: --

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-08-17 Thread Maksim Grinman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580762#comment-17580762 ] Maksim Grinman commented on SPARK-38330: Thanks for the response. I did try compiling myself and

[jira] [Updated] (SPARK-40122) py4j-0.10.9.5 often produces "Connection reset by peer" in Spark 3.3.0

2022-08-17 Thread Ihor Bobak (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-40122: --- Description: Without any visible reason I am getting this error in my Jupyter notebook (see

[jira] [Created] (SPARK-40122) py4j-0.10.9.5 often produces "Connection reset by peer" in Spark 3.3.0

2022-08-17 Thread Ihor Bobak (Jira)
Ihor Bobak created SPARK-40122: -- Summary: py4j-0.10.9.5 often produces "Connection reset by peer" in Spark 3.3.0 Key: SPARK-40122 URL: https://issues.apache.org/jira/browse/SPARK-40122 Project: Spark

[jira] [Commented] (SPARK-40114) Arrow 9.0.0 support with SparkR

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580731#comment-17580731 ] Apache Spark commented on SPARK-40114: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-40114) Arrow 9.0.0 support with SparkR

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40114: Assignee: (was: Apache Spark) > Arrow 9.0.0 support with SparkR >

[jira] [Assigned] (SPARK-40114) Arrow 9.0.0 support with SparkR

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40114: Assignee: Apache Spark > Arrow 9.0.0 support with SparkR >

[jira] [Assigned] (SPARK-40121) Initialize projection used for Python UDF

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40121: Assignee: Apache Spark > Initialize projection used for Python UDF >

[jira] [Assigned] (SPARK-40121) Initialize projection used for Python UDF

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40121: Assignee: (was: Apache Spark) > Initialize projection used for Python UDF >

[jira] [Commented] (SPARK-40121) Initialize projection used for Python UDF

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580714#comment-17580714 ] Apache Spark commented on SPARK-40121: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

2022-08-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580711#comment-17580711 ] Steve Loughran commented on SPARK-38954: any plans to put the PR up? i'm curious about what

[jira] [Created] (SPARK-40121) Initialize projection used for Python UDF

2022-08-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-40121: Summary: Initialize projection used for Python UDF Key: SPARK-40121 URL: https://issues.apache.org/jira/browse/SPARK-40121 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-38445) Are hadoop committers used in Structured Streaming?

2022-08-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580710#comment-17580710 ] Steve Loughran commented on SPARK-38445: SPARK-40039 might address this > Are hadoop committers

[jira] [Assigned] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

2022-08-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40105: --- Assignee: XiDuo You > Improve repartition in ReplaceCTERefWithRepartition >

[jira] [Comment Edited] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-08-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580707#comment-17580707 ] Steve Loughran edited comment on SPARK-38330 at 8/17/22 9:46 AM: - bq. Is

[jira] [Resolved] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

2022-08-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40105. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37537

[jira] [Comment Edited] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-08-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580707#comment-17580707 ] Steve Loughran edited comment on SPARK-38330 at 8/17/22 9:45 AM: - bq. Is

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-08-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580707#comment-17580707 ] Steve Loughran commented on SPARK-38330: remove all jars with cos in the title from your

[jira] [Created] (SPARK-40120) Make pyspark.sql.readwriter examples self-contained

2022-08-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-40120: Summary: Make pyspark.sql.readwriter examples self-contained Key: SPARK-40120 URL: https://issues.apache.org/jira/browse/SPARK-40120 Project: Spark Issue

[jira] [Updated] (SPARK-40050) Eliminate the Sort if there is a LocalLimit between Join and Sort

2022-08-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40050: Summary: Eliminate the Sort if there is a LocalLimit between Join and Sort (was: Eliminate sort

[jira] [Created] (SPARK-40119) Add reason for cancelJobGroup

2022-08-17 Thread Santosh Pingale (Jira)
Santosh Pingale created SPARK-40119: --- Summary: Add reason for cancelJobGroup Key: SPARK-40119 URL: https://issues.apache.org/jira/browse/SPARK-40119 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-40050) Eliminate sort if parent is local limit

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40050: Assignee: Apache Spark > Eliminate sort if parent is local limit >

[jira] [Commented] (SPARK-40050) Eliminate sort if parent is local limit

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580661#comment-17580661 ] Apache Spark commented on SPARK-40050: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40050) Eliminate sort if parent is local limit

2022-08-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40050: Assignee: (was: Apache Spark) > Eliminate sort if parent is local limit >

  1   2   >