[jira] [Created] (SPARK-40135) Support ps.Index in DataFrame creation

Ruifeng Zheng created SPARK-40135: - Summary: Support ps.Index in DataFrame creation Key: SPARK-40135 URL: https://issues.apache.org/jira/browse/SPARK-40135 Project: Spark Issue Type: Improvem

[jira] [Commented] (SPARK-40134) Update ORC to 1.7.6

[ https://issues.apache.org/jira/browse/SPARK-40134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581186#comment-17581186 ] Apache Spark commented on SPARK-40134: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-40134) Update ORC to 1.7.6

[ https://issues.apache.org/jira/browse/SPARK-40134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40134: Assignee: Apache Spark > Update ORC to 1.7.6 > --- > > Ke

[jira] [Assigned] (SPARK-40134) Update ORC to 1.7.6

[ https://issues.apache.org/jira/browse/SPARK-40134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40134: Assignee: (was: Apache Spark) > Update ORC to 1.7.6 > --- > >

[jira] [Created] (SPARK-40134) Update ORC to 1.7.6

William Hyun created SPARK-40134: Summary: Update ORC to 1.7.6 Key: SPARK-40134 URL: https://issues.apache.org/jira/browse/SPARK-40134 Project: Spark Issue Type: Bug Components: Bui

[jira] [Assigned] (SPARK-40133) Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true

[ https://issues.apache.org/jira/browse/SPARK-40133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40133: Assignee: (was: Apache Spark) > Regenerate excludedTpcdsQueries's golden files if reg

[jira] [Commented] (SPARK-40133) Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true

[ https://issues.apache.org/jira/browse/SPARK-40133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581160#comment-17581160 ] Apache Spark commented on SPARK-40133: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-40133) Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true

[ https://issues.apache.org/jira/browse/SPARK-40133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40133: Assignee: Apache Spark > Regenerate excludedTpcdsQueries's golden files if regenerateGold

[jira] [Commented] (SPARK-40133) Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true

[ https://issues.apache.org/jira/browse/SPARK-40133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581159#comment-17581159 ] Apache Spark commented on SPARK-40133: -- User 'wangyum' has created a pull request f

[jira] [Created] (SPARK-40133) Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true

Yuming Wang created SPARK-40133: --- Summary: Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true Key: SPARK-40133 URL: https://issues.apache.org/jira/browse/SPARK-40133 Project

[jira] [Resolved] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

[ https://issues.apache.org/jira/browse/SPARK-40132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40132. -- Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Resolved by https://git

[jira] [Updated] (SPARK-40123) Security Vulnerability CVE-2018-11793 due to mesos-1.4.3-shaded-protobuf.jar

[ https://issues.apache.org/jira/browse/SPARK-40123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40123: - Fix Version/s: (was: 3.3.1) > Security Vulnerability CVE-2018-11793 due to mesos-1.4.3-shade

[jira] [Resolved] (SPARK-40115) Pin Arrow version to 8.0.0 in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-40115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40115. -- Resolution: Invalid > Pin Arrow version to 8.0.0 in AppVeyor > ---

[jira] [Assigned] (SPARK-38946) Generates a new dataframe instead of operating inplace in setitem

[ https://issues.apache.org/jira/browse/SPARK-38946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38946: Assignee: Yikun Jiang > Generates a new dataframe instead of operating inplace in setitem

[jira] [Resolved] (SPARK-38946) Generates a new dataframe instead of operating inplace in setitem

[ https://issues.apache.org/jira/browse/SPARK-38946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38946. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36353 [https://gi

[jira] [Resolved] (SPARK-40121) Initialize projection used for Python UDF

[ https://issues.apache.org/jira/browse/SPARK-40121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40121. -- Fix Version/s: 3.3.1 3.1.4 3.2.3 3.4.0

[jira] [Assigned] (SPARK-40121) Initialize projection used for Python UDF

[ https://issues.apache.org/jira/browse/SPARK-40121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40121: Assignee: Hyukjin Kwon > Initialize projection used for Python UDF >

[jira] [Commented] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

[ https://issues.apache.org/jira/browse/SPARK-40132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1758#comment-1758 ] Apache Spark commented on SPARK-40132: -- User 'srowen' has created a pull request fo

[jira] [Assigned] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

[ https://issues.apache.org/jira/browse/SPARK-40132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40132: Assignee: Apache Spark (was: Sean R. Owen) > MultilayerPerceptronClassifier rawPredictio

[jira] [Assigned] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

[ https://issues.apache.org/jira/browse/SPARK-40132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40132: Assignee: Sean R. Owen (was: Apache Spark) > MultilayerPerceptronClassifier rawPredictio

[jira] [Commented] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

[ https://issues.apache.org/jira/browse/SPARK-40132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581110#comment-17581110 ] Apache Spark commented on SPARK-40132: -- User 'srowen' has created a pull request fo

[jira] [Created] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

Sean R. Owen created SPARK-40132: Summary: MultilayerPerceptronClassifier rawPredictionCol param missing from setParams Key: SPARK-40132 URL: https://issues.apache.org/jira/browse/SPARK-40132 Project:

[jira] [Created] (SPARK-40131) Support NumPy ndarray in built-in functions

Xinrong Meng created SPARK-40131: Summary: Support NumPy ndarray in built-in functions Key: SPARK-40131 URL: https://issues.apache.org/jira/browse/SPARK-40131 Project: Spark Issue Type: Sub-t

[jira] [Commented] (SPARK-40130) Support NumPy scalars in built-in functions

[ https://issues.apache.org/jira/browse/SPARK-40130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581090#comment-17581090 ] Apache Spark commented on SPARK-40130: -- User 'xinrong-meng' has created a pull requ

[jira] [Assigned] (SPARK-40130) Support NumPy scalars in built-in functions

[ https://issues.apache.org/jira/browse/SPARK-40130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40130: Assignee: (was: Apache Spark) > Support NumPy scalars in built-in functions > ---

[jira] [Commented] (SPARK-40130) Support NumPy scalars in built-in functions

[ https://issues.apache.org/jira/browse/SPARK-40130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581091#comment-17581091 ] Apache Spark commented on SPARK-40130: -- User 'xinrong-meng' has created a pull requ

[jira] [Assigned] (SPARK-40130) Support NumPy scalars in built-in functions

[ https://issues.apache.org/jira/browse/SPARK-40130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40130: Assignee: Apache Spark > Support NumPy scalars in built-in functions > --

[jira] [Created] (SPARK-40130) Support NumPy scalars in built-in functions

Xinrong Meng created SPARK-40130: Summary: Support NumPy scalars in built-in functions Key: SPARK-40130 URL: https://issues.apache.org/jira/browse/SPARK-40130 Project: Spark Issue Type: Sub-t

[jira] [Commented] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581077#comment-17581077 ] L. C. Hsieh commented on SPARK-40128: - Added [~dennishuo] as Spark contributor and a

[jira] [Assigned] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-40128: --- Assignee: Dennis Huo > Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in

[jira] [Commented] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581073#comment-17581073 ] Chao Sun commented on SPARK-40128: -- Seems we need to add [~dennishuo] as Spark contribu

[jira] [Resolved] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-40128. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37557 [https://github.com

[jira] [Commented] (SPARK-37544) sequence over dates with month interval is producing incorrect results

[ https://issues.apache.org/jira/browse/SPARK-37544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581068#comment-17581068 ] Apache Spark commented on SPARK-37544: -- User 'bersprockets' has created a pull requ

[jira] [Assigned] (SPARK-40110) Add JDBCWithAQESuite

[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-40110: Assignee: Kazuyuki Tanimura > Add JDBCWithAQESuite > > > Key

[jira] [Resolved] (SPARK-40110) Add JDBCWithAQESuite

[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-40110. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37544 [https://github.com

[jira] [Resolved] (SPARK-40109) New SQL function: get()

[ https://issues.apache.org/jira/browse/SPARK-40109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40109. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37541 [https:

[jira] [Created] (SPARK-40129) Decimal multiply can produce the wrong answer because it rounds twice

Robert Joseph Evans created SPARK-40129: --- Summary: Decimal multiply can produce the wrong answer because it rounds twice Key: SPARK-40129 URL: https://issues.apache.org/jira/browse/SPARK-40129 P

[jira] [Commented] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581011#comment-17581011 ] Apache Spark commented on SPARK-38954: -- User 'parthchandra' has created a pull requ

[jira] [Assigned] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38954: Assignee: Apache Spark > Implement sharing of cloud credentials among driver and executor

[jira] [Commented] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581009#comment-17581009 ] Apache Spark commented on SPARK-38954: -- User 'parthchandra' has created a pull requ

[jira] [Assigned] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38954: Assignee: (was: Apache Spark) > Implement sharing of cloud credentials among driver a

[jira] [Updated] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated SPARK-40128: --- Docs Text: Added support for keeping vectorized reads enabled for Parquet files using the DELTA_LENG

[jira] [Comment Edited] (SPARK-40063) pyspark.pandas .apply() changing rows ordering

[ https://issues.apache.org/jira/browse/SPARK-40063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580971#comment-17580971 ] Marcelo Rossini Castro edited comment on SPARK-40063 at 8/17/22 7:36 PM: -

[jira] [Commented] (SPARK-40063) pyspark.pandas .apply() changing rows ordering

[ https://issues.apache.org/jira/browse/SPARK-40063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580971#comment-17580971 ] Marcelo Rossini Castro commented on SPARK-40063: Normally I use the defa

[jira] [Commented] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580929#comment-17580929 ] Parth Chandra commented on SPARK-38954: --- Sorry about the delay, should have update

[jira] [Updated] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated SPARK-40128: --- Description: Even though https://issues.apache.org/jira/browse/SPARK-36879 added implementations fo

[jira] [Commented] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580899#comment-17580899 ] Apache Spark commented on SPARK-40128: -- User 'sfc-gh-dhuo' has created a pull reque

[jira] [Assigned] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40128: Assignee: (was: Apache Spark) > Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalon

[jira] [Commented] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580898#comment-17580898 ] Apache Spark commented on SPARK-40128: -- User 'sfc-gh-dhuo' has created a pull reque

[jira] [Assigned] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40128: Assignee: Apache Spark > Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding

[jira] [Updated] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

[ https://issues.apache.org/jira/browse/SPARK-40128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated SPARK-40128: --- Attachment: delta_length_byte_array.parquet > Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone

[jira] [Created] (SPARK-40128) Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader

Dennis Huo created SPARK-40128: -- Summary: Add DELTA_LENGTH_BYTE_ARRAY as a recognized standalone encoding in VectorizedColumnReader Key: SPARK-40128 URL: https://issues.apache.org/jira/browse/SPARK-40128

[jira] [Created] (SPARK-40127) FaultToleranceTest should in test dir

Yang Jie created SPARK-40127: Summary: FaultToleranceTest should in test dir Key: SPARK-40127 URL: https://issues.apache.org/jira/browse/SPARK-40127 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-39799) DataSourceV2: View catalog interface

[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580873#comment-17580873 ] Apache Spark commented on SPARK-39799: -- User 'jzhuge' has created a pull request fo

[jira] [Assigned] (SPARK-39799) DataSourceV2: View catalog interface

[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39799: Assignee: Apache Spark > DataSourceV2: View catalog interface > -

[jira] [Assigned] (SPARK-39799) DataSourceV2: View catalog interface

[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39799: Assignee: (was: Apache Spark) > DataSourceV2: View catalog interface > --

[jira] [Commented] (SPARK-39799) DataSourceV2: View catalog interface

[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580872#comment-17580872 ] Apache Spark commented on SPARK-39799: -- User 'jzhuge' has created a pull request fo

[jira] [Updated] (SPARK-40126) Security scanning spark v3.3.0 docker image results in DSA-5169-1 critical vulnerability

[ https://issues.apache.org/jira/browse/SPARK-40126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Tan updated SPARK-40126: -- Description: Dear Spark Team, Whilst security scanning the docker image: docker.io/apache/spark:v3.3.

[jira] [Updated] (SPARK-40126) Security scanning spark v3.3.0 docker image results in DSA-5169-1 critical vulnerability

[ https://issues.apache.org/jira/browse/SPARK-40126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Tan updated SPARK-40126: -- Summary: Security scanning spark v3.3.0 docker image results in DSA-5169-1 critical vulnerability (wa

[jira] [Created] (SPARK-40126) Security scanning spark v3.3.0 results in DSA-5169-1 critical vulnerability

Jason Tan created SPARK-40126: - Summary: Security scanning spark v3.3.0 results in DSA-5169-1 critical vulnerability Key: SPARK-40126 URL: https://issues.apache.org/jira/browse/SPARK-40126 Project: Spark

[jira] [Assigned] (SPARK-40119) Add reason for cancelJobGroup

[ https://issues.apache.org/jira/browse/SPARK-40119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40119: Assignee: (was: Apache Spark) > Add reason for cancelJobGroup >

[jira] [Assigned] (SPARK-40119) Add reason for cancelJobGroup

[ https://issues.apache.org/jira/browse/SPARK-40119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40119: Assignee: Apache Spark > Add reason for cancelJobGroup > --

[jira] [Commented] (SPARK-40119) Add reason for cancelJobGroup

[ https://issues.apache.org/jira/browse/SPARK-40119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580835#comment-17580835 ] Apache Spark commented on SPARK-40119: -- User 'santosh-d3vpl3x' has created a pull r

[jira] [Resolved] (SPARK-39623) partitionng by datestamp leads to wrong query on backend?

[ https://issues.apache.org/jira/browse/SPARK-39623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco resolved SPARK-39623. Resolution: Not A Problem > partitionng by datestamp leads to wrong query on backe

[jira] [Resolved] (SPARK-40114) Arrow 9.0.0 support with SparkR

[ https://issues.apache.org/jira/browse/SPARK-40114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40114. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37553 [https://

[jira] [Assigned] (SPARK-40114) Arrow 9.0.0 support with SparkR

[ https://issues.apache.org/jira/browse/SPARK-40114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40114: - Assignee: Hyukjin Kwon > Arrow 9.0.0 support with SparkR >

[jira] [Commented] (SPARK-40125) Add separate infra image for lint job

[ https://issues.apache.org/jira/browse/SPARK-40125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580806#comment-17580806 ] Apache Spark commented on SPARK-40125: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-40125) Add separate infra image for lint job

[ https://issues.apache.org/jira/browse/SPARK-40125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40125: Assignee: (was: Apache Spark) > Add separate infra image for lint job > -

[jira] [Commented] (SPARK-40125) Add separate infra image for lint job

[ https://issues.apache.org/jira/browse/SPARK-40125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580805#comment-17580805 ] Apache Spark commented on SPARK-40125: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-40125) Add separate infra image for lint job

[ https://issues.apache.org/jira/browse/SPARK-40125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40125: Assignee: Apache Spark > Add separate infra image for lint job >

[jira] [Created] (SPARK-40125) Add separate infra image for lint job

Yikun Jiang created SPARK-40125: --- Summary: Add separate infra image for lint job Key: SPARK-40125 URL: https://issues.apache.org/jira/browse/SPARK-40125 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-40124) Update TPCDS v1.4 q32 for Plan Stability tests

[ https://issues.apache.org/jira/browse/SPARK-40124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580791#comment-17580791 ] Apache Spark commented on SPARK-40124: -- User 'mskapilks' has created a pull request

[jira] [Assigned] (SPARK-40124) Update TPCDS v1.4 q32 for Plan Stability tests

[ https://issues.apache.org/jira/browse/SPARK-40124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40124: Assignee: Apache Spark > Update TPCDS v1.4 q32 for Plan Stability tests > ---

[jira] [Assigned] (SPARK-40124) Update TPCDS v1.4 q32 for Plan Stability tests

[ https://issues.apache.org/jira/browse/SPARK-40124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40124: Assignee: (was: Apache Spark) > Update TPCDS v1.4 q32 for Plan Stability tests >

[jira] [Updated] (SPARK-40124) Update TPCDS v1.4 q32 for Plan Stability tests

[ https://issues.apache.org/jira/browse/SPARK-40124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kapil Singh updated SPARK-40124: Summary: Update TPCDS v1.4 q32 for Plan Stability tests (was: Update TPCDS v1.4 query32) > Updat

[jira] [Created] (SPARK-40124) Update TPCDS v1.4 query32

Kapil Singh created SPARK-40124: --- Summary: Update TPCDS v1.4 query32 Key: SPARK-40124 URL: https://issues.apache.org/jira/browse/SPARK-40124 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-40123) Security Vulnerability CVE-2018-11793 due to mesos-1.4.3-shaded-protobuf.jar

[ https://issues.apache.org/jira/browse/SPARK-40123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] manohar updated SPARK-40123: Flags: Patch Labels: security-issue (was: ) > Security Vulnerability CVE-2018-11793 due to mesos-1.4

[jira] [Created] (SPARK-40123) Security Vulnerability CVE-2018-11793 due to mesos-1.4.3-shaded-protobuf.jar

manohar created SPARK-40123: --- Summary: Security Vulnerability CVE-2018-11793 due to mesos-1.4.3-shaded-protobuf.jar Key: SPARK-40123 URL: https://issues.apache.org/jira/browse/SPARK-40123 Project: Spark

[jira] [Updated] (SPARK-40087) Support multiple Column drop in R

[ https://issues.apache.org/jira/browse/SPARK-40087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santosh Pingale updated SPARK-40087: Description: This is a followup on SPARK-39895. The PR previously attempted to adjust imp

[jira] [Comment Edited] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580762#comment-17580762 ] Maksim Grinman edited comment on SPARK-38330 at 8/17/22 12:28 PM:

[jira] [Comment Edited] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580762#comment-17580762 ] Maksim Grinman edited comment on SPARK-38330 at 8/17/22 12:23 PM:

[jira] [Comment Edited] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580762#comment-17580762 ] Maksim Grinman edited comment on SPARK-38330 at 8/17/22 12:22 PM:

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580762#comment-17580762 ] Maksim Grinman commented on SPARK-38330: Thanks for the response. I did try comp

[jira] [Updated] (SPARK-40122) py4j-0.10.9.5 often produces "Connection reset by peer" in Spark 3.3.0

[ https://issues.apache.org/jira/browse/SPARK-40122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-40122: --- Description: Without any visible reason I am getting this error in my Jupyter notebook (see stacktr

[jira] [Created] (SPARK-40122) py4j-0.10.9.5 often produces "Connection reset by peer" in Spark 3.3.0

Ihor Bobak created SPARK-40122: -- Summary: py4j-0.10.9.5 often produces "Connection reset by peer" in Spark 3.3.0 Key: SPARK-40122 URL: https://issues.apache.org/jira/browse/SPARK-40122 Project: Spark

[jira] [Commented] (SPARK-40114) Arrow 9.0.0 support with SparkR

[ https://issues.apache.org/jira/browse/SPARK-40114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580731#comment-17580731 ] Apache Spark commented on SPARK-40114: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-40114) Arrow 9.0.0 support with SparkR

[ https://issues.apache.org/jira/browse/SPARK-40114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40114: Assignee: (was: Apache Spark) > Arrow 9.0.0 support with SparkR > ---

[jira] [Assigned] (SPARK-40114) Arrow 9.0.0 support with SparkR

[ https://issues.apache.org/jira/browse/SPARK-40114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40114: Assignee: Apache Spark > Arrow 9.0.0 support with SparkR > --

[jira] [Assigned] (SPARK-40121) Initialize projection used for Python UDF

[ https://issues.apache.org/jira/browse/SPARK-40121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40121: Assignee: Apache Spark > Initialize projection used for Python UDF >

[jira] [Assigned] (SPARK-40121) Initialize projection used for Python UDF

[ https://issues.apache.org/jira/browse/SPARK-40121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40121: Assignee: (was: Apache Spark) > Initialize projection used for Python UDF > -

[jira] [Commented] (SPARK-40121) Initialize projection used for Python UDF

[ https://issues.apache.org/jira/browse/SPARK-40121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580714#comment-17580714 ] Apache Spark commented on SPARK-40121: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580711#comment-17580711 ] Steve Loughran commented on SPARK-38954: any plans to put the PR up? i'm curious

[jira] [Created] (SPARK-40121) Initialize projection used for Python UDF

Hyukjin Kwon created SPARK-40121: Summary: Initialize projection used for Python UDF Key: SPARK-40121 URL: https://issues.apache.org/jira/browse/SPARK-40121 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-38445) Are hadoop committers used in Structured Streaming?

[ https://issues.apache.org/jira/browse/SPARK-38445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580710#comment-17580710 ] Steve Loughran commented on SPARK-38445: SPARK-40039 might address this > Are h

[jira] [Assigned] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40105: --- Assignee: XiDuo You > Improve repartition in ReplaceCTERefWithRepartition > ---

[jira] [Comment Edited] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580707#comment-17580707 ] Steve Loughran edited comment on SPARK-38330 at 8/17/22 9:46 AM: -

[jira] [Resolved] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40105. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37537 [https://gith

[jira] [Comment Edited] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580707#comment-17580707 ] Steve Loughran edited comment on SPARK-38330 at 8/17/22 9:45 AM: -

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580707#comment-17580707 ] Steve Loughran commented on SPARK-38330: remove all jars with cos in the title f

[jira] [Created] (SPARK-40120) Make pyspark.sql.readwriter examples self-contained

Hyukjin Kwon created SPARK-40120: Summary: Make pyspark.sql.readwriter examples self-contained Key: SPARK-40120 URL: https://issues.apache.org/jira/browse/SPARK-40120 Project: Spark Issue Typ

  1   2   >