[jira] [Commented] (SPARK-39313) V2ExpressionUtils.toCatalystOrdering should fail if V2Expression can not be translated

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542807#comment-17542807 ] Apache Spark commented on SPARK-39313: -- User 'pan3793' has created a pull request f

[jira] [Assigned] (SPARK-39313) V2ExpressionUtils.toCatalystOrdering should fail if V2Expression can not be translated

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39313: Assignee: (was: Apache Spark) > V2ExpressionUtils.toCatalystOrdering should fail if V

[jira] [Commented] (SPARK-39313) V2ExpressionUtils.toCatalystOrdering should fail if V2Expression can not be translated

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542806#comment-17542806 ] Apache Spark commented on SPARK-39313: -- User 'pan3793' has created a pull request f

[jira] [Assigned] (SPARK-39313) V2ExpressionUtils.toCatalystOrdering should fail if V2Expression can not be translated

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39313: Assignee: Apache Spark > V2ExpressionUtils.toCatalystOrdering should fail if V2Expression

[jira] [Created] (SPARK-39313) V2ExpressionUtils.toCatalystOrdering should fail if V2Expression can not be translated

2022-05-26 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-39313: - Summary: V2ExpressionUtils.toCatalystOrdering should fail if V2Expression can not be translated Key: SPARK-39313 URL: https://issues.apache.org/jira/browse/SPARK-39313 Proj

[jira] [Resolved] (SPARK-39296) Replcace `Array.toString` with `Array.mkString`

2022-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39296. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36677 [https://gi

[jira] [Assigned] (SPARK-39296) Replcace `Array.toString` with `Array.mkString`

2022-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39296: Assignee: Yang Jie > Replcace `Array.toString` with `Array.mkString` > --

[jira] [Commented] (SPARK-39312) Use Parquet in predicate for Spark In filter

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542786#comment-17542786 ] Apache Spark commented on SPARK-39312: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-39312) Use Parquet in predicate for Spark In filter

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542784#comment-17542784 ] Apache Spark commented on SPARK-39312: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-39312) Use Parquet in predicate for Spark In filter

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39312: Assignee: Apache Spark > Use Parquet in predicate for Spark In filter > -

[jira] [Assigned] (SPARK-39312) Use Parquet in predicate for Spark In filter

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39312: Assignee: (was: Apache Spark) > Use Parquet in predicate for Spark In filter > --

[jira] [Created] (SPARK-39312) Use Parquet in predicate for Spark In filter

2022-05-26 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-39312: -- Summary: Use Parquet in predicate for Spark In filter Key: SPARK-39312 URL: https://issues.apache.org/jira/browse/SPARK-39312 Project: Spark Issue Type: Improvem

[jira] [Resolved] (SPARK-39305) Implement the EQUAL_NULL function

2022-05-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39305. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36688 [https://github.com

[jira] [Created] (SPARK-39311) KafkaBatchPartitionReader blocks until timeout when transactional messages are enabled

2022-05-26 Thread Nikolay V (Jira)
Nikolay V created SPARK-39311: - Summary: KafkaBatchPartitionReader blocks until timeout when transactional messages are enabled Key: SPARK-39311 URL: https://issues.apache.org/jira/browse/SPARK-39311 Proj

[jira] [Commented] (SPARK-38474) Use error classes in org.apache.spark.security

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542777#comment-17542777 ] Apache Spark commented on SPARK-38474: -- User 'sandeep-katta' has created a pull req

[jira] [Assigned] (SPARK-38474) Use error classes in org.apache.spark.security

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38474: Assignee: (was: Apache Spark) > Use error classes in org.apache.spark.security >

[jira] [Assigned] (SPARK-38474) Use error classes in org.apache.spark.security

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38474: Assignee: Apache Spark > Use error classes in org.apache.spark.security > ---

[jira] [Commented] (SPARK-38474) Use error classes in org.apache.spark.security

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542776#comment-17542776 ] Apache Spark commented on SPARK-38474: -- User 'sandeep-katta' has created a pull req

[jira] [Created] (SPARK-39310) rename `required_same_anchor`

2022-05-26 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-39310: --- Summary: rename `required_same_anchor` Key: SPARK-39310 URL: https://issues.apache.org/jira/browse/SPARK-39310 Project: Spark Issue Type: Sub-task Co

[jira] [Created] (SPARK-39309) '_SubTest' object has no attribute 'elapsed_time'

2022-05-26 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-39309: --- Summary: '_SubTest' object has no attribute 'elapsed_time' Key: SPARK-39309 URL: https://issues.apache.org/jira/browse/SPARK-39309 Project: Spark Issue Type: S

[jira] [Resolved] (SPARK-39308) Upgrade parquet to 1.12.3

2022-05-26 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39308. - Fix Version/s: 3.4.0 Assignee: Yuming Wang Resolution: Fixed Issue resolved by p

[jira] [Assigned] (SPARK-37825) Make spark beeline be able to handle javaOpts

2022-05-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-37825: Assignee: Kent Yao > Make spark beeline be able to handle javaOpts >

[jira] [Resolved] (SPARK-37825) Make spark beeline be able to handle javaOpts

2022-05-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-37825. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35116 [https://github.com

[jira] [Updated] (SPARK-39307) Proposed spark.SQL.function to return an array of fixed sized collections from a collection (array or string)

2022-05-26 Thread Aishwarya Srivastava (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aishwarya Srivastava updated SPARK-39307: - Description: In scenarios where a lot of UDFs centered around chunking collectio

[jira] [Assigned] (SPARK-39228) Implement `skipna` of `Series.argmax`

2022-05-26 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-39228: Assignee: Xinrong Meng > Implement `skipna` of `Series.argmax` >

[jira] [Resolved] (SPARK-39228) Implement `skipna` of `Series.argmax`

2022-05-26 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-39228. -- Resolution: Resolved resolved by https://github.com/apache/spark/pull/36599 > Implement `skip

[jira] [Assigned] (SPARK-39308) Upgrade parquet to 1.12.3

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39308: Assignee: Apache Spark > Upgrade parquet to 1.12.3 > - > >

[jira] [Assigned] (SPARK-39308) Upgrade parquet to 1.12.3

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39308: Assignee: (was: Apache Spark) > Upgrade parquet to 1.12.3 > -

[jira] [Commented] (SPARK-39308) Upgrade parquet to 1.12.3

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542714#comment-17542714 ] Apache Spark commented on SPARK-39308: -- User 'wangyum' has created a pull request f

[jira] [Created] (SPARK-39308) Upgrade parquet to 1.12.3

2022-05-26 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39308: --- Summary: Upgrade parquet to 1.12.3 Key: SPARK-39308 URL: https://issues.apache.org/jira/browse/SPARK-39308 Project: Spark Issue Type: Improvement Com

[jira] [Resolved] (SPARK-39294) Support Orc file scans with DEFAULT values

2022-05-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39294. --- Fix Version/s: 3.4.0 Assignee: Daniel Resolution: Fixed This is resolved via

[jira] [Created] (SPARK-39307) Need a spark.sql.function to return array from a collection of arrays

2022-05-26 Thread Aishwarya Srivastava (Jira)
Aishwarya Srivastava created SPARK-39307: Summary: Need a spark.sql.function to return array from a collection of arrays Key: SPARK-39307 URL: https://issues.apache.org/jira/browse/SPARK-39307

[jira] [Updated] (SPARK-39262) Correct the behavior of creating DataFrame from an RDD

2022-05-26 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39262: - Description: Correct the behavior of creating DataFrame from an RDD **with `0` or an empty list

[jira] [Updated] (SPARK-39262) Correct the behavior of creating DataFrame from an RDD

2022-05-26 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39262: - Summary: Correct the behavior of creating DataFrame from an RDD (was: Correct error messages wh

[jira] [Commented] (SPARK-39304) ps.read_csv ignore commas in double quotes.

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542592#comment-17542592 ] Apache Spark commented on SPARK-39304: -- User 'bjornjorgensen' has created a pull re

[jira] [Commented] (SPARK-39294) Support Orc file scans with DEFAULT values

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542590#comment-17542590 ] Apache Spark commented on SPARK-39294: -- User 'dtenedor' has created a pull request

[jira] [Assigned] (SPARK-39304) ps.read_csv ignore commas in double quotes.

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39304: Assignee: (was: Apache Spark) > ps.read_csv ignore commas in double quotes. > ---

[jira] [Assigned] (SPARK-39304) ps.read_csv ignore commas in double quotes.

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39304: Assignee: Apache Spark > ps.read_csv ignore commas in double quotes. > --

[jira] [Commented] (SPARK-39304) ps.read_csv ignore commas in double quotes.

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542589#comment-17542589 ] Apache Spark commented on SPARK-39304: -- User 'bjornjorgensen' has created a pull re

[jira] [Commented] (SPARK-39294) Support Orc file scans with DEFAULT values

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542588#comment-17542588 ] Apache Spark commented on SPARK-39294: -- User 'dtenedor' has created a pull request

[jira] [Commented] (SPARK-39268) AttachDistributedSequenceExec do not checkpoint childRDD with single partition

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542555#comment-17542555 ] Apache Spark commented on SPARK-39268: -- User 'tedyu' has created a pull request for

[jira] [Commented] (SPARK-39268) AttachDistributedSequenceExec do not checkpoint childRDD with single partition

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542554#comment-17542554 ] Apache Spark commented on SPARK-39268: -- User 'tedyu' has created a pull request for

[jira] [Commented] (SPARK-39306) support scalar subquery in time travel

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542541#comment-17542541 ] Apache Spark commented on SPARK-39306: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-39306) support scalar subquery in time travel

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39306: Assignee: (was: Apache Spark) > support scalar subquery in time travel >

[jira] [Commented] (SPARK-39306) support scalar subquery in time travel

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542540#comment-17542540 ] Apache Spark commented on SPARK-39306: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-39306) support scalar subquery in time travel

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39306: Assignee: Apache Spark > support scalar subquery in time travel > ---

[jira] [Created] (SPARK-39306) support scalar subquery in time travel

2022-05-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-39306: --- Summary: support scalar subquery in time travel Key: SPARK-39306 URL: https://issues.apache.org/jira/browse/SPARK-39306 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-39305) Implement the EQUAL_NULL function

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542528#comment-17542528 ] Apache Spark commented on SPARK-39305: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-39305) Implement the EQUAL_NULL function

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39305: Assignee: Max Gekk (was: Apache Spark) > Implement the EQUAL_NULL function > ---

[jira] [Assigned] (SPARK-39305) Implement the EQUAL_NULL function

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39305: Assignee: Apache Spark (was: Max Gekk) > Implement the EQUAL_NULL function > ---

[jira] [Commented] (SPARK-39305) Implement the EQUAL_NULL function

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542529#comment-17542529 ] Apache Spark commented on SPARK-39305: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-39265) Support Parquet file scans with DEFAULT values

2022-05-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39265: -- Assignee: Daniel > Support Parquet file scans with DEFAULT values > -

[jira] [Resolved] (SPARK-39265) Support Parquet file scans with DEFAULT values

2022-05-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39265. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36643 [https:

[jira] [Created] (SPARK-39305) Implement the EQUAL_NULL function

2022-05-26 Thread Max Gekk (Jira)
Max Gekk created SPARK-39305: Summary: Implement the EQUAL_NULL function Key: SPARK-39305 URL: https://issues.apache.org/jira/browse/SPARK-39305 Project: Spark Issue Type: New Feature C

[jira] [Updated] (SPARK-39304) ps.read_csv ignore commas in double quotes.

2022-05-26 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39304: Description: This one is coming from u...@spark.org mail list tittle "Complexity with the

[jira] [Created] (SPARK-39304) ps.read_csv ignore commas in double quotes.

2022-05-26 Thread Jira
Bjørn Jørgensen created SPARK-39304: --- Summary: ps.read_csv ignore commas in double quotes. Key: SPARK-39304 URL: https://issues.apache.org/jira/browse/SPARK-39304 Project: Spark Issue Type:

[jira] [Updated] (SPARK-39304) ps.read_csv ignore commas in double quotes.

2022-05-26 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39304: Attachment: csvfile.csv > ps.read_csv ignore commas in double quotes. > --

[jira] [Updated] (SPARK-39304) ps.read_csv ignore commas in double quotes.

2022-05-26 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39304: Attachment: Untitled (4).ipynb > ps.read_csv ignore commas in double quotes. > ---

[jira] [Resolved] (SPARK-39272) Increase the start position of query context by 1

2022-05-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39272. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36684 [https:

[jira] [Commented] (SPARK-38474) Use error classes in org.apache.spark.security

2022-05-26 Thread Sandeep Katta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542473#comment-17542473 ] Sandeep Katta commented on SPARK-38474: --- I will start working on this > Use error

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542453#comment-17542453 ] Apache Spark commented on SPARK-36681: -- User 'peter-toth' has created a pull reques

[jira] [Resolved] (SPARK-39300) Move pandasSkewness and pandasKurtosis into pandas.spark.functions

2022-05-26 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-39300. -- Resolution: Resolved > Move pandasSkewness and pandasKurtosis into pandas.spark.functions > --

[jira] [Commented] (SPARK-39303) timestamp type support precision, example: timestamp(3)

2022-05-26 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542448#comment-17542448 ] melin commented on SPARK-39303: --- [~Qin Yao]  > timestamp type support precision, example:

[jira] [Created] (SPARK-39303) timestamp type support precision, example: timestamp(3)

2022-05-26 Thread melin (Jira)
melin created SPARK-39303: - Summary: timestamp type support precision, example: timestamp(3) Key: SPARK-39303 URL: https://issues.apache.org/jira/browse/SPARK-39303 Project: Spark Issue Type: Improve

[jira] [Resolved] (SPARK-39299) Series.autocorr use SQL.corr to avoid conversion to vector

2022-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39299. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36681 [https://gi

[jira] [Assigned] (SPARK-39299) Series.autocorr use SQL.corr to avoid conversion to vector

2022-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39299: Assignee: zhengruifeng > Series.autocorr use SQL.corr to avoid conversion to vector > ---

[jira] [Updated] (SPARK-39253) Improve PySpark API reference to be more readable

2022-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39253: - Fix Version/s: 3.3.0 > Improve PySpark API reference to be more readable > -

[jira] [Assigned] (SPARK-39254) Upgrade ZSTD-JNI to 1.5.2-3

2022-05-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-39254: Assignee: Yang Jie > Upgrade ZSTD-JNI to 1.5.2-3 > > >

[jira] [Resolved] (SPARK-39254) Upgrade ZSTD-JNI to 1.5.2-3

2022-05-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-39254. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36634 [https://github.com

[jira] [Resolved] (SPARK-39285) Spark should not check filed name when read data

2022-05-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39285. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36661 [https://gith

[jira] [Assigned] (SPARK-39285) Spark should not check filed name when read data

2022-05-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39285: --- Assignee: angerszhu > Spark should not check filed name when read data > --

[jira] [Resolved] (SPARK-39268) AttachDistributedSequenceExec do not checkpoint childRDD with single partition

2022-05-26 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-39268. -- Resolution: Resolved > AttachDistributedSequenceExec do not checkpoint childRDD with single pa

[jira] [Updated] (SPARK-39292) Make Dataset.melt work with struct fields

2022-05-26 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-39292: -- Description: In SPARK-38864, the melt function was added to Dataset. It would be nice if fiel

[jira] [Commented] (SPARK-39253) Improve PySpark API reference to be more readable

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542398#comment-17542398 ] Apache Spark commented on SPARK-39253: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-39253) Improve PySpark API reference to be more readable

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542397#comment-17542397 ] Apache Spark commented on SPARK-39253: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-39253) Improve PySpark API reference to be more readable

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542395#comment-17542395 ] Apache Spark commented on SPARK-39253: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-39272) Increase the start position of query context by 1

2022-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542390#comment-17542390 ] Apache Spark commented on SPARK-39272: -- User 'gengliangwang' has created a pull req

[jira] [Updated] (SPARK-39234) Code clean up in SparkThrowableHelper.getMessage

2022-05-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39234: --- Fix Version/s: 3.3.0 > Code clean up in SparkThrowableHelper.getMessage > --

[jira] [Created] (SPARK-39302) Spark SQL - wrong field selection in group by

2022-05-26 Thread shaharl...@gmail.com (Jira)
shaharl...@gmail.com created SPARK-39302: Summary: Spark SQL - wrong field selection in group by Key: SPARK-39302 URL: https://issues.apache.org/jira/browse/SPARK-39302 Project: Spark