[jira] [Created] (SPARK-36690) Clean up deprecated api usage related to commons-pool2

2021-09-07 Thread Yang Jie (Jira)
Yang Jie created SPARK-36690: Summary: Clean up deprecated api usage related to commons-pool2 Key: SPARK-36690 URL: https://issues.apache.org/jira/browse/SPARK-36690 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36688. -- Assignee: Yuto Akutsu Resolution: Fixed Fixed in

[jira] [Assigned] (SPARK-33781) Improve caching of MergeStatus on the executor side to save memory

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33781: Assignee: (was: Apache Spark) > Improve caching of MergeStatus on the executor side

[jira] [Commented] (SPARK-33781) Improve caching of MergeStatus on the executor side to save memory

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411692#comment-17411692 ] Apache Spark commented on SPARK-33781: -- User 'rmcyang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33781) Improve caching of MergeStatus on the executor side to save memory

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33781: Assignee: Apache Spark > Improve caching of MergeStatus on the executor side to save

[jira] [Resolved] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36684. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33926

[jira] [Assigned] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36684: - Assignee: Yang Jie > Clean up `Cannot load filesystem` warning log when test the

[jira] [Commented] (SPARK-36689) Cleanup the deprecated APIs and raise proper warning message.

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411683#comment-17411683 ] Apache Spark commented on SPARK-36689: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36689) Cleanup the deprecated APIs and raise proper warning message.

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36689: Assignee: Apache Spark > Cleanup the deprecated APIs and raise proper warning message. >

[jira] [Commented] (SPARK-36689) Cleanup the deprecated APIs and raise proper warning message.

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411681#comment-17411681 ] Apache Spark commented on SPARK-36689: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36689) Cleanup the deprecated APIs and raise proper warning message.

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36689: Assignee: (was: Apache Spark) > Cleanup the deprecated APIs and raise proper warning

[jira] [Assigned] (SPARK-35803) Spark SQL does not support creating views using DataSource v2 based data sources

2021-09-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35803: --- Assignee: Pablo Langa Blanco > Spark SQL does not support creating views using DataSource

[jira] [Updated] (SPARK-36683) Support secent and cosecent

2021-09-07 Thread Yuto Akutsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuto Akutsu updated SPARK-36683: Component/s: (was: Spark Shell) (was: R) (was:

[jira] [Updated] (SPARK-36683) Support secent and cosecent

2021-09-07 Thread Yuto Akutsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuto Akutsu updated SPARK-36683: Component/s: Spark Shell R PySpark > Support secent and

[jira] [Resolved] (SPARK-35803) Spark SQL does not support creating views using DataSource v2 based data sources

2021-09-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35803. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33922

[jira] [Commented] (SPARK-36668) py4j.protocol.Py4JJavaError: java.util.NoSuchElementException: None.get

2021-09-07 Thread liuzruzi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411664#comment-17411664 ] liuzruzi commented on SPARK-36668: -- [^spark-test.tar] is a demo,  can try it >

[jira] [Updated] (SPARK-36668) py4j.protocol.Py4JJavaError: java.util.NoSuchElementException: None.get

2021-09-07 Thread liuzruzi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuzruzi updated SPARK-36668: - Attachment: spark-test.tar > py4j.protocol.Py4JJavaError: java.util.NoSuchElementException: None.get >

[jira] [Commented] (SPARK-36649) Support Trigger.AvailableNow on Kafka data source

2021-09-07 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411658#comment-17411658 ] Jungtaek Lim commented on SPARK-36649: -- [~noslowerdna] Ah OK. Never mind. Thanks for the response.

[jira] [Commented] (SPARK-36434) Implement DataFrame.lookup

2021-09-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411651#comment-17411651 ] Haejoon Lee commented on SPARK-36434: - Close this ticket since this API is deprecated as [~dc-heros] 

[jira] [Commented] (SPARK-36689) Cleanup the deprecated APIs and raise proper warning message.

2021-09-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411647#comment-17411647 ] Haejoon Lee commented on SPARK-36689: - I'm working on this. > Cleanup the deprecated APIs and raise

[jira] [Created] (SPARK-36689) Cleanup the deprecated APIs and raise proper warning message.

2021-09-07 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-36689: --- Summary: Cleanup the deprecated APIs and raise proper warning message. Key: SPARK-36689 URL: https://issues.apache.org/jira/browse/SPARK-36689 Project: Spark

[jira] [Resolved] (SPARK-36434) Implement DataFrame.lookup

2021-09-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-36434. - Resolution: Won't Fix > Implement DataFrame.lookup > -- > >

[jira] [Resolved] (SPARK-36515) Improve test coverage for groupby.py.

2021-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36515. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33850

[jira] [Assigned] (SPARK-36515) Improve test coverage for groupby.py.

2021-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36515: Assignee: Haejoon Lee > Improve test coverage for groupby.py. >

[jira] [Resolved] (SPARK-36642) Add df.withMetadata: a syntax suger to update the metadata of a dataframe

2021-09-07 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-36642. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33853

[jira] [Assigned] (SPARK-36642) Add df.withMetadata: a syntax suger to update the metadata of a dataframe

2021-09-07 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-36642: -- Assignee: Liang Zhang > Add df.withMetadata: a syntax suger to update the metadata of a

[jira] [Assigned] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36688: Assignee: Apache Spark > Add cot as an R function > > >

[jira] [Assigned] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36688: Assignee: (was: Apache Spark) > Add cot as an R function >

[jira] [Commented] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411611#comment-17411611 ] Apache Spark commented on SPARK-36688: -- User 'yutoacts' has created a pull request for this issue:

[jira] [Commented] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411612#comment-17411612 ] Apache Spark commented on SPARK-36688: -- User 'yutoacts' has created a pull request for this issue:

[jira] [Updated] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Yuto Akutsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuto Akutsu updated SPARK-36688: Fix Version/s: 3.3.0 > Add cot as an R function > > >

[jira] [Updated] (SPARK-36683) Support secent and cosecent

2021-09-07 Thread Yuto Akutsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuto Akutsu updated SPARK-36683: Fix Version/s: 3.3.0 Affects Version/s: (was: 3.3.0) 3.1.2 >

[jira] [Resolved] (SPARK-36531) Improve test coverage for data_type_ops/*

2021-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36531. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33850

[jira] [Assigned] (SPARK-36531) Improve test coverage for data_type_ops/*

2021-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36531: Assignee: Haejoon Lee > Improve test coverage for data_type_ops/* >

[jira] [Created] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Yuto Akutsu (Jira)
Yuto Akutsu created SPARK-36688: --- Summary: Add cot as an R function Key: SPARK-36688 URL: https://issues.apache.org/jira/browse/SPARK-36688 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-36677) NestedColumnAliasing pushes down aggregate functions into projections

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36677: --- Assignee: Venkata Sai Akhil Gudesa (was: L. C. Hsieh) > NestedColumnAliasing pushes down

[jira] [Resolved] (SPARK-36677) NestedColumnAliasing pushes down aggregate functions into projections

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36677. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33921

[jira] [Assigned] (SPARK-36677) NestedColumnAliasing pushes down aggregate functions into projections

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36677: --- Assignee: L. C. Hsieh > NestedColumnAliasing pushes down aggregate functions into

[jira] [Assigned] (SPARK-36665) Add more Not operator optimizations

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36665: Assignee: (was: Apache Spark) > Add more Not operator optimizations >

[jira] [Assigned] (SPARK-36665) Add more Not operator optimizations

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36665: Assignee: Apache Spark > Add more Not operator optimizations >

[jira] [Commented] (SPARK-36665) Add more Not operator optimizations

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411594#comment-17411594 ] Apache Spark commented on SPARK-36665: -- User 'kazuyukitanimura' has created a pull request for this

[jira] [Resolved] (SPARK-36670) Add end-to-end codec test cases for main datasources

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36670. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33912

[jira] [Commented] (SPARK-36618) Support dropping rows of a single-indexed DataFrame

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411585#comment-17411585 ] Apache Spark commented on SPARK-36618: -- User 'xinrong-databricks' has created a pull request for

[jira] [Commented] (SPARK-36618) Support dropping rows of a single-indexed DataFrame

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411584#comment-17411584 ] Apache Spark commented on SPARK-36618: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-36618) Support dropping rows of a single-indexed DataFrame

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36618: Assignee: Apache Spark > Support dropping rows of a single-indexed DataFrame >

[jira] [Assigned] (SPARK-36618) Support dropping rows of a single-indexed DataFrame

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36618: Assignee: (was: Apache Spark) > Support dropping rows of a single-indexed DataFrame

[jira] [Updated] (SPARK-36618) Support dropping rows of a single-indexed DataFrame

2021-09-07 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36618: - Summary: Support dropping rows of a single-indexed DataFrame (was: Support axis=0 for drop

[jira] [Commented] (SPARK-36618) Support axis=0 for drop API

2021-09-07 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411565#comment-17411565 ] Xinrong Meng commented on SPARK-36618: -- I am working on that. > Support axis=0 for drop API >

[jira] [Updated] (SPARK-36687) Rename error classes with _ERROR suffix

2021-09-07 Thread Karen Feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Feng updated SPARK-36687: --- Parent: SPARK-36094 Issue Type: Sub-task (was: Task) > Rename error classes with _ERROR

[jira] [Created] (SPARK-36687) Rename error classes with _ERROR suffix

2021-09-07 Thread Karen Feng (Jira)
Karen Feng created SPARK-36687: -- Summary: Rename error classes with _ERROR suffix Key: SPARK-36687 URL: https://issues.apache.org/jira/browse/SPARK-36687 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-36666) [SQL] Regression in AQEShuffleReadExec

2021-09-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-3. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33910

[jira] [Assigned] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36682: --- Assignee: L. C. Hsieh > Add Hadoop sequence file test for Hadoop codecs >

[jira] [Resolved] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36682. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33924

[jira] [Commented] (SPARK-36686) fix SimplifyConditionalsInPredicate to be null-safe

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411417#comment-17411417 ] Apache Spark commented on SPARK-36686: -- User 'hypercubestart' has created a pull request for this

[jira] [Assigned] (SPARK-36686) fix SimplifyConditionalsInPredicate to be null-safe

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36686: Assignee: (was: Apache Spark) > fix SimplifyConditionalsInPredicate to be null-safe

[jira] [Assigned] (SPARK-36686) fix SimplifyConditionalsInPredicate to be null-safe

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36686: Assignee: Apache Spark > fix SimplifyConditionalsInPredicate to be null-safe >

[jira] [Commented] (SPARK-36686) fix SimplifyConditionalsInPredicate to be null-safe

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411415#comment-17411415 ] Apache Spark commented on SPARK-36686: -- User 'hypercubestart' has created a pull request for this

[jira] [Created] (SPARK-36686) fix SimplifyConditionalsInPredicate to be null-safe

2021-09-07 Thread Andrew (Jira)
Andrew created SPARK-36686: -- Summary: fix SimplifyConditionalsInPredicate to be null-safe Key: SPARK-36686 URL: https://issues.apache.org/jira/browse/SPARK-36686 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

2021-09-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411391#comment-17411391 ] Gengliang Wang commented on SPARK-34276: [~nemon][~gszadovszky][~csun] the PR

[jira] [Comment Edited] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

2021-09-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411391#comment-17411391 ] Gengliang Wang edited comment on SPARK-34276 at 9/7/21, 5:45 PM: -

[jira] [Comment Edited] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

2021-09-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411391#comment-17411391 ] Gengliang Wang edited comment on SPARK-34276 at 9/7/21, 5:45 PM: -

[jira] [Commented] (SPARK-34952) DS V2 Aggregate push down

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411390#comment-17411390 ] Apache Spark commented on SPARK-34952: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-34952) DS V2 Aggregate push down

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411389#comment-17411389 ] Apache Spark commented on SPARK-34952: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Created] (SPARK-36685) Fix wrong assert statement

2021-09-07 Thread Sanket Reddy (Jira)
Sanket Reddy created SPARK-36685: Summary: Fix wrong assert statement Key: SPARK-36685 URL: https://issues.apache.org/jira/browse/SPARK-36685 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411307#comment-17411307 ] Apache Spark commented on SPARK-36684: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36684: Assignee: (was: Apache Spark) > Clean up `Cannot load filesystem` warning log when

[jira] [Assigned] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36684: Assignee: Apache Spark > Clean up `Cannot load filesystem` warning log when test the

[jira] [Commented] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411304#comment-17411304 ] Apache Spark commented on SPARK-36684: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-36684: - Summary: Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7

[jira] [Updated] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 module

2021-09-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-36684: - Description:

[jira] [Created] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 module

2021-09-07 Thread Yang Jie (Jira)
Yang Jie created SPARK-36684: Summary: Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 module Key: SPARK-36684 URL: https://issues.apache.org/jira/browse/SPARK-36684

[jira] [Commented] (SPARK-36649) Support Trigger.AvailableNow on Kafka data source

2021-09-07 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411256#comment-17411256 ] Andrew Olson commented on SPARK-36649: -- [~kabhwan] I am not sure I fully understand the details of

[jira] [Commented] (SPARK-36683) Support secent and cosecent

2021-09-07 Thread Yuto Akutsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411099#comment-17411099 ] Yuto Akutsu commented on SPARK-36683: - I'm working on this. > Support secent and cosecent >

[jira] [Commented] (SPARK-36660) Cotangent is not supported by Dataframe

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411028#comment-17411028 ] Apache Spark commented on SPARK-36660: -- User 'yutoacts' has created a pull request for this issue:

[jira] [Commented] (SPARK-36660) Cotangent is not supported by Dataframe

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411027#comment-17411027 ] Apache Spark commented on SPARK-36660: -- User 'yutoacts' has created a pull request for this issue:

[jira] [Commented] (SPARK-36671) Support __and__ in num_ops.py

2021-09-07 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411009#comment-17411009 ] dgd_contributor commented on SPARK-36671: - working on this > Support __and__ in num_ops.py >

[jira] [Assigned] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36682: Assignee: Apache Spark > Add Hadoop sequence file test for Hadoop codecs >

[jira] [Assigned] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36682: Assignee: (was: Apache Spark) > Add Hadoop sequence file test for Hadoop codecs >

[jira] [Commented] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410999#comment-17410999 ] Apache Spark commented on SPARK-36682: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

2021-09-07 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-36682: --- Summary: Add Hadoop sequence file test for Hadoop codecs Key: SPARK-36682 URL: https://issues.apache.org/jira/browse/SPARK-36682 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36681) Fail to load Snappy codec

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36681: Priority: Blocker (was: Major) > Fail to load Snappy codec > - > >

[jira] [Created] (SPARK-36681) Fail to load Snappy codec

2021-09-07 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-36681: --- Summary: Fail to load Snappy codec Key: SPARK-36681 URL: https://issues.apache.org/jira/browse/SPARK-36681 Project: Spark Issue Type: Bug