[jira] [Updated] (SPARK-36681) Fail to load Snappy codec

2021-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36681: - Target Version/s: 3.2.0 > Fail to load Snappy codec > - > >

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411717#comment-17411717 ] L. C. Hsieh commented on SPARK-36681: - yea. > Fail to load Snappy codec > -

[jira] [Assigned] (SPARK-36691) PythonRunner failed should pass error message to ApplicationMaster too

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36691: Assignee: (was: Apache Spark) > PythonRunner failed should pass error message to Appl

[jira] [Commented] (SPARK-36691) PythonRunner failed should pass error message to ApplicationMaster too

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411715#comment-17411715 ] Apache Spark commented on SPARK-36691: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-36691) PythonRunner failed should pass error message to ApplicationMaster too

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411714#comment-17411714 ] Apache Spark commented on SPARK-36691: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-36691) PythonRunner failed should pass error message to ApplicationMaster too

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36691: Assignee: Apache Spark > PythonRunner failed should pass error message to ApplicationMast

[jira] [Commented] (SPARK-36690) Clean up deprecated api usage related to commons-pool2

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411713#comment-17411713 ] Apache Spark commented on SPARK-36690: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-36690) Clean up deprecated api usage related to commons-pool2

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36690: Assignee: Apache Spark > Clean up deprecated api usage related to commons-pool2 > ---

[jira] [Assigned] (SPARK-36690) Clean up deprecated api usage related to commons-pool2

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36690: Assignee: (was: Apache Spark) > Clean up deprecated api usage related to commons-pool

[jira] [Updated] (SPARK-36691) PythonRunner failed should pass error message to ApplicationMaster too

2021-09-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36691: -- Description: In current pyspark, stderr and stdout are print together, if py-script failed, will only

[jira] [Commented] (SPARK-36685) Fix wrong assert statement

2021-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411706#comment-17411706 ] Hyukjin Kwon commented on SPARK-36685: -- Please go ahead for a PR. > Fix wrong asse

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

2021-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411707#comment-17411707 ] Hyukjin Kwon commented on SPARK-36681: -- Is it 3.2 blocker? > Fail to load Snappy c

[jira] [Created] (SPARK-36691) PythonRunner failed should pass error message to ApplicationMaster too

2021-09-07 Thread angerszhu (Jira)
angerszhu created SPARK-36691: - Summary: PythonRunner failed should pass error message to ApplicationMaster too Key: SPARK-36691 URL: https://issues.apache.org/jira/browse/SPARK-36691 Project: Spark

[jira] [Created] (SPARK-36690) Clean up deprecated api usage related to commons-pool2

2021-09-07 Thread Yang Jie (Jira)
Yang Jie created SPARK-36690: Summary: Clean up deprecated api usage related to commons-pool2 Key: SPARK-36690 URL: https://issues.apache.org/jira/browse/SPARK-36690 Project: Spark Issue Type: Im

[jira] [Resolved] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36688. -- Assignee: Yuto Akutsu Resolution: Fixed Fixed in https://github.com/apache/spark/pull/33

[jira] [Assigned] (SPARK-33781) Improve caching of MergeStatus on the executor side to save memory

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33781: Assignee: (was: Apache Spark) > Improve caching of MergeStatus on the executor side t

[jira] [Commented] (SPARK-33781) Improve caching of MergeStatus on the executor side to save memory

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411692#comment-17411692 ] Apache Spark commented on SPARK-33781: -- User 'rmcyang' has created a pull request f

[jira] [Assigned] (SPARK-33781) Improve caching of MergeStatus on the executor side to save memory

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33781: Assignee: Apache Spark > Improve caching of MergeStatus on the executor side to save memo

[jira] [Resolved] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36684. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33926 [https://

[jira] [Assigned] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36684: - Assignee: Yang Jie > Clean up `Cannot load filesystem` warning log when test the sql/co

[jira] [Commented] (SPARK-36689) Cleanup the deprecated APIs and raise proper warning message.

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411683#comment-17411683 ] Apache Spark commented on SPARK-36689: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-36689) Cleanup the deprecated APIs and raise proper warning message.

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36689: Assignee: Apache Spark > Cleanup the deprecated APIs and raise proper warning message. >

[jira] [Commented] (SPARK-36689) Cleanup the deprecated APIs and raise proper warning message.

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411681#comment-17411681 ] Apache Spark commented on SPARK-36689: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-36689) Cleanup the deprecated APIs and raise proper warning message.

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36689: Assignee: (was: Apache Spark) > Cleanup the deprecated APIs and raise proper warning

[jira] [Assigned] (SPARK-35803) Spark SQL does not support creating views using DataSource v2 based data sources

2021-09-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35803: --- Assignee: Pablo Langa Blanco > Spark SQL does not support creating views using DataSource v

[jira] [Updated] (SPARK-36683) Support secent and cosecent

2021-09-07 Thread Yuto Akutsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuto Akutsu updated SPARK-36683: Component/s: (was: Spark Shell) (was: R) (was: PySpar

[jira] [Updated] (SPARK-36683) Support secent and cosecent

2021-09-07 Thread Yuto Akutsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuto Akutsu updated SPARK-36683: Component/s: Spark Shell R PySpark > Support secent and cosecent

[jira] [Resolved] (SPARK-35803) Spark SQL does not support creating views using DataSource v2 based data sources

2021-09-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35803. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33922 [https://gith

[jira] [Commented] (SPARK-36668) py4j.protocol.Py4JJavaError: java.util.NoSuchElementException: None.get

2021-09-07 Thread liuzruzi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411664#comment-17411664 ] liuzruzi commented on SPARK-36668: -- [^spark-test.tar] is a demo,  can try it > py4j.pr

[jira] [Updated] (SPARK-36668) py4j.protocol.Py4JJavaError: java.util.NoSuchElementException: None.get

2021-09-07 Thread liuzruzi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuzruzi updated SPARK-36668: - Attachment: spark-test.tar > py4j.protocol.Py4JJavaError: java.util.NoSuchElementException: None.get > -

[jira] [Commented] (SPARK-36649) Support Trigger.AvailableNow on Kafka data source

2021-09-07 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411658#comment-17411658 ] Jungtaek Lim commented on SPARK-36649: -- [~noslowerdna] Ah OK. Never mind. Thanks fo

[jira] [Commented] (SPARK-36434) Implement DataFrame.lookup

2021-09-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411651#comment-17411651 ] Haejoon Lee commented on SPARK-36434: - Close this ticket since this API is deprecate

[jira] [Commented] (SPARK-36689) Cleanup the deprecated APIs and raise proper warning message.

2021-09-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411647#comment-17411647 ] Haejoon Lee commented on SPARK-36689: - I'm working on this. > Cleanup the deprecate

[jira] [Created] (SPARK-36689) Cleanup the deprecated APIs and raise proper warning message.

2021-09-07 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-36689: --- Summary: Cleanup the deprecated APIs and raise proper warning message. Key: SPARK-36689 URL: https://issues.apache.org/jira/browse/SPARK-36689 Project: Spark

[jira] [Resolved] (SPARK-36434) Implement DataFrame.lookup

2021-09-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-36434. - Resolution: Won't Fix > Implement DataFrame.lookup > -- > >

[jira] [Resolved] (SPARK-36515) Improve test coverage for groupby.py.

2021-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36515. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33850 [https://gi

[jira] [Assigned] (SPARK-36515) Improve test coverage for groupby.py.

2021-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36515: Assignee: Haejoon Lee > Improve test coverage for groupby.py. > -

[jira] [Resolved] (SPARK-36642) Add df.withMetadata: a syntax suger to update the metadata of a dataframe

2021-09-07 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-36642. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33853 [https://github

[jira] [Assigned] (SPARK-36642) Add df.withMetadata: a syntax suger to update the metadata of a dataframe

2021-09-07 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-36642: -- Assignee: Liang Zhang > Add df.withMetadata: a syntax suger to update the metadata of a dataf

[jira] [Assigned] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36688: Assignee: Apache Spark > Add cot as an R function > > >

[jira] [Assigned] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36688: Assignee: (was: Apache Spark) > Add cot as an R function > >

[jira] [Commented] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411611#comment-17411611 ] Apache Spark commented on SPARK-36688: -- User 'yutoacts' has created a pull request

[jira] [Commented] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411612#comment-17411612 ] Apache Spark commented on SPARK-36688: -- User 'yutoacts' has created a pull request

[jira] [Updated] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Yuto Akutsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuto Akutsu updated SPARK-36688: Fix Version/s: 3.3.0 > Add cot as an R function > > > Key

[jira] [Updated] (SPARK-36683) Support secent and cosecent

2021-09-07 Thread Yuto Akutsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuto Akutsu updated SPARK-36683: Fix Version/s: 3.3.0 Affects Version/s: (was: 3.3.0) 3.1.2 > Su

[jira] [Resolved] (SPARK-36531) Improve test coverage for data_type_ops/*

2021-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36531. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33850 [https://gi

[jira] [Assigned] (SPARK-36531) Improve test coverage for data_type_ops/*

2021-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36531: Assignee: Haejoon Lee > Improve test coverage for data_type_ops/* > -

[jira] [Created] (SPARK-36688) Add cot as an R function

2021-09-07 Thread Yuto Akutsu (Jira)
Yuto Akutsu created SPARK-36688: --- Summary: Add cot as an R function Key: SPARK-36688 URL: https://issues.apache.org/jira/browse/SPARK-36688 Project: Spark Issue Type: Improvement Comp

[jira] [Assigned] (SPARK-36677) NestedColumnAliasing pushes down aggregate functions into projections

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36677: --- Assignee: Venkata Sai Akhil Gudesa (was: L. C. Hsieh) > NestedColumnAliasing pushes down a

[jira] [Resolved] (SPARK-36677) NestedColumnAliasing pushes down aggregate functions into projections

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36677. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33921 [https://gith

[jira] [Assigned] (SPARK-36677) NestedColumnAliasing pushes down aggregate functions into projections

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36677: --- Assignee: L. C. Hsieh > NestedColumnAliasing pushes down aggregate functions into projectio

[jira] [Assigned] (SPARK-36665) Add more Not operator optimizations

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36665: Assignee: (was: Apache Spark) > Add more Not operator optimizations > ---

[jira] [Assigned] (SPARK-36665) Add more Not operator optimizations

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36665: Assignee: Apache Spark > Add more Not operator optimizations > --

[jira] [Commented] (SPARK-36665) Add more Not operator optimizations

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411594#comment-17411594 ] Apache Spark commented on SPARK-36665: -- User 'kazuyukitanimura' has created a pull

[jira] [Resolved] (SPARK-36670) Add end-to-end codec test cases for main datasources

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36670. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33912 [https://gith

[jira] [Commented] (SPARK-36618) Support dropping rows of a single-indexed DataFrame

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411585#comment-17411585 ] Apache Spark commented on SPARK-36618: -- User 'xinrong-databricks' has created a pul

[jira] [Commented] (SPARK-36618) Support dropping rows of a single-indexed DataFrame

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411584#comment-17411584 ] Apache Spark commented on SPARK-36618: -- User 'xinrong-databricks' has created a pul

[jira] [Assigned] (SPARK-36618) Support dropping rows of a single-indexed DataFrame

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36618: Assignee: Apache Spark > Support dropping rows of a single-indexed DataFrame > --

[jira] [Assigned] (SPARK-36618) Support dropping rows of a single-indexed DataFrame

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36618: Assignee: (was: Apache Spark) > Support dropping rows of a single-indexed DataFrame >

[jira] [Updated] (SPARK-36618) Support dropping rows of a single-indexed DataFrame

2021-09-07 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36618: - Summary: Support dropping rows of a single-indexed DataFrame (was: Support axis=0 for drop API)

[jira] [Commented] (SPARK-36618) Support axis=0 for drop API

2021-09-07 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411565#comment-17411565 ] Xinrong Meng commented on SPARK-36618: -- I am working on that. > Support axis=0 for

[jira] [Updated] (SPARK-36687) Rename error classes with _ERROR suffix

2021-09-07 Thread Karen Feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Feng updated SPARK-36687: --- Parent: SPARK-36094 Issue Type: Sub-task (was: Task) > Rename error classes with _ERROR suf

[jira] [Created] (SPARK-36687) Rename error classes with _ERROR suffix

2021-09-07 Thread Karen Feng (Jira)
Karen Feng created SPARK-36687: -- Summary: Rename error classes with _ERROR suffix Key: SPARK-36687 URL: https://issues.apache.org/jira/browse/SPARK-36687 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-36666) [SQL] Regression in AQEShuffleReadExec

2021-09-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-3. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33910 [https://

[jira] [Assigned] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36682: --- Assignee: L. C. Hsieh > Add Hadoop sequence file test for Hadoop codecs > -

[jira] [Resolved] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36682. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33924 [https://gith

[jira] [Commented] (SPARK-36686) fix SimplifyConditionalsInPredicate to be null-safe

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411417#comment-17411417 ] Apache Spark commented on SPARK-36686: -- User 'hypercubestart' has created a pull re

[jira] [Assigned] (SPARK-36686) fix SimplifyConditionalsInPredicate to be null-safe

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36686: Assignee: (was: Apache Spark) > fix SimplifyConditionalsInPredicate to be null-safe >

[jira] [Assigned] (SPARK-36686) fix SimplifyConditionalsInPredicate to be null-safe

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36686: Assignee: Apache Spark > fix SimplifyConditionalsInPredicate to be null-safe > --

[jira] [Commented] (SPARK-36686) fix SimplifyConditionalsInPredicate to be null-safe

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411415#comment-17411415 ] Apache Spark commented on SPARK-36686: -- User 'hypercubestart' has created a pull re

[jira] [Created] (SPARK-36686) fix SimplifyConditionalsInPredicate to be null-safe

2021-09-07 Thread Andrew (Jira)
Andrew created SPARK-36686: -- Summary: fix SimplifyConditionalsInPredicate to be null-safe Key: SPARK-36686 URL: https://issues.apache.org/jira/browse/SPARK-36686 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

2021-09-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411391#comment-17411391 ] Gengliang Wang commented on SPARK-34276: [~nemon][~gszadovszky][~csun] the PR h

[jira] [Comment Edited] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

2021-09-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411391#comment-17411391 ] Gengliang Wang edited comment on SPARK-34276 at 9/7/21, 5:45 PM: -

[jira] [Comment Edited] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

2021-09-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411391#comment-17411391 ] Gengliang Wang edited comment on SPARK-34276 at 9/7/21, 5:45 PM: -

[jira] [Commented] (SPARK-34952) DS V2 Aggregate push down

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411390#comment-17411390 ] Apache Spark commented on SPARK-34952: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-34952) DS V2 Aggregate push down

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411389#comment-17411389 ] Apache Spark commented on SPARK-34952: -- User 'huaxingao' has created a pull request

[jira] [Created] (SPARK-36685) Fix wrong assert statement

2021-09-07 Thread Sanket Reddy (Jira)
Sanket Reddy created SPARK-36685: Summary: Fix wrong assert statement Key: SPARK-36685 URL: https://issues.apache.org/jira/browse/SPARK-36685 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411307#comment-17411307 ] Apache Spark commented on SPARK-36684: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36684: Assignee: (was: Apache Spark) > Clean up `Cannot load filesystem` warning log when te

[jira] [Assigned] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36684: Assignee: Apache Spark > Clean up `Cannot load filesystem` warning log when test the sql/

[jira] [Commented] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411304#comment-17411304 ] Apache Spark commented on SPARK-36684: -- User 'LuciferYang' has created a pull reque

[jira] [Updated] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 profile

2021-09-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-36684: - Summary: Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 pro

[jira] [Updated] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 module

2021-09-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-36684: - Description: [https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-hadoop-2.7/2493/console

[jira] [Created] (SPARK-36684) Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 module

2021-09-07 Thread Yang Jie (Jira)
Yang Jie created SPARK-36684: Summary: Clean up `Cannot load filesystem` warning log when test the sql/core module with hadoop-2.7 module Key: SPARK-36684 URL: https://issues.apache.org/jira/browse/SPARK-36684

[jira] [Commented] (SPARK-36649) Support Trigger.AvailableNow on Kafka data source

2021-09-07 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411256#comment-17411256 ] Andrew Olson commented on SPARK-36649: -- [~kabhwan] I am not sure I fully understand

[jira] [Commented] (SPARK-36683) Support secent and cosecent

2021-09-07 Thread Yuto Akutsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411099#comment-17411099 ] Yuto Akutsu commented on SPARK-36683: - I'm working on this. > Support secent and co

[jira] [Commented] (SPARK-36660) Cotangent is not supported by Dataframe

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411028#comment-17411028 ] Apache Spark commented on SPARK-36660: -- User 'yutoacts' has created a pull request

[jira] [Commented] (SPARK-36660) Cotangent is not supported by Dataframe

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411027#comment-17411027 ] Apache Spark commented on SPARK-36660: -- User 'yutoacts' has created a pull request

[jira] [Commented] (SPARK-36671) Support __and__ in num_ops.py

2021-09-07 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411009#comment-17411009 ] dgd_contributor commented on SPARK-36671: - working on this > Support __and__ in

[jira] [Assigned] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36682: Assignee: Apache Spark > Add Hadoop sequence file test for Hadoop codecs > --

[jira] [Assigned] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36682: Assignee: (was: Apache Spark) > Add Hadoop sequence file test for Hadoop codecs > ---

[jira] [Commented] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

2021-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17410999#comment-17410999 ] Apache Spark commented on SPARK-36682: -- User 'viirya' has created a pull request fo

[jira] [Created] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

2021-09-07 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-36682: --- Summary: Add Hadoop sequence file test for Hadoop codecs Key: SPARK-36682 URL: https://issues.apache.org/jira/browse/SPARK-36682 Project: Spark Issue Type: Tes

[jira] [Updated] (SPARK-36681) Fail to load Snappy codec

2021-09-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36681: Priority: Blocker (was: Major) > Fail to load Snappy codec > - > >

[jira] [Created] (SPARK-36681) Fail to load Snappy codec

2021-09-07 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-36681: --- Summary: Fail to load Snappy codec Key: SPARK-36681 URL: https://issues.apache.org/jira/browse/SPARK-36681 Project: Spark Issue Type: Bug Components: