[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309873#comment-17309873 ] Dongjoon Hyun commented on SPARK-34674: --- I'll take a look at this during this weekend, [~Kotlov].

[jira] [Commented] (SPARK-34848) add duration in TaskMetricsDistribution

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309864#comment-17309864 ] Apache Spark commented on SPARK-34848: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-34848) add duration in TaskMetricsDistribution

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309863#comment-17309863 ] Apache Spark commented on SPARK-34848: -- User 'AngersZh' has created a pull request for this

[jira] [Updated] (SPARK-34092) support filtering by task status in REST API call for a specific stage

2021-03-26 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-34092: --- Description: When we want to get a specific stage's detail info with task information, it will return all

[jira] [Assigned] (SPARK-34744) Improve error message for casting cause overflow error

2021-03-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34744: Assignee: angerszhu (was: Apache Spark) > Improve error message for casting cause overflow

[jira] [Resolved] (SPARK-34744) Improve error message for casting cause overflow error

2021-03-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34744. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31971

[jira] [Assigned] (SPARK-34744) Improve error message for casting cause overflow error

2021-03-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34744: Assignee: Apache Spark > Improve error message for casting cause overflow error >

[jira] [Commented] (SPARK-31754) Spark Structured Streaming: NullPointerException in Stream Stream join

2021-03-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309833#comment-17309833 ] Jungtaek Lim commented on SPARK-31754: -- Did anyone make a backup of problematic state with

[jira] [Commented] (SPARK-34814) LikeSimplification should handle NULL

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309830#comment-17309830 ] Apache Spark commented on SPARK-34814: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34814) LikeSimplification should handle NULL

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34814: Assignee: Apache Spark > LikeSimplification should handle NULL >

[jira] [Assigned] (SPARK-34814) LikeSimplification should handle NULL

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34814: Assignee: (was: Apache Spark) > LikeSimplification should handle NULL >

[jira] [Commented] (SPARK-34814) LikeSimplification should handle NULL

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309829#comment-17309829 ] Apache Spark commented on SPARK-34814: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-34527) De-duplicated common columns cannot be resolved from USING/NATURAL JOIN

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309806#comment-17309806 ] Apache Spark commented on SPARK-34527: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Commented] (SPARK-34527) De-duplicated common columns cannot be resolved from USING/NATURAL JOIN

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309804#comment-17309804 ] Apache Spark commented on SPARK-34527: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33717) deprecate spark.launcher.childConectionTimeout

2021-03-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-33717: Assignee: Josh Soref > deprecate spark.launcher.childConectionTimeout >

[jira] [Updated] (SPARK-34701) Remove analyzing temp view again in CreateViewCommand

2021-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34701: -- Fix Version/s: (was: 3.2.0) > Remove analyzing temp view again in CreateViewCommand >

[jira] [Updated] (SPARK-33717) deprecate spark.launcher.childConectionTimeout

2021-03-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-33717: - Issue Type: Improvement (was: Bug) Priority: Minor (was: Major) > deprecate

[jira] [Resolved] (SPARK-33717) deprecate spark.launcher.childConectionTimeout

2021-03-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-33717. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30679

[jira] [Commented] (SPARK-34701) Remove analyzing temp view again in CreateViewCommand

2021-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309725#comment-17309725 ] Dongjoon Hyun commented on SPARK-34701: --- This is reverted via

[jira] [Reopened] (SPARK-34701) Remove analyzing temp view again in CreateViewCommand

2021-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-34701: --- Assignee: (was: Terry Kim) > Remove analyzing temp view again in CreateViewCommand >

[jira] [Updated] (SPARK-34876) Non-nullable aggregates can return NULL in a correlated subquery

2021-03-26 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-34876: --- Affects Version/s: 2.4.7 3.0.2 3.1.1 > Non-nullable

[jira] [Created] (SPARK-34878) Test actual size of year-month and day-time intervals

2021-03-26 Thread Max Gekk (Jira)
Max Gekk created SPARK-34878: Summary: Test actual size of year-month and day-time intervals Key: SPARK-34878 URL: https://issues.apache.org/jira/browse/SPARK-34878 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-34848) add duration in TaskMetricsDistribution

2021-03-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34848. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31948

[jira] [Resolved] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-03-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34448. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31693

[jira] [Updated] (SPARK-34848) add duration in TaskMetricsDistribution

2021-03-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34848: - Priority: Minor (was: Major) > add duration in TaskMetricsDistribution >

[jira] [Assigned] (SPARK-34848) add duration in TaskMetricsDistribution

2021-03-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34848: Assignee: angerszhu > add duration in TaskMetricsDistribution >

[jira] [Assigned] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-03-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34448: Assignee: zhengruifeng > Binary logistic regression incorrectly computes the intercept

[jira] [Assigned] (SPARK-34858) Binary Logistic Regression with intercept support centering

2021-03-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34858: Assignee: zhengruifeng > Binary Logistic Regression with intercept support centering >

[jira] [Resolved] (SPARK-34858) Binary Logistic Regression with intercept support centering

2021-03-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34858. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31693

[jira] [Commented] (SPARK-34780) Cached Table (parquet) with old Configs Used

2021-03-26 Thread Michael Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309514#comment-17309514 ] Michael Chen commented on SPARK-34780: -- Yes, I think as long as there aren't any correctness issues

[jira] [Resolved] (SPARK-34875) Divide day-time interval by numeric

2021-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34875. - Resolution: Fixed Issue resolved by pull request 31972

[jira] [Comment Edited] (SPARK-34849) SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309492#comment-17309492 ] Haejoon Lee edited comment on SPARK-34849 at 3/26/21, 3:23 PM: --- The

[jira] [Commented] (SPARK-34849) SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309492#comment-17309492 ] Haejoon Lee commented on SPARK-34849: - The SPIP voting started at

[jira] [Updated] (SPARK-34849) SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34849: Description: This is a SPIP for porting [Koalas project|https://github.com/databricks/koalas] to

[jira] [Updated] (SPARK-34849) SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34849: Description: This is a SPIP for porting [Koalas project|https://github.com/databricks/koalas] to

[jira] [Updated] (SPARK-34849) SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34849: Description: This is a SPIP for porting [Koalas project|https://github.com/databricks/koalas] to

[jira] [Updated] (SPARK-34849) SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34849: Description: This is a SPIP for porting [Koalas project|https://github.com/databricks/koalas] to

[jira] [Resolved] (SPARK-34846) Sort output rows in SQLQueryTestSuite even if a plan has a Sort node

2021-03-26 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34846. -- Resolution: Won't Fix > Sort output rows in SQLQueryTestSuite even if a plan has a

[jira] [Updated] (SPARK-34877) Add Spark AM Log link in case of master as yarn and deploy mode as client

2021-03-26 Thread Saurabh Chawla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saurabh Chawla updated SPARK-34877: --- Priority: Minor (was: Major) > Add Spark AM Log link in case of master as yarn and deploy

[jira] [Commented] (SPARK-34877) Add Spark AM Log link in case of master as yarn and deploy mode as client

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309462#comment-17309462 ] Apache Spark commented on SPARK-34877: -- User 'SaurabhChawla100' has created a pull request for this

[jira] [Assigned] (SPARK-34877) Add Spark AM Log link in case of master as yarn and deploy mode as client

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34877: Assignee: Apache Spark > Add Spark AM Log link in case of master as yarn and deploy mode

[jira] [Assigned] (SPARK-34877) Add Spark AM Log link in case of master as yarn and deploy mode as client

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34877: Assignee: (was: Apache Spark) > Add Spark AM Log link in case of master as yarn and

[jira] [Created] (SPARK-34877) Add Spark AM Log link in case of master as yarn and deploy mode as client

2021-03-26 Thread Saurabh Chawla (Jira)
Saurabh Chawla created SPARK-34877: -- Summary: Add Spark AM Log link in case of master as yarn and deploy mode as client Key: SPARK-34877 URL: https://issues.apache.org/jira/browse/SPARK-34877

[jira] [Assigned] (SPARK-34876) Non-nullable aggregates can return NULL in a correlated subquery

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34876: Assignee: (was: Apache Spark) > Non-nullable aggregates can return NULL in a

[jira] [Commented] (SPARK-34876) Non-nullable aggregates can return NULL in a correlated subquery

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309457#comment-17309457 ] Apache Spark commented on SPARK-34876: -- User 'tanelk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34876) Non-nullable aggregates can return NULL in a correlated subquery

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34876: Assignee: Apache Spark > Non-nullable aggregates can return NULL in a correlated

[jira] [Commented] (SPARK-34876) Non-nullable aggregates can return NULL in a correlated subquery

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309456#comment-17309456 ] Apache Spark commented on SPARK-34876: -- User 'tanelk' has created a pull request for this issue:

[jira] [Created] (SPARK-34876) Non-nullable aggregates can return NULL in a correlated subquery

2021-03-26 Thread Tanel Kiis (Jira)
Tanel Kiis created SPARK-34876: -- Summary: Non-nullable aggregates can return NULL in a correlated subquery Key: SPARK-34876 URL: https://issues.apache.org/jira/browse/SPARK-34876 Project: Spark

[jira] [Updated] (SPARK-34876) Non-nullable aggregates can return NULL in a correlated subquery

2021-03-26 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-34876: --- Description: Test case in scalar-subquery-select.sql: {code:title=query} SELECT t1a, (SELECT

[jira] [Commented] (SPARK-23977) Add commit protocol binding to Hadoop 3.1 PathOutputCommitter mechanism

2021-03-26 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309397#comment-17309397 ] Steve Loughran commented on SPARK-23977: use the partitioned committer and configure it to do

[jira] [Updated] (SPARK-34873) Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-03-26 Thread Wang Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Shuo updated SPARK-34873: -- Description: In the current code, a `QueryExecution` will be wrapped in

[jira] [Updated] (SPARK-34873) Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-03-26 Thread Wang Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Shuo updated SPARK-34873: -- Description: In the current code, a `QueryExecution` will be wrapped in

[jira] [Updated] (SPARK-34873) Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-03-26 Thread Wang Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Shuo updated SPARK-34873: -- Description: In the current code, a `QueryExecution` will be wrapped in

[jira] [Assigned] (SPARK-34875) Divide day-time interval by numeric

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34875: Assignee: Max Gekk (was: Apache Spark) > Divide day-time interval by numeric >

[jira] [Commented] (SPARK-34875) Divide day-time interval by numeric

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309383#comment-17309383 ] Apache Spark commented on SPARK-34875: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34875) Divide day-time interval by numeric

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309382#comment-17309382 ] Apache Spark commented on SPARK-34875: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34875) Divide day-time interval by numeric

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34875: Assignee: Apache Spark (was: Max Gekk) > Divide day-time interval by numeric >

[jira] [Created] (SPARK-34875) Divide day-time interval by numeric

2021-03-26 Thread Max Gekk (Jira)
Max Gekk created SPARK-34875: Summary: Divide day-time interval by numeric Key: SPARK-34875 URL: https://issues.apache.org/jira/browse/SPARK-34875 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34875) Divide day-time interval by numeric

2021-03-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34875: - Description: Support the divide op of day-time interval by numeric types including: # ByteType #

[jira] [Commented] (SPARK-34859) Vectorized parquet reader needs synchronization among pages for column index

2021-03-26 Thread Li Xian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309330#comment-17309330 ] Li Xian commented on SPARK-34859: - [~yumwang] Yes, I'm interested in this issue and I would like to work

[jira] [Updated] (SPARK-34849) SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34849: - Description: This is a SPIP for porting [Koalas project|https://github.com/databricks/koalas] 

[jira] [Updated] (SPARK-34849) SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34849: - Description: This is a SPIP for porting [Koalas project|https://github.com/databricks/koalas] 

[jira] [Updated] (SPARK-34849) SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34849: - Description: This is a SPIP for porting [Koalas project|https://github.com/databricks/koalas] 

[jira] [Updated] (SPARK-34849) SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34849: - Description: This is a SPIP for porting [Koalas project|https://github.com/databricks/koalas] 

[jira] [Resolved] (SPARK-34874) Recover test reports for failed GA builds

2021-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34874. -- Fix Version/s: 3.0.3 3.1.2 2.4.8

[jira] [Assigned] (SPARK-34874) Recover test reports for failed GA builds

2021-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34874: Assignee: Hyukjin Kwon > Recover test reports for failed GA builds >

[jira] [Commented] (SPARK-34744) Improve error message for casting cause overflow error

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309286#comment-17309286 ] Apache Spark commented on SPARK-34744: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34744) Improve error message for casting cause overflow error

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34744: Assignee: Apache Spark > Improve error message for casting cause overflow error >

[jira] [Assigned] (SPARK-34744) Improve error message for casting cause overflow error

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34744: Assignee: (was: Apache Spark) > Improve error message for casting cause overflow

[jira] [Commented] (SPARK-34744) Improve error message for casting cause overflow error

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309284#comment-17309284 ] Apache Spark commented on SPARK-34744: -- User 'AngersZh' has created a pull request for this

[jira] [Updated] (SPARK-34744) Improve error message for casting cause overflow error

2021-03-26 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-34744: -- Parent: SPARK-33539 Issue Type: Sub-task (was: Improvement) > Improve error message for

[jira] [Assigned] (SPARK-34874) Recover test reports for failed GA builds

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34874: Assignee: (was: Apache Spark) > Recover test reports for failed GA builds >

[jira] [Commented] (SPARK-34874) Recover test reports for failed GA builds

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309270#comment-17309270 ] Apache Spark commented on SPARK-34874: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-34874) Recover test reports for failed GA builds

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34874: Assignee: Apache Spark > Recover test reports for failed GA builds >

[jira] [Updated] (SPARK-34874) Recover test reports for failed GA builds

2021-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34874: - Affects Version/s: 3.1.1 Summary: Recover test reports for failed GA builds (was:

[jira] [Updated] (SPARK-34874) Recover test reports for failed GA builds

2021-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34874: - Affects Version/s: 2.4.7 3.0.2 > Recover test reports for failed GA

[jira] [Created] (SPARK-34874) Publish test reports for failed GA builds

2021-03-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-34874: Summary: Publish test reports for failed GA builds Key: SPARK-34874 URL: https://issues.apache.org/jira/browse/SPARK-34874 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-32855) Improve DPP for some join type do not support broadcast filtering side

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309215#comment-17309215 ] Apache Spark commented on SPARK-32855: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-32855) Improve DPP for some join type do not support broadcast filtering side

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309214#comment-17309214 ] Apache Spark commented on SPARK-32855: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34873) Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34873: Assignee: Apache Spark > Avoid wrapped in withNewExecutionId twice when run SQL with

[jira] [Assigned] (SPARK-34873) Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34873: Assignee: (was: Apache Spark) > Avoid wrapped in withNewExecutionId twice when run

[jira] [Commented] (SPARK-34873) Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-03-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309195#comment-17309195 ] Apache Spark commented on SPARK-34873: -- User 'wangshuo128' has created a pull request for this

[jira] [Updated] (SPARK-34873) Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-03-26 Thread Wang Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Shuo updated SPARK-34873: -- Attachment: 0F9E09B0-7FAF-4424-9C11-66930F1BBB7B.png > Avoid wrapped in withNewExecutionId twice when

[jira] [Updated] (SPARK-34873) Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-03-26 Thread Wang Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Shuo updated SPARK-34873: -- Description: In the current code, a `QueryExecution` will be wrapped in

[jira] [Created] (SPARK-34873) Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-03-26 Thread Wang Shuo (Jira)
Wang Shuo created SPARK-34873: - Summary: Avoid wrapped in withNewExecutionId twice when run SQL with side effects Key: SPARK-34873 URL: https://issues.apache.org/jira/browse/SPARK-34873 Project: Spark