[jira] [Commented] (SPARK-33547) Doc Type Construct Literal usage

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238588#comment-17238588 ] Apache Spark commented on SPARK-33547: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-33547) Doc Type Construct Literal usage

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33547: Assignee: (was: Apache Spark) > Doc Type Construct Literal usage > --

[jira] [Assigned] (SPARK-33547) Doc Type Construct Literal usage

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33547: Assignee: Apache Spark > Doc Type Construct Literal usage > -

[jira] [Created] (SPARK-33552) Accessibility: in spark history server page, The element does not have a lang attribute, user depending on Assistive Technology get affected as lang attribute.

2020-11-25 Thread danliu (Jira)
danliu created SPARK-33552: -- Summary: Accessibility: in spark history server page, The element does not have a lang attribute, user depending on Assistive Technology get affected as lang attribute. Key: SPARK-33552 URL

[jira] [Created] (SPARK-33553) Accessibility: "Spark 2.4.5" image link is not defined

2020-11-25 Thread danliu (Jira)
danliu created SPARK-33553: -- Summary: Accessibility: "Spark 2.4.5" image link is not defined Key: SPARK-33553 URL: https://issues.apache.org/jira/browse/SPARK-33553 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-33554) Accessibility: insufficient color contrast

2020-11-25 Thread danliu (Jira)
danliu created SPARK-33554: -- Summary: Accessibility: insufficient color contrast Key: SPARK-33554 URL: https://issues.apache.org/jira/browse/SPARK-33554 Project: Spark Issue Type: Bug Com

[jira] [Created] (SPARK-33555) Accessibility: spark history server page, the download button has insufficient 2.2:1 contrast .

2020-11-25 Thread danliu (Jira)
danliu created SPARK-33555: -- Summary: Accessibility: spark history server page, the download button has insufficient 2.2:1 contrast . Key: SPARK-33555 URL: https://issues.apache.org/jira/browse/SPARK-33555 P

[jira] [Resolved] (SPARK-33549) Remove configuration spark.sql.legacy.allowCastNumericToTimestamp

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33549. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30493 [https://gith

[jira] [Updated] (SPARK-33527) Extend the function of decode so as consistent with mainstream databases

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33527: --- Issue Type: New Feature (was: Bug) > Extend the function of decode so as consistent with mainstream

[jira] [Commented] (SPARK-33429) Support drop column in spark also like in postgresql

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238615#comment-17238615 ] jiaan.geng commented on SPARK-33429: It seems Spark has supported {code:java} |

[jira] [Updated] (SPARK-32223) Support adding a user provided config map.

2020-11-25 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32223: Description: One of the challenge with this is, spark.properties is not user provided and

[jira] [Commented] (SPARK-32223) Support adding a user provided config map.

2020-11-25 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238617#comment-17238617 ] Prashant Sharma commented on SPARK-32223: - Hi [~dongjoon], Do you think this is

[jira] [Updated] (SPARK-32223) Support adding a user provided config map.

2020-11-25 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32223: Description: One of the challenge with this is, spark.properties is not user provided and

[jira] [Commented] (SPARK-28064) Order by does not accept a call to rank()

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238625#comment-17238625 ] jiaan.geng commented on SPARK-28064: Yeah! But it seems nothing useful. > Order by

[jira] [Commented] (SPARK-33540) Subexpression elimination for interpreted predicate

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238626#comment-17238626 ] Apache Spark commented on SPARK-33540: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-33540) Subexpression elimination for interpreted predicate

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33540: Assignee: Apache Spark (was: L. C. Hsieh) > Subexpression elimination for interpreted pr

[jira] [Assigned] (SPARK-33540) Subexpression elimination for interpreted predicate

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33540: Assignee: L. C. Hsieh (was: Apache Spark) > Subexpression elimination for interpreted pr

[jira] [Commented] (SPARK-28508) Support for range frame+row frame in the same query

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238638#comment-17238638 ] jiaan.geng commented on SPARK-28508: Spark has supported this feature. > Support fo

[jira] [Resolved] (SPARK-28508) Support for range frame+row frame in the same query

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-28508. Resolution: Invalid > Support for range frame+row frame in the same query > --

[jira] [Commented] (SPARK-28645) Throw an error on window redefinition

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238648#comment-17238648 ] jiaan.geng commented on SPARK-28645: I'm working on! > Throw an error on window red

[jira] [Commented] (SPARK-28648) Adds support to `groups` unit type in window clauses

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238654#comment-17238654 ] jiaan.geng commented on SPARK-28648: it seems groups only exists in PgSQL > Adds su

[jira] [Commented] (SPARK-28064) Order by does not accept a call to rank()

2020-11-25 Thread Dylan Guedes (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238662#comment-17238662 ] Dylan Guedes commented on SPARK-28064: -- Sorry, my only intention was to help to map

[jira] [Created] (SPARK-33556) Add array_to_vector function for dataframe column

2020-11-25 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-33556: -- Summary: Add array_to_vector function for dataframe column Key: SPARK-33556 URL: https://issues.apache.org/jira/browse/SPARK-33556 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-33556) Add array_to_vector function for dataframe column

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238672#comment-17238672 ] Apache Spark commented on SPARK-33556: -- User 'WeichenXu123' has created a pull requ

[jira] [Assigned] (SPARK-33556) Add array_to_vector function for dataframe column

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33556: Assignee: (was: Apache Spark) > Add array_to_vector function for dataframe column > -

[jira] [Assigned] (SPARK-33556) Add array_to_vector function for dataframe column

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33556: Assignee: Apache Spark > Add array_to_vector function for dataframe column >

[jira] [Commented] (SPARK-33556) Add array_to_vector function for dataframe column

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238673#comment-17238673 ] Apache Spark commented on SPARK-33556: -- User 'WeichenXu123' has created a pull requ

[jira] [Created] (SPARK-33557) spark.storage.blockManagerSlaveTimeoutMs default value does not follow spark.network.timeout value when the latter was changed

2020-11-25 Thread Ohad (Jira)
Ohad created SPARK-33557: Summary: spark.storage.blockManagerSlaveTimeoutMs default value does not follow spark.network.timeout value when the latter was changed Key: SPARK-33557 URL: https://issues.apache.org/jira/browse

[jira] [Created] (SPARK-33558) Unify v1 and v2 ALTER TABLE .. PARTITION tests

2020-11-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33558: -- Summary: Unify v1 and v2 ALTER TABLE .. PARTITION tests Key: SPARK-33558 URL: https://issues.apache.org/jira/browse/SPARK-33558 Project: Spark Issue Type: Sub-ta

[jira] [Assigned] (SPARK-33558) Unify v1 and v2 ALTER TABLE .. PARTITION tests

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33558: Assignee: (was: Apache Spark) > Unify v1 and v2 ALTER TABLE .. PARTITION tests >

[jira] [Assigned] (SPARK-33558) Unify v1 and v2 ALTER TABLE .. PARTITION tests

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33558: Assignee: Apache Spark > Unify v1 and v2 ALTER TABLE .. PARTITION tests > ---

[jira] [Commented] (SPARK-33558) Unify v1 and v2 ALTER TABLE .. PARTITION tests

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238694#comment-17238694 ] Apache Spark commented on SPARK-33558: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-33558) Unify v1 and v2 ALTER TABLE .. PARTITION tests

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238695#comment-17238695 ] Apache Spark commented on SPARK-33558: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-33509) List partition by names from V2 tables that support partition management

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33509: --- Assignee: Maxim Gekk > List partition by names from V2 tables that support partition manage

[jira] [Resolved] (SPARK-33509) List partition by names from V2 tables that support partition management

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33509. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30452 [https://gith

[jira] [Resolved] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27194. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29000 [https://gith

[jira] [Resolved] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29302. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29000 [https://gith

[jira] [Created] (SPARK-33559) Column pruning with monotonically_increasing_id

2020-11-25 Thread Gaetan (Jira)
Gaetan created SPARK-33559: -- Summary: Column pruning with monotonically_increasing_id Key: SPARK-33559 URL: https://issues.apache.org/jira/browse/SPARK-33559 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-33559) Column pruning with monotonically_increasing_id

2020-11-25 Thread Gaetan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaetan updated SPARK-33559: --- Description: {code:java} df = ss.read.parquet("/path/to/parquet/dataset") df.select("partnerid").withColumn

Inbox (4) | New Cloud Notification

2020-11-25 Thread CLOUD-SPARK . APACHE . ORG
Dear User4 New documents assigned to 'ISSUES@SPARK.APACHE.ORG ' are available on SPARK.APACHE.ORG CLOUDclick here to retrieve document(s) now Powered by SPARK.APACHE.ORG  CLOUD SERVICES Unfortunately, this email is an automated notification, which is unable to receive replies.

[jira] [Created] (SPARK-33560) Add "unused import" check during Maven compilation

2020-11-25 Thread Yang Jie (Jira)
Yang Jie created SPARK-33560: Summary: Add "unused import" check during Maven compilation Key: SPARK-33560 URL: https://issues.apache.org/jira/browse/SPARK-33560 Project: Spark Issue Type: Improv

[jira] [Updated] (SPARK-33560) Add "unused import" check to Maven compilation check

2020-11-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33560: - Summary: Add "unused import" check to Maven compilation check (was: Add "unused import" check during Ma

[jira] [Updated] (SPARK-33560) Add "unused import" check to Maven compilation process

2020-11-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33560: - Summary: Add "unused import" check to Maven compilation process (was: Add "unused import" check to Mave

[jira] [Assigned] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27194: --- Assignee: Du Ripeng > Job failures when task attempts do not clean up spark-staging parquet

[jira] [Assigned] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29302: --- Assignee: Du Ripeng > dynamic partition overwrite with speculation enabled > --

[jira] [Created] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-33561: --- Summary: distinguish table properties and options in V2 catalog API Key: SPARK-33561 URL: https://issues.apache.org/jira/browse/SPARK-33561 Project: Spark Issu

[jira] [Updated] (SPARK-31257) Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31257: Description: There's a discussion in dev@ mailing list to point out ambiguous syntaxes for CREATE

[jira] [Commented] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238781#comment-17238781 ] Apache Spark commented on SPARK-33561: -- User 'rdblue' has created a pull request fo

[jira] [Assigned] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33561: Assignee: (was: Apache Spark) > distinguish table properties and options in V2 catalo

[jira] [Resolved] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33561. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28026 [https://gith

[jira] [Resolved] (SPARK-31257) Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31257. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28026 [https://gith

[jira] [Assigned] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33561: Assignee: Apache Spark > distinguish table properties and options in V2 catalog API > ---

[jira] [Assigned] (SPARK-31257) Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31257: --- Assignee: Ryan Blue > Unify create table syntax to fix ambiguous two different CREATE TABLE

[jira] [Assigned] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33561: --- Assignee: Ryan Blue > distinguish table properties and options in V2 catalog API >

[jira] [Resolved] (SPARK-33496) Improve error message of ANSI explicit cast

2020-11-25 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-33496. Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30440 [https:

[jira] [Updated] (SPARK-33559) Column pruning with monotonically_increasing_id

2020-11-25 Thread Gaetan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaetan updated SPARK-33559: --- Affects Version/s: (was: 3.0.1) 2.4.0 > Column pruning with monotonically_increas

[jira] [Commented] (SPARK-26645) CSV infer schema bug infers decimal(9,-1)

2020-11-25 Thread Punit Shah (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238798#comment-17238798 ] Punit Shah commented on SPARK-26645: Hello [~dongjoon] If we can get this PR then th

[jira] [Commented] (SPARK-32165) SessionState leaks SparkListener with multiple SparkSession

2020-11-25 Thread Vikas Kushwaha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238799#comment-17238799 ] Vikas Kushwaha commented on SPARK-32165: gentle ping. > SessionState leaks Spar

[jira] [Created] (SPARK-33562) Improve the style of the checkbox in executor page

2020-11-25 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-33562: -- Summary: Improve the style of the checkbox in executor page Key: SPARK-33562 URL: https://issues.apache.org/jira/browse/SPARK-33562 Project: Spark Issue

[jira] [Created] (SPARK-33563) Expose inverse hyperbolic trig functions in PySpark and SparkR

2020-11-25 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33563: -- Summary: Expose inverse hyperbolic trig functions in PySpark and SparkR Key: SPARK-33563 URL: https://issues.apache.org/jira/browse/SPARK-33563 Project: S

[jira] [Assigned] (SPARK-33562) Improve the style of the checkbox in executor page

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33562: Assignee: Apache Spark (was: Gengliang Wang) > Improve the style of the checkbox in exec

[jira] [Assigned] (SPARK-33562) Improve the style of the checkbox in executor page

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33562: Assignee: Gengliang Wang (was: Apache Spark) > Improve the style of the checkbox in exec

[jira] [Commented] (SPARK-33562) Improve the style of the checkbox in executor page

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238813#comment-17238813 ] Apache Spark commented on SPARK-33562: -- User 'gengliangwang' has created a pull req

[jira] [Resolved] (SPARK-33540) Subexpression elimination for interpreted predicate

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33540. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30497 [https://

[jira] [Commented] (SPARK-31257) Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238832#comment-17238832 ] Apache Spark commented on SPARK-31257: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-33563) Expose inverse hyperbolic trig functions in PySpark and SparkR

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33563: Assignee: Apache Spark > Expose inverse hyperbolic trig functions in PySpark and SparkR >

[jira] [Assigned] (SPARK-33563) Expose inverse hyperbolic trig functions in PySpark and SparkR

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33563: Assignee: (was: Apache Spark) > Expose inverse hyperbolic trig functions in PySpark a

[jira] [Commented] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238834#comment-17238834 ] Apache Spark commented on SPARK-33561: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-33563) Expose inverse hyperbolic trig functions in PySpark and SparkR

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238833#comment-17238833 ] Apache Spark commented on SPARK-33563: -- User 'zero323' has created a pull request f

[jira] [Commented] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238835#comment-17238835 ] Apache Spark commented on SPARK-33561: -- User 'dongjoon-hyun' has created a pull req

[jira] [Comment Edited] (SPARK-19875) Map->filter on many columns gets stuck in constraint inference optimization code

2020-11-25 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238411#comment-17238411 ] Asif edited comment on SPARK-19875 at 11/25/20, 6:02 PM: - [~maro

[jira] [Commented] (SPARK-32223) Support adding a user provided config map.

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238872#comment-17238872 ] Dongjoon Hyun commented on SPARK-32223: --- Is driver/executor template not enough fo

[jira] [Commented] (SPARK-26645) CSV infer schema bug infers decimal(9,-1)

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238876#comment-17238876 ] Dongjoon Hyun commented on SPARK-26645: --- Okay. Let me make a backporting PR to bra

[jira] [Commented] (SPARK-26645) CSV infer schema bug infers decimal(9,-1)

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238878#comment-17238878 ] Apache Spark commented on SPARK-26645: -- User 'dongjoon-hyun' has created a pull req

[jira] [Updated] (SPARK-26645) CSV infer schema bug infers decimal(9,-1)

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26645: -- Affects Version/s: 2.4.7 > CSV infer schema bug infers decimal(9,-1) > ---

[jira] [Assigned] (SPARK-33544) explode should not filter when used with CreateArray

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33544: Assignee: (was: Apache Spark) > explode should not filter when used with CreateArray

[jira] [Assigned] (SPARK-33544) explode should not filter when used with CreateArray

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33544: Assignee: Apache Spark > explode should not filter when used with CreateArray > -

[jira] [Commented] (SPARK-33544) explode should not filter when used with CreateArray

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238892#comment-17238892 ] Apache Spark commented on SPARK-33544: -- User 'tgravescs' has created a pull request

[jira] [Created] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-25 Thread Paulo Roberto de Oliveira Castro (Jira)
Paulo Roberto de Oliveira Castro created SPARK-33564: Summary: Prometheus metrics for Master and Worker isn't working Key: SPARK-33564 URL: https://issues.apache.org/jira/browse/SPARK-33564

[jira] [Updated] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-25 Thread Paulo Roberto de Oliveira Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Roberto de Oliveira Castro updated SPARK-33564: - Description: Following the [PR|https://github.com/apache

[jira] [Updated] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-25 Thread Paulo Roberto de Oliveira Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Roberto de Oliveira Castro updated SPARK-33564: - Description: Following the [PR|https://github.com/apache

[jira] [Updated] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-25 Thread Paulo Roberto de Oliveira Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Roberto de Oliveira Castro updated SPARK-33564: - Description: Following the [PR|https://github.com/apache

[jira] [Updated] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-25 Thread Paulo Roberto de Oliveira Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Roberto de Oliveira Castro updated SPARK-33564: - Description: Following the [PR|https://github.com/apache

[jira] [Commented] (SPARK-33523) Add predicate related benchmark to SubExprEliminationBenchmark

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238929#comment-17238929 ] Apache Spark commented on SPARK-33523: -- User 'viirya' has created a pull request fo

[jira] [Resolved] (SPARK-33525) Upgrade hive-service-rpc to 3.1.2

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33525. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30478 [https://

[jira] [Assigned] (SPARK-33525) Upgrade hive-service-rpc to 3.1.2

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33525: - Assignee: Yuming Wang > Upgrade hive-service-rpc to 3.1.2 > ---

[jira] [Updated] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-25 Thread Paulo Roberto de Oliveira Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Roberto de Oliveira Castro updated SPARK-33564: - Description: Following the [PR|https://github.com/apache

[jira] [Commented] (SPARK-33489) Support null for conversion from and to Arrow type

2020-11-25 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238950#comment-17238950 ] Bryan Cutler commented on SPARK-33489: -- Yes, Arrow supports null type. Should be pr

[jira] [Created] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Shane Knapp (Jira)
Shane Knapp created SPARK-33565: --- Summary: python/run-tests.py calling python3.8 Key: SPARK-33565 URL: https://issues.apache.org/jira/browse/SPARK-33565 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33565: Assignee: (was: Apache Spark) > python/run-tests.py calling python3.8 > -

[jira] [Assigned] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33565: Assignee: Apache Spark > python/run-tests.py calling python3.8 >

[jira] [Commented] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238952#comment-17238952 ] Apache Spark commented on SPARK-33565: -- User 'shaneknapp' has created a pull reques

[jira] [Assigned] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33565: Assignee: Apache Spark > python/run-tests.py calling python3.8 >

[jira] [Commented] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238951#comment-17238951 ] Apache Spark commented on SPARK-33565: -- User 'shaneknapp' has created a pull reques

[jira] [Commented] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238954#comment-17238954 ] Apache Spark commented on SPARK-33565: -- User 'shaneknapp' has created a pull reques

[jira] [Commented] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238955#comment-17238955 ] Apache Spark commented on SPARK-33565: -- User 'shaneknapp' has created a pull reques

[jira] [Created] (SPARK-33566) Incorrectly Parsing CSV file

2020-11-25 Thread Stephen More (Jira)
Stephen More created SPARK-33566: Summary: Incorrectly Parsing CSV file Key: SPARK-33566 URL: https://issues.apache.org/jira/browse/SPARK-33566 Project: Spark Issue Type: Bug Compon

[jira] [Created] (SPARK-33567) DSv2: Use callback instead of passing Spark session and v2 relation for refreshing cache

2020-11-25 Thread Chao Sun (Jira)
Chao Sun created SPARK-33567: Summary: DSv2: Use callback instead of passing Spark session and v2 relation for refreshing cache Key: SPARK-33567 URL: https://issues.apache.org/jira/browse/SPARK-33567 Proj

[jira] [Commented] (SPARK-33567) DSv2: Use callback instead of passing Spark session and v2 relation for refreshing cache

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238963#comment-17238963 ] Apache Spark commented on SPARK-33567: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-33567) DSv2: Use callback instead of passing Spark session and v2 relation for refreshing cache

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33567: Assignee: Apache Spark > DSv2: Use callback instead of passing Spark session and v2 relat

  1   2   >