[jira] [Commented] (SPARK-28312) Add numeric.sql

2019-07-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880992#comment-16880992 ] Yuming Wang commented on SPARK-28312: - I'm working on. > Add numeric.sql >

[jira] [Created] (SPARK-28312) Add numeric.sql

2019-07-08 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28312: --- Summary: Add numeric.sql Key: SPARK-28312 URL: https://issues.apache.org/jira/browse/SPARK-28312 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Resolved] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28302. -- Resolution: Fixed Fix Version/s: 2.4.4 2.3.4 3.0.0

[jira] [Assigned] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28302: Assignee: wuyi > SparkLauncher: The process cannot access the file because it is being us

[jira] [Commented] (SPARK-28271) Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880975#comment-16880975 ] Hyukjin Kwon commented on SPARK-28271: -- It doesn't necessarily assign somebody. It

[jira] [Commented] (SPARK-28308) CalendarInterval sub-second part should be padded before parsing

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880964#comment-16880964 ] Dongjoon Hyun commented on SPARK-28308: --- This is resolved via https://github.com/a

[jira] [Resolved] (SPARK-28308) CalendarInterval sub-second part should be padded before parsing

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28308. --- Resolution: Fixed Fix Version/s: 3.0.0 2.4.4 2.3

[jira] [Assigned] (SPARK-28308) CalendarInterval sub-second part should be padded before parsing

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28308: - Assignee: Dongjoon Hyun > CalendarInterval sub-second part should be padded before pars

[jira] [Commented] (SPARK-28269) ArrowStreamPandasSerializer get stack

2019-07-08 Thread Modi Tamam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880942#comment-16880942 ] Modi Tamam commented on SPARK-28269: Sorry, I had a typo, not stack but *stuck*. Th

[jira] [Updated] (SPARK-28266) data correctness issue: data duplication when `path` serde property is present

2019-07-08 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-28266: -- Summary: data correctness issue: data duplication when `path` serde property is presen

[jira] [Commented] (SPARK-28271) Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base

2019-07-08 Thread Terry Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880934#comment-16880934 ] Terry Kim commented on SPARK-28271: --- [~hyukjin.kwon], please assign this to me. I am h

[jira] [Updated] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-08 Thread Zhu, Lipeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu, Lipeng updated SPARK-28310: Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-27764) > ANSI SQL grammar

[jira] [Updated] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-08 Thread Zhu, Lipeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu, Lipeng updated SPARK-28310: Description: According to the ANSI SQL 2011: {code:sql} ::= ::= RESPECT NULLS | IGNORE NULLS :

[jira] [Assigned] (SPARK-28311) Spark Thrift Server protocol version compatibility setup too late

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28311: Assignee: (was: Apache Spark) > Spark Thrift Server protocol version compatibility se

[jira] [Assigned] (SPARK-28311) Spark Thrift Server protocol version compatibility setup too late

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28311: Assignee: Apache Spark > Spark Thrift Server protocol version compatibility setup too lat

[jira] [Updated] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-08 Thread Zhu, Lipeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu, Lipeng updated SPARK-28310: Issue Type: Sub-task (was: Bug) Parent: SPARK-27764 > ANSI SQL grammar support: first_val

[jira] [Updated] (SPARK-28311) Spark Thrift Server protocol version compatibility setup too late

2019-07-08 Thread angerszhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28311: -- Description: {code:java} SessionHandle getSessionHandle(TOpenSessionReq req, TOpenSessionResp res)

[jira] [Created] (SPARK-28311) Spark Thrift Server protocol version compatibility setup too late

2019-07-08 Thread angerszhu (JIRA)
angerszhu created SPARK-28311: - Summary: Spark Thrift Server protocol version compatibility setup too late Key: SPARK-28311 URL: https://issues.apache.org/jira/browse/SPARK-28311 Project: Spark

[jira] [Assigned] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28309: Assignee: Hyukjin Kwon > AppVeyor fails to install testthat (1.0.2) due to previously ins

[jira] [Comment Edited] (SPARK-28023) Trim the string when cast string type to other types

2019-07-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880881#comment-16880881 ] Yuming Wang edited comment on SPARK-28023 at 7/9/19 3:07 AM: -

[jira] [Resolved] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28309. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25081 [https://gi

[jira] [Resolved] (SPARK-28023) Trim the string when cast string type to other types

2019-07-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-28023. - Resolution: Later Resolve the issue as {{Later}}. More details: https://github.com/apache/spark

[jira] [Resolved] (SPARK-28250) QueryPlan#references should exclude producedAttributes

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28250. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25052 [https://gi

[jira] [Assigned] (SPARK-28273) Convert and port 'pgSQL/case.sql' into UDF test base

2019-07-08 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28273: --- Assignee: Hyukjin Kwon > Convert and port 'pgSQL/case.sql' into UDF test base > ---

[jira] [Resolved] (SPARK-28273) Convert and port 'pgSQL/case.sql' into UDF test base

2019-07-08 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28273. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25070 [https://gith

[jira] [Assigned] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28310: Assignee: (was: Apache Spark) > ANSI SQL grammar support: first_value/last_value(expr

[jira] [Assigned] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28310: Assignee: Apache Spark > ANSI SQL grammar support: first_value/last_value(expression, [RE

[jira] [Created] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-08 Thread Zhu, Lipeng (JIRA)
Zhu, Lipeng created SPARK-28310: --- Summary: ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS]) Key: SPARK-28310 URL: https://issues.apache.org/jira/browse/SPARK-28310

[jira] [Updated] (SPARK-28306) Once optimizer rule NormalizeFloatingNumbers is not idempotent

2019-07-08 Thread Yesheng Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesheng Ma updated SPARK-28306: --- Issue Type: Improvement (was: Bug) > Once optimizer rule NormalizeFloatingNumbers is not idempotent

[jira] [Commented] (SPARK-28269) ArrowStreamPandasSerializer get stack

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880840#comment-16880840 ] Hyukjin Kwon commented on SPARK-28269: -- {quote} The above code gets stacked on the

[jira] [Updated] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28309: -- Component/s: R > AppVeyor fails to install testthat (1.0.2) due to previously installed > tes

[jira] [Updated] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28309: -- Component/s: (was: R) SparkR > AppVeyor fails to install testthat (1.0.2)

[jira] [Assigned] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28309: Assignee: Apache Spark > AppVeyor fails to install testthat (1.0.2) due to previously ins

[jira] [Assigned] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28309: Assignee: (was: Apache Spark) > AppVeyor fails to install testthat (1.0.2) due to pre

[jira] [Resolved] (SPARK-28295) Is there a way of getting feature names from pyspark.ml.regression GeneralizedLinearRegression?

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28295. -- Resolution: Invalid > Is there a way of getting feature names from pyspark.ml.regression > Ge

[jira] [Commented] (SPARK-28295) Is there a way of getting feature names from pyspark.ml.regression GeneralizedLinearRegression?

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880827#comment-16880827 ] Hyukjin Kwon commented on SPARK-28295: -- For questions, you can ask it to mailing li

[jira] [Created] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-28309: Summary: AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools Key: SPARK-28309 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Assigned] (SPARK-28306) Once optimizer rule NormalizeFloatingNumbers is not idempotent

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28306: Assignee: Apache Spark > Once optimizer rule NormalizeFloatingNumbers is not idempotent >

[jira] [Assigned] (SPARK-28306) Once optimizer rule NormalizeFloatingNumbers is not idempotent

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28306: Assignee: (was: Apache Spark) > Once optimizer rule NormalizeFloatingNumbers is not i

[jira] [Assigned] (SPARK-28308) CalendarInterval sub-second part should be padded before parsing

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28308: Assignee: Apache Spark > CalendarInterval sub-second part should be padded before parsing

[jira] [Assigned] (SPARK-28308) CalendarInterval sub-second part should be padded before parsing

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28308: Assignee: (was: Apache Spark) > CalendarInterval sub-second part should be padded bef

[jira] [Updated] (SPARK-28308) CalendarInterval sub-second part should be padded before parsing

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28308: -- Labels: correctness (was: ) > CalendarInterval sub-second part should be padded before parsin

[jira] [Created] (SPARK-28308) CalendarInterval sub-second part should be padded before parsing

2019-07-08 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28308: - Summary: CalendarInterval sub-second part should be padded before parsing Key: SPARK-28308 URL: https://issues.apache.org/jira/browse/SPARK-28308 Project: Spark

[jira] [Updated] (SPARK-28307) Support Interval comparison

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28307: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-27764 > Support Interval compar

[jira] [Created] (SPARK-28307) Support Interval comparison

2019-07-08 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28307: - Summary: Support Interval comparison Key: SPARK-28307 URL: https://issues.apache.org/jira/browse/SPARK-28307 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-28067) Incorrect results in decimal aggregation with whole-stage code gen enabled

2019-07-08 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880700#comment-16880700 ] Marco Gaido commented on SPARK-28067: - I cannot reproduce in 2.4.0 either: {code}

[jira] [Resolved] (SPARK-28159) Make the transform natively in ml framework to avoid extra conversion

2019-07-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28159. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24963 [https://github.c

[jira] [Assigned] (SPARK-28159) Make the transform natively in ml framework to avoid extra conversion

2019-07-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28159: - Assignee: zhengruifeng > Make the transform natively in ml framework to avoid extra conversion

[jira] [Resolved] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28261. --- Resolution: Fixed Assignee: Gabor Somogyi Fix Version/s: 3.0.0

[jira] [Updated] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28261: -- Affects Version/s: 2.0.2 > Flaky test: > org.apache.spark.network.TransportClientFactorySuite

[jira] [Created] (SPARK-28306) Once optimizer rule NormalizeFloatingNumbers is not idempotent

2019-07-08 Thread Yesheng Ma (JIRA)
Yesheng Ma created SPARK-28306: -- Summary: Once optimizer rule NormalizeFloatingNumbers is not idempotent Key: SPARK-28306 URL: https://issues.apache.org/jira/browse/SPARK-28306 Project: Spark I

[jira] [Commented] (SPARK-22876) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

2019-07-08 Thread Nikita Gorbachevski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880508#comment-16880508 ] Nikita Gorbachevski commented on SPARK-22876: - Hi, i believe we should reope

[jira] [Assigned] (SPARK-28305) When the AM cannot obtain the container loss reason, ask GetExecutorLossReason times out

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28305: Assignee: Apache Spark > When the AM cannot obtain the container loss reason, ask > GetE

[jira] [Assigned] (SPARK-28305) When the AM cannot obtain the container loss reason, ask GetExecutorLossReason times out

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28305: Assignee: (was: Apache Spark) > When the AM cannot obtain the container loss reason,

[jira] [Created] (SPARK-28305) When the AM cannot obtain the container loss reason, ask GetExecutorLossReason times out

2019-07-08 Thread dzcxzl (JIRA)
dzcxzl created SPARK-28305: -- Summary: When the AM cannot obtain the container loss reason, ask GetExecutorLossReason times out Key: SPARK-28305 URL: https://issues.apache.org/jira/browse/SPARK-28305 Project:

[jira] [Commented] (SPARK-28304) FileFormatWriter introduces an uncoditional sort, even when all attributes are constants

2019-07-08 Thread Eyal Farago (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880402#comment-16880402 ] Eyal Farago commented on SPARK-28304: - cc [~cloud_fan],[~hvanhovell] > FileFormatWr

[jira] [Updated] (SPARK-28304) FileFormatWriter introduces an uncoditional sort, even when all attributes are constants

2019-07-08 Thread Eyal Farago (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eyal Farago updated SPARK-28304: Summary: FileFormatWriter introduces an uncoditional sort, even when all attributes are constants

[jira] [Created] (SPARK-28304) FileFormatWriter introduces an uncoditional join, even when all attributes are constants

2019-07-08 Thread Eyal Farago (JIRA)
Eyal Farago created SPARK-28304: --- Summary: FileFormatWriter introduces an uncoditional join, even when all attributes are constants Key: SPARK-28304 URL: https://issues.apache.org/jira/browse/SPARK-28304

[jira] [Updated] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-08 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-28261: -- Affects Version/s: 2.1.3 2.2.3 2.3.3 > Flaky tes

[jira] [Updated] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-08 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-28261: -- Affects Version/s: 2.4.3 > Flaky test: > org.apache.spark.network.TransportClientFactorySuite

[jira] [Assigned] (SPARK-28301) fix the behavior of table name resolution with multi-catalog

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28301: Assignee: Wenchen Fan (was: Apache Spark) > fix the behavior of table name resolution wi

[jira] [Assigned] (SPARK-28301) fix the behavior of table name resolution with multi-catalog

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28301: Assignee: Apache Spark (was: Wenchen Fan) > fix the behavior of table name resolution wi

[jira] [Assigned] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28302: Assignee: (was: Apache Spark) > SparkLauncher: The process cannot access the file bec

[jira] [Assigned] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28302: Assignee: Apache Spark > SparkLauncher: The process cannot access the file because it is

[jira] [Commented] (SPARK-28303) Support DELETE/UPDATE/MERGE Operations in DataSource V2

2019-07-08 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880258#comment-16880258 ] Xianyin Xin commented on SPARK-28303: - The SQL entrance is need also. > Support DEL

[jira] [Updated] (SPARK-28303) Support DELETE/UPDATE/MERGE Operations in DataSource V2

2019-07-08 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-28303: Description: Now many datasources (delta, jdbc, hive with transaction support, kudu, etc) support

[jira] [Created] (SPARK-28303) Support DELETE/UPDATE/MERGE Operations in DataSource V2

2019-07-08 Thread Xianyin Xin (JIRA)
Xianyin Xin created SPARK-28303: --- Summary: Support DELETE/UPDATE/MERGE Operations in DataSource V2 Key: SPARK-28303 URL: https://issues.apache.org/jira/browse/SPARK-28303 Project: Spark Issue T

[jira] [Updated] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-28302: - Description: When using SparkLauncher to submit applications concurrently with a thread pool under *Windows*, s

[jira] [Updated] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-28302: - Attachment: Main.scala > SparkLauncher: The process cannot access the file because it is being used by > anothe

[jira] [Assigned] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28261: Assignee: (was: Apache Spark) > Flaky test: > org.apache.spark.network.TransportClie

[jira] [Updated] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-28302: - Description: When using SparkLauncher to submit applications concurrently with a thread pool under *Windows*, s

[jira] [Assigned] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28261: Assignee: Apache Spark > Flaky test: > org.apache.spark.network.TransportClientFactorySu

[jira] [Created] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread wuyi (JIRA)
wuyi created SPARK-28302: Summary: SparkLauncher: The process cannot access the file because it is being used by another process Key: SPARK-28302 URL: https://issues.apache.org/jira/browse/SPARK-28302 Project

[jira] [Created] (SPARK-28301) fix the behavior of table name resolution with multi-catalog

2019-07-08 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-28301: --- Summary: fix the behavior of table name resolution with multi-catalog Key: SPARK-28301 URL: https://issues.apache.org/jira/browse/SPARK-28301 Project: Spark I

[jira] [Commented] (SPARK-28255) Upgrade dependencies with vulnerabilities

2019-07-08 Thread Bozhidar Bozhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880218#comment-16880218 ] Bozhidar Bozhanov commented on SPARK-28255: --- [~hyukjin.kwon] yes, upgrade the

[jira] [Commented] (SPARK-28269) ArrowStreamPandasSerializer get stack

2019-07-08 Thread Modi Tamam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880216#comment-16880216 ] Modi Tamam commented on SPARK-28269: [~hyukjin.kwon] I've updated the message with s

[jira] [Updated] (SPARK-28269) ArrowStreamPandasSerializer get stack

2019-07-08 Thread Modi Tamam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Modi Tamam updated SPARK-28269: --- Description: I'm working with Pyspark version 2.4.3. I have a big data frame: * ~15M rows * ~130

[jira] [Updated] (SPARK-28269) ArrowStreamPandasSerializer get stack

2019-07-08 Thread Modi Tamam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Modi Tamam updated SPARK-28269: --- Description: I'm working with Pyspark version 2.4.3. I have a big data frame: * ~15M rows * ~130

[jira] [Updated] (SPARK-28300) Kmeans is failing when we run parallely passing an RDD

2019-07-08 Thread Ramanjaneya Naidu Nalla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramanjaneya Naidu Nalla updated SPARK-28300: Description: Hi, I am facing when we run the spark KMEAN algorithm parall

[jira] [Updated] (SPARK-28300) Kmeans is failing when we run parallely passing an RDD

2019-07-08 Thread Ramanjaneya Naidu Nalla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramanjaneya Naidu Nalla updated SPARK-28300: Description: Hi, I am facing when we run the spark KMEAN algorithm parall

[jira] [Created] (SPARK-28300) Kmeans is failing when we run parallely passing an RDD

2019-07-08 Thread Ramanjaneya Naidu Nalla (JIRA)
Ramanjaneya Naidu Nalla created SPARK-28300: --- Summary: Kmeans is failing when we run parallely passing an RDD Key: SPARK-28300 URL: https://issues.apache.org/jira/browse/SPARK-28300 Project:

[jira] [Created] (SPARK-28299) Evaluation of multiple CTE uses

2019-07-08 Thread Peter Toth (JIRA)
Peter Toth created SPARK-28299: -- Summary: Evaluation of multiple CTE uses Key: SPARK-28299 URL: https://issues.apache.org/jira/browse/SPARK-28299 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-28298) Strange behavior of CAST string to char/varchar

2019-07-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28298: Issue Type: Sub-task (was: Bug) Parent: SPARK-27764 > Strange behavior of CAST string to

[jira] [Commented] (SPARK-28298) Strange behavior of CAST string to char/varchar

2019-07-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880178#comment-16880178 ] Yuming Wang commented on SPARK-28298: - PostgreSQL: {code:sql} postgres=# select subs

[jira] [Updated] (SPARK-28298) Strange behavior of CAST string to char/varchar

2019-07-08 Thread Zhu, Lipeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu, Lipeng updated SPARK-28298: Description: Execute below SQL in Spark, the result is "abcdef".   But the result of other DBMS i

[jira] [Created] (SPARK-28298) Strange behavior of CAST string to char/varchar

2019-07-08 Thread Zhu, Lipeng (JIRA)
Zhu, Lipeng created SPARK-28298: --- Summary: Strange behavior of CAST string to char/varchar Key: SPARK-28298 URL: https://issues.apache.org/jira/browse/SPARK-28298 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-28297) Handling outer links in CTE subquery expressions

2019-07-08 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28297: --- Description: This query does work in Spark SQL: {noformat} select (with cte(x) as (select 1) select

[jira] [Updated] (SPARK-28297) Handling outer links in CTE subquery expressions

2019-07-08 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28297: --- Description: This query does work in Spark SQL: {noformat} select (with cte(x) as (select 1) select

[jira] [Updated] (SPARK-28297) Handling outer links in CTE subquery expressions

2019-07-08 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28297: --- Description: This query does work in Spark SQL: {noformat} select (with cte(x) as (select 1) select

[jira] [Created] (SPARK-28297) Handling outer links in CTE subquery expressions

2019-07-08 Thread Peter Toth (JIRA)
Peter Toth created SPARK-28297: -- Summary: Handling outer links in CTE subquery expressions Key: SPARK-28297 URL: https://issues.apache.org/jira/browse/SPARK-28297 Project: Spark Issue Type: Sub-

[jira] [Updated] (SPARK-28296) Improved VALUES support

2019-07-08 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28296: --- Description: These are valid queries in PostgreSQL, but they don't work in Spark SQL: {noformat} va

[jira] [Updated] (SPARK-28296) Improved VALUES support

2019-07-08 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28296: --- Description: These are valid queries in PostgreSQL, but they don't work in Spark SQL: {noformat} va

[jira] [Updated] (SPARK-28296) Improved VALUES support

2019-07-08 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28296: --- Description: These are valid queries in PostgreSQL, but they don't work in Spark SQL: {noformat} va

[jira] [Created] (SPARK-28296) Improved VALUES support

2019-07-08 Thread Peter Toth (JIRA)
Peter Toth created SPARK-28296: -- Summary: Improved VALUES support Key: SPARK-28296 URL: https://issues.apache.org/jira/browse/SPARK-28296 Project: Spark Issue Type: Sub-task Components

[jira] [Assigned] (SPARK-27924) ANSI SQL: Boolean Test

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27924: Assignee: Apache Spark > ANSI SQL: Boolean Test > -- > >

[jira] [Assigned] (SPARK-27924) ANSI SQL: Boolean Test

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27924: Assignee: (was: Apache Spark) > ANSI SQL: Boolean Test > -- > >

[jira] [Updated] (SPARK-28295) Is there a way of getting feature names from pyspark.ml.regression GeneralizedLinearRegression?

2019-07-08 Thread Nils Skotara (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nils Skotara updated SPARK-28295: - Description: Using pyspark.ml.regression, when I fit a GeneralizedLinearRegression like this:

[jira] [Updated] (SPARK-28295) Is there a way of getting feature names from pyspark.ml.regression GeneralizedLinearRegression?

2019-07-08 Thread Nils Skotara (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nils Skotara updated SPARK-28295: - Summary: Is there a way of getting feature names from pyspark.ml.regression GeneralizedLinearReg

[jira] [Created] (SPARK-28295) Is there a way of getting feature names in from pyspark.ml.regression GeneralizedLinearRegression?

2019-07-08 Thread Nils Skotara (JIRA)
Nils Skotara created SPARK-28295: Summary: Is there a way of getting feature names in from pyspark.ml.regression GeneralizedLinearRegression? Key: SPARK-28295 URL: https://issues.apache.org/jira/browse/SPARK-28295

[jira] [Assigned] (SPARK-28293) Implement Spark's own GetTableTypesOperation

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28293: Assignee: (was: Apache Spark) > Implement Spark's own GetTableTypesOperation > --

  1   2   >