[jira] [Commented] (SPARK-28269) ArrowStreamPandasSerializer get stack

2019-07-08 Thread Modi Tamam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880942#comment-16880942 ] Modi Tamam commented on SPARK-28269: Sorry, I had a typo, not stack but *stuck*. There shouldn't be

[jira] [Updated] (SPARK-28266) data correctness issue: data duplication when `path` serde property is present

2019-07-08 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-28266: -- Summary: data correctness issue: data duplication when `path` serde property is

[jira] [Commented] (SPARK-28271) Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base

2019-07-08 Thread Terry Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880934#comment-16880934 ] Terry Kim commented on SPARK-28271: --- [~hyukjin.kwon], please assign this to me. I am happy to help

[jira] [Updated] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-08 Thread Zhu, Lipeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu, Lipeng updated SPARK-28310: Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-27764) > ANSI SQL

[jira] [Updated] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-08 Thread Zhu, Lipeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu, Lipeng updated SPARK-28310: Description: According to the ANSI SQL 2011: {code:sql} ::= ::= RESPECT NULLS | IGNORE NULLS

[jira] [Assigned] (SPARK-28311) Spark Thrift Server protocol version compatibility setup too late

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28311: Assignee: (was: Apache Spark) > Spark Thrift Server protocol version compatibility

[jira] [Assigned] (SPARK-28311) Spark Thrift Server protocol version compatibility setup too late

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28311: Assignee: Apache Spark > Spark Thrift Server protocol version compatibility setup too

[jira] [Updated] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-08 Thread Zhu, Lipeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu, Lipeng updated SPARK-28310: Issue Type: Sub-task (was: Bug) Parent: SPARK-27764 > ANSI SQL grammar support:

[jira] [Updated] (SPARK-28311) Spark Thrift Server protocol version compatibility setup too late

2019-07-08 Thread angerszhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28311: -- Description: {code:java} SessionHandle getSessionHandle(TOpenSessionReq req, TOpenSessionResp res)

[jira] [Created] (SPARK-28311) Spark Thrift Server protocol version compatibility setup too late

2019-07-08 Thread angerszhu (JIRA)
angerszhu created SPARK-28311: - Summary: Spark Thrift Server protocol version compatibility setup too late Key: SPARK-28311 URL: https://issues.apache.org/jira/browse/SPARK-28311 Project: Spark

[jira] [Assigned] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28309: Assignee: Hyukjin Kwon > AppVeyor fails to install testthat (1.0.2) due to previously

[jira] [Comment Edited] (SPARK-28023) Trim the string when cast string type to other types

2019-07-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880881#comment-16880881 ] Yuming Wang edited comment on SPARK-28023 at 7/9/19 3:07 AM: - Resolve the

[jira] [Resolved] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28309. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25081

[jira] [Resolved] (SPARK-28023) Trim the string when cast string type to other types

2019-07-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-28023. - Resolution: Later Resolve the issue as {{Later}}. More details:

[jira] [Resolved] (SPARK-28250) QueryPlan#references should exclude producedAttributes

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28250. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25052

[jira] [Assigned] (SPARK-28273) Convert and port 'pgSQL/case.sql' into UDF test base

2019-07-08 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28273: --- Assignee: Hyukjin Kwon > Convert and port 'pgSQL/case.sql' into UDF test base >

[jira] [Resolved] (SPARK-28273) Convert and port 'pgSQL/case.sql' into UDF test base

2019-07-08 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28273. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25070

[jira] [Assigned] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28310: Assignee: (was: Apache Spark) > ANSI SQL grammar support:

[jira] [Assigned] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28310: Assignee: Apache Spark > ANSI SQL grammar support: first_value/last_value(expression,

[jira] [Created] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-08 Thread Zhu, Lipeng (JIRA)
Zhu, Lipeng created SPARK-28310: --- Summary: ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS]) Key: SPARK-28310 URL: https://issues.apache.org/jira/browse/SPARK-28310

[jira] [Updated] (SPARK-28306) Once optimizer rule NormalizeFloatingNumbers is not idempotent

2019-07-08 Thread Yesheng Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesheng Ma updated SPARK-28306: --- Issue Type: Improvement (was: Bug) > Once optimizer rule NormalizeFloatingNumbers is not

[jira] [Commented] (SPARK-28269) ArrowStreamPandasSerializer get stack

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880840#comment-16880840 ] Hyukjin Kwon commented on SPARK-28269: -- {quote} The above code gets stacked on the

[jira] [Updated] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28309: -- Component/s: R > AppVeyor fails to install testthat (1.0.2) due to previously installed >

[jira] [Updated] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28309: -- Component/s: (was: R) SparkR > AppVeyor fails to install testthat

[jira] [Assigned] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28309: Assignee: Apache Spark > AppVeyor fails to install testthat (1.0.2) due to previously

[jira] [Assigned] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28309: Assignee: (was: Apache Spark) > AppVeyor fails to install testthat (1.0.2) due to

[jira] [Resolved] (SPARK-28295) Is there a way of getting feature names from pyspark.ml.regression GeneralizedLinearRegression?

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28295. -- Resolution: Invalid > Is there a way of getting feature names from pyspark.ml.regression >

[jira] [Commented] (SPARK-28295) Is there a way of getting feature names from pyspark.ml.regression GeneralizedLinearRegression?

2019-07-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880827#comment-16880827 ] Hyukjin Kwon commented on SPARK-28295: -- For questions, you can ask it to mailing list. Let's

[jira] [Created] (SPARK-28309) AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools

2019-07-08 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-28309: Summary: AppVeyor fails to install testthat (1.0.2) due to previously installed testthat (2.1.0) due to devtools Key: SPARK-28309 URL:

[jira] [Assigned] (SPARK-28306) Once optimizer rule NormalizeFloatingNumbers is not idempotent

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28306: Assignee: Apache Spark > Once optimizer rule NormalizeFloatingNumbers is not idempotent

[jira] [Assigned] (SPARK-28306) Once optimizer rule NormalizeFloatingNumbers is not idempotent

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28306: Assignee: (was: Apache Spark) > Once optimizer rule NormalizeFloatingNumbers is not

[jira] [Assigned] (SPARK-28308) CalendarInterval sub-second part should be padded before parsing

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28308: Assignee: Apache Spark > CalendarInterval sub-second part should be padded before

[jira] [Assigned] (SPARK-28308) CalendarInterval sub-second part should be padded before parsing

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28308: Assignee: (was: Apache Spark) > CalendarInterval sub-second part should be padded

[jira] [Updated] (SPARK-28308) CalendarInterval sub-second part should be padded before parsing

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28308: -- Labels: correctness (was: ) > CalendarInterval sub-second part should be padded before

[jira] [Created] (SPARK-28308) CalendarInterval sub-second part should be padded before parsing

2019-07-08 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28308: - Summary: CalendarInterval sub-second part should be padded before parsing Key: SPARK-28308 URL: https://issues.apache.org/jira/browse/SPARK-28308 Project: Spark

[jira] [Updated] (SPARK-28307) Support Interval comparison

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28307: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-27764 > Support Interval

[jira] [Created] (SPARK-28307) Support Interval comparison

2019-07-08 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28307: - Summary: Support Interval comparison Key: SPARK-28307 URL: https://issues.apache.org/jira/browse/SPARK-28307 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-28067) Incorrect results in decimal aggregation with whole-stage code gen enabled

2019-07-08 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880700#comment-16880700 ] Marco Gaido commented on SPARK-28067: - I cannot reproduce in 2.4.0 either: {code}

[jira] [Resolved] (SPARK-28159) Make the transform natively in ml framework to avoid extra conversion

2019-07-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28159. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24963

[jira] [Assigned] (SPARK-28159) Make the transform natively in ml framework to avoid extra conversion

2019-07-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28159: - Assignee: zhengruifeng > Make the transform natively in ml framework to avoid extra conversion

[jira] [Resolved] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28261. --- Resolution: Fixed Assignee: Gabor Somogyi Fix Version/s: 3.0.0

[jira] [Updated] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28261: -- Affects Version/s: 2.0.2 > Flaky test: >

[jira] [Created] (SPARK-28306) Once optimizer rule NormalizeFloatingNumbers is not idempotent

2019-07-08 Thread Yesheng Ma (JIRA)
Yesheng Ma created SPARK-28306: -- Summary: Once optimizer rule NormalizeFloatingNumbers is not idempotent Key: SPARK-28306 URL: https://issues.apache.org/jira/browse/SPARK-28306 Project: Spark

[jira] [Commented] (SPARK-22876) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

2019-07-08 Thread Nikita Gorbachevski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880508#comment-16880508 ] Nikita Gorbachevski commented on SPARK-22876: - Hi, i believe we should reopen this issue

[jira] [Assigned] (SPARK-28305) When the AM cannot obtain the container loss reason, ask GetExecutorLossReason times out

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28305: Assignee: Apache Spark > When the AM cannot obtain the container loss reason, ask >

[jira] [Assigned] (SPARK-28305) When the AM cannot obtain the container loss reason, ask GetExecutorLossReason times out

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28305: Assignee: (was: Apache Spark) > When the AM cannot obtain the container loss reason,

[jira] [Created] (SPARK-28305) When the AM cannot obtain the container loss reason, ask GetExecutorLossReason times out

2019-07-08 Thread dzcxzl (JIRA)
dzcxzl created SPARK-28305: -- Summary: When the AM cannot obtain the container loss reason, ask GetExecutorLossReason times out Key: SPARK-28305 URL: https://issues.apache.org/jira/browse/SPARK-28305

[jira] [Commented] (SPARK-28304) FileFormatWriter introduces an uncoditional sort, even when all attributes are constants

2019-07-08 Thread Eyal Farago (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880402#comment-16880402 ] Eyal Farago commented on SPARK-28304: - cc [~cloud_fan],[~hvanhovell] > FileFormatWriter introduces

[jira] [Updated] (SPARK-28304) FileFormatWriter introduces an uncoditional sort, even when all attributes are constants

2019-07-08 Thread Eyal Farago (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eyal Farago updated SPARK-28304: Summary: FileFormatWriter introduces an uncoditional sort, even when all attributes are constants

[jira] [Created] (SPARK-28304) FileFormatWriter introduces an uncoditional join, even when all attributes are constants

2019-07-08 Thread Eyal Farago (JIRA)
Eyal Farago created SPARK-28304: --- Summary: FileFormatWriter introduces an uncoditional join, even when all attributes are constants Key: SPARK-28304 URL: https://issues.apache.org/jira/browse/SPARK-28304

[jira] [Updated] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-08 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-28261: -- Affects Version/s: 2.1.3 2.2.3 2.3.3 > Flaky

[jira] [Updated] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-08 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-28261: -- Affects Version/s: 2.4.3 > Flaky test: >

[jira] [Assigned] (SPARK-28301) fix the behavior of table name resolution with multi-catalog

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28301: Assignee: Wenchen Fan (was: Apache Spark) > fix the behavior of table name resolution

[jira] [Assigned] (SPARK-28301) fix the behavior of table name resolution with multi-catalog

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28301: Assignee: Apache Spark (was: Wenchen Fan) > fix the behavior of table name resolution

[jira] [Assigned] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28302: Assignee: (was: Apache Spark) > SparkLauncher: The process cannot access the file

[jira] [Assigned] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28302: Assignee: Apache Spark > SparkLauncher: The process cannot access the file because it is

[jira] [Commented] (SPARK-28303) Support DELETE/UPDATE/MERGE Operations in DataSource V2

2019-07-08 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880258#comment-16880258 ] Xianyin Xin commented on SPARK-28303: - The SQL entrance is need also. > Support DELETE/UPDATE/MERGE

[jira] [Updated] (SPARK-28303) Support DELETE/UPDATE/MERGE Operations in DataSource V2

2019-07-08 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-28303: Description: Now many datasources (delta, jdbc, hive with transaction support, kudu, etc)

[jira] [Created] (SPARK-28303) Support DELETE/UPDATE/MERGE Operations in DataSource V2

2019-07-08 Thread Xianyin Xin (JIRA)
Xianyin Xin created SPARK-28303: --- Summary: Support DELETE/UPDATE/MERGE Operations in DataSource V2 Key: SPARK-28303 URL: https://issues.apache.org/jira/browse/SPARK-28303 Project: Spark Issue

[jira] [Updated] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-28302: - Description: When using SparkLauncher to submit applications concurrently with a thread pool under *Windows*,

[jira] [Updated] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-28302: - Attachment: Main.scala > SparkLauncher: The process cannot access the file because it is being used by >

[jira] [Assigned] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28261: Assignee: (was: Apache Spark) > Flaky test: >

[jira] [Updated] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-28302: - Description: When using SparkLauncher to submit applications concurrently with a thread pool under *Windows*,

[jira] [Assigned] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28261: Assignee: Apache Spark > Flaky test: >

[jira] [Created] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread wuyi (JIRA)
wuyi created SPARK-28302: Summary: SparkLauncher: The process cannot access the file because it is being used by another process Key: SPARK-28302 URL: https://issues.apache.org/jira/browse/SPARK-28302

[jira] [Created] (SPARK-28301) fix the behavior of table name resolution with multi-catalog

2019-07-08 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-28301: --- Summary: fix the behavior of table name resolution with multi-catalog Key: SPARK-28301 URL: https://issues.apache.org/jira/browse/SPARK-28301 Project: Spark

[jira] [Commented] (SPARK-28255) Upgrade dependencies with vulnerabilities

2019-07-08 Thread Bozhidar Bozhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880218#comment-16880218 ] Bozhidar Bozhanov commented on SPARK-28255: --- [~hyukjin.kwon] yes, upgrade the dependency to a

[jira] [Commented] (SPARK-28269) ArrowStreamPandasSerializer get stack

2019-07-08 Thread Modi Tamam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880216#comment-16880216 ] Modi Tamam commented on SPARK-28269: [~hyukjin.kwon] I've updated the message with simple code so

[jira] [Updated] (SPARK-28269) ArrowStreamPandasSerializer get stack

2019-07-08 Thread Modi Tamam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Modi Tamam updated SPARK-28269: --- Description: I'm working with Pyspark version 2.4.3. I have a big data frame: * ~15M rows * ~130

[jira] [Updated] (SPARK-28269) ArrowStreamPandasSerializer get stack

2019-07-08 Thread Modi Tamam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Modi Tamam updated SPARK-28269: --- Description: I'm working with Pyspark version 2.4.3. I have a big data frame: * ~15M rows * ~130

[jira] [Updated] (SPARK-28300) Kmeans is failing when we run parallely passing an RDD

2019-07-08 Thread Ramanjaneya Naidu Nalla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramanjaneya Naidu Nalla updated SPARK-28300: Description: Hi, I am facing when we run the spark KMEAN algorithm

[jira] [Updated] (SPARK-28300) Kmeans is failing when we run parallely passing an RDD

2019-07-08 Thread Ramanjaneya Naidu Nalla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramanjaneya Naidu Nalla updated SPARK-28300: Description: Hi, I am facing when we run the spark KMEAN algorithm

[jira] [Created] (SPARK-28300) Kmeans is failing when we run parallely passing an RDD

2019-07-08 Thread Ramanjaneya Naidu Nalla (JIRA)
Ramanjaneya Naidu Nalla created SPARK-28300: --- Summary: Kmeans is failing when we run parallely passing an RDD Key: SPARK-28300 URL: https://issues.apache.org/jira/browse/SPARK-28300 Project:

[jira] [Created] (SPARK-28299) Evaluation of multiple CTE uses

2019-07-08 Thread Peter Toth (JIRA)
Peter Toth created SPARK-28299: -- Summary: Evaluation of multiple CTE uses Key: SPARK-28299 URL: https://issues.apache.org/jira/browse/SPARK-28299 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-28298) Strange behavior of CAST string to char/varchar

2019-07-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28298: Issue Type: Sub-task (was: Bug) Parent: SPARK-27764 > Strange behavior of CAST string to

[jira] [Commented] (SPARK-28298) Strange behavior of CAST string to char/varchar

2019-07-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880178#comment-16880178 ] Yuming Wang commented on SPARK-28298: - PostgreSQL: {code:sql} postgres=# select substr(version(), 0,

[jira] [Updated] (SPARK-28298) Strange behavior of CAST string to char/varchar

2019-07-08 Thread Zhu, Lipeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu, Lipeng updated SPARK-28298: Description: Execute below SQL in Spark, the result is "abcdef".   But the result of other DBMS

[jira] [Created] (SPARK-28298) Strange behavior of CAST string to char/varchar

2019-07-08 Thread Zhu, Lipeng (JIRA)
Zhu, Lipeng created SPARK-28298: --- Summary: Strange behavior of CAST string to char/varchar Key: SPARK-28298 URL: https://issues.apache.org/jira/browse/SPARK-28298 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28297) Handling outer links in CTE subquery expressions

2019-07-08 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28297: --- Description: This query does work in Spark SQL: {noformat} select (with cte(x) as (select 1) select

[jira] [Updated] (SPARK-28297) Handling outer links in CTE subquery expressions

2019-07-08 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28297: --- Description: This query does work in Spark SQL: {noformat} select (with cte(x) as (select 1) select

[jira] [Updated] (SPARK-28297) Handling outer links in CTE subquery expressions

2019-07-08 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28297: --- Description: This query does work in Spark SQL: {noformat} select (with cte(x) as (select 1) select

[jira] [Created] (SPARK-28297) Handling outer links in CTE subquery expressions

2019-07-08 Thread Peter Toth (JIRA)
Peter Toth created SPARK-28297: -- Summary: Handling outer links in CTE subquery expressions Key: SPARK-28297 URL: https://issues.apache.org/jira/browse/SPARK-28297 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28296) Improved VALUES support

2019-07-08 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28296: --- Description: These are valid queries in PostgreSQL, but they don't work in Spark SQL: {noformat}

[jira] [Updated] (SPARK-28296) Improved VALUES support

2019-07-08 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28296: --- Description: These are valid queries in PostgreSQL, but they don't work in Spark SQL: {noformat}

[jira] [Updated] (SPARK-28296) Improved VALUES support

2019-07-08 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28296: --- Description: These are valid queries in PostgreSQL, but they don't work in Spark SQL: {noformat}

[jira] [Created] (SPARK-28296) Improved VALUES support

2019-07-08 Thread Peter Toth (JIRA)
Peter Toth created SPARK-28296: -- Summary: Improved VALUES support Key: SPARK-28296 URL: https://issues.apache.org/jira/browse/SPARK-28296 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-27924) ANSI SQL: Boolean Test

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27924: Assignee: Apache Spark > ANSI SQL: Boolean Test > -- > >

[jira] [Assigned] (SPARK-27924) ANSI SQL: Boolean Test

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27924: Assignee: (was: Apache Spark) > ANSI SQL: Boolean Test > -- > >

[jira] [Updated] (SPARK-28295) Is there a way of getting feature names from pyspark.ml.regression GeneralizedLinearRegression?

2019-07-08 Thread Nils Skotara (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nils Skotara updated SPARK-28295: - Description: Using pyspark.ml.regression, when I fit a GeneralizedLinearRegression like this:

[jira] [Updated] (SPARK-28295) Is there a way of getting feature names from pyspark.ml.regression GeneralizedLinearRegression?

2019-07-08 Thread Nils Skotara (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nils Skotara updated SPARK-28295: - Summary: Is there a way of getting feature names from pyspark.ml.regression

[jira] [Created] (SPARK-28295) Is there a way of getting feature names in from pyspark.ml.regression GeneralizedLinearRegression?

2019-07-08 Thread Nils Skotara (JIRA)
Nils Skotara created SPARK-28295: Summary: Is there a way of getting feature names in from pyspark.ml.regression GeneralizedLinearRegression? Key: SPARK-28295 URL:

[jira] [Assigned] (SPARK-28293) Implement Spark's own GetTableTypesOperation

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28293: Assignee: (was: Apache Spark) > Implement Spark's own GetTableTypesOperation >

[jira] [Assigned] (SPARK-28293) Implement Spark's own GetTableTypesOperation

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28293: Assignee: Apache Spark > Implement Spark's own GetTableTypesOperation >

[jira] [Assigned] (SPARK-28294) Support `spark.history.fs.cleaner.maxNum` configuration

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28294: Assignee: Apache Spark > Support `spark.history.fs.cleaner.maxNum` configuration >

[jira] [Assigned] (SPARK-28294) Support `spark.history.fs.cleaner.maxNum` configuration

2019-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28294: Assignee: (was: Apache Spark) > Support `spark.history.fs.cleaner.maxNum`

[jira] [Commented] (SPARK-28293) Implement Spark's own GetTableTypesOperation

2019-07-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880069#comment-16880069 ] Yuming Wang commented on SPARK-28293: - I'm working on > Implement Spark's own

[jira] [Updated] (SPARK-28293) Implement Spark's own GetTableTypesOperation

2019-07-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28293: Description: Build with Hive 1.2.1: !Hive-1.2.1.png! Build with Hive 2.3.5: !Hive-2.3.5.png!

[jira] [Updated] (SPARK-28293) Implement Spark's own GetTableTypesOperation

2019-07-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28293: Attachment: Hive-1.2.1.png > Implement Spark's own GetTableTypesOperation >

[jira] [Created] (SPARK-28294) Support `spark.history.fs.cleaner.maxNum` configuration

2019-07-08 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28294: - Summary: Support `spark.history.fs.cleaner.maxNum` configuration Key: SPARK-28294 URL: https://issues.apache.org/jira/browse/SPARK-28294 Project: Spark

[jira] [Updated] (SPARK-28293) Implement Spark's own GetTableTypesOperation

2019-07-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28293: Attachment: Hive-2.3.5.png > Implement Spark's own GetTableTypesOperation >

  1   2   >