[
https://issues.apache.org/jira/browse/SPARK-27827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857297#comment-16857297
]
zhoukang commented on SPARK-27827:
--
I just test this in 2.3 cluster [~dongjoon]
> File does not exist
[
https://issues.apache.org/jira/browse/SPARK-27827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-27827:
-
Affects Version/s: (was: 2.4.3)
> File does not exist notice is misleading in FileScanRDD
>
[
https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857291#comment-16857291
]
zhoukang commented on SPARK-27068:
--
[~srowen] Here is a use case in our cluster.
We have a long running
[
https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-27068:
-
Attachment: 屏幕快照 2019-06-06 下午1.12.04.png
> Support failed jobs ui and completed jobs ui use different
[
https://issues.apache.org/jira/browse/SPARK-27965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27965:
--
Issue Type: Improvement (was: Bug)
> Add extractors for logical transforms
>
[
https://issues.apache.org/jira/browse/SPARK-27965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857232#comment-16857232
]
Dongjoon Hyun commented on SPARK-27965:
---
Hi, [~rdblue]. Could you use `Improvement` issue type
[
https://issues.apache.org/jira/browse/SPARK-27964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27964.
---
Resolution: Fixed
Assignee: Ryan Blue
Fix Version/s: 3.0.0
This is resolved
[
https://issues.apache.org/jira/browse/SPARK-27964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27964:
--
Issue Type: Improvement (was: Bug)
> Create CatalogV2Util
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-27964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27964:
Assignee: Apache Spark
> Create CatalogV2Util
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-27964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27964:
Assignee: (was: Apache Spark)
> Create CatalogV2Util
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-27965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27965:
Assignee: Apache Spark
> Add extractors for logical transforms
>
[
https://issues.apache.org/jira/browse/SPARK-27965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27965:
Assignee: (was: Apache Spark)
> Add extractors for logical transforms
>
Ryan Blue created SPARK-27965:
-
Summary: Add extractors for logical transforms
Key: SPARK-27965
URL: https://issues.apache.org/jira/browse/SPARK-27965
Project: Spark
Issue Type: Bug
Ryan Blue created SPARK-27964:
-
Summary: Create CatalogV2Util
Key: SPARK-27964
URL: https://issues.apache.org/jira/browse/SPARK-27964
Project: Spark
Issue Type: Bug
Components: SQL
[
https://issues.apache.org/jira/browse/SPARK-27931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27931:
Description:
This ticket contains two things:
1. Accept 'on' and 'off' as input for boolean data
[
https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857146#comment-16857146
]
Marcelo Vanzin commented on SPARK-27963:
FYI I have a WIP patch to implement this that I plan to
Marcelo Vanzin created SPARK-27963:
--
Summary: Allow dynamic allocation without an external shuffle
service
Key: SPARK-27963
URL: https://issues.apache.org/jira/browse/SPARK-27963
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated SPARK-27919:
--
Affects Version/s: (was: 2.4.3)
3.0.0
> DataSourceV2: Add v2 session
[
https://issues.apache.org/jira/browse/SPARK-27857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-27857.
-
Resolution: Fixed
Assignee: Ryan Blue
Fix Version/s: 3.0.0
> DataSourceV2: Support
[
https://issues.apache.org/jira/browse/SPARK-24130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857006#comment-16857006
]
Parshuram V Patki commented on SPARK-24130:
---
Do we have any traction on this?
> Data Source
[
https://issues.apache.org/jira/browse/SPARK-27962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27962:
Assignee: (was: Apache Spark)
> Propagate subprocess stdout when subprocess exits
[
https://issues.apache.org/jira/browse/SPARK-27962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27962:
Assignee: Apache Spark
> Propagate subprocess stdout when subprocess exits with nonzero
Jeremy Liu created SPARK-27962:
--
Summary: Propagate subprocess stdout when subprocess exits with
nonzero status in deploy.RRunner
Key: SPARK-27962
URL: https://issues.apache.org/jira/browse/SPARK-27962
[
https://issues.apache.org/jira/browse/SPARK-27760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27760:
Assignee: Thomas Graves (was: Apache Spark)
> Spark resources - user configs change
[
https://issues.apache.org/jira/browse/SPARK-27760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27760:
Assignee: Apache Spark (was: Thomas Graves)
> Spark resources - user configs change
[
https://issues.apache.org/jira/browse/SPARK-27961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John Zhuge updated SPARK-27961:
---
Description:
The newly added `Refresh` method in [PR
[
https://issues.apache.org/jira/browse/SPARK-27961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856982#comment-16856982
]
John Zhuge commented on SPARK-27961:
[~Gengliang.Wang] [~cloud_fan] Could you help?
>
John Zhuge created SPARK-27961:
--
Summary: DataSourceV2Relation should not have refresh method
Key: SPARK-27961
URL: https://issues.apache.org/jira/browse/SPARK-27961
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856975#comment-16856975
]
Johannes Schaffrath commented on SPARK-27939:
-
Hi Bryan,
thank you very much for the
Ryan Blue created SPARK-27960:
-
Summary: DataSourceV2 ORC implementation doesn't handle schemas
correctly
Key: SPARK-27960
URL: https://issues.apache.org/jira/browse/SPARK-27960
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856955#comment-16856955
]
Ryan Blue commented on SPARK-27960:
---
[~Gengliang.Wang], FYI
> DataSourceV2 ORC implementation doesn't
[
https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21136:
Assignee: Apache Spark (was: Yesheng Ma)
> Misleading error message for typo in SQL
>
[
https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21136:
Assignee: Yesheng Ma (was: Apache Spark)
> Misleading error message for typo in SQL
>
[
https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-24615:
-
Assignee: Thomas Graves (was: Xingbo Jiang)
> SPIP: Accelerator-aware task scheduling
[
https://issues.apache.org/jira/browse/SPARK-27368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-27368:
--
Description:
Design draft:
Scenarios:
* client-mode, worker might create one or more
[
https://issues.apache.org/jira/browse/SPARK-27368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-27368:
--
Description:
Design draft:
Scenarios:
* client-mode, worker might create one or more
[
https://issues.apache.org/jira/browse/SPARK-27760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27760:
--
Description:
For the Spark resources, we created the config
[
https://issues.apache.org/jira/browse/SPARK-27760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27760:
--
Description:
For the Spark resources, we created the config
[
https://issues.apache.org/jira/browse/SPARK-27760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-27760:
-
Assignee: Thomas Graves
> Spark resources - user configs change .count to be .amount
>
[
https://issues.apache.org/jira/browse/SPARK-27760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27760:
--
Summary: Spark resources - user configs change .count to be .amount (was:
Spark resources -
Thomas Graves created SPARK-27959:
-
Summary: Change YARN resource configs to use .amount
Key: SPARK-27959
URL: https://issues.apache.org/jira/browse/SPARK-27959
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27760:
--
Description:
For the Spark resources, we created the config
[
https://issues.apache.org/jira/browse/SPARK-27933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27933.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24781
[
https://issues.apache.org/jira/browse/SPARK-27933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-27933:
-
Assignee: Jacek Laskowski
> Extracting common purge "behaviour" to the parent StreamExecution
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-27364.
---
Resolution: Fixed
Fix Version/s: 3.0.0
> User-facing APIs for GPU-aware scheduling
>
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856895#comment-16856895
]
Thomas Graves commented on SPARK-27364:
---
User facing changes are all committed so going to close
[
https://issues.apache.org/jira/browse/SPARK-27521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-27521.
-
Resolution: Fixed
Fix Version/s: 3.0.0
> move data source v2 API to catalyst module
>
[
https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856827#comment-16856827
]
Ruben Berenguel commented on SPARK-25994:
-
Hi [~mju] I'd like to lend a hand if you feel like it
[
https://issues.apache.org/jira/browse/SPARK-27958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27958:
Assignee: Apache Spark
> Stopping a SparkSession should not always stop Spark Context
>
[
https://issues.apache.org/jira/browse/SPARK-27958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27958:
Assignee: (was: Apache Spark)
> Stopping a SparkSession should not always stop Spark
[
https://issues.apache.org/jira/browse/SPARK-27958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856810#comment-16856810
]
Apache Spark commented on SPARK-27958:
--
User 'vinooganesh' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-27958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856808#comment-16856808
]
Vinoo Ganesh commented on SPARK-27958:
--
[https://github.com/apache/spark/pull/24807]
> Stopping a
[
https://issues.apache.org/jira/browse/SPARK-27958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856803#comment-16856803
]
Vinoo Ganesh commented on SPARK-27958:
--
Putting up a PR shortly
> Stopping a SparkSession should
Vinoo Ganesh created SPARK-27958:
Summary: Stopping a SparkSession should not always stop Spark
Context
Key: SPARK-27958
URL: https://issues.apache.org/jira/browse/SPARK-27958
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-27749.
-
Resolution: Fixed
Assignee: Yuming Wang
Fix Version/s: 3.0.0
> hadoop-3.2 support
[
https://issues.apache.org/jira/browse/SPARK-20286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid resolved SPARK-20286.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24704
[
https://issues.apache.org/jira/browse/SPARK-20286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid reassigned SPARK-20286:
Assignee: Marcelo Vanzin
> dynamicAllocation.executorIdleTimeout is ignored after
[
https://issues.apache.org/jira/browse/SPARK-27943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-27943:
---
Description:
*Background*
Default constraint with column is ANSI standard.
Hive 3.0+ has
jiaan.geng created SPARK-27957:
--
Summary: Display default constraint of column when running desc
table.
Key: SPARK-27957
URL: https://issues.apache.org/jira/browse/SPARK-27957
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856595#comment-16856595
]
Apache Spark commented on SPARK-27943:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-27943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-27943:
---
Description:
Default constraint with column is ANSI standard.
Hive 3.0+ has supported default
[
https://issues.apache.org/jira/browse/SPARK-27943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-27943:
---
Description:
Default constraint with column is ANSI standard.
Hive 3.0+ has supported default
[
https://issues.apache.org/jira/browse/SPARK-27913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856592#comment-16856592
]
Andrey Zinovyev commented on SPARK-27913:
-
Simple way to reproduce it
{code:sql}
create
[
https://issues.apache.org/jira/browse/SPARK-27798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27798:
Assignee: (was: Apache Spark)
> from_avro can modify variables in other rows in
[
https://issues.apache.org/jira/browse/SPARK-27798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27798:
Assignee: Apache Spark
> from_avro can modify variables in other rows in local mode
>
[
https://issues.apache.org/jira/browse/SPARK-27953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27953:
Assignee: Apache Spark
> Save default constraint with Column into table properties when
[
https://issues.apache.org/jira/browse/SPARK-27953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856588#comment-16856588
]
Apache Spark commented on SPARK-27953:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-27953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27953:
Assignee: (was: Apache Spark)
> Save default constraint with Column into table
Johannes Mayer created SPARK-27956:
--
Summary: Allow subqueries as partition filter
Key: SPARK-27956
URL: https://issues.apache.org/jira/browse/SPARK-27956
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856558#comment-16856558
]
Piotr Chowaniec commented on SPARK-18105:
-
I have a similar issue with Spark 2.3.2.
Here is a
[
https://issues.apache.org/jira/browse/SPARK-27923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27923:
Description:
In this ticket, we plan to list all cases that PostgreSQL throws an exception
but
[
https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856470#comment-16856470
]
Iris Shaibsky commented on SPARK-25380:
---
We are facing it also on spark 2.4.2, I see that the PR
[
https://issues.apache.org/jira/browse/SPARK-27462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-27462:
---
Issue Type: Sub-task (was: New Feature)
Parent: SPARK-27943
> Spark hive can not choose
jiaan.geng created SPARK-27955:
--
Summary: Update default constraint with Column into table
properties when alter Hive table
Key: SPARK-27955
URL: https://issues.apache.org/jira/browse/SPARK-27955
jiaan.geng created SPARK-27954:
--
Summary: Restore default constraint with Column from table
properties after get metadata from Hive
Key: SPARK-27954
URL: https://issues.apache.org/jira/browse/SPARK-27954
jiaan.geng created SPARK-27953:
--
Summary: Save default constraint with Column into table properties
when create Hive table
Key: SPARK-27953
URL: https://issues.apache.org/jira/browse/SPARK-27953
[
https://issues.apache.org/jira/browse/SPARK-27943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-27943:
---
Description:
Default constraint with column is ANSI standard.
Hive 3.0+ has supported default
[
https://issues.apache.org/jira/browse/SPARK-27521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-27521:
Labels: release-notes (was: )
> move data source v2 API to catalyst module
>
[
https://issues.apache.org/jira/browse/SPARK-27943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-27943:
---
Description:
Default constraint with column is ANSI standard.
Hive 3.0+ has supported default
[
https://issues.apache.org/jira/browse/SPARK-27943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-27943:
---
Description:
Default constraint with column is ANSI standard.
Hive 3.0+ has supported default
[
https://issues.apache.org/jira/browse/SPARK-27943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-27943:
---
Description:
Default constraint with column is ANSI standard.
Hive 3.0+ has supported default
[
https://issues.apache.org/jira/browse/SPARK-27943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-27943:
---
Description:
Default constraint with column is ANSI standard.
Hive 3.0+ has supported default
[
https://issues.apache.org/jira/browse/SPARK-27943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-27943:
---
Summary: Implement default constraint with Column for Hive table (was: Add
default constraint when
[
https://issues.apache.org/jira/browse/SPARK-27943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-27943:
---
Description:
Default constraint with column is ANSI standard.
Hive 3.0+ has supported default
84 matches
Mail list logo
