[
https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26985:
Assignee: (was: Apache Spark)
> Test "access only some column of the all of columns
[
https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858318#comment-16858318
]
Apache Spark commented on SPARK-26985:
--
User 'ketank-new' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26985:
Assignee: Apache Spark
> Test "access only some column of the all of columns " fails on
[
https://issues.apache.org/jira/browse/SPARK-27973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27973:
Assignee: (was: Apache Spark)
> Streaming sample DirectKafkaWordCount should mention
[
https://issues.apache.org/jira/browse/SPARK-27973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27973:
Assignee: Apache Spark
> Streaming sample DirectKafkaWordCount should mention GroupId in
Yuexin Zhang created SPARK-27973:
Summary: Streaming sample DirectKafkaWordCount should mention
GroupId in usage
Key: SPARK-27973
URL: https://issues.apache.org/jira/browse/SPARK-27973
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-27928:
-
Target Version/s: (was: 2.4.0)
> hadoop
> --
>
> Key: SPARK-27928
>
[
https://issues.apache.org/jira/browse/SPARK-27928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27928.
--
Resolution: Invalid
> hadoop
> --
>
> Key: SPARK-27928
>
[
https://issues.apache.org/jira/browse/SPARK-27928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-27928:
-
Fix Version/s: (was: 2.4.4)
> hadoop
> --
>
> Key: SPARK-27928
>
[
https://issues.apache.org/jira/browse/SPARK-27956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27956.
--
Resolution: Duplicate
> Allow subqueries as partition filter
>
[
https://issues.apache.org/jira/browse/SPARK-27966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858291#comment-16858291
]
Hyukjin Kwon commented on SPARK-27966:
--
Can you know reproducible steps? In my env, it always shows
[
https://issues.apache.org/jira/browse/SPARK-27970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27970:
Assignee: (was: Apache Spark)
> Support Hive 3.0 metastore
>
[
https://issues.apache.org/jira/browse/SPARK-27970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858288#comment-16858288
]
Apache Spark commented on SPARK-27970:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-27970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27970:
Assignee: Apache Spark
> Support Hive 3.0 metastore
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858285#comment-16858285
]
Hyukjin Kwon commented on SPARK-27927:
--
Does this happen in non-Kubernates envs?
> driver pod
[
https://issues.apache.org/jira/browse/SPARK-27962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-27962:
-
Component/s: SparkR
> Propagate subprocess stdout when subprocess exits with nonzero status in
[
https://issues.apache.org/jira/browse/SPARK-27938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-27938:
Assignee: Liwen Sun
> Turn on LEGACY_PASS_PARTITION_BY_AS_OPTIONS by default
>
[
https://issues.apache.org/jira/browse/SPARK-27938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27938.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24784
[
https://issues.apache.org/jira/browse/SPARK-27971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27971:
Assignee: Apache Spark
> MapPartitionsInRWithArrowExec.evaluate shouldn't eagerly read
[
https://issues.apache.org/jira/browse/SPARK-27971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27971:
Assignee: (was: Apache Spark)
> MapPartitionsInRWithArrowExec.evaluate shouldn't
[
https://issues.apache.org/jira/browse/SPARK-27971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-27971:
-
Summary: MapPartitionsInRWithArrowExec.evaluate shouldn't eagerly read the
first batch (was:
[
https://issues.apache.org/jira/browse/SPARK-27968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-27968:
-
Summary: ArrowEvalPythonExec.evaluate shouldn't eagerly read the first
batch (was:
Xiao Li created SPARK-27972:
---
Summary: Move SQL migration guide to the top level
Key: SPARK-27972
URL: https://issues.apache.org/jira/browse/SPARK-27972
Project: Spark
Issue Type: Improvement
Hyukjin Kwon created SPARK-27971:
Summary: MapPartitionsInRWithArrowExec.evaluate shouldn't eagerly
read the first row
Key: SPARK-27971
URL: https://issues.apache.org/jira/browse/SPARK-27971
Project:
[
https://issues.apache.org/jira/browse/SPARK-27969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858208#comment-16858208
]
Josh Rosen commented on SPARK-27969:
It looks like this issue has been reported twice in the past:
[
https://issues.apache.org/jira/browse/SPARK-27970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27970:
Description:
It seems that some users are using Hive 3.0.0, at least HDP 3.0.0:
[
https://issues.apache.org/jira/browse/SPARK-27970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27970:
Attachment: screenshot-1.png
> Support Hive 3.0 metastore
> --
>
>
Yuming Wang created SPARK-27970:
---
Summary: Support Hive 3.0 metastore
Key: SPARK-27970
URL: https://issues.apache.org/jira/browse/SPARK-27970
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-27969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-27969:
---
Component/s: Optimizer
> Non-deterministic expressions in filters or projects can unnecessarily
>
[
https://issues.apache.org/jira/browse/SPARK-27761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858155#comment-16858155
]
Josh Rosen commented on SPARK-27761:
FYI, I'm marking SPARK-27969 as a blocker to this because
Josh Rosen created SPARK-27969:
--
Summary: Non-deterministic expressions in filters or projects can
unnecessarily prevent all scan-time column pruning, harming performance
Key: SPARK-27969
URL:
[
https://issues.apache.org/jira/browse/SPARK-27968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-27968.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24816
[
https://issues.apache.org/jira/browse/SPARK-26412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-26412:
--
Description:
Pandas UDF is the ideal connection between PySpark and DL model inference
[
https://issues.apache.org/jira/browse/SPARK-26412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-26412:
--
Description:
Pandas UDF is the ideal connection between PySpark and DL model inference
[
https://issues.apache.org/jira/browse/SPARK-26412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-26412:
--
Description:
Pandas UDF is the ideal connection between PySpark and DL model inference
[
https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27963:
Assignee: Apache Spark
> Allow dynamic allocation without an external shuffle service
>
[
https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27963:
Assignee: (was: Apache Spark)
> Allow dynamic allocation without an external shuffle
[
https://issues.apache.org/jira/browse/SPARK-27760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-27760.
---
Resolution: Fixed
Fix Version/s: 3.0.0
> Spark resources - user configs change
[
https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857998#comment-16857998
]
Steve Loughran commented on SPARK-24523:
In HDFS:
{code}
if (!file.isUnderConstruction()) {
[
https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857995#comment-16857995
]
Steve Loughran commented on SPARK-24523:
The HDFS failure lookjs more serious; the timeout is a
Xiangrui Meng created SPARK-27968:
-
Summary: ArrowEvalPythonExec.evaluate shouldn't eagerly read the
first row
Key: SPARK-27968
URL: https://issues.apache.org/jira/browse/SPARK-27968
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857979#comment-16857979
]
Martin Studer commented on SPARK-24523:
---
We're observing the same issue on Hortonworks HDP 2.6.5
[
https://issues.apache.org/jira/browse/SPARK-27961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27961:
Assignee: (was: Apache Spark)
> DataSourceV2Relation should not have refresh method
[
https://issues.apache.org/jira/browse/SPARK-27961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27961:
Assignee: Apache Spark
> DataSourceV2Relation should not have refresh method
>
[
https://issues.apache.org/jira/browse/SPARK-27961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857961#comment-16857961
]
Gengliang Wang commented on SPARK-27961:
So, will Spark support "refresh table" in DSV2
[
https://issues.apache.org/jira/browse/SPARK-27918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-27918.
-
Resolution: Fixed
Assignee: Yuming Wang
Fix Version/s: 3.0.0
> Add boolean.sql
>
[
https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-27924:
Description:
{quote} ::=
[ IS [ NOT ] ]
::=
TRUE
| FALSE
| UNKNOWN{quote}
Currently, the
[
https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-27924:
Summary: ANSI SQL: Boolean Test (was: E061-14: Search Conditions)
> ANSI SQL: Boolean Test
>
[
https://issues.apache.org/jira/browse/SPARK-15015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857902#comment-16857902
]
John-Michael Reed commented on SPARK-15015:
---
[~srowen] - An no, it is not already resolved
[
https://issues.apache.org/jira/browse/SPARK-27967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Igor Kamyshnikov updated SPARK-27967:
-
Description:
Synthetic test:
1) run ZK
2) run Master
3) run Worker with remote
Igor Kamyshnikov created SPARK-27967:
Summary: Fault tolerance broken: Race conditions: a supervised
Driver is not relaunched and completely removed sometimes under Standalone
cluster when Worker gracefully shuts down
Key:
[
https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-27924:
Target Version/s: 3.0.0
> E061-14: Search Conditions
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-27883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-27883:
---
Assignee: Yuming Wang
> Add aggregates.sql - Part2
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-27883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-27883.
-
Resolution: Fixed
Fix Version/s: 3.0.0
> Add aggregates.sql - Part2
> --
[
https://issues.apache.org/jira/browse/SPARK-26896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857843#comment-16857843
]
Sean Owen commented on SPARK-26896:
---
BTW should we close this? I don't think we need a new profile.
>
[
https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857833#comment-16857833
]
Martin Junghanns commented on SPARK-25994:
--
Hi [~RBerenguel]. Thanks a lot for your interest. I
[
https://issues.apache.org/jira/browse/SPARK-27704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27704.
---
Resolution: Not A Problem
Do you mean garbage collector? the user can already choose the GC by
[
https://issues.apache.org/jira/browse/SPARK-27961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857823#comment-16857823
]
Gengliang Wang commented on SPARK-27961:
[~jzhuge][~rdblue] Make sense. I will remove it.
>
[
https://issues.apache.org/jira/browse/SPARK-27966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christian Homberg updated SPARK-27966:
--
Attachment: input_file_name_bug
> input_file_name empty when listing files in
[
https://issues.apache.org/jira/browse/SPARK-27966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christian Homberg updated SPARK-27966:
--
Description:
I ran into an issue similar and probably related to SPARK-26128. The
[
https://issues.apache.org/jira/browse/SPARK-27966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christian Homberg updated SPARK-27966:
--
Description:
I ran into an issue similar and probably related to SPARK-26128. The
[
https://issues.apache.org/jira/browse/SPARK-27966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christian Homberg updated SPARK-27966:
--
Description:
I ran into an issue similar and probably related to SPARK-26128. The
[
https://issues.apache.org/jira/browse/SPARK-27966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christian Homberg updated SPARK-27966:
--
Description:
I ran into an issue similar and probably related to SPARK-26128. The
[
https://issues.apache.org/jira/browse/SPARK-15015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857772#comment-16857772
]
John-Michael Reed commented on SPARK-15015:
---
[~srowen] [~WangTao] [~hyukjin.kwon],
I am just
[
https://issues.apache.org/jira/browse/SPARK-15015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-15015.
---
Resolution: Auto Closed
We're not going to reopen these unless there's a material change, like
[
https://issues.apache.org/jira/browse/SPARK-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857719#comment-16857719
]
Sean Owen commented on SPARK-20856:
---
We're not going to reopen these unless there's a material change,
[
https://issues.apache.org/jira/browse/SPARK-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-20856.
---
Resolution: Auto Closed
We're not going to reopen these unless there's a material change, like
[
https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-21136:
--
Priority: Minor (was: Critical)
> Misleading error message for typo in SQL
>
[
https://issues.apache.org/jira/browse/SPARK-27966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christian Homberg updated SPARK-27966:
--
Description:
I ran into an issue similar and probably related to SPARK-26128. The
Christian Homberg created SPARK-27966:
-
Summary: input_file_name empty when listing files in parallel
Key: SPARK-27966
URL: https://issues.apache.org/jira/browse/SPARK-27966
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-27943:
---
Description:
*Background*
Default constraint with column is ANSI standard.
Hive 3.0+ has
[
https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857534#comment-16857534
]
Edwin Biemond commented on SPARK-27927:
---
[~hyukjin.kwon] do you have a clue why in 2.4.X and 3.0 I
[
https://issues.apache.org/jira/browse/SPARK-27931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27931:
Description:
This ticket contains three things:
1. Accept 'on' and 'off' as input for boolean
[
https://issues.apache.org/jira/browse/SPARK-27931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27931:
Description:
This ticket contains three things:
1. Accept 'on' and 'off' as input for boolean
74 matches
Mail list logo
