[
https://issues.apache.org/jira/browse/SPARK-27931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27931:
Description:
This ticket contains two things:
1.
Example:
{code:sql}
SELECT cast('no' as
[
https://issues.apache.org/jira/browse/SPARK-27931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27931:
Description:
This ticket contains two things:
1. Accept 'on' and 'off' as input for boolean data
[
https://issues.apache.org/jira/browse/SPARK-27940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-27940:
---
Description:
{{SubtractedRDD}}, which is used to implement {{RDD.subtract()}} and
[
https://issues.apache.org/jira/browse/SPARK-27940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-27940:
---
Description:
{{SubtractedRDD}}, which is used to implement {{RDD.subtract()}} and
[
https://issues.apache.org/jira/browse/SPARK-27940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-27940:
---
Description:
{{SubtractedRDD}}, which is used to implement {{RDD.subtract()}} and
Josh Rosen created SPARK-27940:
--
Summary: SubtractedRDD is OOM-prone because it does not support
spilling
Key: SPARK-27940
URL: https://issues.apache.org/jira/browse/SPARK-27940
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-27748.
Resolution: Fixed
Assignee: Gabor Somogyi
Fix Version/s: 3.0.0
> Kafka
Johannes Schaffrath created SPARK-27939:
---
Summary: Defining a schema with VectorUDT
Key: SPARK-27939
URL: https://issues.apache.org/jira/browse/SPARK-27939
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855104#comment-16855104
]
Xiangrui Meng commented on SPARK-27889:
---
[~smilegator] I assigned this ticket to you for auditing
[
https://issues.apache.org/jira/browse/SPARK-27887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27887:
Assignee: Apache Spark
> Check python version and print deprecation warning if version <
[
https://issues.apache.org/jira/browse/SPARK-27887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27887:
Assignee: (was: Apache Spark)
> Check python version and print deprecation warning
[
https://issues.apache.org/jira/browse/SPARK-27887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng reassigned SPARK-27887:
-
Assignee: Xiangrui Meng
> Check python version and print deprecation warning if
[
https://issues.apache.org/jira/browse/SPARK-27889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng reassigned SPARK-27889:
-
Assignee: Xiao Li
> Make development scripts under dev/ support Python 3
>
[
https://issues.apache.org/jira/browse/SPARK-27938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855094#comment-16855094
]
Apache Spark commented on SPARK-27938:
--
User 'liwensun' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-27938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27938:
Assignee: Apache Spark
> Turn on LEGACY_PASS_PARTITION_BY_AS_OPTIONS by default
>
[
https://issues.apache.org/jira/browse/SPARK-27938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27938:
Assignee: (was: Apache Spark)
> Turn on LEGACY_PASS_PARTITION_BY_AS_OPTIONS by
Liwen Sun created SPARK-27938:
-
Summary: Turn on LEGACY_PASS_PARTITION_BY_AS_OPTIONS by default
Key: SPARK-27938
URL: https://issues.apache.org/jira/browse/SPARK-27938
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27937:
Assignee: (was: Apache Spark)
> Revert changes introduced as a part of Automatic
[
https://issues.apache.org/jira/browse/SPARK-27937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27937:
Assignee: Apache Spark
> Revert changes introduced as a part of Automatic namespace
[
https://issues.apache.org/jira/browse/SPARK-27453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855086#comment-16855086
]
Apache Spark commented on SPARK-27453:
--
User 'liwensun' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855079#comment-16855079
]
Stavros Kontopoulos commented on SPARK-27936:
-
[~eje] I guess the same is the case for R
Dhruve Ashar created SPARK-27937:
Summary: Revert changes introduced as a part of Automatic
namespace discovery [SPARK-24149]
Key: SPARK-27937
URL: https://issues.apache.org/jira/browse/SPARK-27937
[
https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854998#comment-16854998
]
Erik Erlandson commented on SPARK-27936:
cc [~skonto]
> Support local dependency uploading from
Erik Erlandson created SPARK-27936:
--
Summary: Support local dependency uploading from --py-files
Key: SPARK-27936
URL: https://issues.apache.org/jira/browse/SPARK-27936
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-27886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854833#comment-16854833
]
Xiangrui Meng commented on SPARK-27886:
---
Created a PR here:
[
https://issues.apache.org/jira/browse/SPARK-27935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Spencer updated SPARK-27935:
Description:
Currently, calling *Dataset[A].joinWith(Dataset[B], col, "left_outer")* or
Spencer created SPARK-27935:
---
Summary: Introduce leftOuterJoinWith and fullOuterJoinWith
Key: SPARK-27935
URL: https://issues.apache.org/jira/browse/SPARK-27935
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-27885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-27885.
---
Resolution: Done
> Announce deprecation of Python 2 support
>
[
https://issues.apache.org/jira/browse/SPARK-27886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng reassigned SPARK-27886:
-
Assignee: Xiangrui Meng
> Add Apache Spark project to https://python3statement.org/
>
[
https://issues.apache.org/jira/browse/SPARK-27885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854737#comment-16854737
]
Xiangrui Meng commented on SPARK-27885:
---
Announced at:
*
[
https://issues.apache.org/jira/browse/SPARK-27934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27934:
Assignee: (was: Apache Spark)
> Add case.sql
>
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-27934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27934:
Assignee: Apache Spark
> Add case.sql
>
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-27933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27933:
Assignee: (was: Apache Spark)
> Introduce StreamExecution.purge for removing entries
[
https://issues.apache.org/jira/browse/SPARK-27933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27933:
Assignee: Apache Spark
> Introduce StreamExecution.purge for removing entries from
Yuming Wang created SPARK-27934:
---
Summary: Add case.sql
Key: SPARK-27934
URL: https://issues.apache.org/jira/browse/SPARK-27934
Project: Spark
Issue Type: Sub-task
Components: SQL
Jacek Laskowski created SPARK-27933:
---
Summary: Introduce StreamExecution.purge for removing entries from
metadata logs
Key: SPARK-27933
URL: https://issues.apache.org/jira/browse/SPARK-27933
[
https://issues.apache.org/jira/browse/SPARK-27923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27923:
Description:
# {{SELECT bool 'test' AS error;}}
Alex Dettinger created SPARK-27932:
--
Summary: Update jackson versions on 2.4.x and 2.3.x branches
Key: SPARK-27932
URL: https://issues.apache.org/jira/browse/SPARK-27932
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27931:
Description:
Example:
{code:sql}
SELECT cast('no' as boolean) AS false;
SELECT cast('off' as
Yuming Wang created SPARK-27931:
---
Summary: Accept 'on' and 'off' as input for boolean data type
Key: SPARK-27931
URL: https://issues.apache.org/jira/browse/SPARK-27931
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854565#comment-16854565
]
Edwin Biemond commented on SPARK-27927:
---
I got it working again when I call
[
https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854557#comment-16854557
]
Emanuele Bardelli commented on SPARK-26388:
---
Just submitted a PR for this, reviews and
[
https://issues.apache.org/jira/browse/SPARK-27917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854550#comment-16854550
]
Akash R Nilugal commented on SPARK-27917:
-
Thank you [~dongjoon](y)
> Semantic equals of
Yuming Wang created SPARK-27930:
---
Summary: Add built-in Math Function: RANDOM
Key: SPARK-27930
URL: https://issues.apache.org/jira/browse/SPARK-27930
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26388:
Assignee: Apache Spark
> No support for "alter table .. replace columns" to drop columns
[
https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26388:
Assignee: (was: Apache Spark)
> No support for "alter table .. replace columns" to
[
https://issues.apache.org/jira/browse/SPARK-27929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27929:
Assignee: Apache Spark
> make sql percentile function be able to receive double frq
>
[
https://issues.apache.org/jira/browse/SPARK-27900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854465#comment-16854465
]
Stavros Kontopoulos edited comment on SPARK-27900 at 6/3/19 11:46 AM:
[
https://issues.apache.org/jira/browse/SPARK-27929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27929:
Assignee: (was: Apache Spark)
> make sql percentile function be able to receive
[
https://issues.apache.org/jira/browse/SPARK-27900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854465#comment-16854465
]
Stavros Kontopoulos edited comment on SPARK-27900 at 6/3/19 11:45 AM:
Taeksang Kim created SPARK-27929:
Summary: make sql percentile function be able to receive double frq
Key: SPARK-27929
URL: https://issues.apache.org/jira/browse/SPARK-27929
Project: Spark
Rajesh created SPARK-27928:
--
Summary: hadoop
Key: SPARK-27928
URL: https://issues.apache.org/jira/browse/SPARK-27928
Project: Spark
Issue Type: Bug
Components: Build
Affects Versions:
[
https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Edwin Biemond updated SPARK-27927:
--
Component/s: PySpark
> driver pod hangs with pyspark 2.4.3 and master on kubenetes
>
[
https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854474#comment-16854474
]
Edwin Biemond commented on SPARK-27927:
---
on the same hanging driver pod when I do the manual spark
[
https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854471#comment-16854471
]
Edwin Biemond commented on SPARK-27927:
---
same but then for 2.4.0 , in this case the shutdown hook
Edwin Biemond created SPARK-27927:
-
Summary: driver pod hangs with pyspark 2.4.3 and master on
kubenetes
Key: SPARK-27927
URL: https://issues.apache.org/jira/browse/SPARK-27927
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854470#comment-16854470
]
Edwin Biemond commented on SPARK-27927:
---
the 2.4.3 output
{noformat}
root 1 0 0 09:03 ? 00:00:00
[
https://issues.apache.org/jira/browse/SPARK-27900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854465#comment-16854465
]
Stavros Kontopoulos commented on SPARK-27900:
-
Setting -XX:+ExitOnOutOfMemoryError
[
https://issues.apache.org/jira/browse/SPARK-27900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27900:
Summary: Spark on K8s will not report container failure due to an oom error
[
https://issues.apache.org/jira/browse/SPARK-27900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854449#comment-16854449
]
Stavros Kontopoulos edited comment on SPARK-27900 at 6/3/19 10:42 AM:
[
https://issues.apache.org/jira/browse/SPARK-27900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854449#comment-16854449
]
Stavros Kontopoulos commented on SPARK-27900:
-
A better approach to try here:
[
https://issues.apache.org/jira/browse/SPARK-27926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27926:
Assignee: (was: Apache Spark)
> Allow altering table add columns with
[
https://issues.apache.org/jira/browse/SPARK-27926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27926:
Assignee: Apache Spark
> Allow altering table add columns with
[
https://issues.apache.org/jira/browse/SPARK-27926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-27926:
---
Issue Type: Sub-task (was: Bug)
Parent: SPARK-27589
> Allow altering table add
Gengliang Wang created SPARK-27926:
--
Summary: Allow altering table add columns with
CSVFileFormat/JsonFileFormat provider
Key: SPARK-27926
URL: https://issues.apache.org/jira/browse/SPARK-27926
[
https://issues.apache.org/jira/browse/SPARK-27925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27925:
Assignee: (was: Apache Spark)
> Better control numBins of curves in
[
https://issues.apache.org/jira/browse/SPARK-27925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27925:
Assignee: Apache Spark
> Better control numBins of curves in BinaryClassificationMetrics
zhengruifeng created SPARK-27925:
Summary: Better control numBins of curves in
BinaryClassificationMetrics
Key: SPARK-27925
URL: https://issues.apache.org/jira/browse/SPARK-27925
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854418#comment-16854418
]
Sergey Torgashov commented on SPARK-27864:
--
[~dongjoon], I tried the binary that you suggested.
[
https://issues.apache.org/jira/browse/SPARK-27881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Toth updated SPARK-27881:
---
Description:
SQL:2016 standard supports the following Cast functions
{noformat}
CAST( AS [FORMAT
[
https://issues.apache.org/jira/browse/SPARK-27880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27880:
Description:
{code:sql}
bool_and/booland_statefunc(expression) -- true if all input values are
[
https://issues.apache.org/jira/browse/SPARK-27880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27880:
Comment: was deleted
(was: Presto also support this feature:
[
https://issues.apache.org/jira/browse/SPARK-27880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854397#comment-16854397
]
Yuming Wang edited comment on SPARK-27880 at 6/3/19 9:11 AM:
-
Presto also
[
https://issues.apache.org/jira/browse/SPARK-27880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27880:
Description:
{code:sql}
bool_and/booland_statefunc(expression) -- true if all input values are
[
https://issues.apache.org/jira/browse/SPARK-27880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854397#comment-16854397
]
Yuming Wang commented on SPARK-27880:
-
Presto also support this feature:
[
https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27924:
Description:
Support for various forms of search conditions are mandatory in the SQL
standard.
Yuming Wang created SPARK-27924:
---
Summary: E061-14: Search Conditions
Key: SPARK-27924
URL: https://issues.apache.org/jira/browse/SPARK-27924
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-27923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27923:
Description: # {{SELECT bool 'test' AS error;}}
Yuming Wang created SPARK-27923:
---
Summary: List all cases that PostgreSQL throws an exception but
Spark SQL is NULL
Key: SPARK-27923
URL: https://issues.apache.org/jira/browse/SPARK-27923
Project:
[
https://issues.apache.org/jira/browse/SPARK-27899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27899:
Assignee: Apache Spark (was: Lantao Jin)
> Make
[
https://issues.apache.org/jira/browse/SPARK-27899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27899:
Assignee: Lantao Jin (was: Apache Spark)
> Make
[
https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854249#comment-16854249
]
M. Le Bihan edited comment on SPARK-18105 at 6/3/19 6:18 AM:
-
I have also a
[
https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854249#comment-16854249
]
M. Le Bihan commented on SPARK-18105:
-
I have also a problem involving a corrupted stream by LZ4,
83 matches
Mail list logo
