[
https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-27714:
Target Version/s: 3.0.0
> Support Join Reorder based on Genetic Algorithm when the # of joined tables >
>
[
https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-27714:
---
Assignee: Xianyin Xin
> Support Join Reorder based on Genetic Algorithm when the # of joined tables
[
https://issues.apache.org/jira/browse/SPARK-28237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-28237:
---
Assignee: Yesheng Ma
> Idempotence checker for Idempotent batches in RuleExecutors
> --
[
https://issues.apache.org/jira/browse/SPARK-28237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-28237.
-
Resolution: Fixed
Fix Version/s: 3.0.0
> Idempotence checker for Idempotent batches in RuleExecut
[
https://issues.apache.org/jira/browse/SPARK-28518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28518:
Summary: Fix StatisticsCollectionTestBase#getDataSize refer to
ChecksumFileSystem#isChecksumFile
[
https://issues.apache.org/jira/browse/SPARK-28518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28518:
Summary: Fix StatisticsCollectionTestBase#getDataSize refer to
ChecksumFileSystem.isChecksumFile
[
https://issues.apache.org/jira/browse/SPARK-28518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28518:
Description:
StatisticsCollectionTestBase.getDataSize is incorrect. We should refer to
ChecksumFi
[
https://issues.apache.org/jira/browse/SPARK-28518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28518:
Summary: Fix StatisticsCollectionTestBase#getDataSize (was: Only filter
out the checksum file whe
[
https://issues.apache.org/jira/browse/SPARK-28518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28518:
Description:
StatisticsCollectionTestBase.getDataSize is incorrect. We should filter out the
chec
[
https://issues.apache.org/jira/browse/SPARK-25653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25653:
--
Priority: Minor (was: Major)
> Add tag ExtendedHiveTest for HiveSparkSubmitSuite
> --
Yuming Wang created SPARK-28518:
---
Summary: Only filter out the checksum file when enabling fall back
to HDFS
Key: SPARK-28518
URL: https://issues.apache.org/jira/browse/SPARK-28518
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25653:
--
Affects Version/s: (was: 2.4.0)
3.0.0
> Add tag ExtendedHiveTest fo
[
https://issues.apache.org/jira/browse/SPARK-28512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893334#comment-16893334
]
Gengliang Wang commented on SPARK-28512:
[~dongjoon]Thanks!
> New optional mode
[
https://issues.apache.org/jira/browse/SPARK-28512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893331#comment-16893331
]
Dongjoon Hyun commented on SPARK-28512:
---
I changed the type from `BUG` to `Improve
[
https://issues.apache.org/jira/browse/SPARK-28512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28512:
--
Issue Type: Improvement (was: Bug)
> New optional mode: throw runtime exceptions on casting f
[
https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893318#comment-16893318
]
Hyukjin Kwon commented on SPARK-28515:
--
Which Python version do you use? IIRC, Pyth
[
https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893318#comment-16893318
]
Hyukjin Kwon edited comment on SPARK-28515 at 7/26/19 4:29 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28515:
-
Description:
I am not sure if this is a bug - but it was a very unexpected behavior, so I'd
lik
[
https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28365:
Assignee: Liang-Chi Hsieh
> Fallback locale to en_US in StopWordsRemover if system defaul
[
https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28365.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25133
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-28289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28289.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25202
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-28289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28289:
Assignee: Yiheng Wang
> Convert and port 'union.sql' into UDF test base
> ---
[
https://issues.apache.org/jira/browse/SPARK-28476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-28476:
---
Assignee: Weichen Xu
> Support ALTER DATABASE SET LOCATION
> ---
>
[
https://issues.apache.org/jira/browse/SPARK-28476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893274#comment-16893274
]
Xiao Li commented on SPARK-28476:
-
[~ivy.weichan.xu]
> Support ALTER DATABASE SET LO
[
https://issues.apache.org/jira/browse/SPARK-23469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893258#comment-16893258
]
Huaxin Gao commented on SPARK-23469:
I will work on this jira once PR https://github
[
https://issues.apache.org/jira/browse/SPARK-28137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28137:
Description:
||Function||Return Type||Description||Example||
|{{to_number(}}{{text}}{{, }}{{text}}
[
https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28516:
Description:
Currently, Spark does not have support for `to_char`. PgSQL, however,
[does|[https:/
[
https://issues.apache.org/jira/browse/SPARK-28137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28137:
Summary: Data Type Formatting Functions: `to_number` (was: Data Type
Formatting Functions: `to_ch
[
https://issues.apache.org/jira/browse/SPARK-28137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28137:
Summary: Data Type Formatting Functions: `to_char` (was: Data Type
Formatting Functions)
> Data
[
https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28516:
Summary: Data Type Formatting Functions: `to_char` (was: adds `to_char`)
> Data Type Formatting F
Barry created SPARK-28517:
-
Summary: pyspark with --conf spark.jars.packages causes duplicate
jars to be uploaded
Key: SPARK-28517
URL: https://issues.apache.org/jira/browse/SPARK-28517
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893209#comment-16893209
]
Bryan Cutler commented on SPARK-28264:
--
It's great to be taking another look at thi
[
https://issues.apache.org/jira/browse/SPARK-27845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-27845.
-
Resolution: Done
Fix Version/s: 3.0.0
> DataSourceV2: InsertTable
> -
[
https://issues.apache.org/jira/browse/SPARK-27845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reassigned SPARK-27845:
---
Assignee: John Zhuge
> DataSourceV2: InsertTable
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-27845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893162#comment-16893162
]
Burak Yavuz commented on SPARK-27845:
-
Resolved with [https://github.com/apache/spar
[
https://issues.apache.org/jira/browse/SPARK-16754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893125#comment-16893125
]
Shixiong Zhu commented on SPARK-16754:
--
I think prepending
`org.apache.spark.sql.c
[
https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nasir Ali updated SPARK-28502:
--
Issue Type: Bug (was: Question)
> Error with struct conversion while using pandas_udf
> -
[
https://issues.apache.org/jira/browse/SPARK-16754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893115#comment-16893115
]
Josh Rosen commented on SPARK-16754:
This is still a problem as of Spark 2.4.x; I ju
Dylan Guedes created SPARK-28516:
Summary: adds `to_char`
Key: SPARK-28516
URL: https://issues.apache.org/jira/browse/SPARK-28516
Project: Spark
Issue Type: Sub-task
Components: SQL
[
https://issues.apache.org/jira/browse/SPARK-25787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893043#comment-16893043
]
Paweł Wiejacha commented on SPARK-25787:
I *can* reproduce this issue. In Spark
[
https://issues.apache.org/jira/browse/SPARK-25914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-25914:
---
Assignee: (was: Dilip Biswal)
> Separate projection from grouping and aggregate in logical Aggr
[
https://issues.apache.org/jira/browse/SPARK-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shane knapp closed SPARK-28509.
---
> K8S integration tests are failing
> -
>
> Key: SPARK-2
[
https://issues.apache.org/jira/browse/SPARK-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893031#comment-16893031
]
shane knapp commented on SPARK-28509:
-
checked that worker today and all k8s builds
[
https://issues.apache.org/jira/browse/SPARK-27734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893018#comment-16893018
]
Paweł Wiejacha commented on SPARK-27734:
We also encountered this problem. We've
[
https://issues.apache.org/jira/browse/SPARK-28511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-28511.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25254
[https://
[
https://issues.apache.org/jira/browse/SPARK-28511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-28511:
-
Assignee: Dongjoon Hyun
> Get REV from RELEASE_VERSION instead of VERSION
> ---
[
https://issues.apache.org/jira/browse/SPARK-28415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892888#comment-16892888
]
Michael Spector commented on SPARK-28415:
-
In this case I think it's a regressio
[
https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892875#comment-16892875
]
Tomas Bartalos commented on SPARK-28025:
I'm also affected by performance issue
[
https://issues.apache.org/jira/browse/SPARK-28288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28288.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25195
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-28288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28288:
Assignee: YoungGyu Chun
> Convert and port 'window.sql' into UDF test base
>
[
https://issues.apache.org/jira/browse/SPARK-28421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-28421:
--
Affects Version/s: 2.4.3
Priority: Minor (was: Major)
Fix Version/s: 2.4.4
> Spa
[
https://issues.apache.org/jira/browse/SPARK-28512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892692#comment-16892692
]
Marco Gaido commented on SPARK-28512:
-
Thanks for pinging me [~maropu]. It is not th
[
https://issues.apache.org/jira/browse/SPARK-28512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892683#comment-16892683
]
Takeshi Yamamuro commented on SPARK-28512:
--
Is this related to https://issues.a
[
https://issues.apache.org/jira/browse/SPARK-28497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28497.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25242
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-28497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28497:
Assignee: Gengliang Wang
> Disallow upcasting complex data types to string type
> ---
[
https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andreas Költringer updated SPARK-28515:
---
Description:
I am not sure if this is a bug - but it was a very unexpected behavior,
[
https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andreas Költringer updated SPARK-28515:
---
Description:
I am not sure if this is a bug - but it was a very unexpected behavior,
[
https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andreas Költringer updated SPARK-28515:
---
Description:
I am not sure if this is a bug - but it was a very unexpected behavior,
[
https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andreas Költringer updated SPARK-28515:
---
Description:
I am not sure if this is a bug - but it was a very unexpected behavior,
[
https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andreas Költringer updated SPARK-28515:
---
Description:
I am not sure if this is a bug - but it was a very unexpected behavior,
Andreas Költringer created SPARK-28515:
--
Summary: to_timestamp returns null for summer time switch dates
Key: SPARK-28515
URL: https://issues.apache.org/jira/browse/SPARK-28515
Project: Spark
zhengruifeng created SPARK-28514:
Summary: Remove the redundant transformImpl method in RF & GBT
Key: SPARK-28514
URL: https://issues.apache.org/jira/browse/SPARK-28514
Project: Spark
Issue T
Martin Junghanns created SPARK-28513:
Summary: Compute distinct label sets instead of subsets
Key: SPARK-28513
URL: https://issues.apache.org/jira/browse/SPARK-28513
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892595#comment-16892595
]
Manu Zhang edited comment on SPARK-22063 at 7/25/19 9:41 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892595#comment-16892595
]
Manu Zhang commented on SPARK-22063:
Is there any update in this thread ? Which lint
[
https://issues.apache.org/jira/browse/SPARK-27688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892580#comment-16892580
]
Yuming Wang edited comment on SPARK-27688 at 7/25/19 9:24 AM:
[
https://issues.apache.org/jira/browse/SPARK-27688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-27688.
-
Resolution: Fixed
We supported it after upgrading the built-in Hive to 2.3.5.
> Beeline should
[
https://issues.apache.org/jira/browse/SPARK-27688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27688:
Affects Version/s: (was: 2.4.3)
3.0.0
> Beeline should show database in
[
https://issues.apache.org/jira/browse/SPARK-27688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892580#comment-16892580
]
Yuming Wang commented on SPARK-27688:
-
{code:sh}
build/sbt clean package -Phive -Phi
[
https://issues.apache.org/jira/browse/SPARK-28156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-28156:
Fix Version/s: 2.4.4
> Join plan sometimes does not use cached query
> ---
[
https://issues.apache.org/jira/browse/SPARK-26995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-26995:
--
Fix Version/s: 2.4.4
> Running Spark in Docker image with Alpine Linux 3.9.0 throws errors whe
[
https://issues.apache.org/jira/browse/SPARK-26995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892559#comment-16892559
]
Dongjoon Hyun commented on SPARK-26995:
---
This is backported to `branch-2.4` via
h
Gengliang Wang created SPARK-28512:
--
Summary: New optional mode: throw runtime exceptions on casting
failures
Key: SPARK-28512
URL: https://issues.apache.org/jira/browse/SPARK-28512
Project: Spark
Dongjoon Hyun created SPARK-28511:
-
Summary: Get REV from RELEASE_VERSION instead of VERSION
Key: SPARK-28511
URL: https://issues.apache.org/jira/browse/SPARK-28511
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-28510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28510:
Description: We should implement Spark's own {{GetFunctionsOperation}}
because Spark SQL and Hive'
75 matches
Mail list logo
