[
https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080265#comment-17080265
]
Reynold Xin commented on SPARK-31399:
-
This is bad... [~sowen] and [~joshrosen] did you look into
[
https://issues.apache.org/jira/browse/SPARK-31402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-31402:
Parent: SPARK-31404
Issue Type: Sub-task (was: Bug)
> Incorrect rebasing of BCE dates
>
[
https://issues.apache.org/jira/browse/SPARK-31386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080257#comment-17080257
]
JinxinTang edited comment on SPARK-31386 at 4/10/20, 5:32 AM:
--
or could you
[
https://issues.apache.org/jira/browse/SPARK-31386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080257#comment-17080257
]
JinxinTang commented on SPARK-31386:
or could you please try the spark 2.4.5, also no problem could
[
https://issues.apache.org/jira/browse/SPARK-24963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-24963:
-
Assignee: Matthew Cheah
> Integration tests will fail if they run in a namespace not
[
https://issues.apache.org/jira/browse/SPARK-31401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-31401.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28171
[
https://issues.apache.org/jira/browse/SPARK-31404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-31404:
Summary: backward compatibility issues after switching to Proleptic
Gregorian calendar (was:
[
https://issues.apache.org/jira/browse/SPARK-31386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080205#comment-17080205
]
JinxinTang commented on SPARK-31386:
is it already fix in the 2.4.4 version?
it seems ok both in
[
https://issues.apache.org/jira/browse/SPARK-31386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
JinxinTang updated SPARK-31386:
---
Attachment: 选区_267.png
> Reading broadcast in UDF raises MemoryError when
>
[
https://issues.apache.org/jira/browse/SPARK-31406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080203#comment-17080203
]
jiaan.geng commented on SPARK-31406:
I'm working on.
> ThriftServerQueryTestSuite: Sharing test
jiaan.geng created SPARK-31406:
--
Summary: ThriftServerQueryTestSuite: Sharing test data and test
tables among multiple test cases.
Key: SPARK-31406
URL: https://issues.apache.org/jira/browse/SPARK-31406
[
https://issues.apache.org/jira/browse/SPARK-31361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-31361:
Parent: SPARK-31404
Issue Type: Sub-task (was: Bug)
> Rebase datetime in parquet/avro
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080193#comment-17080193
]
Wenchen Fan commented on SPARK-30951:
-
FTYI I've created a ticket for the fail-by-default behavior:
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080193#comment-17080193
]
Wenchen Fan edited comment on SPARK-30951 at 4/10/20, 3:40 AM:
---
FYI I've
Wenchen Fan created SPARK-31405:
---
Summary: fail by default when read/write datetime values and not
sure if they need rebase or not
Key: SPARK-31405
URL: https://issues.apache.org/jira/browse/SPARK-31405
[
https://issues.apache.org/jira/browse/SPARK-31297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-31297:
Parent Issue: SPARK-31404 (was: SPARK-30951)
> Speed-up date-time rebasing
>
[
https://issues.apache.org/jira/browse/SPARK-31359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-31359:
Parent: SPARK-31404
Issue Type: Sub-task (was: Improvement)
> Speed up timestamps
[
https://issues.apache.org/jira/browse/SPARK-31385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-31385:
Parent: SPARK-31404
Issue Type: Sub-task (was: Bug)
> Results of Julian-Gregorian
Wenchen Fan created SPARK-31404:
---
Summary: backward compatibility after switching to Proleptic
Gregorian calendar
Key: SPARK-31404
URL: https://issues.apache.org/jira/browse/SPARK-31404
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-31359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-31359:
---
Assignee: Maxim Gekk
> Speed up timestamps rebasing
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-31359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-31359.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28163
[
https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-30808.
-
Resolution: Cannot Reproduce
> Thrift server returns wrong timestamps/dates strings before 1582
>
[
https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080183#comment-17080183
]
Xiao Li commented on SPARK-30808:
-
The problem does not exist.
> Thrift server returns wrong
[
https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reopened SPARK-30808:
-
> Thrift server returns wrong timestamps/dates strings before 1582
>
[
https://issues.apache.org/jira/browse/SPARK-31301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080175#comment-17080175
]
zhengruifeng commented on SPARK-31301:
--
(One small question: the new method takes a Dataset[_]
[
https://issues.apache.org/jira/browse/SPARK-31355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-31355.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28130
[
https://issues.apache.org/jira/browse/SPARK-31355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-31355:
Assignee: Huaxin Gao
> Document TABLESAMPLE in SQL Reference
>
[
https://issues.apache.org/jira/browse/SPARK-30819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-30819.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 27571
[
https://issues.apache.org/jira/browse/SPARK-30819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-30819:
Assignee: Maciej Szymkiewicz
> Add FMRegressor wrapper to SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080102#comment-17080102
]
Xiao Li commented on SPARK-30808:
-
Is it reverted?
> Thrift server returns wrong timestamps/dates
Carl Sverre created SPARK-31403:
---
Summary: TreeNode asCode function incorrectly handles null literals
Key: SPARK-31403
URL: https://issues.apache.org/jira/browse/SPARK-31403
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-31399:
--
Priority: Blocker (was: Major)
> closure cleaner is broken in Spark 3.0
>
[
https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-31399:
--
Target Version/s: 3.0.0
> closure cleaner is broken in Spark 3.0
>
[
https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079992#comment-17079992
]
Dongjoon Hyun commented on SPARK-31399:
---
Thank you for pinging me, [~cloud_fan].
cc [~dbtsai] and
Maxim Gekk created SPARK-31402:
--
Summary: Incorrect rebasing of BCE dates
Key: SPARK-31402
URL: https://issues.apache.org/jira/browse/SPARK-31402
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-31401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-31401:
-
Assignee: Dongjoon Hyun
> Add JDK11 example in `bin/docker-image-tool.sh` usage
>
Dongjoon Hyun created SPARK-31401:
-
Summary: Add JDK11 example in `bin/docker-image-tool.sh` usage
Key: SPARK-31401
URL: https://issues.apache.org/jira/browse/SPARK-31401
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-31377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Srinivas Rishindra Pothireddi updated SPARK-31377:
--
Description:
For some combinations of join algorithm and join
Junpei Zhou created SPARK-31400:
---
Summary: The catalogString doesn't distinguish Vectors in ml and
mllib
Key: SPARK-31400
URL: https://issues.apache.org/jira/browse/SPARK-31400
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-31400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junpei Zhou updated SPARK-31400:
Description:
h2. Bug Description
The `catalogString` is not detailed enough to distinguish the
[
https://issues.apache.org/jira/browse/SPARK-31331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-31331.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28104
[
https://issues.apache.org/jira/browse/SPARK-31331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-31331:
Assignee: Huaxin Gao
> Document Spark integration with Hive UDFs/UDAFs/UDTFs
>
[
https://issues.apache.org/jira/browse/SPARK-31389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Srinivas Rishindra Pothireddi updated SPARK-31389:
--
Description:
Many tests in SQLMetricsSuite run only with
[
https://issues.apache.org/jira/browse/SPARK-31021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Masiero Vanzin resolved SPARK-31021.
Fix Version/s: 3.1.0
Assignee: Gabor Somogyi
Resolution:
[
https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079514#comment-17079514
]
Xiao Li commented on SPARK-31399:
-
cc [~zsxwing]
> closure cleaner is broken in Spark 3.0
>
[
https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079454#comment-17079454
]
Wenchen Fan commented on SPARK-31399:
-
cc [~rxin] [~sowen] [~dongjoon] [~tgraves]
> closure cleaner
[
https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-31399:
Description:
The `ClosureCleaner` only support Scala functions and it uses the following
check
Wenchen Fan created SPARK-31399:
---
Summary: closure cleaner is broken in Spark 3.0
Key: SPARK-31399
URL: https://issues.apache.org/jira/browse/SPARK-31399
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-31301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079371#comment-17079371
]
Sean R. Owen commented on SPARK-31301:
--
(One small question: the new method takes a Dataset[_]
[
https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079337#comment-17079337
]
Everett Rush commented on SPARK-27249:
--
Hi Nick,
I think the solution could make use of the
Maxim Gekk created SPARK-31398:
--
Summary: Speed up reading dates in ORC
Key: SPARK-31398
URL: https://issues.apache.org/jira/browse/SPARK-31398
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-31397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31397.
--
Resolution: Won't Fix
> Support json_arrayAgg
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-31396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31396.
--
Resolution: Won't Fix
> Support json_objectAgg function
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-31397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079268#comment-17079268
]
Rakesh Raushan commented on SPARK-31397:
The same functionality can be achieved using
[
https://issues.apache.org/jira/browse/SPARK-31397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rakesh Raushan updated SPARK-31397:
---
Comment: was deleted
(was: I am working on it.)
> Support json_arrayAgg
>
[
https://issues.apache.org/jira/browse/SPARK-31396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079267#comment-17079267
]
Rakesh Raushan commented on SPARK-31396:
We can achieve the same functionality using
[
https://issues.apache.org/jira/browse/SPARK-31396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rakesh Raushan updated SPARK-31396:
---
Comment: was deleted
(was: I am working on it.)
> Support json_objectAgg function
>
[
https://issues.apache.org/jira/browse/SPARK-31291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-31291:
---
Assignee: jiaan.geng
> SQLQueryTestSuite: Sharing test data and test tables among multiple
[
https://issues.apache.org/jira/browse/SPARK-31291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-31291.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28060
[
https://issues.apache.org/jira/browse/SPARK-31395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31395.
--
Resolution: Not A Problem
> [SPARK][Core]preferred location causing single node be a hot spot
[
https://issues.apache.org/jira/browse/SPARK-31397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079226#comment-17079226
]
Rakesh Raushan commented on SPARK-31397:
I am working on it.
> Support json_arrayAgg
>
Rakesh Raushan created SPARK-31397:
--
Summary: Support json_arrayAgg
Key: SPARK-31397
URL: https://issues.apache.org/jira/browse/SPARK-31397
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-31396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079198#comment-17079198
]
Rakesh Raushan commented on SPARK-31396:
I am working on it.
> Support json_objectAgg function
Rakesh Raushan created SPARK-31396:
--
Summary: Support json_objectAgg function
Key: SPARK-31396
URL: https://issues.apache.org/jira/browse/SPARK-31396
Project: Spark
Issue Type: New Feature
StephenZou created SPARK-31395:
--
Summary: [SPARK][Core]preferred location causing single node be a
hot spot
Key: SPARK-31395
URL: https://issues.apache.org/jira/browse/SPARK-31395
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-31106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rakesh Raushan updated SPARK-31106:
---
Description:
This function will allow users to verify whether the given string is valid
[
https://issues.apache.org/jira/browse/SPARK-31106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rakesh Raushan updated SPARK-31106:
---
Summary: Support is_json function (was: Support IS_JSON)
> Support is_json function
>
[
https://issues.apache.org/jira/browse/SPARK-28902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079165#comment-17079165
]
chiranjeevi commented on SPARK-28902:
-
Hi team,
i am having the same issue, May i know how can this
[
https://issues.apache.org/jira/browse/SPARK-31393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-31393:
---
Description:
Spark SQL exists some function no elegant implementation alias.
For example:
[
https://issues.apache.org/jira/browse/SPARK-31106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rakesh Raushan updated SPARK-31106:
---
Description:
Currently, null is returned when we come across invalid json. We should either
[
https://issues.apache.org/jira/browse/SPARK-31291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-31291:
---
Summary: SQLQueryTestSuite: Sharing test data and test tables among
multiple test cases. (was:
Seongjin Cho created SPARK-31394:
Summary: Support for Kubernetes NFS volume mounts
Key: SPARK-31394
URL: https://issues.apache.org/jira/browse/SPARK-31394
Project: Spark
Issue Type:
jiaan.geng created SPARK-31393:
--
Summary: Show the correct alias in a more elegant way
Key: SPARK-31393
URL: https://issues.apache.org/jira/browse/SPARK-31393
Project: Spark
Issue Type:
Kent Yao created SPARK-31392:
Summary: Support CalendarInterval to be reflect to
CalendarIntervalType
Key: SPARK-31392
URL: https://issues.apache.org/jira/browse/SPARK-31392
Project: Spark
wuyi created SPARK-31391:
Summary: Add AdaptiveTestUtils to ease the test of AQE
Key: SPARK-31391
URL: https://issues.apache.org/jira/browse/SPARK-31391
Project: Spark
Issue Type: Test
[
https://issues.apache.org/jira/browse/SPARK-31301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078958#comment-17078958
]
zhengruifeng commented on SPARK-31301:
--
[~srowen] There are two methods now:
{code:java}
76 matches
Mail list logo
