[
https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-30893:
Description: This is a problem because the configuration can change between
different phases of
[
https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041618#comment-17041618
]
Wenchen Fan edited comment on SPARK-30893 at 2/21/20 7:14 AM:
--
For data
[
https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041618#comment-17041618
]
Wenchen Fan commented on SPARK-30893:
-
For data type and nullability, I think we should fix before
[
https://issues.apache.org/jira/browse/SPARK-30894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-30894:
Summary: The nullability of Size function should not depend on SQLConf.get
(was: The behavior of
[
https://issues.apache.org/jira/browse/SPARK-30894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-30894:
Priority: Blocker (was: Major)
> The nullability of Size function should not depend on
[
https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041617#comment-17041617
]
L. C. Hsieh commented on SPARK-30893:
-
hmm, an action like `df.collect` should re-evaluate if it is
[
https://issues.apache.org/jira/browse/SPARK-30852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30852.
-
Resolution: Won't Fix
> Use Long instead of Int as argument type in Dataset limit method
>
[
https://issues.apache.org/jira/browse/SPARK-18502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041602#comment-17041602
]
Gan Wei edited comment on SPARK-18502 at 2/21/20 6:36 AM:
--
Is there a
[
https://issues.apache.org/jira/browse/SPARK-18502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041602#comment-17041602
]
Gan Wei commented on SPARK-18502:
-
Is there a resolution for this issue. I am also encountering the same
[
https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041576#comment-17041576
]
Takeshi Yamamuro commented on SPARK-30893:
--
Yea, I've already seen someone opening PRs for this
[
https://issues.apache.org/jira/browse/SPARK-30880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041570#comment-17041570
]
Hyukjin Kwon commented on SPARK-30880:
--
Fixed in https://github.com/apache/spark/pull/27625
>
[
https://issues.apache.org/jira/browse/SPARK-30880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-30880:
-
Fix Version/s: 3.1.0
> Delete Sphinx Makefile cruft
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-30880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30880.
--
Resolution: Fixed
> Delete Sphinx Makefile cruft
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041567#comment-17041567
]
Wenchen Fan commented on SPARK-30893:
-
My assumption is: after you create a `df`, calling
[
https://issues.apache.org/jira/browse/SPARK-28093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-28093.
-
Fix Version/s: (was: 3.0.0)
Resolution: Won't Fix
> Built-in function
[
https://issues.apache.org/jira/browse/SPARK-28093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041556#comment-17041556
]
Wenchen Fan commented on SPARK-28093:
-
This has been reverted in
[
https://issues.apache.org/jira/browse/SPARK-28093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reopened SPARK-28093:
-
Assignee: (was: Yuming Wang)
> Built-in function trim/ltrim/rtrim has bug when using
[
https://issues.apache.org/jira/browse/SPARK-30914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041464#comment-17041464
]
jiaan.geng commented on SPARK-30914:
I'm working on.
> Arrange version info of UI
>
[
https://issues.apache.org/jira/browse/SPARK-30912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041462#comment-17041462
]
jiaan.geng commented on SPARK-30912:
I'm working on.
> Arrange version info of Streaming.scala
>
[
https://issues.apache.org/jira/browse/SPARK-30911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041461#comment-17041461
]
jiaan.geng commented on SPARK-30911:
I'm working on.
> Arrange version info of Status
>
[
https://issues.apache.org/jira/browse/SPARK-30913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041463#comment-17041463
]
jiaan.geng commented on SPARK-30913:
I'm working on.
> Arrange version info of Tests.scala
>
[
https://issues.apache.org/jira/browse/SPARK-30910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041460#comment-17041460
]
jiaan.geng commented on SPARK-30910:
I'm working on.
> Arrange version info of R
>
[
https://issues.apache.org/jira/browse/SPARK-30909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041459#comment-17041459
]
jiaan.geng commented on SPARK-30909:
I'm working on.
> Arrange version info of Python
>
jiaan.geng created SPARK-30914:
--
Summary: Arrange version info of UI
Key: SPARK-30914
URL: https://issues.apache.org/jira/browse/SPARK-30914
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-30908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041457#comment-17041457
]
jiaan.geng commented on SPARK-30908:
I'm working on.
> Arrange version info of Kryo
>
jiaan.geng created SPARK-30913:
--
Summary: Arrange version info of Tests.scala
Key: SPARK-30913
URL: https://issues.apache.org/jira/browse/SPARK-30913
Project: Spark
Issue Type: Sub-task
jiaan.geng created SPARK-30912:
--
Summary: Arrange version info of Streaming.scala
Key: SPARK-30912
URL: https://issues.apache.org/jira/browse/SPARK-30912
Project: Spark
Issue Type: Sub-task
jiaan.geng created SPARK-30911:
--
Summary: Arrange version info of Status
Key: SPARK-30911
URL: https://issues.apache.org/jira/browse/SPARK-30911
Project: Spark
Issue Type: Sub-task
jiaan.geng created SPARK-30910:
--
Summary: Arrange version info of R
Key: SPARK-30910
URL: https://issues.apache.org/jira/browse/SPARK-30910
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-30908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-30908:
---
Component/s: (was: SQL)
Spark Core
> Arrange version info of Kryo
>
jiaan.geng created SPARK-30909:
--
Summary: Arrange version info of Python
Key: SPARK-30909
URL: https://issues.apache.org/jira/browse/SPARK-30909
Project: Spark
Issue Type: Sub-task
jiaan.geng created SPARK-30908:
--
Summary: Arrange version info of Kryo
Key: SPARK-30908
URL: https://issues.apache.org/jira/browse/SPARK-30908
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-30891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041452#comment-17041452
]
jiaan.geng commented on SPARK-30891:
I'm working on.
> Arrange version info of history
>
[
https://issues.apache.org/jira/browse/SPARK-30889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041451#comment-17041451
]
jiaan.geng commented on SPARK-30889:
I'm working on.
> Arrange version info of worker
>
[
https://issues.apache.org/jira/browse/SPARK-30888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041450#comment-17041450
]
jiaan.geng commented on SPARK-30888:
I'm working on.
> Arrange version info of network
>
[
https://issues.apache.org/jira/browse/SPARK-30841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041447#comment-17041447
]
jiaan.geng commented on SPARK-30841:
I'm working on.
> Display the version of Spark Sql
[
https://issues.apache.org/jira/browse/SPARK-30840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041446#comment-17041446
]
jiaan.geng commented on SPARK-30840:
I'm working on.
> Add version property for ConfigEntry and
[
https://issues.apache.org/jira/browse/SPARK-30887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041448#comment-17041448
]
jiaan.geng commented on SPARK-30887:
I'm working on.
> Arrange version info of deploy
>
[
https://issues.apache.org/jira/browse/SPARK-30907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30907.
--
Fix Version/s: 3.0.0
2.4.6
Resolution: Fixed
Issue resolved by pull
Gengliang Wang created SPARK-30907:
--
Summary: Revise the doc of spark.ui.retainedTasks
Key: SPARK-30907
URL: https://issues.apache.org/jira/browse/SPARK-30907
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-30768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-30768:
Summary: Constraints inferred from inequality attributes (was: Constraints
should be inferred
Wei Xue created SPARK-30906:
---
Summary: Turning off AQE in CacheManager is not thread-safe
Key: SPARK-30906
URL: https://issues.apache.org/jira/browse/SPARK-30906
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-30894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041284#comment-17041284
]
Maxim Gekk commented on SPARK-30894:
I am working on it.
> The behavior of Size function should not
[
https://issues.apache.org/jira/browse/SPARK-30667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-30667:
--
Fix Version/s: (was: 3.0.0)
> Support simple all gather in barrier task context
>
[
https://issues.apache.org/jira/browse/SPARK-30667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng reopened SPARK-30667:
---
> Support simple all gather in barrier task context
>
[
https://issues.apache.org/jira/browse/SPARK-30861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler updated SPARK-30861:
-
Fix Version/s: 3.0.0
> Deprecate constructor of SQLContext and getOrCreate in SQLContext at
[
https://issues.apache.org/jira/browse/SPARK-30861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler resolved SPARK-30861.
--
Resolution: Fixed
> Deprecate constructor of SQLContext and getOrCreate in SQLContext at
[
https://issues.apache.org/jira/browse/SPARK-30861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041268#comment-17041268
]
Bryan Cutler commented on SPARK-30861:
--
Issue resolved by pull request 27614
[
https://issues.apache.org/jira/browse/SPARK-30861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler reassigned SPARK-30861:
Assignee: Hyukjin Kwon
> Deprecate constructor of SQLContext and getOrCreate in
H. Vetinari created SPARK-30905:
---
Summary: Execute the TIMESTAMP roadmap
Key: SPARK-30905
URL: https://issues.apache.org/jira/browse/SPARK-30905
Project: Spark
Issue Type: Task
Christian Stuart created SPARK-30904:
Summary: Thrift RowBasedSet serialization throws
NullPointerException on NULL BigDecimal
Key: SPARK-30904
URL: https://issues.apache.org/jira/browse/SPARK-30904
[
https://issues.apache.org/jira/browse/SPARK-30884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30884.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27641
[
https://issues.apache.org/jira/browse/SPARK-30892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30892:
---
Assignee: Maxim Gekk
> Exclude spark.sql.variable.substitute.depth from removedSQLConfigs
[
https://issues.apache.org/jira/browse/SPARK-30892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30892.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27646
wuyi created SPARK-30903:
Summary: Fail fast on duplicate columns when analyze columns
Key: SPARK-30903
URL: https://issues.apache.org/jira/browse/SPARK-30903
Project: Spark
Issue Type: Improvement
Wenchen Fan created SPARK-30902:
---
Summary: default table provider should be decided by catalog
implementations
Key: SPARK-30902
URL: https://issues.apache.org/jira/browse/SPARK-30902
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DavidXU updated SPARK-30901:
Description:
In Spark documentation :
[
https://issues.apache.org/jira/browse/SPARK-30901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DavidXU updated SPARK-30901:
Description:
In Spark documentation :
[
https://issues.apache.org/jira/browse/SPARK-30901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DavidXU updated SPARK-30901:
Description:
In Spark documentation :
DavidXU created SPARK-30901:
---
Summary: [DOC] In streaming-kinesis-integration.md, the
initialPosition method changed
Key: SPARK-30901
URL: https://issues.apache.org/jira/browse/SPARK-30901
Project: Spark
Jungtaek Lim created SPARK-30900:
Summary: FileStreamSource: Avoid reading compact metadata log
twice if the query stops from compact batch and restarts
Key: SPARK-30900
URL:
[
https://issues.apache.org/jira/browse/SPARK-30858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30858.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27628
[
https://issues.apache.org/jira/browse/SPARK-30858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30858:
---
Assignee: Maxim Gekk
> IntegralDivide's dataType should not depend on SQLConf.get
>
[
https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-30893:
Summary: Expressions should not change its data type/behavior after it's
created (was:
Wenchen Fan created SPARK-30899:
---
Summary: CreateArray/CreateMap's data type should not depend on
SQLConf.get
Key: SPARK-30899
URL: https://issues.apache.org/jira/browse/SPARK-30899
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-30893:
Priority: Critical (was: Blocker)
> Expressions should not change its data
Wenchen Fan created SPARK-30898:
---
Summary: The behavior of MakeDecimal should not depend on
SQLConf.get
Key: SPARK-30898
URL: https://issues.apache.org/jira/browse/SPARK-30898
Project: Spark
Wenchen Fan created SPARK-30897:
---
Summary: The behavior of ArrayExists should not depend on
SQLConf.get
Key: SPARK-30897
URL: https://issues.apache.org/jira/browse/SPARK-30897
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-30894:
Summary: The behavior of Size function should not depend on SQLConf.get
(was: the behavior of
[
https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-30893:
Summary: Expressions should not change its data type/nullability/behavior
after it's created
Wenchen Fan created SPARK-30896:
---
Summary: The behavior of JsonToStructs should not depend on
SQLConf.get
Key: SPARK-30896
URL: https://issues.apache.org/jira/browse/SPARK-30896
Project: Spark
Wenchen Fan created SPARK-30895:
---
Summary: The behavior of CsvToStructs should not depend on
SQLConf.get
Key: SPARK-30895
URL: https://issues.apache.org/jira/browse/SPARK-30895
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-30893:
Summary: expressions should not change its data type/nullability/behavior
after it's created
Wenchen Fan created SPARK-30894:
---
Summary: the behavior of Size operation should not depend on
SQLConf.get
Key: SPARK-30894
URL: https://issues.apache.org/jira/browse/SPARK-30894
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-30858:
Parent: SPARK-30893
Issue Type: Sub-task (was: Bug)
> IntegralDivide's dataType should
Wenchen Fan created SPARK-30893:
---
Summary: expressions should not change its data type/nullability
after it's created
Key: SPARK-30893
URL: https://issues.apache.org/jira/browse/SPARK-30893
Project:
[
https://issues.apache.org/jira/browse/SPARK-30892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-30892:
---
Description: The spark.sql.variable.substitute.depth SQL config is not used
since Spark 2.4
[
https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040868#comment-17040868
]
Jackey Lee commented on SPARK-30868:
Can't agree more. It is up to the user to choose how to handle
Maxim Gekk created SPARK-30892:
--
Summary: Exclude spark.sql.variable.substitute.depth from
removedSQLConfigs
Key: SPARK-30892
URL: https://issues.apache.org/jira/browse/SPARK-30892
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040853#comment-17040853
]
Wenchen Fan commented on SPARK-26836:
-
cc [~Gengliang.Wang]
> Columns get switched in Spark SQL
[
https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040848#comment-17040848
]
Wenchen Fan commented on SPARK-28024:
-
these are the behaviors of Java:
{code}
scala>
[
https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040834#comment-17040834
]
Ankit Raj Boudh edited comment on SPARK-30868 at 2/20/20 10:45 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-30878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30878.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27638
[
https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040834#comment-17040834
]
Ankit Raj Boudh commented on SPARK-30868:
-
According to me user should handle Exception
[
https://issues.apache.org/jira/browse/SPARK-30883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
deshanxiao updated SPARK-30883:
---
Environment: The java api *setWritable,setReadable and setExecutable*
dosen't work well because
[
https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040822#comment-17040822
]
Jackey Lee commented on SPARK-30868:
So your opinion is to return normal results even if the
[
https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040803#comment-17040803
]
Ankit Raj Boudh edited comment on SPARK-30868 at 2/20/20 9:44 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040803#comment-17040803
]
Ankit Raj Boudh edited comment on SPARK-30868 at 2/20/20 9:43 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040803#comment-17040803
]
Ankit Raj Boudh commented on SPARK-30868:
-
[~srowen] and [~cloud_fan] please give your
[
https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040795#comment-17040795
]
Ankit Raj Boudh commented on SPARK-30868:
-
no i have not created any jira.
> Throw Exception if
[
https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jackey Lee updated SPARK-30868:
---
Description:
At present, HiveClientImpl.runHive will not throw an exception when it runs
[
https://issues.apache.org/jira/browse/SPARK-30881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-30881.
Resolution: Fixed
The issue is resolved in https://github.com/apache/spark/pull/27639
>
92 matches
Mail list logo
