[jira] [Updated] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen

[ https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24957: -- Affects Version/s: 2.0.2 > Decimal arithmetic can lead to wrong values using codegen > ---

[jira] [Updated] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen

[ https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24957: -- Affects Version/s: 2.1.3 2.2.2 > Decimal arithmetic can lead to wrong v

[jira] [Updated] (SPARK-30982) List All the removed APIs of Spark SQL and Core

[ https://issues.apache.org/jira/browse/SPARK-30982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-30982: - Attachment: removed_hive_class hive_signature.diff added_hive_cla

[jira] [Updated] (SPARK-22951) count() after dropDuplicates() on emptyDataFrame returns incorrect value

[ https://issues.apache.org/jira/browse/SPARK-22951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22951: -- Affects Version/s: 2.1.3 > count() after dropDuplicates() on emptyDataFrame returns incorrect

[jira] [Commented] (SPARK-30532) DataFrameStatFunctions.approxQuantile doesn't work with TABLE.COLUMN syntax

[ https://issues.apache.org/jira/browse/SPARK-30532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048839#comment-17048839 ] Oleksii Kachaiev commented on SPARK-30532: -- The same applies to other stats fun

[jira] [Created] (SPARK-31005) Support time zone ids in casting strings to timestamps

Maxim Gekk created SPARK-31005: -- Summary: Support time zone ids in casting strings to timestamps Key: SPARK-31005 URL: https://issues.apache.org/jira/browse/SPARK-31005 Project: Spark Issue Type

[jira] [Assigned] (SPARK-30912) Add version information to the configuration of Streaming.scala

[ https://issues.apache.org/jira/browse/SPARK-30912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30912: Assignee: jiaan.geng > Add version information to the configuration of Streaming.scala >

[jira] [Resolved] (SPARK-30912) Add version information to the configuration of Streaming.scala

[ https://issues.apache.org/jira/browse/SPARK-30912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30912. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27745 [https://gi

[jira] [Resolved] (SPARK-30891) Add version information to the configuration of History

[ https://issues.apache.org/jira/browse/SPARK-30891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30891. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27751 [https://gi

[jira] [Assigned] (SPARK-30891) Add version information to the configuration of History

[ https://issues.apache.org/jira/browse/SPARK-30891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30891: Assignee: jiaan.geng > Add version information to the configuration of History >

[jira] [Assigned] (SPARK-30908) Add version information to the configuration of Kryo

[ https://issues.apache.org/jira/browse/SPARK-30908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30908: Assignee: jiaan.geng > Add version information to the configuration of Kryo > ---

[jira] [Resolved] (SPARK-30908) Add version information to the configuration of Kryo

[ https://issues.apache.org/jira/browse/SPARK-30908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30908. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27734 [https://gi

[jira] [Updated] (SPARK-30982) List All the removed APIs of Spark SQL and Core

[ https://issues.apache.org/jira/browse/SPARK-30982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-30982: - Attachment: removed_core_class > List All the removed APIs of Spark SQL and Core > -

[jira] [Updated] (SPARK-30982) List All the removed APIs of Spark SQL and Core

[ https://issues.apache.org/jira/browse/SPARK-30982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-30982: - Attachment: removed_sql_class > List All the removed APIs of Spark SQL and Core > --

[jira] [Updated] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25206: -- Affects Version/s: 2.2.0 > wrong records are returned when Hive metastore schema and parquet s

[jira] [Comment Edited] (SPARK-30990) Binary incompatibility changes

[ https://issues.apache.org/jira/browse/SPARK-30990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047953#comment-17047953 ] Huaxin Gao edited comment on SPARK-30990 at 3/2/20 5:03 AM:

[jira] [Comment Edited] (SPARK-30990) Binary incompatibility changes

[ https://issues.apache.org/jira/browse/SPARK-30990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047953#comment-17047953 ] Huaxin Gao edited comment on SPARK-30990 at 3/2/20 4:38 AM:

[jira] [Commented] (SPARK-29969) parse_url function result in incorrect result

[ https://issues.apache.org/jira/browse/SPARK-29969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048784#comment-17048784 ] Hyukjin Kwon commented on SPARK-29969: -- +1. Thanks [~younggyuchun]. > parse_url fu

[jira] [Commented] (SPARK-25694) URL.setURLStreamHandlerFactory causing incompatible HttpURLConnection issue

[ https://issues.apache.org/jira/browse/SPARK-25694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048754#comment-17048754 ] holmes.infra commented on SPARK-25694: -- i have a question than why FsUrlStreamHandl

[jira] [Created] (SPARK-31004) Show message for empty Streaming Queries instead of empty timelines and histograms.

Kousuke Saruta created SPARK-31004: -- Summary: Show message for empty Streaming Queries instead of empty timelines and histograms. Key: SPARK-31004 URL: https://issues.apache.org/jira/browse/SPARK-31004

[jira] [Created] (SPARK-31003) Fix incorrect use of assume() in tests

Josh Rosen created SPARK-31003: -- Summary: Fix incorrect use of assume() in tests Key: SPARK-31003 URL: https://issues.apache.org/jira/browse/SPARK-31003 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-29969) parse_url function result in incorrect result

[ https://issues.apache.org/jira/browse/SPARK-29969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048729#comment-17048729 ] Victor Zhang commented on SPARK-29969: -- [~younggyuchun] Thank you! Nice work. > pa

[jira] [Commented] (SPARK-29701) Different answers when empty input given in GROUPING SETS

[ https://issues.apache.org/jira/browse/SPARK-29701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048728#comment-17048728 ] Takeshi Yamamuro commented on SPARK-29701: -- Yea, never mind. I don't have a sma

[jira] [Updated] (SPARK-29701) Different answers when empty input given in GROUPING SETS

[ https://issues.apache.org/jira/browse/SPARK-29701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29701: - Priority: Critical (was: Blocker) > Different answers when empty input given in GROUPING SETS >

[jira] [Commented] (SPARK-29701) Different answers when empty input given in GROUPING SETS

[ https://issues.apache.org/jira/browse/SPARK-29701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048727#comment-17048727 ] Hyukjin Kwon commented on SPARK-29701: -- [~maropu] Let me lower the priority (given

[jira] [Resolved] (SPARK-30995) Latex doesn't work correctly in FMClassifier/FMRegressor Scala doc

[ https://issues.apache.org/jira/browse/SPARK-30995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30995. -- Fix Version/s: 3.0.0 Resolution: Fixed Fixed in https://github.com/apache/spark/pull/27

[jira] [Resolved] (SPARK-30988) Add more edge-case exercising values to stats tests

[ https://issues.apache.org/jira/browse/SPARK-30988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30988. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/27741 > Add more edge-case ex

[jira] [Updated] (SPARK-30988) Add more edge-case exercising values to stats tests

[ https://issues.apache.org/jira/browse/SPARK-30988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30988: - Fix Version/s: 3.1.0 > Add more edge-case exercising values to stats tests > ---

[jira] [Updated] (SPARK-29419) Seq.toDS / spark.createDataset(Seq) is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-29419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29419: -- Affects Version/s: 2.0.2 > Seq.toDS / spark.createDataset(Seq) is not thread-safe > --

[jira] [Resolved] (SPARK-29419) Seq.toDS / spark.createDataset(Seq) is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-29419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29419. -- Fix Version/s: 2.4.6 3.0.0 Resolution: Fixed Fixed in https://github

[jira] [Updated] (SPARK-29419) Seq.toDS / spark.createDataset(Seq) is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-29419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29419: -- Affects Version/s: 2.1.3 > Seq.toDS / spark.createDataset(Seq) is not thread-safe > --

[jira] [Updated] (SPARK-29419) Seq.toDS / spark.createDataset(Seq) is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-29419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29419: -- Affects Version/s: 2.2.3 > Seq.toDS / spark.createDataset(Seq) is not thread-safe > --

[jira] [Updated] (SPARK-29419) Seq.toDS / spark.createDataset(Seq) is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-29419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29419: -- Affects Version/s: 2.3.4 > Seq.toDS / spark.createDataset(Seq) is not thread-safe > --

[jira] [Updated] (SPARK-29419) Seq.toDS / spark.createDataset(Seq) is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-29419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29419: - Target Version/s: 3.0.0 > Seq.toDS / spark.createDataset(Seq) is not thread-safe > -

[jira] [Updated] (SPARK-29419) Seq.toDS / spark.createDataset(Seq) is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-29419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29419: - Priority: Blocker (was: Critical) > Seq.toDS / spark.createDataset(Seq) is not thread-safe > --

[jira] [Commented] (SPARK-29969) parse_url function result in incorrect result

[ https://issues.apache.org/jira/browse/SPARK-29969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048716#comment-17048716 ] Dongjoon Hyun commented on SPARK-29969: --- +1 for [~younggyuchun] analysis. > parse

[jira] [Updated] (SPARK-29419) Seq.toDS / spark.createDataset(Seq) is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-29419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29419: - Target Version/s: (was: 3.0.0) > Seq.toDS / spark.createDataset(Seq) is not thread-safe >

[jira] [Updated] (SPARK-29419) Seq.toDS / spark.createDataset(Seq) is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-29419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29419: - Priority: Critical (was: Blocker) > Seq.toDS / spark.createDataset(Seq) is not thread-safe > --

[jira] [Updated] (SPARK-31002) Add version information to the configuration of Core

[ https://issues.apache.org/jira/browse/SPARK-31002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-31002: --- Description: core/src/main/scala/org/apache/spark/internal/config/package.scala > Add version infor

[jira] [Created] (SPARK-31002) Add version information to the configuration of Core

jiaan.geng created SPARK-31002: -- Summary: Add version information to the configuration of Core Key: SPARK-31002 URL: https://issues.apache.org/jira/browse/SPARK-31002 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30993) GenerateUnsafeRowJoiner corrupts the value if the datatype is UDF and its sql type has fixed length

[ https://issues.apache.org/jira/browse/SPARK-30993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048713#comment-17048713 ] Dongjoon Hyun commented on SPARK-30993: --- Thank you, [~kabhwan]! > GenerateUnsafeR

[jira] [Updated] (SPARK-30986) Structured Streaming: mapGroupsWithState UDT serialization does not work

[ https://issues.apache.org/jira/browse/SPARK-30986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30986: -- Labels: correctness (was: ) > Structured Streaming: mapGroupsWithState UDT serialization does

[jira] [Commented] (SPARK-30986) Structured Streaming: mapGroupsWithState UDT serialization does not work

[ https://issues.apache.org/jira/browse/SPARK-30986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048712#comment-17048712 ] Dongjoon Hyun commented on SPARK-30986: --- Thank you for reporting, [~bryan.jeff...@

[jira] [Resolved] (SPARK-30982) List All the removed APIs of Spark SQL and Core

[ https://issues.apache.org/jira/browse/SPARK-30982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30982. - Resolution: Fixed > List All the removed APIs of Spark SQL and Core > --

[jira] [Created] (SPARK-31001) Add ability to create a partitioned table via catalog.createTable()

Nicholas Chammas created SPARK-31001: Summary: Add ability to create a partitioned table via catalog.createTable() Key: SPARK-31001 URL: https://issues.apache.org/jira/browse/SPARK-31001 Project:

[jira] [Created] (SPARK-31000) Add ability to set table description in the catalog

Nicholas Chammas created SPARK-31000: Summary: Add ability to set table description in the catalog Key: SPARK-31000 URL: https://issues.apache.org/jira/browse/SPARK-31000 Project: Spark I

[jira] [Commented] (SPARK-24617) Spark driver not requesting another executor once original executor exits due to 'lost worker'

[ https://issues.apache.org/jira/browse/SPARK-24617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048627#comment-17048627 ] t oo commented on SPARK-24617: -- same problem in spark 2.3.4 > Spark driver not requesting

[jira] [Created] (SPARK-30999) Don't cancel a QueryStageExec when it's already finished

wuyi created SPARK-30999: Summary: Don't cancel a QueryStageExec when it's already finished Key: SPARK-30999 URL: https://issues.apache.org/jira/browse/SPARK-30999 Project: Spark Issue Type: Improvem