[jira] [Resolved] (SPARK-30904) Thrift RowBasedSet serialization throws NullPointerException on NULL BigDecimal

[ https://issues.apache.org/jira/browse/SPARK-30904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-30904. - Fix Version/s: 3.1.0 3.0.0 Resolution: Fixed > Thrift RowBasedSet

[jira] [Assigned] (SPARK-30904) Thrift RowBasedSet serialization throws NullPointerException on NULL BigDecimal

[ https://issues.apache.org/jira/browse/SPARK-30904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-30904: --- Assignee: Christian Stuart > Thrift RowBasedSet serialization throws NullPointerException

[jira] [Commented] (SPARK-30904) Thrift RowBasedSet serialization throws NullPointerException on NULL BigDecimal

[ https://issues.apache.org/jira/browse/SPARK-30904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042370#comment-17042370 ] Yuming Wang commented on SPARK-30904: - Issue resolved by pull request 27654

[jira] [Updated] (SPARK-30888) Add version information to the configuration of Network

[ https://issues.apache.org/jira/browse/SPARK-30888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30888: --- Summary: Add version information to the configuration of Network (was: Arrange version info of

[jira] [Commented] (SPARK-30923) Spark MLlib, GraphX 2.4 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-30923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042362#comment-17042362 ] Xiao Li commented on SPARK-30923: - cc [~ruifengz] Could you lead this effort and open the subtasks? >

[jira] [Updated] (SPARK-30923) Spark MLlib, GraphX 2.4 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-30923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30923: Component/s: ML Documentation > Spark MLlib, GraphX 2.4 QA umbrella >

[jira] [Created] (SPARK-30923) Spark MLlib, GraphX 2.4 QA umbrella

Xiao Li created SPARK-30923: --- Summary: Spark MLlib, GraphX 2.4 QA umbrella Key: SPARK-30923 URL: https://issues.apache.org/jira/browse/SPARK-30923 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-30922) Remove the max split config after changing the multi sub joins to multi sub partitions

Ke Jia created SPARK-30922: -- Summary: Remove the max split config after changing the multi sub joins to multi sub partitions Key: SPARK-30922 URL: https://issues.apache.org/jira/browse/SPARK-30922 Project:

[jira] [Assigned] (SPARK-30840) Add version property for ConfigEntry and ConfigBuilder

[ https://issues.apache.org/jira/browse/SPARK-30840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30840: Assignee: jiaan.geng > Add version property for ConfigEntry and ConfigBuilder >

[jira] [Resolved] (SPARK-30840) Add version property for ConfigEntry and ConfigBuilder

[ https://issues.apache.org/jira/browse/SPARK-30840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30840. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27592

[jira] [Updated] (SPARK-30921) Error using VectorAssembler after Pandas GROUPED_AGG UDF

[ https://issues.apache.org/jira/browse/SPARK-30921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Kellogg updated SPARK-30921: Attachment: test_dyn_pandas_function.py > Error using VectorAssembler after Pandas GROUPED_AGG

[jira] [Created] (SPARK-30921) Error using VectorAssembler after Pandas GROUPED_AGG UDF

Tim Kellogg created SPARK-30921: --- Summary: Error using VectorAssembler after Pandas GROUPED_AGG UDF Key: SPARK-30921 URL: https://issues.apache.org/jira/browse/SPARK-30921 Project: Spark Issue

[jira] [Created] (SPARK-30920) DSv2 Predicate Framework

DB Tsai created SPARK-30920: --- Summary: DSv2 Predicate Framework Key: SPARK-30920 URL: https://issues.apache.org/jira/browse/SPARK-30920 Project: Spark Issue Type: New Feature Components:

[jira] [Comment Edited] (SPARK-30869) Convert dates to/from timestamps in microseconds precision

[ https://issues.apache.org/jira/browse/SPARK-30869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042102#comment-17042102 ] YoungGyu Chun edited comment on SPARK-30869 at 2/21/20 6:56 PM: I closed

[jira] [Commented] (SPARK-30869) Convert dates to/from timestamps in microseconds precision

[ https://issues.apache.org/jira/browse/SPARK-30869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042102#comment-17042102 ] YoungGyu Chun commented on SPARK-30869: --- I closed Pull Request

[jira] [Created] (SPARK-30919) Make interval multiply and divide's overflow behavior consisitent with other interval operations

Kent Yao created SPARK-30919: Summary: Make interval multiply and divide's overflow behavior consisitent with other interval operations Key: SPARK-30919 URL: https://issues.apache.org/jira/browse/SPARK-30919

[jira] [Resolved] (SPARK-30764) Improve the readability of EXPLAIN FORMATTED style

[ https://issues.apache.org/jira/browse/SPARK-30764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30764. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27509

[jira] [Assigned] (SPARK-30764) Improve the readability of EXPLAIN FORMATTED style

[ https://issues.apache.org/jira/browse/SPARK-30764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30764: --- Assignee: Xin Wu > Improve the readability of EXPLAIN FORMATTED style >

[jira] [Resolved] (SPARK-30906) Turning off AQE in CacheManager is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-30906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30906. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27659

[jira] [Assigned] (SPARK-30906) Turning off AQE in CacheManager is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-30906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30906: --- Assignee: Wei Xue > Turning off AQE in CacheManager is not thread-safe >

[jira] [Commented] (SPARK-30893) Expressions should not change its data type/behavior after it's created

[ https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041903#comment-17041903 ] Takeshi Yamamuro commented on SPARK-30893: -- Ah, I see. As for the second case, I think we need

[jira] [Resolved] (SPARK-24000) S3A: Create Table should fail on invalid AK/SK

[ https://issues.apache.org/jira/browse/SPARK-24000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SPARK-24000. Resolution: Done closing as done but not giving a spark version, as it just depends on

[jira] [Commented] (SPARK-24000) S3A: Create Table should fail on invalid AK/SK

[ https://issues.apache.org/jira/browse/SPARK-24000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041894#comment-17041894 ] Steve Loughran commented on SPARK-24000: HADOOP-16711 fixes this by moving to the v2 API which

[jira] [Created] (SPARK-30918) improve the splitting of skewed partitions

Wenchen Fan created SPARK-30918: --- Summary: improve the splitting of skewed partitions Key: SPARK-30918 URL: https://issues.apache.org/jira/browse/SPARK-30918 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30887) Add version information to the configuration of Deploy

[ https://issues.apache.org/jira/browse/SPARK-30887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30887: --- Summary: Add version information to the configuration of Deploy (was: Arrange version info of

[jira] [Commented] (SPARK-30917) The behaviour of UnaryMinus should not depend on SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-30917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041774#comment-17041774 ] Rakesh Raushan commented on SPARK-30917: I am working on this. > The behaviour of UnaryMinus

[jira] [Created] (SPARK-30917) The behaviour of UnaryMinus should not depend on SQLConf.get

Rakesh Raushan created SPARK-30917: -- Summary: The behaviour of UnaryMinus should not depend on SQLConf.get Key: SPARK-30917 URL: https://issues.apache.org/jira/browse/SPARK-30917 Project: Spark

[jira] [Assigned] (SPARK-30809) Review and fix issues in SQL API docs

[ https://issues.apache.org/jira/browse/SPARK-30809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30809: --- Assignee: Yuanjian Li > Review and fix issues in SQL API docs >

[jira] [Resolved] (SPARK-30809) Review and fix issues in SQL API docs

[ https://issues.apache.org/jira/browse/SPARK-30809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30809. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27560

[jira] [Commented] (SPARK-30868) Throw Exception if runHive(sql) failed

[ https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041727#comment-17041727 ] Ankit Raj Boudh commented on SPARK-30868: - [~Jackey Lee], your point is correct , Thank you for

[jira] [Issue Comment Deleted] (SPARK-30896) The behavior of JsonToStructs should not depend on SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-30896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-30896: --- Comment: was deleted (was: I am working on this.) > The behavior of JsonToStructs should

[jira] [Commented] (SPARK-30896) The behavior of JsonToStructs should not depend on SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-30896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041682#comment-17041682 ] Rakesh Raushan commented on SPARK-30896: I am working on this. > The behavior of JsonToStructs

[jira] [Updated] (SPARK-30916) Dead Lock when Loading BLAS Class

[ https://issues.apache.org/jira/browse/SPARK-30916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingda Jia updated SPARK-30916: --- Description: When using transactions including aggregation and treeAggregation, and the seqOp and

[jira] [Updated] (SPARK-30916) Dead Lock when Loading BLAS Class

[ https://issues.apache.org/jira/browse/SPARK-30916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingda Jia updated SPARK-30916: --- Description: When using transactions including aggregation and treeAggregation, and the seqOp and

[jira] [Updated] (SPARK-30916) Dead Lock when Loading BLAS Class

[ https://issues.apache.org/jira/browse/SPARK-30916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingda Jia updated SPARK-30916: --- Description: When using transactions including aggregation and treeAggregation, and the seqOp and

[jira] [Updated] (SPARK-30916) Dead Lock when Loading BLAS Class

[ https://issues.apache.org/jira/browse/SPARK-30916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingda Jia updated SPARK-30916: --- Attachment: image-2020-02-21-16-31-19-880.png > Dead Lock when Loading BLAS Class >

[jira] [Updated] (SPARK-30916) Dead Lock when Loading BLAS Class

[ https://issues.apache.org/jira/browse/SPARK-30916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingda Jia updated SPARK-30916: --- Description: When using transactions including aggregation and treeAggregation, and the seqOp and

[jira] [Updated] (SPARK-30916) Dead Lock when Loading BLAS Class

[ https://issues.apache.org/jira/browse/SPARK-30916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingda Jia updated SPARK-30916: --- Attachment: image-2020-02-21-16-31-34-274.png > Dead Lock when Loading BLAS Class >

[jira] [Updated] (SPARK-30916) Dead Lock when Loading BLAS Class

[ https://issues.apache.org/jira/browse/SPARK-30916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingda Jia updated SPARK-30916: --- Attachment: image-2020-02-21-16-30-35-652.png > Dead Lock when Loading BLAS Class >

[jira] [Updated] (SPARK-30916) Dead Lock when Loading BLAS Class

[ https://issues.apache.org/jira/browse/SPARK-30916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingda Jia updated SPARK-30916: --- Attachment: image-2020-02-21-16-30-45-553.png > Dead Lock when Loading BLAS Class >

[jira] [Created] (SPARK-30916) Dead Lock when Loading BLAS Class

Mingda Jia created SPARK-30916: -- Summary: Dead Lock when Loading BLAS Class Key: SPARK-30916 URL: https://issues.apache.org/jira/browse/SPARK-30916 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-30894) The nullability of Size function should not depend on SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-30894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30894. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27658

[jira] [Assigned] (SPARK-30894) The nullability of Size function should not depend on SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-30894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30894: --- Assignee: Maxim Gekk > The nullability of Size function should not depend on SQLConf.get >

[jira] [Created] (SPARK-30915) FileStreamSinkLog: Avoid reading the metadata log file when finding the latest batch ID

Jungtaek Lim created SPARK-30915: Summary: FileStreamSinkLog: Avoid reading the metadata log file when finding the latest batch ID Key: SPARK-30915 URL: https://issues.apache.org/jira/browse/SPARK-30915