[jira] [Commented] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269964#comment-17269964 ] Apache Spark commented on SPARK-33813: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269963#comment-17269963 ] Apache Spark commented on SPARK-33813: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269962#comment-17269962 ] Apache Spark commented on SPARK-33813: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269961#comment-17269961 ] Apache Spark commented on SPARK-33813: -- User 'sarutak' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33933) Broadcast timeout happened unexpectedly in AQE

2021-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33933. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31269

[jira] [Commented] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269834#comment-17269834 ] Apache Spark commented on SPARK-33813: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-34200) ambiguous column reference should consider attribute availability

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269802#comment-17269802 ] Apache Spark commented on SPARK-34200: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-34200) ambiguous column reference should consider attribute availability

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269800#comment-17269800 ] Apache Spark commented on SPARK-34200: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34200) ambiguous column reference should consider attribute availability

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34200: Assignee: Apache Spark (was: Wenchen Fan) > ambiguous column reference should consider

[jira] [Assigned] (SPARK-34200) ambiguous column reference should consider attribute availability

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34200: Assignee: Wenchen Fan (was: Apache Spark) > ambiguous column reference should consider

[jira] [Created] (SPARK-34200) ambiguous column reference should consider attribute availability

2021-01-21 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-34200: --- Summary: ambiguous column reference should consider attribute availability Key: SPARK-34200 URL: https://issues.apache.org/jira/browse/SPARK-34200 Project: Spark

[jira] [Resolved] (SPARK-33245) Add built-in UDF - GETBIT

2021-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33245. - Fix Version/s: 3.2.0 Resolution: Fixed > Add built-in UDF - GETBIT >

[jira] [Reopened] (SPARK-33245) Add built-in UDF - GETBIT

2021-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-33245: - > Add built-in UDF - GETBIT > -- > > Key: SPARK-33245 >

[jira] [Commented] (SPARK-34199) Block `count(table.*)` to follow ANSI standard and other SQL engines

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269791#comment-17269791 ] Apache Spark commented on SPARK-34199: -- User 'linhongliu-db' has created a pull request for this

[jira] [Assigned] (SPARK-34199) Block `count(table.*)` to follow ANSI standard and other SQL engines

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34199: Assignee: Apache Spark > Block `count(table.*)` to follow ANSI standard and other SQL

[jira] [Assigned] (SPARK-34199) Block `count(table.*)` to follow ANSI standard and other SQL engines

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34199: Assignee: (was: Apache Spark) > Block `count(table.*)` to follow ANSI standard and

[jira] [Assigned] (SPARK-33245) Add built-in UDF - GETBIT

2021-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33245: --- Assignee: jiaan.geng > Add built-in UDF - GETBIT > -- > >

[jira] [Assigned] (SPARK-33541) Group exception messages in catalyst/expressions

2021-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33541: --- Assignee: jiaan.geng > Group exception messages in catalyst/expressions >

[jira] [Resolved] (SPARK-33541) Group exception messages in catalyst/expressions

2021-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33541. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31228

[jira] [Resolved] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33813. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31283

[jira] [Assigned] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33813: --- Assignee: Kousuke Saruta > JDBC datasource fails when reading spatial datatypes with the

[jira] [Resolved] (SPARK-34180) Fix the regression brought by SPARK-33888 for PostgresDialect

2021-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34180. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31262

[jira] [Created] (SPARK-34199) Block `count(table.*)` to follow ANSI standard and other SQL engines

2021-01-21 Thread Linhong Liu (Jira)
Linhong Liu created SPARK-34199: --- Summary: Block `count(table.*)` to follow ANSI standard and other SQL engines Key: SPARK-34199 URL: https://issues.apache.org/jira/browse/SPARK-34199 Project: Spark

[jira] [Commented] (SPARK-33489) Support null for conversion from and to Arrow type

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269744#comment-17269744 ] Apache Spark commented on SPARK-33489: -- User 'ueshin' has created a pull request for this issue:

[jira] [Updated] (SPARK-34148) Move general StateStore tests to StateStoreSuiteBase

2021-01-21 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-34148: Parent: SPARK-34198 Issue Type: Sub-task (was: Test) > Move general StateStore tests to

[jira] [Resolved] (SPARK-34148) Move general StateStore tests to StateStoreSuiteBase

2021-01-21 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34148. - Resolution: Resolved > Move general StateStore tests to StateStoreSuiteBase >

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

2021-01-21 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269737#comment-17269737 ] L. C. Hsieh commented on SPARK-34198: - cc [~dbtsai][~dongjoon][~hyukjin.kwon] > Add RocksDB

[jira] [Updated] (SPARK-34198) Add RocksDB StateStore as external module

2021-01-21 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-34198: Issue Type: New Feature (was: Bug) > Add RocksDB StateStore as external module >

[jira] [Created] (SPARK-34198) Add RocksDB StateStore as external module

2021-01-21 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-34198: --- Summary: Add RocksDB StateStore as external module Key: SPARK-34198 URL: https://issues.apache.org/jira/browse/SPARK-34198 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-34167) Reading parquet with Decimal(8,2) written as a Decimal64 blows up

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269726#comment-17269726 ] Apache Spark commented on SPARK-34167: -- User 'razajafri' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34167) Reading parquet with Decimal(8,2) written as a Decimal64 blows up

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34167: Assignee: (was: Apache Spark) > Reading parquet with Decimal(8,2) written as a

[jira] [Commented] (SPARK-34167) Reading parquet with Decimal(8,2) written as a Decimal64 blows up

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269725#comment-17269725 ] Apache Spark commented on SPARK-34167: -- User 'razajafri' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34167) Reading parquet with Decimal(8,2) written as a Decimal64 blows up

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34167: Assignee: Apache Spark > Reading parquet with Decimal(8,2) written as a Decimal64 blows

[jira] [Comment Edited] (SPARK-7768) Make user-defined type (UDT) API public

2021-01-21 Thread Patrick Grandjean (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269707#comment-17269707 ] Patrick Grandjean edited comment on SPARK-7768 at 1/21/21, 11:44 PM: -

[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

2021-01-21 Thread Patrick Grandjean (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269707#comment-17269707 ] Patrick Grandjean commented on SPARK-7768: -- Sorry, but it is frustrating to see this ticket

[jira] [Updated] (SPARK-34195) Base value for parsing two-digit year should be made configurable

2021-01-21 Thread Anthony Smart (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Smart updated SPARK-34195: -- Description: The base value is set as 2000 within spark for parsing a two-digit year date

[jira] [Commented] (SPARK-34197) refreshTable() should not invalidate the relation cache for temporary views

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269617#comment-17269617 ] Apache Spark commented on SPARK-34197: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34197) refreshTable() should not invalidate the relation cache for temporary views

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34197: Assignee: (was: Apache Spark) > refreshTable() should not invalidate the relation

[jira] [Commented] (SPARK-34197) refreshTable() should not invalidate the relation cache for temporary views

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269616#comment-17269616 ] Apache Spark commented on SPARK-34197: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34197) refreshTable() should not invalidate the relation cache for temporary views

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34197: Assignee: Apache Spark > refreshTable() should not invalidate the relation cache for

[jira] [Created] (SPARK-34197) refreshTable() should not invalidate the relation cache for temporary views

2021-01-21 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34197: -- Summary: refreshTable() should not invalidate the relation cache for temporary views Key: SPARK-34197 URL: https://issues.apache.org/jira/browse/SPARK-34197 Project:

[jira] [Created] (SPARK-34196) Improve error message when folks try and install in Python 2

2021-01-21 Thread Holden Karau (Jira)
Holden Karau created SPARK-34196: Summary: Improve error message when folks try and install in Python 2 Key: SPARK-34196 URL: https://issues.apache.org/jira/browse/SPARK-34196 Project: Spark

[jira] [Updated] (SPARK-34193) Potential race condition during decommissioning with TorrentBroadcast

2021-01-21 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-34193: - Issue Type: Bug (was: Improvement) > Potential race condition during decommissioning with

[jira] [Updated] (SPARK-34195) Base value for parsing two-digit year should be made configurable

2021-01-21 Thread Anthony Smart (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Smart updated SPARK-34195: -- Description: The base value is set as 2000 within spark for parsing a two-digit year date

[jira] [Created] (SPARK-34195) Base value for parsing two-digit year should be made configurable

2021-01-21 Thread Anthony Smart (Jira)
Anthony Smart created SPARK-34195: - Summary: Base value for parsing two-digit year should be made configurable Key: SPARK-34195 URL: https://issues.apache.org/jira/browse/SPARK-34195 Project: Spark

[jira] [Commented] (SPARK-12890) Spark SQL query related to only partition fields should not scan the whole data.

2021-01-21 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269571#comment-17269571 ] Nicholas Chammas commented on SPARK-12890: -- I've created SPARK-34194 and fleshed out the

[jira] [Created] (SPARK-34194) Queries that only touch partition columns shouldn't scan through all files

2021-01-21 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-34194: Summary: Queries that only touch partition columns shouldn't scan through all files Key: SPARK-34194 URL: https://issues.apache.org/jira/browse/SPARK-34194

[jira] [Commented] (SPARK-34193) Potential race condition during decommissioning with TorrentBroadcast

2021-01-21 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269565#comment-17269565 ] Holden Karau commented on SPARK-34193: -- Note, so far I've only triggered this once and in the back

[jira] [Created] (SPARK-34193) Potential race condition during decommissioning with TorrentBroadcast

2021-01-21 Thread Holden Karau (Jira)
Holden Karau created SPARK-34193: Summary: Potential race condition during decommissioning with TorrentBroadcast Key: SPARK-34193 URL: https://issues.apache.org/jira/browse/SPARK-34193 Project: Spark

[jira] [Commented] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269404#comment-17269404 ] Apache Spark commented on SPARK-33813: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33813: Assignee: (was: Apache Spark) > JDBC datasource fails when reading spatial datatypes

[jira] [Assigned] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33813: Assignee: Apache Spark > JDBC datasource fails when reading spatial datatypes with the

[jira] [Commented] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269403#comment-17269403 ] Apache Spark commented on SPARK-33813: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-34191) udf type hint should allow dectorator with named returnType

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269364#comment-17269364 ] Apache Spark commented on SPARK-34191: -- User 'pgrz' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34191) udf type hint should allow dectorator with named returnType

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34191: Assignee: Apache Spark > udf type hint should allow dectorator with named returnType >

[jira] [Assigned] (SPARK-34191) udf type hint should allow dectorator with named returnType

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34191: Assignee: (was: Apache Spark) > udf type hint should allow dectorator with named

[jira] [Assigned] (SPARK-34192) Move char padding to write side

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34192: Assignee: (was: Apache Spark) > Move char padding to write side >

[jira] [Commented] (SPARK-34192) Move char padding to write side

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269335#comment-17269335 ] Apache Spark commented on SPARK-34192: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34192) Move char padding to write side

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34192: Assignee: Apache Spark > Move char padding to write side >

[jira] [Created] (SPARK-34192) Move char padding to write side

2021-01-21 Thread Kent Yao (Jira)
Kent Yao created SPARK-34192: Summary: Move char padding to write side Key: SPARK-34192 URL: https://issues.apache.org/jira/browse/SPARK-34192 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-34094) Extends StringTranslate to support unicode characters whose code point >= U+10000

2021-01-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34094. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31164

[jira] [Created] (SPARK-34191) udf type hint should allow dectorator with named returnType

2021-01-21 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-34191: -- Summary: udf type hint should allow dectorator with named returnType Key: SPARK-34191 URL: https://issues.apache.org/jira/browse/SPARK-34191 Project:

[jira] [Updated] (SPARK-34190) Supplement the description for Python Package Management

2021-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34190: - Parent: SPARK-31851 Issue Type: Sub-task (was: Documentation) > Supplement the

[jira] [Assigned] (SPARK-34190) Supplement the description for Python Package Management

2021-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34190: Assignee: Haejoon Lee > Supplement the description for Python Package Management >

[jira] [Resolved] (SPARK-34190) Supplement the description for Python Package Management

2021-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34190. -- Fix Version/s: 3.1.2 Resolution: Fixed Issue resolved by pull request 31280

[jira] [Updated] (SPARK-34190) Supplement the description for Python Package Management

2021-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34190: - Affects Version/s: (was: 3.0.1) 3.1.0 > Supplement the description

[jira] [Assigned] (SPARK-34138) Keep dependants cached while refreshing v1 tables

2021-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34138: --- Assignee: Maxim Gekk > Keep dependants cached while refreshing v1 tables >

[jira] [Resolved] (SPARK-34138) Keep dependants cached while refreshing v1 tables

2021-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34138. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31206

[jira] [Commented] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269271#comment-17269271 ] Kousuke Saruta commented on SPARK-33813: [~cloud_fan] O.K, I'll try it. > JDBC datasource fails

[jira] [Commented] (SPARK-34190) Supplement the description for Python Package Management

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269190#comment-17269190 ] Apache Spark commented on SPARK-34190: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34190) Supplement the description for Python Package Management

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34190: Assignee: Apache Spark > Supplement the description for Python Package Management >

[jira] [Assigned] (SPARK-34190) Supplement the description for Python Package Management

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34190: Assignee: (was: Apache Spark) > Supplement the description for Python Package

[jira] [Updated] (SPARK-34190) Supplement the description for Python Package Management

2021-01-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34190: Summary: Supplement the description for Python Package Management (was: Supplement the

[jira] [Updated] (SPARK-34190) Supplement the description in the document

2021-01-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34190: Description: There is lack of explanation for "Using Virtualenv" chapter. It says "It packs the

[jira] [Updated] (SPARK-34190) Supplement the description in the document

2021-01-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34190: Description: There is lack of explanation for "Using Virtualenv" chapter. It says "It packs the

[jira] [Updated] (SPARK-34190) Supplement the description in the document

2021-01-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34190: Description: There is lack of explanation for "Using Virtualenv" chapter. It says "It packs the

[jira] [Updated] (SPARK-34190) Supplement the description in the document

2021-01-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34190: Description: There is lack of explanation for "Using Virtualenv" chapter. It says "It packs the

[jira] [Updated] (SPARK-34190) Supplement the description in the document

2021-01-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34190: Summary: Supplement the description in the document (was: Fix inconsistent docs in Python

[jira] [Comment Edited] (SPARK-34167) Reading parquet with Decimal(8,2) written as a Decimal64 blows up

2021-01-21 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269182#comment-17269182 ] Attila Zsolt Piros edited comment on SPARK-34167 at 1/21/21, 9:49 AM:

[jira] [Commented] (SPARK-34167) Reading parquet with Decimal(8,2) written as a Decimal64 blows up

2021-01-21 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269182#comment-17269182 ] Attila Zsolt Piros commented on SPARK-34167: [~razajafri] could you share with us how the

[jira] [Commented] (SPARK-33518) Improve performance of ML ALS recommendForAll by GEMV

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269177#comment-17269177 ] Apache Spark commented on SPARK-33518: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-33518) Improve performance of ML ALS recommendForAll by GEMV

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269176#comment-17269176 ] Apache Spark commented on SPARK-33518: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-34190) Fix inconsistent docs in Python Package Management

2021-01-21 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-34190: --- Summary: Fix inconsistent docs in Python Package Management Key: SPARK-34190 URL: https://issues.apache.org/jira/browse/SPARK-34190 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34188) Char varchar length check blocks CBO statistics

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269136#comment-17269136 ] Apache Spark commented on SPARK-34188: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34188) Char varchar length check blocks CBO statistics

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34188: Assignee: (was: Apache Spark) > Char varchar length check blocks CBO statistics >

[jira] [Commented] (SPARK-34188) Char varchar length check blocks CBO statistics

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269133#comment-17269133 ] Apache Spark commented on SPARK-34188: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34188) Char varchar length check blocks CBO statistics

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34188: Assignee: Apache Spark > Char varchar length check blocks CBO statistics >

[jira] [Commented] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269119#comment-17269119 ] Wenchen Fan commented on SPARK-33813: - [~sarutak] do you have time to look into this? thanks! >

[jira] [Commented] (SPARK-33901) Char and Varchar display error after DDLs

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269117#comment-17269117 ] Apache Spark commented on SPARK-33901: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-34189) w2v findSynonyms optimization

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34189: Assignee: Apache Spark (was: zhengruifeng) > w2v findSynonyms optimization >

[jira] [Assigned] (SPARK-34189) w2v findSynonyms optimization

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34189: Assignee: Apache Spark (was: zhengruifeng) > w2v findSynonyms optimization >

[jira] [Assigned] (SPARK-34189) w2v findSynonyms optimization

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34189: Assignee: zhengruifeng (was: Apache Spark) > w2v findSynonyms optimization >

[jira] [Commented] (SPARK-34189) w2v findSynonyms optimization

2021-01-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269115#comment-17269115 ] Apache Spark commented on SPARK-34189: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-34189) w2v findSynonyms optimization

2021-01-21 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-34189: Assignee: zhengruifeng > w2v findSynonyms optimization > - >

[jira] [Created] (SPARK-34189) w2v findSynonyms optimization

2021-01-21 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-34189: Summary: w2v findSynonyms optimization Key: SPARK-34189 URL: https://issues.apache.org/jira/browse/SPARK-34189 Project: Spark Issue Type: Improvement