[jira] [Commented] (SPARK-28512) New optional mode: throw runtime exceptions on casting failures

[ https://issues.apache.org/jira/browse/SPARK-28512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893334#comment-16893334 ] Gengliang Wang commented on SPARK-28512: [~dongjoon]Thanks! > New optional mode: throw runtime

[jira] [Commented] (SPARK-28512) New optional mode: throw runtime exceptions on casting failures

[ https://issues.apache.org/jira/browse/SPARK-28512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893331#comment-16893331 ] Dongjoon Hyun commented on SPARK-28512: --- I changed the type from `BUG` to `Improvement` since this

[jira] [Updated] (SPARK-28512) New optional mode: throw runtime exceptions on casting failures

[ https://issues.apache.org/jira/browse/SPARK-28512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28512: -- Issue Type: Improvement (was: Bug) > New optional mode: throw runtime exceptions on casting

[jira] [Commented] (SPARK-28515) to_timestamp returns null for summer time switch dates

[ https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893318#comment-16893318 ] Hyukjin Kwon commented on SPARK-28515: -- Which Python version do you use? IIRC, Python 3.4 has an

[jira] [Comment Edited] (SPARK-28515) to_timestamp returns null for summer time switch dates

[ https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893318#comment-16893318 ] Hyukjin Kwon edited comment on SPARK-28515 at 7/26/19 4:29 AM: --- Which

[jira] [Updated] (SPARK-28515) to_timestamp returns null for summer time switch dates

[ https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28515: - Description: I am not sure if this is a bug - but it was a very unexpected behavior, so I'd

[jira] [Assigned] (SPARK-28365) Fallback locale to en_US in StopWordsRemover if system default locale isn't in available locales in JVM

[ https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28365: Assignee: Liang-Chi Hsieh > Fallback locale to en_US in StopWordsRemover if system

[jira] [Resolved] (SPARK-28365) Fallback locale to en_US in StopWordsRemover if system default locale isn't in available locales in JVM

[ https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28365. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25133

[jira] [Resolved] (SPARK-28289) Convert and port 'union.sql' into UDF test base

[ https://issues.apache.org/jira/browse/SPARK-28289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28289. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25202

[jira] [Assigned] (SPARK-28289) Convert and port 'union.sql' into UDF test base

[ https://issues.apache.org/jira/browse/SPARK-28289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28289: Assignee: Yiheng Wang > Convert and port 'union.sql' into UDF test base >

[jira] [Assigned] (SPARK-28476) Support ALTER DATABASE SET LOCATION

[ https://issues.apache.org/jira/browse/SPARK-28476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28476: --- Assignee: Weichen Xu > Support ALTER DATABASE SET LOCATION > --- >

[jira] [Commented] (SPARK-28476) Support ALTER DATABASE SET LOCATION

[ https://issues.apache.org/jira/browse/SPARK-28476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893274#comment-16893274 ] Xiao Li commented on SPARK-28476: - [~ivy.weichan.xu]   > Support ALTER DATABASE SET LOCATION >

[jira] [Commented] (SPARK-23469) HashingTF should use corrected MurmurHash3 implementation

[ https://issues.apache.org/jira/browse/SPARK-23469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893258#comment-16893258 ] Huaxin Gao commented on SPARK-23469: I will work on this jira once PR

[jira] [Updated] (SPARK-28137) Data Type Formatting Functions: `to_number`

[ https://issues.apache.org/jira/browse/SPARK-28137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28137: Description: ||Function||Return Type||Description||Example|| |{{to_number(}}{{text}}{{, 

[jira] [Updated] (SPARK-28516) Data Type Formatting Functions: `to_char`

[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28516: Description: Currently, Spark does not have support for `to_char`. PgSQL, however,

[jira] [Updated] (SPARK-28137) Data Type Formatting Functions: `to_number`

[ https://issues.apache.org/jira/browse/SPARK-28137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28137: Summary: Data Type Formatting Functions: `to_number` (was: Data Type Formatting Functions:

[jira] [Updated] (SPARK-28137) Data Type Formatting Functions: `to_char`

[ https://issues.apache.org/jira/browse/SPARK-28137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28137: Summary: Data Type Formatting Functions: `to_char` (was: Data Type Formatting Functions) > Data

[jira] [Updated] (SPARK-28516) Data Type Formatting Functions: `to_char`

[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28516: Summary: Data Type Formatting Functions: `to_char` (was: adds `to_char`) > Data Type Formatting

[jira] [Created] (SPARK-28517) pyspark with --conf spark.jars.packages causes duplicate jars to be uploaded

Barry created SPARK-28517: - Summary: pyspark with --conf spark.jars.packages causes duplicate jars to be uploaded Key: SPARK-28517 URL: https://issues.apache.org/jira/browse/SPARK-28517 Project: Spark

[jira] [Commented] (SPARK-28264) Revisiting Python / pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-28264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893209#comment-16893209 ] Bryan Cutler commented on SPARK-28264: -- It's great to be taking another look at this, I think some

[jira] [Resolved] (SPARK-27845) DataSourceV2: InsertTable

[ https://issues.apache.org/jira/browse/SPARK-27845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-27845. - Resolution: Done Fix Version/s: 3.0.0 > DataSourceV2: InsertTable >

[jira] [Assigned] (SPARK-27845) DataSourceV2: InsertTable

[ https://issues.apache.org/jira/browse/SPARK-27845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-27845: --- Assignee: John Zhuge > DataSourceV2: InsertTable > - > >

[jira] [Commented] (SPARK-27845) DataSourceV2: InsertTable

[ https://issues.apache.org/jira/browse/SPARK-27845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893162#comment-16893162 ] Burak Yavuz commented on SPARK-27845: - Resolved with [https://github.com/apache/spark/pull/24832] >

[jira] [Commented] (SPARK-16754) NPE when defining case class and searching Encoder in the same line

[ https://issues.apache.org/jira/browse/SPARK-16754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893125#comment-16893125 ] Shixiong Zhu commented on SPARK-16754: -- I think prepending

[jira] [Updated] (SPARK-28502) Error with struct conversion while using pandas_udf

[ https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nasir Ali updated SPARK-28502: -- Issue Type: Bug (was: Question) > Error with struct conversion while using pandas_udf >

[jira] [Commented] (SPARK-16754) NPE when defining case class and searching Encoder in the same line

[ https://issues.apache.org/jira/browse/SPARK-16754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893115#comment-16893115 ] Josh Rosen commented on SPARK-16754: This is still a problem as of Spark 2.4.x; I just encountered

[jira] [Created] (SPARK-28516) adds `to_char`

Dylan Guedes created SPARK-28516: Summary: adds `to_char` Key: SPARK-28516 URL: https://issues.apache.org/jira/browse/SPARK-28516 Project: Spark Issue Type: Sub-task Components:

[jira] [Commented] (SPARK-25787) [K8S] Spark can't use data locality information

[ https://issues.apache.org/jira/browse/SPARK-25787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893043#comment-16893043 ] Paweł Wiejacha commented on SPARK-25787: I *can* reproduce this issue. In Spark UI, Locality

[jira] [Assigned] (SPARK-25914) Separate projection from grouping and aggregate in logical Aggregate

[ https://issues.apache.org/jira/browse/SPARK-25914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25914: --- Assignee: (was: Dilip Biswal) > Separate projection from grouping and aggregate in logical

[jira] [Closed] (SPARK-28509) K8S integration tests are failing

[ https://issues.apache.org/jira/browse/SPARK-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp closed SPARK-28509. --- > K8S integration tests are failing > - > > Key:

[jira] [Commented] (SPARK-28509) K8S integration tests are failing

[ https://issues.apache.org/jira/browse/SPARK-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893031#comment-16893031 ] shane knapp commented on SPARK-28509: - checked that worker today and all k8s builds are running

[jira] [Commented] (SPARK-27734) Add memory based thresholds for shuffle spill

[ https://issues.apache.org/jira/browse/SPARK-27734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893018#comment-16893018 ] Paweł Wiejacha commented on SPARK-27734: We also encountered this problem. We've reduced the

[jira] [Resolved] (SPARK-28511) Get REV from RELEASE_VERSION instead of VERSION

[ https://issues.apache.org/jira/browse/SPARK-28511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28511. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25254

[jira] [Assigned] (SPARK-28511) Get REV from RELEASE_VERSION instead of VERSION

[ https://issues.apache.org/jira/browse/SPARK-28511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28511: - Assignee: Dongjoon Hyun > Get REV from RELEASE_VERSION instead of VERSION >

[jira] [Commented] (SPARK-28415) Add messageHandler to Kafka 10 direct stream API

[ https://issues.apache.org/jira/browse/SPARK-28415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892888#comment-16892888 ] Michael Spector commented on SPARK-28415: - In this case I think it's a regression / broken API

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892875#comment-16892875 ] Tomas Bartalos commented on SPARK-28025: I'm also affected by performance issue caused by .crc

[jira] [Resolved] (SPARK-28288) Convert and port 'window.sql' into UDF test base

[ https://issues.apache.org/jira/browse/SPARK-28288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28288. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25195

[jira] [Assigned] (SPARK-28288) Convert and port 'window.sql' into UDF test base

[ https://issues.apache.org/jira/browse/SPARK-28288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28288: Assignee: YoungGyu Chun > Convert and port 'window.sql' into UDF test base >

[jira] [Updated] (SPARK-28421) SparseVector.apply performance optimization

[ https://issues.apache.org/jira/browse/SPARK-28421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28421: -- Affects Version/s: 2.4.3 Priority: Minor (was: Major) Fix Version/s: 2.4.4 >

[jira] [Commented] (SPARK-28512) New optional mode: throw runtime exceptions on casting failures

[ https://issues.apache.org/jira/browse/SPARK-28512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892692#comment-16892692 ] Marco Gaido commented on SPARK-28512: - Thanks for pinging me [~maropu]. It is not the same issue, I

[jira] [Commented] (SPARK-28512) New optional mode: throw runtime exceptions on casting failures

[ https://issues.apache.org/jira/browse/SPARK-28512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892683#comment-16892683 ] Takeshi Yamamuro commented on SPARK-28512: -- Is this related to 

[jira] [Resolved] (SPARK-28497) Disallow upcasting complex data types to string type

[ https://issues.apache.org/jira/browse/SPARK-28497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28497. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25242

[jira] [Assigned] (SPARK-28497) Disallow upcasting complex data types to string type

[ https://issues.apache.org/jira/browse/SPARK-28497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28497: Assignee: Gengliang Wang > Disallow upcasting complex data types to string type >

[jira] [Updated] (SPARK-28515) to_timestamp returns null for summer time switch dates

[ https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andreas Költringer updated SPARK-28515: --- Description: I am not sure if this is a bug - but it was a very unexpected

[jira] [Updated] (SPARK-28515) to_timestamp returns null for summer time switch dates

[ https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andreas Költringer updated SPARK-28515: --- Description: I am not sure if this is a bug - but it was a very unexpected

[jira] [Updated] (SPARK-28515) to_timestamp returns null for summer time switch dates

[ https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andreas Költringer updated SPARK-28515: --- Description: I am not sure if this is a bug - but it was a very unexpected

[jira] [Updated] (SPARK-28515) to_timestamp returns null for summer time switch dates

[ https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andreas Költringer updated SPARK-28515: --- Description: I am not sure if this is a bug - but it was a very unexpected

[jira] [Updated] (SPARK-28515) to_timestamp returns null for summer time switch dates

[ https://issues.apache.org/jira/browse/SPARK-28515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andreas Költringer updated SPARK-28515: --- Description: I am not sure if this is a bug - but it was a very unexpected

[jira] [Created] (SPARK-28515) to_timestamp returns null for summer time switch dates

Andreas Költringer created SPARK-28515: -- Summary: to_timestamp returns null for summer time switch dates Key: SPARK-28515 URL: https://issues.apache.org/jira/browse/SPARK-28515 Project: Spark

[jira] [Created] (SPARK-28514) Remove the redundant transformImpl method in RF & GBT

zhengruifeng created SPARK-28514: Summary: Remove the redundant transformImpl method in RF & GBT Key: SPARK-28514 URL: https://issues.apache.org/jira/browse/SPARK-28514 Project: Spark Issue

[jira] [Created] (SPARK-28513) Compute distinct label sets instead of subsets

Martin Junghanns created SPARK-28513: Summary: Compute distinct label sets instead of subsets Key: SPARK-28513 URL: https://issues.apache.org/jira/browse/SPARK-28513 Project: Spark Issue

[jira] [Comment Edited] (SPARK-22063) Upgrade lintr to latest commit sha1 ID

[ https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892595#comment-16892595 ] Manu Zhang edited comment on SPARK-22063 at 7/25/19 9:41 AM: - Is there any

[jira] [Commented] (SPARK-22063) Upgrade lintr to latest commit sha1 ID

[ https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892595#comment-16892595 ] Manu Zhang commented on SPARK-22063: Is there any update in this thread ? Which lint-r version is

[jira] [Comment Edited] (SPARK-27688) Beeline should show database in the prompt

[ https://issues.apache.org/jira/browse/SPARK-27688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892580#comment-16892580 ] Yuming Wang edited comment on SPARK-27688 at 7/25/19 9:24 AM: -- {code:sh}

[jira] [Resolved] (SPARK-27688) Beeline should show database in the prompt

[ https://issues.apache.org/jira/browse/SPARK-27688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-27688. - Resolution: Fixed We supported it after upgrading the built-in Hive to 2.3.5. > Beeline should

[jira] [Updated] (SPARK-27688) Beeline should show database in the prompt

[ https://issues.apache.org/jira/browse/SPARK-27688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27688: Affects Version/s: (was: 2.4.3) 3.0.0 > Beeline should show database

[jira] [Commented] (SPARK-27688) Beeline should show database in the prompt

[ https://issues.apache.org/jira/browse/SPARK-27688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892580#comment-16892580 ] Yuming Wang commented on SPARK-27688: - {code:sh} build/sbt clean package -Phive -Phive-thriftserver

[jira] [Updated] (SPARK-28156) Join plan sometimes does not use cached query

[ https://issues.apache.org/jira/browse/SPARK-28156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-28156: Fix Version/s: 2.4.4 > Join plan sometimes does not use cached query >

[jira] [Updated] (SPARK-26995) Running Spark in Docker image with Alpine Linux 3.9.0 throws errors when using snappy

[ https://issues.apache.org/jira/browse/SPARK-26995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26995: -- Fix Version/s: 2.4.4 > Running Spark in Docker image with Alpine Linux 3.9.0 throws errors

[jira] [Commented] (SPARK-26995) Running Spark in Docker image with Alpine Linux 3.9.0 throws errors when using snappy

[ https://issues.apache.org/jira/browse/SPARK-26995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892559#comment-16892559 ] Dongjoon Hyun commented on SPARK-26995: --- This is backported to `branch-2.4` via

[jira] [Created] (SPARK-28512) New optional mode: throw runtime exceptions on casting failures

Gengliang Wang created SPARK-28512: -- Summary: New optional mode: throw runtime exceptions on casting failures Key: SPARK-28512 URL: https://issues.apache.org/jira/browse/SPARK-28512 Project: Spark

[jira] [Created] (SPARK-28511) Get REV from RELEASE_VERSION instead of VERSION

Dongjoon Hyun created SPARK-28511: - Summary: Get REV from RELEASE_VERSION instead of VERSION Key: SPARK-28511 URL: https://issues.apache.org/jira/browse/SPARK-28511 Project: Spark Issue

[jira] [Updated] (SPARK-28510) Implement Spark's own GetFunctionsOperation

[ https://issues.apache.org/jira/browse/SPARK-28510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28510: Description: We should implement Spark's own {{GetFunctionsOperation}}  because Spark SQL and

[jira] [Created] (SPARK-28510) Implement Spark's own GetFunctionsOperation

Yuming Wang created SPARK-28510: --- Summary: Implement Spark's own GetFunctionsOperation Key: SPARK-28510 URL: https://issues.apache.org/jira/browse/SPARK-28510 Project: Spark Issue Type: