[jira] [Created] (SPARK-30826) LIKE returns wrong result from external table using parquet

Maxim Gekk created SPARK-30826: -- Summary: LIKE returns wrong result from external table using parquet Key: SPARK-30826 URL: https://issues.apache.org/jira/browse/SPARK-30826 Project: Spark

[jira] [Created] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

Maxim Gekk created SPARK-30808: -- Summary: Thrift server returns wrong timestamps/dates strings before 1582 Key: SPARK-30808 URL: https://issues.apache.org/jira/browse/SPARK-30808 Project: Spark

[jira] [Created] (SPARK-30793) Wrong truncations of timestamps before the epoch to minutes and seconds

Maxim Gekk created SPARK-30793: -- Summary: Wrong truncations of timestamps before the epoch to minutes and seconds Key: SPARK-30793 URL: https://issues.apache.org/jira/browse/SPARK-30793 Project: Spark

[jira] [Created] (SPARK-30788) Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters

Maxim Gekk created SPARK-30788: -- Summary: Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters Key: SPARK-30788 URL: https://issues.apache.org/jira/browse/SPARK-30788

[jira] [Commented] (SPARK-30687) When reading from a file with pre-defined schema and encountering a single value that is not the same type as that of its column , Spark nullifies the entire row

[ https://issues.apache.org/jira/browse/SPARK-30687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033298#comment-17033298 ] Maxim Gekk commented on SPARK-30687: This feature will come with Spark 3.0

[jira] [Comment Edited] (SPARK-30767) from_json changes times of timestmaps by several minutes without error

[ https://issues.apache.org/jira/browse/SPARK-30767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033293#comment-17033293 ] Maxim Gekk edited comment on SPARK-30767 at 2/9/20 9:08 PM: The default

[jira] [Commented] (SPARK-30767) from_json changes times of timestmaps by several minutes without error

[ https://issues.apache.org/jira/browse/SPARK-30767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033294#comment-17033294 ] Maxim Gekk commented on SPARK-30767: Also 2.4.4 supports only `SSS` for second fractions. That was

[jira] [Commented] (SPARK-30767) from_json changes times of timestmaps by several minutes without error

[ https://issues.apache.org/jira/browse/SPARK-30767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033293#comment-17033293 ] Maxim Gekk commented on SPARK-30767: The default timestamp pattern in JSON datasource specifies only

[jira] [Created] (SPARK-30766) Wrong truncation of old timestamps to hours and days

Maxim Gekk created SPARK-30766: -- Summary: Wrong truncation of old timestamps to hours and days Key: SPARK-30766 URL: https://issues.apache.org/jira/browse/SPARK-30766 Project: Spark Issue Type:

[jira] [Created] (SPARK-30760) Port `millisToDays` and `daysToMillis` on Java 8 time API

Maxim Gekk created SPARK-30760: -- Summary: Port `millisToDays` and `daysToMillis` on Java 8 time API Key: SPARK-30760 URL: https://issues.apache.org/jira/browse/SPARK-30760 Project: Spark Issue

[jira] [Updated] (SPARK-30759) The cache in StringRegexExpression is not initialized for foldable patterns

[ https://issues.apache.org/jira/browse/SPARK-30759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30759: --- Priority: Minor (was: Major) > The cache in StringRegexExpression is not initialized for foldable

[jira] [Created] (SPARK-30759) The cache in StringRegexExpression is not initialized for foldable patterns

Maxim Gekk created SPARK-30759: -- Summary: The cache in StringRegexExpression is not initialized for foldable patterns Key: SPARK-30759 URL: https://issues.apache.org/jira/browse/SPARK-30759 Project:

[jira] [Updated] (SPARK-30759) The cache in StringRegexExpression is not initialized for foldable patterns

[ https://issues.apache.org/jira/browse/SPARK-30759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30759: --- Attachment: Screen Shot 2020-02-08 at 22.45.50.png > The cache in StringRegexExpression is not

[jira] [Commented] (SPARK-30740) months_between wrong calculation

[ https://issues.apache.org/jira/browse/SPARK-30740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032922#comment-17032922 ] Maxim Gekk commented on SPARK-30740: This is because of the special *if* 

[jira] [Created] (SPARK-30754) Reuse results of floorDiv in calculations of floorMod in DateTimeUtils

Maxim Gekk created SPARK-30754: -- Summary: Reuse results of floorDiv in calculations of floorMod in DateTimeUtils Key: SPARK-30754 URL: https://issues.apache.org/jira/browse/SPARK-30754 Project: Spark

[jira] [Resolved] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

[ https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-30730. Resolution: Won't Fix > Wrong results of `converTz` for different session and system time zones >

[jira] [Commented] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

[ https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031776#comment-17031776 ] Maxim Gekk commented on SPARK-30730: I am going to close this ticket w.r.t 

[jira] [Commented] (SPARK-30752) Wrong result of to_utc_timestamp() on daylight saving day

[ https://issues.apache.org/jira/browse/SPARK-30752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031774#comment-17031774 ] Maxim Gekk commented on SPARK-30752: [~dongjoon] FYI, 2.4 has the bug. > Wrong result of

[jira] [Created] (SPARK-30752) Wrong result of to_utc_timestamp() on daylight saving day

Maxim Gekk created SPARK-30752: -- Summary: Wrong result of to_utc_timestamp() on daylight saving day Key: SPARK-30752 URL: https://issues.apache.org/jira/browse/SPARK-30752 Project: Spark Issue

[jira] [Commented] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

[ https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030742#comment-17030742 ] Maxim Gekk commented on SPARK-30730: [~srowen] Since Spark 2.2, CAST uses the session time zone. In

[jira] [Commented] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

[ https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030472#comment-17030472 ] Maxim Gekk commented on SPARK-30730: [~cloud_fan] [~srowen] [~hyukjin.kwon] Please, have a look at

[jira] [Updated] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

[ https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30730: --- Description: Currently, DateTimeUtils.convertTz() assumes that timestamp strings are casted to

[jira] [Commented] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

[ https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030122#comment-17030122 ] Maxim Gekk commented on SPARK-30730: [~dongjoon] FYI. 2.4.x may have this issue because CAST uses

[jira] [Created] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

Maxim Gekk created SPARK-30730: -- Summary: Wrong results of `converTz` for different session and system time zones Key: SPARK-30730 URL: https://issues.apache.org/jira/browse/SPARK-30730 Project: Spark

[jira] [Created] (SPARK-30725) Make all legacy SQL configs as internal configs

Maxim Gekk created SPARK-30725: -- Summary: Make all legacy SQL configs as internal configs Key: SPARK-30725 URL: https://issues.apache.org/jira/browse/SPARK-30725 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028731#comment-17028731 ] Maxim Gekk commented on SPARK-30668: Behind of the removed config 

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028545#comment-17028545 ] Maxim Gekk commented on SPARK-30668: > as a bug introduced by a new improvement patch.  Don't

[jira] [Comment Edited] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028532#comment-17028532 ] Maxim Gekk edited comment on SPARK-30668 at 2/2/20 7:47 PM: [~dongjoon] I

[jira] [Comment Edited] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028532#comment-17028532 ] Maxim Gekk edited comment on SPARK-30668 at 2/2/20 7:40 PM: [~dongjoon] I

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028532#comment-17028532 ] Maxim Gekk commented on SPARK-30668: [~dongjoon] I have found the reason 

[jira] [Comment Edited] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028515#comment-17028515 ] Maxim Gekk edited comment on SPARK-30668 at 2/2/20 6:51 PM: [~dongjoon] 

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028515#comment-17028515 ] Maxim Gekk commented on SPARK-30668: [~dongjoon] Output of your example is surprised - it doesn't

[jira] [Comment Edited] (SPARK-30696) Wrong result of the combination of from_utc_timestamp and to_utc_timestamp

[ https://issues.apache.org/jira/browse/SPARK-30696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027975#comment-17027975 ] Maxim Gekk edited comment on SPARK-30696 at 2/1/20 5:28 AM: [~dongjoon] We

[jira] [Commented] (SPARK-30696) Wrong result of the combination of from_utc_timestamp and to_utc_timestamp

[ https://issues.apache.org/jira/browse/SPARK-30696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027975#comment-17027975 ] Maxim Gekk commented on SPARK-30696: [~dongjoon] We have different default time zones, maybe it

[jira] [Commented] (SPARK-30696) Wrong result of the combination of from_utc_timestamp and to_utc_timestamp

[ https://issues.apache.org/jira/browse/SPARK-30696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027834#comment-17027834 ] Maxim Gekk commented on SPARK-30696: The issue can be reproduced when DateTimeUtils functions are

[jira] [Commented] (SPARK-30696) Wrong result of the combination of from_utc_timestamp and to_utc_timestamp

[ https://issues.apache.org/jira/browse/SPARK-30696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027830#comment-17027830 ] Maxim Gekk commented on SPARK-30696: [~dongjoon] FYI > Wrong result of the combination of

[jira] [Created] (SPARK-30696) Wrong result of the combination of from_utc_timestamp and to_utc_timestamp

Maxim Gekk created SPARK-30696: -- Summary: Wrong result of the combination of from_utc_timestamp and to_utc_timestamp Key: SPARK-30696 URL: https://issues.apache.org/jira/browse/SPARK-30696 Project:

[jira] [Updated] (SPARK-30678) Eliminate warnings from deprecated BisectingKMeansModel.computeCost

[ https://issues.apache.org/jira/browse/SPARK-30678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30678: --- Component/s: (was: SQL) MLlib > Eliminate warnings from deprecated

[jira] [Created] (SPARK-30678) Eliminate warnings from deprecated BisectingKMeansModel.computeCost

Maxim Gekk created SPARK-30678: -- Summary: Eliminate warnings from deprecated BisectingKMeansModel.computeCost Key: SPARK-30678 URL: https://issues.apache.org/jira/browse/SPARK-30678 Project: Spark

[jira] [Created] (SPARK-30676) Eliminate warnings from deprecated constructors of java.lang.Integer and java.lang.Double

Maxim Gekk created SPARK-30676: -- Summary: Eliminate warnings from deprecated constructors of java.lang.Integer and java.lang.Double Key: SPARK-30676 URL: https://issues.apache.org/jira/browse/SPARK-30676

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025729#comment-17025729 ] Maxim Gekk commented on SPARK-30668: We can try to revert this 

[jira] [Comment Edited] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025681#comment-17025681 ] Maxim Gekk edited comment on SPARK-30668 at 1/29/20 8:43 AM: - [~marmbrus]

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025681#comment-17025681 ] Maxim Gekk commented on SPARK-30668: If [~marmbrus] develops something new, he could use correct

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025651#comment-17025651 ] Maxim Gekk commented on SPARK-30668: > This is not mentioned in the migration guide. It is

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025549#comment-17025549 ] Maxim Gekk commented on SPARK-30668: Date/timestamp parsing is based on Java 8 DateTimeFormat in

[jira] [Created] (SPARK-30648) Support filters pushdown in JSON datasource

Maxim Gekk created SPARK-30648: -- Summary: Support filters pushdown in JSON datasource Key: SPARK-30648 URL: https://issues.apache.org/jira/browse/SPARK-30648 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-30632) to_timestamp() doesn't work with certain timezones

[ https://issues.apache.org/jira/browse/SPARK-30632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023263#comment-17023263 ] Maxim Gekk edited comment on SPARK-30632 at 1/24/20 9:12 PM: - Spark 2.4 and

[jira] [Commented] (SPARK-30632) to_timestamp() doesn't work with certain timezones

[ https://issues.apache.org/jira/browse/SPARK-30632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023263#comment-17023263 ] Maxim Gekk commented on SPARK-30632: Spark 2.4 and earlier versions use SimpleDateFormat to parse

[jira] [Commented] (SPARK-30625) Add `escapeChar` parameter to the `like` function

[ https://issues.apache.org/jira/browse/SPARK-30625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022398#comment-17022398 ] Maxim Gekk commented on SPARK-30625: I have implemented the feature but I am not sure it is useful.

[jira] [Created] (SPARK-30625) Add `escapeChar` parameter to the `like` function

Maxim Gekk created SPARK-30625: -- Summary: Add `escapeChar` parameter to the `like` function Key: SPARK-30625 URL: https://issues.apache.org/jira/browse/SPARK-30625 Project: Spark Issue Type:

[jira] [Created] (SPARK-30606) Applying the `like` function with 2 parameters fails

Maxim Gekk created SPARK-30606: -- Summary: Applying the `like` function with 2 parameters fails Key: SPARK-30606 URL: https://issues.apache.org/jira/browse/SPARK-30606 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30599) SparkFunSuite.LogAppender throws java.lang.IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-30599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020480#comment-17020480 ] Maxim Gekk commented on SPARK-30599: > Or I wonder if we can make the logging less noisy too. We

[jira] [Updated] (SPARK-30599) SparkFunSuite.LogAppender throws java.lang.IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-30599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30599: --- Description: The LogAppender has a limit for the number of logged events. By default, it is 100

[jira] [Updated] (SPARK-30599) SparkFunSuite.LogAppender throws java.lang.IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-30599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30599: --- Description: The LogAppender has a limit for the number of logged event. By default, it is 100.

[jira] [Updated] (SPARK-30599) SparkFunSuite.LogAppender throws java.lang.IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-30599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30599: --- Description: The LogAppender has a limit for the number of logged event. By default, it is 100.

[jira] [Commented] (SPARK-30599) SparkFunSuite.LogAppender throws java.lang.IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-30599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020465#comment-17020465 ] Maxim Gekk commented on SPARK-30599: I see at least 2 solutions: 1. Increase the limit from 100 to

[jira] [Updated] (SPARK-30599) SparkFunSuite.LogAppender throws java.lang.IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-30599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30599: --- Description: The LogAppender has a limit for the number of logged event. By default, it is 100.

[jira] [Updated] (SPARK-30599) SparkFunSuite.LogAppender throws java.lang.IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-30599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30599: --- Description: The LogAppender has a limit for the number of logged event. By default, it is 100.

[jira] [Updated] (SPARK-30599) SparkFunSuite.LogAppender throws java.lang.IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-30599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30599: --- Attachment: fail_trace.txt > SparkFunSuite.LogAppender throws java.lang.IllegalStateException >

[jira] [Created] (SPARK-30599) SparkFunSuite.LogAppender throws java.lang.IllegalStateException

Maxim Gekk created SPARK-30599: -- Summary: SparkFunSuite.LogAppender throws java.lang.IllegalStateException Key: SPARK-30599 URL: https://issues.apache.org/jira/browse/SPARK-30599 Project: Spark

[jira] [Updated] (SPARK-30599) SparkFunSuite.LogAppender throws java.lang.IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-30599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30599: --- Attachment: success_trace.txt > SparkFunSuite.LogAppender throws java.lang.IllegalStateException >

[jira] [Created] (SPARK-30587) Run test suites for CSV v1 and JSON v1

Maxim Gekk created SPARK-30587: -- Summary: Run test suites for CSV v1 and JSON v1 Key: SPARK-30587 URL: https://issues.apache.org/jira/browse/SPARK-30587 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-30466) remove dependency on jackson-mapper-asl-1.9.13 and jackson-core-asl-1.9.13

[ https://issues.apache.org/jira/browse/SPARK-30466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019018#comment-17019018 ] Maxim Gekk commented on SPARK-30466: Hadoop 2.7 still depends on the libs, see 

[jira] [Created] (SPARK-30565) Regression in the ORC benchmark

Maxim Gekk created SPARK-30565: -- Summary: Regression in the ORC benchmark Key: SPARK-30565 URL: https://issues.apache.org/jira/browse/SPARK-30565 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-30564) Regression in the wide schema benchmark

[ https://issues.apache.org/jira/browse/SPARK-30564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018653#comment-17018653 ] Maxim Gekk commented on SPARK-30564: [~viirya] Please, take a look at this. Maybe it can be

[jira] [Commented] (SPARK-30564) Regression in the wide schema benchmark

[ https://issues.apache.org/jira/browse/SPARK-30564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018652#comment-17018652 ] Maxim Gekk commented on SPARK-30564: Here, regression is ~8 times 

[jira] [Created] (SPARK-30564) Regression in the wide schema benchmark

Maxim Gekk created SPARK-30564: -- Summary: Regression in the wide schema benchmark Key: SPARK-30564 URL: https://issues.apache.org/jira/browse/SPARK-30564 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-30563) Regressions in Join benchmarks

Maxim Gekk created SPARK-30563: -- Summary: Regressions in Join benchmarks Key: SPARK-30563 URL: https://issues.apache.org/jira/browse/SPARK-30563 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-30562) Regression in interval string parsing

Maxim Gekk created SPARK-30562: -- Summary: Regression in interval string parsing Key: SPARK-30562 URL: https://issues.apache.org/jira/browse/SPARK-30562 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-30558) Avoid rebuilding `AvroOptions` per each partition

Maxim Gekk created SPARK-30558: -- Summary: Avoid rebuilding `AvroOptions` per each partition Key: SPARK-30558 URL: https://issues.apache.org/jira/browse/SPARK-30558 Project: Spark Issue Type:

[jira] [Created] (SPARK-30554) Return Iterable from FailureSafeParser.rawParser

Maxim Gekk created SPARK-30554: -- Summary: Return Iterable from FailureSafeParser.rawParser Key: SPARK-30554 URL: https://issues.apache.org/jira/browse/SPARK-30554 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30530) CSV load followed by "is null" filter produces incorrect results

[ https://issues.apache.org/jira/browse/SPARK-30530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017806#comment-17017806 ] Maxim Gekk commented on SPARK-30530: [~jlowe] I prepared a fix for the issue. [~hyukjin.kwon]

[jira] [Commented] (SPARK-30530) CSV load followed by "is null" filter produces incorrect results

[ https://issues.apache.org/jira/browse/SPARK-30530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017290#comment-17017290 ] Maxim Gekk commented on SPARK-30530: [~jlowe] Thank you for the bug report. I will take a look at

[jira] [Resolved] (SPARK-29448) Support the `INTERVAL` type by Parquet datasource

[ https://issues.apache.org/jira/browse/SPARK-29448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-29448. Resolution: Won't Fix > Support the `INTERVAL` type by Parquet datasource >

[jira] [Created] (SPARK-30521) Eliminate deprecation warnings for ExpressionInfo

Maxim Gekk created SPARK-30521: -- Summary: Eliminate deprecation warnings for ExpressionInfo Key: SPARK-30521 URL: https://issues.apache.org/jira/browse/SPARK-30521 Project: Spark Issue Type:

[jira] [Created] (SPARK-30520) Eliminate deprecation warnings for UserDefinedAggregateFunction

Maxim Gekk created SPARK-30520: -- Summary: Eliminate deprecation warnings for UserDefinedAggregateFunction Key: SPARK-30520 URL: https://issues.apache.org/jira/browse/SPARK-30520 Project: Spark

[jira] [Updated] (SPARK-30165) Eliminate compilation warnings

[ https://issues.apache.org/jira/browse/SPARK-30165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30165: --- Attachment: spark_warnings.txt > Eliminate compilation warnings > -- >

[jira] [Updated] (SPARK-30165) Eliminate compilation warnings

[ https://issues.apache.org/jira/browse/SPARK-30165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30165: --- Attachment: (was: spark_warnings.txt) > Eliminate compilation warnings >

[jira] [Updated] (SPARK-30177) Eliminate warnings: part 7

[ https://issues.apache.org/jira/browse/SPARK-30177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30177: --- Summary: Eliminate warnings: part 7 (was: Eliminate warnings: part7) > Eliminate warnings: part 7

[jira] [Updated] (SPARK-30172) Eliminate warnings: part 3

[ https://issues.apache.org/jira/browse/SPARK-30172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30172: --- Summary: Eliminate warnings: part 3 (was: Eliminate warnings: part3) > Eliminate warnings: part 3

[jira] [Updated] (SPARK-30174) Eliminate warnings: part 4

[ https://issues.apache.org/jira/browse/SPARK-30174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30174: --- Summary: Eliminate warnings: part 4 (was: Eliminate warnings :part 4) > Eliminate warnings: part 4

[jira] [Updated] (SPARK-30171) Eliminate warnings: part 2

[ https://issues.apache.org/jira/browse/SPARK-30171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30171: --- Summary: Eliminate warnings: part 2 (was: Eliminate warnings: part2) > Eliminate warnings: part 2

[jira] [Resolved] (SPARK-30174) Eliminate warnings :part 4

[ https://issues.apache.org/jira/browse/SPARK-30174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-30174. Resolution: Duplicate > Eliminate warnings :part 4 > -- > >

[jira] [Resolved] (SPARK-30171) Eliminate warnings: part2

[ https://issues.apache.org/jira/browse/SPARK-30171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-30171. Resolution: Won't Fix As per discussion in 

[jira] [Resolved] (SPARK-30490) Eliminate warnings in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-30490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-30490. Resolution: Won't Fix See [https://github.com/apache/spark/pull/27174#discussion_r365629991] >

[jira] [Created] (SPARK-30509) Deprecation log warning is not printed in Avro schema inferring

Maxim Gekk created SPARK-30509: -- Summary: Deprecation log warning is not printed in Avro schema inferring Key: SPARK-30509 URL: https://issues.apache.org/jira/browse/SPARK-30509 Project: Spark

[jira] [Resolved] (SPARK-30492) Eliminate deprecation warnings in ORC datasource

[ https://issues.apache.org/jira/browse/SPARK-30492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-30492. Resolution: Won't Fix > Eliminate deprecation warnings in ORC datasource >

[jira] [Created] (SPARK-30505) Deprecate Avro option `ignoreExtension` in a doc

Maxim Gekk created SPARK-30505: -- Summary: Deprecate Avro option `ignoreExtension` in a doc Key: SPARK-30505 URL: https://issues.apache.org/jira/browse/SPARK-30505 Project: Spark Issue Type:

[jira] [Created] (SPARK-30501) Remove SQL config spark.sql.parquet.int64AsTimestampMillis

Maxim Gekk created SPARK-30501: -- Summary: Remove SQL config spark.sql.parquet.int64AsTimestampMillis Key: SPARK-30501 URL: https://issues.apache.org/jira/browse/SPARK-30501 Project: Spark Issue

[jira] [Created] (SPARK-30500) Remove SQL config spark.sql.variable.substitute.depth

Maxim Gekk created SPARK-30500: -- Summary: Remove SQL config spark.sql.variable.substitute.depth Key: SPARK-30500 URL: https://issues.apache.org/jira/browse/SPARK-30500 Project: Spark Issue

[jira] [Created] (SPARK-30499) Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone

Maxim Gekk created SPARK-30499: -- Summary: Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone Key: SPARK-30499 URL: https://issues.apache.org/jira/browse/SPARK-30499 Project: Spark

[jira] [Updated] (SPARK-30492) Eliminate deprecation warnings in ORC datasource

[ https://issues.apache.org/jira/browse/SPARK-30492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30492: --- Summary: Eliminate deprecation warnings in ORC datasource (was: Eliminate deprecation warning in

[jira] [Created] (SPARK-30492) Eliminate deprecation warning in ORC datasource

Maxim Gekk created SPARK-30492: -- Summary: Eliminate deprecation warning in ORC datasource Key: SPARK-30492 URL: https://issues.apache.org/jira/browse/SPARK-30492 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30490) Eliminate warnings in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-30490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30490: --- Summary: Eliminate warnings in Avro datasource (was: Eliminate deprecation warning in Avro

[jira] [Created] (SPARK-30490) Eliminate deprecation warning in Avro datasource

Maxim Gekk created SPARK-30490: -- Summary: Eliminate deprecation warning in Avro datasource Key: SPARK-30490 URL: https://issues.apache.org/jira/browse/SPARK-30490 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30485) Remove SQL configs deprecated before v2.4

[ https://issues.apache.org/jira/browse/SPARK-30485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30485: --- Description: Remove the following SQL configs: * spark.sql.variable.substitute.depth *

[jira] [Commented] (SPARK-30485) Remove SQL configs deprecated before v2.4

[ https://issues.apache.org/jira/browse/SPARK-30485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012678#comment-17012678 ] Maxim Gekk commented on SPARK-30485: [~dongjoon] [~srowen] [~cloud_fan] [~hyukjin.kwon] WDYT of the

[jira] [Created] (SPARK-30485) Remove SQL configs deprecated before v2.4

Maxim Gekk created SPARK-30485: -- Summary: Remove SQL configs deprecated before v2.4 Key: SPARK-30485 URL: https://issues.apache.org/jira/browse/SPARK-30485 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-30482) Add sub-class of AppenderSkeleton reusable in tests

[ https://issues.apache.org/jira/browse/SPARK-30482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30482: --- Component/s: (was: SQL) > Add sub-class of AppenderSkeleton reusable in tests >

[jira] [Created] (SPARK-30482) Add sub-class of AppenderSkeleton reusable in tests

Maxim Gekk created SPARK-30482: -- Summary: Add sub-class of AppenderSkeleton reusable in tests Key: SPARK-30482 URL: https://issues.apache.org/jira/browse/SPARK-30482 Project: Spark Issue Type:

<    1   2   3   4   5   6   7   8   9   10   >