[jira] [Commented] (SPARK-30442) Write mode ignored when using CodecStreams

2020-01-07 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009963#comment-17009963 ] Maxim Gekk commented on SPARK-30442: > This can cause issues, particularly with aws tools, that make

[jira] [Commented] (SPARK-30429) WideSchemaBenchmark fails with OOM

2020-01-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009398#comment-17009398 ] Maxim Gekk commented on SPARK-30429: Bisect have found the first bad commit. I specified the recent

[jira] [Commented] (SPARK-30429) WideSchemaBenchmark fails with OOM

2020-01-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009189#comment-17009189 ] Maxim Gekk commented on SPARK-30429: [~dongjoon] I ran git bisect. Let see what it will find during

[jira] [Updated] (SPARK-30429) WideSchemaBenchmark fails with OOM

2020-01-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30429: --- Attachment: WideSchemaBenchmark_console.txt > WideSchemaBenchmark fails with OOM >

[jira] [Created] (SPARK-30429) WideSchemaBenchmark fails with OOM

2020-01-05 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30429: -- Summary: WideSchemaBenchmark fails with OOM Key: SPARK-30429 URL: https://issues.apache.org/jira/browse/SPARK-30429 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-30416) Log a warning for deprecated SQL config in `set()` and `unset()`

2020-01-03 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30416: -- Summary: Log a warning for deprecated SQL config in `set()` and `unset()` Key: SPARK-30416 URL: https://issues.apache.org/jira/browse/SPARK-30416 Project: Spark

[jira] [Created] (SPARK-30412) Eliminate warnings in Java tests regarding to deprecated API

2020-01-02 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30412: -- Summary: Eliminate warnings in Java tests regarding to deprecated API Key: SPARK-30412 URL: https://issues.apache.org/jira/browse/SPARK-30412 Project: Spark

[jira] [Commented] (SPARK-30174) Eliminate warnings :part 4

2020-01-02 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006953#comment-17006953 ] Maxim Gekk commented on SPARK-30174: [~shivuson...@gmail.com] Are you still working on this? If so,

[jira] [Commented] (SPARK-30172) Eliminate warnings: part3

2020-01-02 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006952#comment-17006952 ] Maxim Gekk commented on SPARK-30172: [~Ankitraj] Are you still working on this? > Eliminate

[jira] [Commented] (SPARK-30171) Eliminate warnings: part2

2020-01-02 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006949#comment-17006949 ] Maxim Gekk commented on SPARK-30171: [~srowen] SPARK-30258 fixes warnings AvroFunctionsSuite.scala

[jira] [Created] (SPARK-30409) Use `NoOp` datasource in SQL benchmarks

2020-01-02 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30409: -- Summary: Use `NoOp` datasource in SQL benchmarks Key: SPARK-30409 URL: https://issues.apache.org/jira/browse/SPARK-30409 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-30401) Call requireNonStaticConf() only once

2020-01-01 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006392#comment-17006392 ] Maxim Gekk commented on SPARK-30401: I am working on it > Call requireNonStaticConf() only once >

[jira] [Created] (SPARK-30401) Call requireNonStaticConf() only once

2020-01-01 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30401: -- Summary: Call requireNonStaticConf() only once Key: SPARK-30401 URL: https://issues.apache.org/jira/browse/SPARK-30401 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-30323) Support filters pushdown in CSV datasource

2019-12-20 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30323: -- Summary: Support filters pushdown in CSV datasource Key: SPARK-30323 URL: https://issues.apache.org/jira/browse/SPARK-30323 Project: Spark Issue Type:

[jira] [Created] (SPARK-30309) Mark `Filter` as a `sealed` class

2019-12-19 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30309: -- Summary: Mark `Filter` as a `sealed` class Key: SPARK-30309 URL: https://issues.apache.org/jira/browse/SPARK-30309 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-30258) Eliminate warnings of deprecated Spark APIs in tests

2019-12-13 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30258: --- Summary: Eliminate warnings of deprecated Spark APIs in tests (was: Eliminate warnings of

[jira] [Created] (SPARK-30258) Eliminate warnings of depracted Spark APIs in tests

2019-12-13 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30258: -- Summary: Eliminate warnings of depracted Spark APIs in tests Key: SPARK-30258 URL: https://issues.apache.org/jira/browse/SPARK-30258 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30168) Eliminate warnings in Parquet datasource

2019-12-13 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995754#comment-16995754 ] Maxim Gekk commented on SPARK-30168: [~Ankitraj] Go ahead. > Eliminate warnings in Parquet

[jira] [Commented] (SPARK-30165) Eliminate compilation warnings

2019-12-12 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994806#comment-16994806 ] Maxim Gekk commented on SPARK-30165: > Are you sure on these? I am almost sure we can fix Parquet

[jira] [Updated] (SPARK-30170) Eliminate warnings: part 1

2019-12-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30170: --- Description: Eliminate compilation warnings in: # StopWordsRemoverSuite {code:java}

[jira] [Commented] (SPARK-30170) Eliminate warnings: part 1

2019-12-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990989#comment-16990989 ] Maxim Gekk commented on SPARK-30170: I am working on this > Eliminate warnings: part 1 >

[jira] [Created] (SPARK-30170) Eliminate warnings: part 1

2019-12-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30170: -- Summary: Eliminate warnings: part 1 Key: SPARK-30170 URL: https://issues.apache.org/jira/browse/SPARK-30170 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-30169) Eliminate warnings in Kafka connector

2019-12-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30169: -- Summary: Eliminate warnings in Kafka connector Key: SPARK-30169 URL: https://issues.apache.org/jira/browse/SPARK-30169 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-30166) Eliminate warnings in JSONOptions

2019-12-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30166: --- Summary: Eliminate warnings in JSONOptions (was: Eliminate compilation warnings in JSONOptions) >

[jira] [Created] (SPARK-30168) Eliminate warnings in Parquet datasource

2019-12-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30168: -- Summary: Eliminate warnings in Parquet datasource Key: SPARK-30168 URL: https://issues.apache.org/jira/browse/SPARK-30168 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-30165) Eliminate compilation warnings

2019-12-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990925#comment-16990925 ] Maxim Gekk commented on SPARK-30165: [~aman_omer] Feel free to take a sub-set of warnings and create

[jira] [Updated] (SPARK-30165) Eliminate compilation warnings

2019-12-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30165: --- Component/s: (was: Build) SQL > Eliminate compilation warnings >

[jira] [Created] (SPARK-30166) Eliminate compilation warnings in JSONOptions

2019-12-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30166: -- Summary: Eliminate compilation warnings in JSONOptions Key: SPARK-30166 URL: https://issues.apache.org/jira/browse/SPARK-30166 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30165) Eliminate compilation warnings

2019-12-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30165: --- Description: This is an umbrella ticket for sub-tasks for eliminating compilation warnings. I

[jira] [Updated] (SPARK-30165) Eliminate compilation warnings

2019-12-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30165: --- Attachment: spark_warnings.txt > Eliminate compilation warnings > -- >

[jira] [Created] (SPARK-30165) Eliminate compilation warnings

2019-12-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30165: -- Summary: Eliminate compilation warnings Key: SPARK-30165 URL: https://issues.apache.org/jira/browse/SPARK-30165 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-29963) Check formatting timestamps up to microsecond precision by JSON/CSV datasource

2019-11-19 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29963: -- Summary: Check formatting timestamps up to microsecond precision by JSON/CSV datasource Key: SPARK-29963 URL: https://issues.apache.org/jira/browse/SPARK-29963 Project:

[jira] [Created] (SPARK-29949) JSON/CSV formats timestamps incorrectly

2019-11-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29949: -- Summary: JSON/CSV formats timestamps incorrectly Key: SPARK-29949 URL: https://issues.apache.org/jira/browse/SPARK-29949 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-29758) json_tuple truncates fields

2019-11-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976106#comment-16976106 ] Maxim Gekk edited comment on SPARK-29758 at 11/17/19 6:17 PM: -- Another

[jira] [Commented] (SPARK-29758) json_tuple truncates fields

2019-11-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976106#comment-16976106 ] Maxim Gekk commented on SPARK-29758: Another solution is to remove this optimization:

[jira] [Commented] (SPARK-29575) from_json can produce nulls for fields which are marked as non-nullable

2019-11-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976102#comment-16976102 ] Maxim Gekk commented on SPARK-29575: This is intentional behavior. User's schema is forcibly set as

[jira] [Commented] (SPARK-29758) json_tuple truncates fields

2019-11-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976099#comment-16976099 ] Maxim Gekk commented on SPARK-29758: I have reproduced the issue on 2.4. The problem is in Jackson

[jira] [Updated] (SPARK-29933) ThriftServerQueryTestSuite runs tests with wrong settings

2019-11-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29933: --- Attachment: filter_tests.patch > ThriftServerQueryTestSuite runs tests with wrong settings >

[jira] [Created] (SPARK-29933) ThriftServerQueryTestSuite runs tests with wrong settings

2019-11-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29933: -- Summary: ThriftServerQueryTestSuite runs tests with wrong settings Key: SPARK-29933 URL: https://issues.apache.org/jira/browse/SPARK-29933 Project: Spark Issue

[jira] [Commented] (SPARK-29931) Declare all SQL legacy configs as will be removed in Spark 4.0

2019-11-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975944#comment-16975944 ] Maxim Gekk commented on SPARK-29931: > It's conceivable there could a reason to do it later, or

[jira] [Commented] (SPARK-29931) Declare all SQL legacy configs as will be removed in Spark 4.0

2019-11-16 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975813#comment-16975813 ] Maxim Gekk commented on SPARK-29931: [~rxin] [~lixiao] [~srowen] [~dongjoon] [~cloud_fan]

[jira] [Created] (SPARK-29931) Declare all SQL legacy configs as will be removed in Spark 4.0

2019-11-16 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29931: -- Summary: Declare all SQL legacy configs as will be removed in Spark 4.0 Key: SPARK-29931 URL: https://issues.apache.org/jira/browse/SPARK-29931 Project: Spark

[jira] [Created] (SPARK-29930) Remove SQL configs declared to be removed in Spark 3.0

2019-11-16 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29930: -- Summary: Remove SQL configs declared to be removed in Spark 3.0 Key: SPARK-29930 URL: https://issues.apache.org/jira/browse/SPARK-29930 Project: Spark Issue

[jira] [Created] (SPARK-29928) Check parsing timestamps up to microsecond precision by JSON/CSV datasource

2019-11-16 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29928: -- Summary: Check parsing timestamps up to microsecond precision by JSON/CSV datasource Key: SPARK-29928 URL: https://issues.apache.org/jira/browse/SPARK-29928 Project:

[jira] [Updated] (SPARK-29904) Parse timestamps in microsecond precision by JSON/CSV datasources

2019-11-16 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29904: --- Affects Version/s: 2.4.0 2.4.1 2.4.2

[jira] [Commented] (SPARK-29927) Parse timestamps in microsecond precision by `to_timestamp`, `to_unix_timestamp`, `unix_timestamp`

2019-11-16 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975697#comment-16975697 ] Maxim Gekk commented on SPARK-29927: [~cloud_fan] WDYT, does it make sense to change the functions

[jira] [Created] (SPARK-29927) Parse timestamps in microsecond precision by `to_timestamp`, `to_unix_timestamp`, `unix_timestamp`

2019-11-16 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29927: -- Summary: Parse timestamps in microsecond precision by `to_timestamp`, `to_unix_timestamp`, `unix_timestamp` Key: SPARK-29927 URL: https://issues.apache.org/jira/browse/SPARK-29927

[jira] [Created] (SPARK-29920) Parsing failure on interval '20 15' day to hour

2019-11-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29920: -- Summary: Parsing failure on interval '20 15' day to hour Key: SPARK-29920 URL: https://issues.apache.org/jira/browse/SPARK-29920 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-29904) Parse timestamps in microsecond precision by JSON/CSV datasources

2019-11-14 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29904: -- Summary: Parse timestamps in microsecond precision by JSON/CSV datasources Key: SPARK-29904 URL: https://issues.apache.org/jira/browse/SPARK-29904 Project: Spark

[jira] [Created] (SPARK-29866) Upper case enum values

2019-11-12 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29866: -- Summary: Upper case enum values Key: SPARK-29866 URL: https://issues.apache.org/jira/browse/SPARK-29866 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-29864) Strict parsing of day-time strings to intervals

2019-11-12 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29864: -- Summary: Strict parsing of day-time strings to intervals Key: SPARK-29864 URL: https://issues.apache.org/jira/browse/SPARK-29864 Project: Spark Issue Type:

[jira] [Created] (SPARK-29819) Introduce an enum for interval units

2019-11-09 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29819: -- Summary: Introduce an enum for interval units Key: SPARK-29819 URL: https://issues.apache.org/jira/browse/SPARK-29819 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-29385) Make `INTERVAL` values comparable

2019-11-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-29385. Fix Version/s: 3.0.0 Resolution: Fixed Resolved by the PR:

[jira] [Updated] (SPARK-29408) Support interval literal with negative sign `-`

2019-11-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29408: --- Description: For example: {code} maxim=# select -interval '1 day -1 hour'; ?column?

[jira] [Created] (SPARK-29750) Avoid dependency from joda-time

2019-11-04 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29750: -- Summary: Avoid dependency from joda-time Key: SPARK-29750 URL: https://issues.apache.org/jira/browse/SPARK-29750 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-29736) Improve stability of tests for special datetime values

2019-11-03 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29736: -- Summary: Improve stability of tests for special datetime values Key: SPARK-29736 URL: https://issues.apache.org/jira/browse/SPARK-29736 Project: Spark Issue

[jira] [Created] (SPARK-29733) Wrong order of assertEquals parameters

2019-11-03 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29733: -- Summary: Wrong order of assertEquals parameters Key: SPARK-29733 URL: https://issues.apache.org/jira/browse/SPARK-29733 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-29723) Get date and time parts of an interval as java classes

2019-11-02 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29723: -- Summary: Get date and time parts of an interval as java classes Key: SPARK-29723 URL: https://issues.apache.org/jira/browse/SPARK-29723 Project: Spark Issue

[jira] [Created] (SPARK-29712) fromDayTimeString() does not take into account the left bound

2019-11-01 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29712: -- Summary: fromDayTimeString() does not take into account the left bound Key: SPARK-29712 URL: https://issues.apache.org/jira/browse/SPARK-29712 Project: Spark

[jira] [Commented] (SPARK-29636) Can't parse '11:00 BST' or '2000-10-19 10:23:54+01' signatures to timestamp

2019-10-31 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963680#comment-16963680 ] Maxim Gekk commented on SPARK-29636: 1. The output is different because Spark uses the session local

[jira] [Commented] (SPARK-29671) Change format of interval string

2019-10-30 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963375#comment-16963375 ] Maxim Gekk commented on SPARK-29671: For example, PostgreSQL displays intervals like: {code} maxim=#

[jira] [Commented] (SPARK-29671) Change format of interval string

2019-10-30 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963373#comment-16963373 ] Maxim Gekk commented on SPARK-29671: [~cloud_fan][~dongjoon] Let's discuss here how to improve the

[jira] [Created] (SPARK-29671) Change format of interval string

2019-10-30 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29671: -- Summary: Change format of interval string Key: SPARK-29671 URL: https://issues.apache.org/jira/browse/SPARK-29671 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-29669) Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29669: -- Summary: Refactor IntervalUtils.fromDayTimeString() Key: SPARK-29669 URL: https://issues.apache.org/jira/browse/SPARK-29669 Project: Spark Issue Type:

[jira] [Created] (SPARK-29651) Incorrect parsing of interval seconds fraction

2019-10-30 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29651: -- Summary: Incorrect parsing of interval seconds fraction Key: SPARK-29651 URL: https://issues.apache.org/jira/browse/SPARK-29651 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-29614) Failure of DateTimeUtilsSuite and TimestampFormatterSuite

2019-10-27 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29614: -- Summary: Failure of DateTimeUtilsSuite and TimestampFormatterSuite Key: SPARK-29614 URL: https://issues.apache.org/jira/browse/SPARK-29614 Project: Spark Issue

[jira] [Created] (SPARK-29607) Move static methods from CalendarInterval to IntervalUtils

2019-10-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29607: -- Summary: Move static methods from CalendarInterval to IntervalUtils Key: SPARK-29607 URL: https://issues.apache.org/jira/browse/SPARK-29607 Project: Spark Issue

[jira] [Created] (SPARK-29605) Optimize string to interval casting

2019-10-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29605: -- Summary: Optimize string to interval casting Key: SPARK-29605 URL: https://issues.apache.org/jira/browse/SPARK-29605 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-29533) Benchmark casting strings to intervals

2019-10-21 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29533: -- Summary: Benchmark casting strings to intervals Key: SPARK-29533 URL: https://issues.apache.org/jira/browse/SPARK-29533 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-29524) Unordered interval units

2019-10-20 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29524: -- Summary: Unordered interval units Key: SPARK-29524 URL: https://issues.apache.org/jira/browse/SPARK-29524 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29520) Incorrect checking of negative intervals

2019-10-19 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29520: -- Summary: Incorrect checking of negative intervals Key: SPARK-29520 URL: https://issues.apache.org/jira/browse/SPARK-29520 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-29518) Benchmark `date_part` for `INTERVAL`

2019-10-19 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29518: -- Summary: Benchmark `date_part` for `INTERVAL` Key: SPARK-29518 URL: https://issues.apache.org/jira/browse/SPARK-29518 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-29508) Implicitly cast strings in datetime arithmetic operations

2019-10-18 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954579#comment-16954579 ] Maxim Gekk commented on SPARK-29508: I am working on it > Implicitly cast strings in datetime

[jira] [Created] (SPARK-29508) Implicitly cast strings in datetime arithmetic operations

2019-10-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29508: -- Summary: Implicitly cast strings in datetime arithmetic operations Key: SPARK-29508 URL: https://issues.apache.org/jira/browse/SPARK-29508 Project: Spark Issue

[jira] [Updated] (SPARK-29387) Support `*` and `/` operators for intervals

2019-10-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29387: --- Summary: Support `*` and `/` operators for intervals (was: Support `*` and `\` operators for

[jira] [Commented] (SPARK-10848) Applied JSON Schema Works for json RDD but not when loading json file

2019-10-13 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950461#comment-16950461 ] Maxim Gekk commented on SPARK-10848: Nullable = false in user's schema cannot guarantee that nulls

[jira] [Created] (SPARK-29448) Support the `INTERVAL` type by Parquet datasource

2019-10-12 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29448: -- Summary: Support the `INTERVAL` type by Parquet datasource Key: SPARK-29448 URL: https://issues.apache.org/jira/browse/SPARK-29448 Project: Spark Issue Type:

[jira] [Created] (SPARK-29440) Support java.time.Duration as an external type of CalendarIntervalType

2019-10-11 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29440: -- Summary: Support java.time.Duration as an external type of CalendarIntervalType Key: SPARK-29440 URL: https://issues.apache.org/jira/browse/SPARK-29440 Project: Spark

[jira] [Updated] (SPARK-29382) Support writing `INTERVAL` type to datasource table

2019-10-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29382: --- Description: Creating a table with `INTERVAL` column for writing failed with the error: {code:java}

[jira] [Updated] (SPARK-29382) Support writing `INTERVAL` type to datasource table

2019-10-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29382: --- Summary: Support writing `INTERVAL` type to datasource table (was: Support the `INTERVAL` type by

[jira] [Commented] (SPARK-26651) Use Proleptic Gregorian calendar

2019-10-10 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948957#comment-16948957 ] Maxim Gekk commented on SPARK-26651: [~jiangxb] Could you consider this for including to the major

[jira] [Updated] (SPARK-29408) Support interval literal with negative sign `-`

2019-10-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29408: --- Summary: Support interval literal with negative sign `-` (was: Support interval literal with

[jira] [Created] (SPARK-29408) Support interval literal with negative sign `-`.

2019-10-09 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29408: -- Summary: Support interval literal with negative sign `-`. Key: SPARK-29408 URL: https://issues.apache.org/jira/browse/SPARK-29408 Project: Spark Issue Type:

[jira] [Created] (SPARK-29407) Support syntax for zero interval

2019-10-09 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29407: -- Summary: Support syntax for zero interval Key: SPARK-29407 URL: https://issues.apache.org/jira/browse/SPARK-29407 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29406) Interval output styles

2019-10-09 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29406: -- Summary: Interval output styles Key: SPARK-29406 URL: https://issues.apache.org/jira/browse/SPARK-29406 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-29370) Interval strings without explicit unit markings

2019-10-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29370: --- Description: In PostgreSQL, Quantities of days, hours, minutes, and seconds can be specified

[jira] [Created] (SPARK-29395) Precision of the interval type

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29395: -- Summary: Precision of the interval type Key: SPARK-29395 URL: https://issues.apache.org/jira/browse/SPARK-29395 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29394) Support ISO 8601 format for intervals

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29394: -- Summary: Support ISO 8601 format for intervals Key: SPARK-29394 URL: https://issues.apache.org/jira/browse/SPARK-29394 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29393) Add the make_interval() function

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29393: -- Summary: Add the make_interval() function Key: SPARK-29393 URL: https://issues.apache.org/jira/browse/SPARK-29393 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29391) Default year-month units

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29391: -- Summary: Default year-month units Key: SPARK-29391 URL: https://issues.apache.org/jira/browse/SPARK-29391 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29390) Add the justify_days(), justify_hours() and justify_interval() functions

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29390: -- Summary: Add the justify_days(), justify_hours() and justify_interval() functions Key: SPARK-29390 URL: https://issues.apache.org/jira/browse/SPARK-29390 Project:

[jira] [Created] (SPARK-29389) Short synonyms of interval units

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29389: -- Summary: Short synonyms of interval units Key: SPARK-29389 URL: https://issues.apache.org/jira/browse/SPARK-29389 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-29389) Support synonyms for interval units

2019-10-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29389: --- Summary: Support synonyms for interval units (was: Short synonyms of interval units) > Support

[jira] [Created] (SPARK-29388) Construct intervals from the `millenniums`, `centuries` or `decades` units

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29388: -- Summary: Construct intervals from the `millenniums`, `centuries` or `decades` units Key: SPARK-29388 URL: https://issues.apache.org/jira/browse/SPARK-29388 Project:

[jira] [Created] (SPARK-29387) Support `*` and `\` operators for intervals

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29387: -- Summary: Support `*` and `\` operators for intervals Key: SPARK-29387 URL: https://issues.apache.org/jira/browse/SPARK-29387 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29386) Copy data between a file and a table

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29386: -- Summary: Copy data between a file and a table Key: SPARK-29386 URL: https://issues.apache.org/jira/browse/SPARK-29386 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29385) Make `INTERVAL` values comparable

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29385: -- Summary: Make `INTERVAL` values comparable Key: SPARK-29385 URL: https://issues.apache.org/jira/browse/SPARK-29385 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29384) Support `ago` in interval strings

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29384: -- Summary: Support `ago` in interval strings Key: SPARK-29384 URL: https://issues.apache.org/jira/browse/SPARK-29384 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29383) Support the optional prefix `@` in interval strings

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29383: -- Summary: Support the optional prefix `@` in interval strings Key: SPARK-29383 URL: https://issues.apache.org/jira/browse/SPARK-29383 Project: Spark Issue Type:

[jira] [Created] (SPARK-29382) Support the `INTERVAL` type by Parquet datasource

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29382: -- Summary: Support the `INTERVAL` type by Parquet datasource Key: SPARK-29382 URL: https://issues.apache.org/jira/browse/SPARK-29382 Project: Spark Issue Type:

<    2   3   4   5   6   7   8   9   10   11   >