[jira] [Reopened] (SPARK-24640) size(null) returns null

2019-10-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk reopened SPARK-24640: > size(null) returns null > > > Key: SPARK-24640 >

[jira] [Comment Edited] (SPARK-24640) size(null) returns null

2019-10-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946503#comment-16946503 ] Maxim Gekk edited comment on SPARK-24640 at 10/8/19 6:11 AM: - As far as I

[jira] [Commented] (SPARK-24640) size(null) returns null

2019-10-07 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946503#comment-16946503 ] Maxim Gekk commented on SPARK-24640: As far as I remember we planed to remove

[jira] [Created] (SPARK-29371) Support interval field values with fractional parts

2019-10-07 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29371: -- Summary: Support interval field values with fractional parts Key: SPARK-29371 URL: https://issues.apache.org/jira/browse/SPARK-29371 Project: Spark Issue Type:

[jira] [Created] (SPARK-29370) Interval strings without explicit unit markings

2019-10-07 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29370: -- Summary: Interval strings without explicit unit markings Key: SPARK-29370 URL: https://issues.apache.org/jira/browse/SPARK-29370 Project: Spark Issue Type:

[jira] [Created] (SPARK-29369) Accept strings without `interval` prefix in casting to intervals

2019-10-07 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29369: -- Summary: Accept strings without `interval` prefix in casting to intervals Key: SPARK-29369 URL: https://issues.apache.org/jira/browse/SPARK-29369 Project: Spark

[jira] [Commented] (SPARK-29368) Port interval.sql

2019-10-07 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16945666#comment-16945666 ] Maxim Gekk commented on SPARK-29368: I am working on this > Port interval.sql > - >

[jira] [Created] (SPARK-29368) Port interval.sql

2019-10-07 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29368: -- Summary: Port interval.sql Key: SPARK-29368 URL: https://issues.apache.org/jira/browse/SPARK-29368 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Created] (SPARK-29365) Support date and timestamp subtraction

2019-10-06 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29365: -- Summary: Support date and timestamp subtraction Key: SPARK-29365 URL: https://issues.apache.org/jira/browse/SPARK-29365 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29364) Return intervals from date subtracts

2019-10-05 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29364: -- Summary: Return intervals from date subtracts Key: SPARK-29364 URL: https://issues.apache.org/jira/browse/SPARK-29364 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-24540) Support for multiple character delimiter in Spark CSV read

2019-10-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16945044#comment-16945044 ] Maxim Gekk commented on SPARK-24540: [~hyukjin.kwon] I think we should open one JIRA ticket for

[jira] [Updated] (SPARK-29362) Move timestamp expressions and tests to separate files

2019-10-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29362: --- Summary: Move timestamp expressions and tests to separate files (was: Move timestamp expression

[jira] [Created] (SPARK-29362) Move timestamp expression and tests to separate files

2019-10-05 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29362: -- Summary: Move timestamp expression and tests to separate files Key: SPARK-29362 URL: https://issues.apache.org/jira/browse/SPARK-29362 Project: Spark Issue

[jira] [Commented] (SPARK-25440) Dump query execution info to a file

2019-10-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944822#comment-16944822 ] Maxim Gekk commented on SPARK-25440: [~shashidha...@gmail.com] Call

[jira] [Updated] (SPARK-28425) Add more Date/Time Operators

2019-10-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28425: --- Description: ||Operator||Example||Result|| |{{+}}|{{date '2001-09-28' + interval '1

[jira] [Updated] (SPARK-29355) Support timestamps subtraction

2019-10-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29355: --- Description: ||Operator||Example||Result|| |{{-}}|{{timestamp '2001-09-29 03:00' - timestamp

[jira] [Created] (SPARK-29355) Support timestamps subtraction

2019-10-04 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29355: -- Summary: Support timestamps subtraction Key: SPARK-29355 URL: https://issues.apache.org/jira/browse/SPARK-29355 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29342) Make casting strings to intervals case insensitive

2019-10-03 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29342: -- Summary: Make casting strings to intervals case insensitive Key: SPARK-29342 URL: https://issues.apache.org/jira/browse/SPARK-29342 Project: Spark Issue Type:

[jira] [Updated] (SPARK-29328) Incorrect calculation mean seconds per month

2019-10-03 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29328: --- Labels: correctness (was: ) > Incorrect calculation mean seconds per month >

[jira] [Created] (SPARK-29328) Incorrect calculation mean seconds per month

2019-10-02 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29328: -- Summary: Incorrect calculation mean seconds per month Key: SPARK-29328 URL: https://issues.apache.org/jira/browse/SPARK-29328 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29313) Failure on writing to `noop` datasource in benchmarks

2019-10-01 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29313: --- Summary: Failure on writing to `noop` datasource in benchmarks (was: Failure on overwriting

[jira] [Created] (SPARK-29313) Failure on overwriting benchmark results

2019-10-01 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29313: -- Summary: Failure on overwriting benchmark results Key: SPARK-29313 URL: https://issues.apache.org/jira/browse/SPARK-29313 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-29311) Return seconds with fraction from `date_part`/`extract`

2019-10-01 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29311: -- Summary: Return seconds with fraction from `date_part`/`extract` Key: SPARK-29311 URL: https://issues.apache.org/jira/browse/SPARK-29311 Project: Spark Issue

[jira] [Commented] (SPARK-29275) Update the SQL migration guide regarding special date/timestamp values

2019-09-29 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940445#comment-16940445 ] Maxim Gekk commented on SPARK-29275: [~dongjoon] Can we resolve this? > Update the SQL migration

[jira] [Resolved] (SPARK-24171) Update comments for non-deterministic functions

2019-09-29 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-24171. Fix Version/s: 2.4.0 Resolution: Done > Update comments for non-deterministic functions >

[jira] [Resolved] (SPARK-24591) Number of cores and executors in the cluster

2019-09-29 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-24591. Resolution: Won't Fix > Number of cores and executors in the cluster >

[jira] [Resolved] (SPARK-25440) Dump query execution info to a file

2019-09-29 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-25440. Fix Version/s: 3.0.0 Resolution: Fixed > Dump query execution info to a file >

[jira] [Commented] (SPARK-29115) Add benchmarks for make_date() and make_timestamp()

2019-09-29 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940440#comment-16940440 ] Maxim Gekk commented on SPARK-29115: [~dongjoon]This can be resolved, I think. > Add benchmarks for

[jira] [Commented] (SPARK-29155) Support special date/timestamp values in the PostgreSQL dialect only

2019-09-29 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940439#comment-16940439 ] Maxim Gekk commented on SPARK-29155: [~dongjoon]This can be resolved, right? > Support special

[jira] [Commented] (SPARK-29241) Show alternative names in the function description

2019-09-29 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940438#comment-16940438 ] Maxim Gekk commented on SPARK-29241: [~dongjoon] [~hyukjin.kwon] [~srowen] WDYT? Will this feature

[jira] [Created] (SPARK-29275) Update the SQL migration guide regarding special date/timestamp values

2019-09-27 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29275: -- Summary: Update the SQL migration guide regarding special date/timestamp values Key: SPARK-29275 URL: https://issues.apache.org/jira/browse/SPARK-29275 Project: Spark

[jira] [Resolved] (SPARK-29264) Incorrect example for the RLike expression

2019-09-26 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-29264. Resolution: Won't Fix > Incorrect example for the RLike expression >

[jira] [Commented] (SPARK-29264) Incorrect example for the RLike expression

2019-09-26 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938952#comment-16938952 ] Maxim Gekk commented on SPARK-29264: Remove Rlike from the ignore set after fix: 

[jira] [Updated] (SPARK-29264) Incorrect example for the RLike expression

2019-09-26 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29264: --- Summary: Incorrect example for the RLike expression (was: Fix examples for the RLike expression)

[jira] [Created] (SPARK-29264) Fix examples for the RLike expression

2019-09-26 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29264: -- Summary: Fix examples for the RLike expression Key: SPARK-29264 URL: https://issues.apache.org/jira/browse/SPARK-29264 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-29242) Check results of expression examples automatically

2019-09-26 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938388#comment-16938388 ] Maxim Gekk commented on SPARK-29242: I am working on this > Check results of expression examples

[jira] [Created] (SPARK-29242) Check results of expression examples automatically

2019-09-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29242: -- Summary: Check results of expression examples automatically Key: SPARK-29242 URL: https://issues.apache.org/jira/browse/SPARK-29242 Project: Spark Issue Type:

[jira] [Created] (SPARK-29241) Show alternative names in the function description

2019-09-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29241: -- Summary: Show alternative names in the function description Key: SPARK-29241 URL: https://issues.apache.org/jira/browse/SPARK-29241 Project: Spark Issue Type:

[jira] [Created] (SPARK-29237) Use _FUNC_ in expression examples

2019-09-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29237: -- Summary: Use _FUNC_ in expression examples Key: SPARK-29237 URL: https://issues.apache.org/jira/browse/SPARK-29237 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-29200) Optimize `extract`/`date_part` for epoch

2019-09-21 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29200: -- Summary: Optimize `extract`/`date_part` for epoch Key: SPARK-29200 URL: https://issues.apache.org/jira/browse/SPARK-29200 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-29190) Optimize `extract`/`date_part` for the milliseconds `field`

2019-09-20 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29190: -- Summary: Optimize `extract`/`date_part` for the milliseconds `field` Key: SPARK-29190 URL: https://issues.apache.org/jira/browse/SPARK-29190 Project: Spark

[jira] [Created] (SPARK-29187) Return null from `date_part()` for the null `field`

2019-09-20 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29187: -- Summary: Return null from `date_part()` for the null `field` Key: SPARK-29187 URL: https://issues.apache.org/jira/browse/SPARK-29187 Project: Spark Issue Type:

[jira] [Updated] (SPARK-29171) Performance regression in Parquet MR on scans of 100 columns

2019-09-19 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29171: --- Description: The updated benchmark results show performance regression *more than 4 times* in

[jira] [Updated] (SPARK-29170) Performance regression in CSV/JSON on partitioned tables

2019-09-19 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29170: --- Description: The updated benchmark results show performance regression *(2 times slower)* in

[jira] [Updated] (SPARK-29169) Performance regression in ORC Vectorized on TINYINT scans

2019-09-19 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29169: --- Description: The updated benchmark results show performance regression *(almost 2 times slower)*

[jira] [Updated] (SPARK-29169) Performance regression in ORC Vectorized on TINYINT scans

2019-09-19 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29169: --- Description: The updated benchmark results show performance regression *(almost 2 times slower)* in

[jira] [Updated] (SPARK-29170) Performance regression in CSV/JSON on partitioned tables

2019-09-19 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29170: --- Description: The updated benchmark results show performance regression *(2 times slower)* in

[jira] [Created] (SPARK-29171) Performance regression in Parquet MR on scans of 100 columns

2019-09-19 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29171: -- Summary: Performance regression in Parquet MR on scans of 100 columns Key: SPARK-29171 URL: https://issues.apache.org/jira/browse/SPARK-29171 Project: Spark

[jira] [Updated] (SPARK-29171) Performance regression in Parquet MR on scans of 100 columns

2019-09-19 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29171: --- Description: The updated benchmark results show performance regression *more than 4 times* in

[jira] [Created] (SPARK-29170) Performance regression in CSV/JSON on partitioned tables

2019-09-19 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29170: -- Summary: Performance regression in CSV/JSON on partitioned tables Key: SPARK-29170 URL: https://issues.apache.org/jira/browse/SPARK-29170 Project: Spark Issue

[jira] [Updated] (SPARK-29169) Performance regression in ORC Vectorized on TINYINT scans

2019-09-19 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29169: --- Summary: Performance regression in ORC Vectorized on TINYINT scans (was: Fix performance

[jira] [Created] (SPARK-29169) Fix performance regression in ORC Vectorized

2019-09-19 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29169: -- Summary: Fix performance regression in ORC Vectorized Key: SPARK-29169 URL: https://issues.apache.org/jira/browse/SPARK-29169 Project: Spark Issue Type:

[jira] [Created] (SPARK-29155) Support special date/timestamp values in the PostgreSQL dialect only

2019-09-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29155: -- Summary: Support special date/timestamp values in the PostgreSQL dialect only Key: SPARK-29155 URL: https://issues.apache.org/jira/browse/SPARK-29155 Project: Spark

[jira] [Created] (SPARK-29141) Use SqlBasedBenchmark in SQL benchmarks

2019-09-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29141: -- Summary: Use SqlBasedBenchmark in SQL benchmarks Key: SPARK-29141 URL: https://issues.apache.org/jira/browse/SPARK-29141 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-29115) Add benchmarks for make_date() and make_timestamp()

2019-09-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29115: -- Summary: Add benchmarks for make_date() and make_timestamp() Key: SPARK-29115 URL: https://issues.apache.org/jira/browse/SPARK-29115 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29055) Memory leak in Spark Driver

2019-09-16 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930467#comment-16930467 ] Maxim Gekk commented on SPARK-29055: [~Geopap] Can you provide the csv files? > Memory leak in

[jira] [Resolved] (SPARK-29090) Invalid patterns of seconds fractions in functions comments

2019-09-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-29090. Resolution: Won't Fix > Invalid patterns of seconds fractions in functions comments >

[jira] [Created] (SPARK-29090) Invalid patterns of seconds fractions in functions comments

2019-09-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29090: -- Summary: Invalid patterns of seconds fractions in functions comments Key: SPARK-29090 URL: https://issues.apache.org/jira/browse/SPARK-29090 Project: Spark

[jira] [Created] (SPARK-29074) Optimize `date_format` for foldable `fmt`

2019-09-13 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29074: -- Summary: Optimize `date_format` for foldable `fmt` Key: SPARK-29074 URL: https://issues.apache.org/jira/browse/SPARK-29074 Project: Spark Issue Type:

[jira] [Created] (SPARK-29065) Extend `EXTRACT` benchmark

2019-09-12 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29065: -- Summary: Extend `EXTRACT` benchmark Key: SPARK-29065 URL: https://issues.apache.org/jira/browse/SPARK-29065 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-29024) Ignore case while resolving time zones

2019-09-10 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29024: --- Summary: Ignore case while resolving time zones (was: Support the `zulu` time zone) > Ignore case

[jira] [Created] (SPARK-29025) Support seconds precision by the timestamp type

2019-09-09 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29025: -- Summary: Support seconds precision by the timestamp type Key: SPARK-29025 URL: https://issues.apache.org/jira/browse/SPARK-29025 Project: Spark Issue Type:

[jira] [Created] (SPARK-29024) Support the `zulu` time zone

2019-09-09 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29024: -- Summary: Support the `zulu` time zone Key: SPARK-29024 URL: https://issues.apache.org/jira/browse/SPARK-29024 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-29006) Support special date/timestamp values `infinity`/`-infinity`

2019-09-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925781#comment-16925781 ] Maxim Gekk commented on SPARK-29006: [~f2005...@gmail.com] Sure, you can but you will need code from

[jira] [Updated] (SPARK-28141) Date type can not accept special values

2019-09-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28141: --- Description: ||Input String||Valid Types||Description|| |{{epoch}}|{{date}}|1970-01-01 00:00:00+00

[jira] [Updated] (SPARK-28141) Date type can not accept special values

2019-09-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28141: --- Summary: Date type can not accept special values (was: Timestamp/Date type can not accept special

[jira] [Updated] (SPARK-29012) Timestamp type can not accept special values

2019-09-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29012: --- Description: ||Input String||Valid Types||Description|| |{{epoch}}|{{timestamp}}|1970-01-01

[jira] [Created] (SPARK-29012) Timestamp type can not accept special values

2019-09-06 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29012: -- Summary: Timestamp type can not accept special values Key: SPARK-29012 URL: https://issues.apache.org/jira/browse/SPARK-29012 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28141) Timestamp/Date type can not accept special values

2019-09-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28141: --- Description: ||Input String||Valid Types||Description|| |{{epoch}}|{{date}}, 

[jira] [Updated] (SPARK-28141) Timestamp/Date type can not accept special values

2019-09-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28141: --- Description: ||Input String||Valid Types||Description|| |{{epoch}}|{{date}}, 

[jira] [Updated] (SPARK-29006) Support special date/timestamp values `infinity`/`-infinity`

2019-09-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29006: --- Description: ||Input String||Valid Types||Description|| |{{infinity}}|{{date}}, {{timestamp}}|later

[jira] [Created] (SPARK-29006) Support special date/timestamp values `infinity`/`-infinity`

2019-09-06 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29006: -- Summary: Support special date/timestamp values `infinity`/`-infinity` Key: SPARK-29006 URL: https://issues.apache.org/jira/browse/SPARK-29006 Project: Spark

[jira] [Updated] (SPARK-28973) Add TimeType to Catalyst

2019-09-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28973: --- Description: The time type should represent local time in microsecond precision with valid range

[jira] [Updated] (SPARK-28973) Add TimeType to Catalyst

2019-09-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28973: --- Description: The time type should represent local time in microsecond precision with valid range of

[jira] [Created] (SPARK-28973) Add TimeType to Catalyst

2019-09-04 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-28973: -- Summary: Add TimeType to Catalyst Key: SPARK-28973 URL: https://issues.apache.org/jira/browse/SPARK-28973 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-28767) ParseException: no viable alternative at input 'year'

2019-08-17 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909712#comment-16909712 ] Maxim Gekk commented on SPARK-28767: See the PR where the issue was found: 

[jira] [Created] (SPARK-28767) ParseException: no viable alternative at input 'year'

2019-08-17 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-28767: -- Summary: ParseException: no viable alternative at input 'year' Key: SPARK-28767 URL: https://issues.apache.org/jira/browse/SPARK-28767 Project: Spark Issue

[jira] [Created] (SPARK-28745) Add benchmarks for `extract()`

2019-08-15 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-28745: -- Summary: Add benchmarks for `extract()` Key: SPARK-28745 URL: https://issues.apache.org/jira/browse/SPARK-28745 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-28718) Support field synonyms at `extract`

2019-08-13 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-28718: -- Summary: Support field synonyms at `extract` Key: SPARK-28718 URL: https://issues.apache.org/jira/browse/SPARK-28718 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-28700) make_timestamp loses seconds fractions

2019-08-12 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-28700: -- Summary: make_timestamp loses seconds fractions Key: SPARK-28700 URL: https://issues.apache.org/jira/browse/SPARK-28700 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-28420) Date/Time Functions: date_part for intervals

2019-08-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28420: --- Description: ||Function||Return Type||Description||Example||Result|| |{{date_part(}}{{text}}{{, 

[jira] [Updated] (SPARK-28420) Date/Time Functions: date_part for intervals

2019-08-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28420: --- Summary: Date/Time Functions: date_part for intervals (was: Date/Time Functions: date_part) >

[jira] [Updated] (SPARK-28690) Date/Time Functions: date_part for intervals

2019-08-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28690: --- Description: ||Function||Return Type||Description||Example||Result|| |{{date_part(}}{{text}}{{, 

[jira] [Updated] (SPARK-28690) Date/Time Functions: date_part for timestamps

2019-08-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28690: --- Summary: Date/Time Functions: date_part for timestamps (was: Date/Time Functions: date_part for

[jira] [Created] (SPARK-28690) Date/Time Functions: date_part for intervals

2019-08-11 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-28690: -- Summary: Date/Time Functions: date_part for intervals Key: SPARK-28690 URL: https://issues.apache.org/jira/browse/SPARK-28690 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28687) Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`

2019-08-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28687: --- Description: Currently, we support these field for EXTRACT: CENTURY, MILLENNIUM, DECADE, YEAR,

[jira] [Created] (SPARK-28687) Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`

2019-08-11 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-28687: -- Summary: Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()` Key: SPARK-28687 URL: https://issues.apache.org/jira/browse/SPARK-28687 Project:

[jira] [Updated] (SPARK-28656) Support `millennium`, `century` and `decade` at `extract()`

2019-08-08 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28656: --- Summary: Support `millennium`, `century` and `decade` at `extract()` (was: Support `millenium`,

[jira] [Created] (SPARK-28656) Support `millenium`, `century` and `decade` at `extract()`

2019-08-08 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-28656: -- Summary: Support `millenium`, `century` and `decade` at `extract()` Key: SPARK-28656 URL: https://issues.apache.org/jira/browse/SPARK-28656 Project: Spark Issue

[jira] [Created] (SPARK-28643) Use Java 8 time API in Dataset.show

2019-08-07 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-28643: -- Summary: Use Java 8 time API in Dataset.show Key: SPARK-28643 URL: https://issues.apache.org/jira/browse/SPARK-28643 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-28624) make_date is inconsistent when reading from table

2019-08-05 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900090#comment-16900090 ] Maxim Gekk commented on SPARK-28624: Just in case, the issue exists for negative years storing to

[jira] [Commented] (SPARK-28624) make_date is inconsistent when reading from table

2019-08-05 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900083#comment-16900083 ] Maxim Gekk commented on SPARK-28624: The problem is in storing values of DATE type to a hive table.

[jira] [Updated] (SPARK-28624) make_date is inconsistent when reading from table

2019-08-05 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28624: --- Attachment: Screen Shot 2019-08-05 at 18.19.39.png > make_date is inconsistent when reading from

[jira] [Commented] (SPARK-28624) make_date is inconsistent when reading from table

2019-08-05 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900059#comment-16900059 ] Maxim Gekk commented on SPARK-28624: [~yumwang] Thanks. I will take a look at the issue. >

[jira] [Updated] (SPARK-28017) Enhance DATE_TRUNC

2019-08-05 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28017: --- Summary: Enhance DATE_TRUNC (was: Enhance EXTRACT/DATE_TRUNC) > Enhance DATE_TRUNC >

[jira] [Updated] (SPARK-28017) Enhance DATE_TRUNC

2019-08-05 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28017: --- Description: For DATE_TRUNC, we need support: microseconds, milliseconds, decade, century,

[jira] [Updated] (SPARK-28623) Enhance EXTRACT

2019-08-05 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28623: --- Description: Currently, we support these field for EXTRACT: YEAR, QUARTER, MONTH, WEEK, DAY,

[jira] [Created] (SPARK-28623) Enhance EXTRACT

2019-08-05 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-28623: -- Summary: Enhance EXTRACT Key: SPARK-28623 URL: https://issues.apache.org/jira/browse/SPARK-28623 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Commented] (SPARK-28596) Use Java 8 time API in date_trunc

2019-08-05 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899834#comment-16899834 ] Maxim Gekk commented on SPARK-28596: DateTimeBenchmark shows performance degradation up to 3 times

[jira] [Comment Edited] (SPARK-28471) Formatting dates with negative years

2019-08-04 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899633#comment-16899633 ] Maxim Gekk edited comment on SPARK-28471 at 8/4/19 1:53 PM: [~yumwang] There

<    3   4   5   6   7   8   9   10   11   12   >