[jira] [Created] (SPARK-30584) Non-synchronized methods override Synchronized methods

2020-01-20 Thread Aman Omer (Jira)
Aman Omer created SPARK-30584: - Summary: Non-synchronized methods override Synchronized methods Key: SPARK-30584 URL: https://issues.apache.org/jira/browse/SPARK-30584 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

2020-01-07 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010227#comment-17010227 ] Aman Omer commented on SPARK-30421: --- cc [~maropu] > Dropped columns still available for filtering >

[jira] [Commented] (SPARK-30444) The same job will be computated for many times when using Dataset.show()

2020-01-06 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009370#comment-17009370 ] Aman Omer commented on SPARK-30444: --- I am looking into this one. > The same job will be computated

[jira] [Updated] (SPARK-30437) Uneven spaces for some fields in EXPLAIN FORMATTED

2020-01-06 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-30437: -- Summary: Uneven spaces for some fields in EXPLAIN FORMATTED (was: Uneven spaces for some fields for

[jira] [Created] (SPARK-30437) Uneven spaces for some fields for EXPLAIN FORMATTED

2020-01-06 Thread Aman Omer (Jira)
Aman Omer created SPARK-30437: - Summary: Uneven spaces for some fields for EXPLAIN FORMATTED Key: SPARK-30437 URL: https://issues.apache.org/jira/browse/SPARK-30437 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

2020-01-06 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008708#comment-17008708 ] Aman Omer commented on SPARK-30421: --- I am panning to add a marker to Project when it is introduced via

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

2020-01-06 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008705#comment-17008705 ] Aman Omer commented on SPARK-30421: --- In Analysis planning phase, rule _*ResolveMissingReferences*_ is

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

2020-01-06 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008699#comment-17008699 ] Aman Omer commented on SPARK-30421: --- Plans for {code:java} df.drop("bar").where($"bar" ===

[jira] [Comment Edited] (SPARK-30421) Dropped columns still available for filtering

2020-01-06 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008699#comment-17008699 ] Aman Omer edited comment on SPARK-30421 at 1/6/20 10:07 AM: Plans for

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

2020-01-06 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008640#comment-17008640 ] Aman Omer commented on SPARK-30421: --- Thanks [~tobias_hermann] for reporting this issue. It seems,

[jira] [Created] (SPARK-30390) Avoid double caching in mllib.KMeans#runWithWeights.

2019-12-30 Thread Aman Omer (Jira)
Aman Omer created SPARK-30390: - Summary: Avoid double caching in mllib.KMeans#runWithWeights. Key: SPARK-30390 URL: https://issues.apache.org/jira/browse/SPARK-30390 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29098) Test both ANSI mode and Spark mode

2019-12-29 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005145#comment-17005145 ] Aman Omer commented on SPARK-29098: --- I will work on this > Test both ANSI mode and Spark mode >

[jira] [Issue Comment Deleted] (SPARK-27148) Support CURRENT_TIME and LOCALTIME when ANSI mode enabled

2019-12-29 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-27148: -- Comment: was deleted (was: I will work on this.) > Support CURRENT_TIME and LOCALTIME when ANSI mode

[jira] [Issue Comment Deleted] (SPARK-29098) Test both ANSI mode and Spark mode

2019-12-29 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29098: -- Comment: was deleted (was: I will work on this.) > Test both ANSI mode and Spark mode >

[jira] [Commented] (SPARK-29098) Test both ANSI mode and Spark mode

2019-12-29 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005136#comment-17005136 ] Aman Omer commented on SPARK-29098: --- I will work on this. > Test both ANSI mode and Spark mode >

[jira] [Commented] (SPARK-27148) Support CURRENT_TIME and LOCALTIME when ANSI mode enabled

2019-12-29 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005135#comment-17005135 ] Aman Omer commented on SPARK-27148: --- I will work on this. > Support CURRENT_TIME and LOCALTIME when

[jira] [Commented] (SPARK-28122) Binary String Functions: SHA functions

2019-12-29 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005131#comment-17005131 ] Aman Omer commented on SPARK-28122: --- I will work on this. > Binary String Functions: SHA

[jira] [Commented] (SPARK-30283) V2 Command logical plan should use UnresolvedV2Relation for a table

2019-12-17 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998825#comment-16998825 ] Aman Omer commented on SPARK-30283: --- [~imback82] I would like to work on this. Please confirm. > V2

[jira] [Commented] (SPARK-29600) array_contains built in function is not backward compatible in 3.0

2019-12-17 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998413#comment-16998413 ] Aman Omer commented on SPARK-29600: --- ID: aman_omer [~cloud_fan] > array_contains built in function is

[jira] [Issue Comment Deleted] (SPARK-30148) Optimize writing plans if there is an analysis exception

2019-12-12 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-30148: -- Comment: was deleted (was: [~hyukjin.kwon] can you assign this JIRA to me. ID: aman_omer) > Optimize

[jira] [Commented] (SPARK-30148) Optimize writing plans if there is an analysis exception

2019-12-12 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995403#comment-16995403 ] Aman Omer commented on SPARK-30148: --- [~hyukjin.kwon] [~cloud_fan] Can you assign this Jira to me. ID:

[jira] [Commented] (SPARK-27217) Nested schema pruning doesn't work for aggregation e.g. `sum`.

2019-12-11 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993460#comment-16993460 ] Aman Omer commented on SPARK-27217: --- I am able to reproduce this bug on spark-shell. Working on this

[jira] [Updated] (SPARK-30184) Implement a helper method for aliasing functions

2019-12-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-30184: -- Summary: Implement a helper method for aliasing functions (was: Implement a helper method for

[jira] [Created] (SPARK-30184) Implement a helper method for aliasing

2019-12-09 Thread Aman Omer (Jira)
Aman Omer created SPARK-30184: - Summary: Implement a helper method for aliasing Key: SPARK-30184 URL: https://issues.apache.org/jira/browse/SPARK-30184 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-30169) Eliminate warnings in Kafka connector

2019-12-08 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991197#comment-16991197 ] Aman Omer edited comment on SPARK-30169 at 12/9/19 7:13 AM: {code:java}

[jira] [Commented] (SPARK-30169) Eliminate warnings in Kafka connector

2019-12-08 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991197#comment-16991197 ] Aman Omer commented on SPARK-30169: --- {code:java} @Deprecated public ConsumerRecords poll(long

[jira] [Updated] (SPARK-30169) Eliminate warnings in Kafka connector

2019-12-08 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-30169: -- Description: *Eliminate compilation warnings (10) in module external/kafka-0-10*: 1.

[jira] [Updated] (SPARK-30169) Eliminate warnings in Kafka connector

2019-12-08 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-30169: -- Description: *Eliminate compilation warnings (10) in module external/kafka-0-10*: 1.

[jira] [Updated] (SPARK-30169) Eliminate warnings in Kafka connector

2019-12-08 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-30169: -- Description: Eliminate compilation warnings (10) in module external/kafka-0-10: 1.

[jira] [Updated] (SPARK-29883) Implement a helper method for aliasing bool_and() and bool_or()

2019-12-08 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29883: -- Summary: Implement a helper method for aliasing bool_and() and bool_or() (was: Improve error

[jira] [Commented] (SPARK-30162) Filter is not being pushed down for Parquet files

2019-12-08 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991137#comment-16991137 ] Aman Omer commented on SPARK-30162: --- Kindly share the results of spark-shell. Thanks > Filter is not

[jira] [Commented] (SPARK-30169) Eliminate warnings in Kafka connector

2019-12-08 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991048#comment-16991048 ] Aman Omer commented on SPARK-30169: --- [~maxgekk] If you haven't started, I will take this. > Eliminate

[jira] [Commented] (SPARK-30165) Eliminate compilation warnings

2019-12-08 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990851#comment-16990851 ] Aman Omer commented on SPARK-30165: --- Hi [~maxgekk], I would like to work on some sub-tasks here. Feel

[jira] [Created] (SPARK-30161) Uncaught Analysis Exception in Spark-Shell

2019-12-06 Thread Aman Omer (Jira)
Aman Omer created SPARK-30161: - Summary: Uncaught Analysis Exception in Spark-Shell Key: SPARK-30161 URL: https://issues.apache.org/jira/browse/SPARK-30161 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-30148) Optimize writing plans if there is an analysis exception

2019-12-06 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990309#comment-16990309 ] Aman Omer commented on SPARK-30148: --- [~hyukjin.kwon] can you assign this JIRA to me. ID: aman_omer >

[jira] [Commented] (SPARK-30099) Improve Analyzed Logical Plan as duplicate AnalysisExceptions are coming

2019-12-05 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988607#comment-16988607 ] Aman Omer commented on SPARK-30099: --- [~cloud_fan] can you assign this jira ticket to me? id: aman_omer

[jira] [Commented] (SPARK-30125) Remove PostgreSQL dialect

2019-12-04 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988032#comment-16988032 ] Aman Omer commented on SPARK-30125: --- I would like to take this work. > Remove PostgreSQL dialect >

[jira] [Updated] (SPARK-30124) unnecessary persist in PythonMLLibAPI.scala

2019-12-04 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-30124: -- Summary: unnecessary persist in PythonMLLibAPI.scala (was: Improper persist in PythonMLLibAPI.scala)

[jira] [Created] (SPARK-30124) Improper persist in PythonMLLibAPI.scala

2019-12-04 Thread Aman Omer (Jira)
Aman Omer created SPARK-30124: - Summary: Improper persist in PythonMLLibAPI.scala Key: SPARK-30124 URL: https://issues.apache.org/jira/browse/SPARK-30124 Project: Spark Issue Type: Improvement

[jira] [Issue Comment Deleted] (SPARK-29591) Support data insertion in a different order if you wish or even omit some columns in spark sql also like postgresql

2019-12-04 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29591: -- Comment: was deleted (was: Thanks for confirming. I will start working on this.) > Support data

[jira] [Comment Edited] (SPARK-29667) implicitly convert mismatched datatypes on right side of "IN" operator

2019-12-03 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987120#comment-16987120 ] Aman Omer edited comment on SPARK-29667 at 12/3/19 7:03 PM: Actually there

[jira] [Commented] (SPARK-29667) implicitly convert mismatched datatypes on right side of "IN" operator

2019-12-03 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987120#comment-16987120 ] Aman Omer commented on SPARK-29667: --- Actually there is also JIRA for decimal type mismatching due to

[jira] [Commented] (SPARK-29667) implicitly convert mismatched datatypes on right side of "IN" operator

2019-12-03 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987119#comment-16987119 ] Aman Omer commented on SPARK-29667: --- Hi [~jessielin], did you observed same issue with any other data

[jira] [Commented] (SPARK-29591) Support data insertion in a different order if you wish or even omit some columns in spark sql also like postgresql

2019-12-02 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986657#comment-16986657 ] Aman Omer commented on SPARK-29591: --- Thanks for confirming. I will start working on this. > Support

[jira] [Comment Edited] (SPARK-30101) Dataset distinct does not respect spark.default.parallelism

2019-12-02 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986619#comment-16986619 ] Aman Omer edited comment on SPARK-30101 at 12/3/19 5:19 AM: {code:java}

[jira] [Comment Edited] (SPARK-30101) Dataset distinct does not respect spark.default.parallelism

2019-12-02 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986619#comment-16986619 ] Aman Omer edited comment on SPARK-30101 at 12/3/19 5:18 AM: {code:java}

[jira] [Commented] (SPARK-30101) Dataset distinct does not respect spark.default.parallelism

2019-12-02 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986619#comment-16986619 ] Aman Omer commented on SPARK-30101: --- {code:java} scala> ds.distinct.explain == Physical Plan == *(2)

[jira] [Issue Comment Deleted] (SPARK-30101) Dataset distinct does not respect spark.default.parallelism

2019-12-02 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-30101: -- Comment: was deleted (was: I am checking this.) > Dataset distinct does not respect

[jira] [Commented] (SPARK-30101) Dataset distinct does not respect spark.default.parallelism

2019-12-02 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986594#comment-16986594 ] Aman Omer commented on SPARK-30101: --- I am checking this. > Dataset distinct does not respect

[jira] [Updated] (SPARK-30093) Improve error message for creating views

2019-12-01 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-30093: -- Description: Improve error message for creating views.

[jira] [Updated] (SPARK-30093) Improve error message for creating views

2019-12-01 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-30093: -- Description: https://github.com/apache/spark/pull/26317#discussion_r352377363 > Improve error

[jira] [Created] (SPARK-30093) Improve error message for creating views

2019-12-01 Thread Aman Omer (Jira)
Aman Omer created SPARK-30093: - Summary: Improve error message for creating views Key: SPARK-30093 URL: https://issues.apache.org/jira/browse/SPARK-30093 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-30080) ADD/LIST Resources should look up catalog/table like v2 commands

2019-11-29 Thread Aman Omer (Jira)
Aman Omer created SPARK-30080: - Summary: ADD/LIST Resources should look up catalog/table like v2 commands Key: SPARK-30080 URL: https://issues.apache.org/jira/browse/SPARK-30080 Project: Spark

[jira] [Commented] (SPARK-30080) ADD/LIST Resources should look up catalog/table like v2 commands

2019-11-29 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984901#comment-16984901 ] Aman Omer commented on SPARK-30080: --- I will work on this > ADD/LIST Resources should look up

[jira] [Commented] (SPARK-29892) Add built-in Array Functions: array_cat

2019-11-14 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974800#comment-16974800 ] Aman Omer commented on SPARK-29892: --- This Jira is a duplicate of 

[jira] [Commented] (SPARK-29878) Improper cache strategies in GraphX

2019-11-13 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973637#comment-16973637 ] Aman Omer commented on SPARK-29878: --- [https://github.com/apache/spark/pull/7469] this PR had

[jira] [Commented] (SPARK-29883) Improve error messages when function name is an alias

2019-11-13 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973633#comment-16973633 ] Aman Omer commented on SPARK-29883: --- Working on this. > Improve error messages when function name is

[jira] [Commented] (SPARK-29823) Improper persist strategy in mllib.clustering.KMeans.run()

2019-11-12 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972473#comment-16972473 ] Aman Omer commented on SPARK-29823: --- I will check this one. > Improper persist strategy in

[jira] [Commented] (SPARK-29838) PostgreSQL dialect: cast to timestamp

2019-11-11 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971680#comment-16971680 ] Aman Omer commented on SPARK-29838: --- Sure, I have started coding for this one and analyzed

[jira] [Commented] (SPARK-29849) Spark trunc() func does not support for number group as PostgreSQL

2019-11-11 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971574#comment-16971574 ] Aman Omer commented on SPARK-29849: --- I am checking this issue. > Spark trunc() func does not support

[jira] [Issue Comment Deleted] (SPARK-29849) Spark trunc() func does not support for number group as PostgreSQL

2019-11-11 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29849: -- Comment: was deleted (was: I am checking this issue.) > Spark trunc() func does not support for

[jira] [Commented] (SPARK-29847) PostgreSQL dialect: cast to varchar

2019-11-11 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971513#comment-16971513 ] Aman Omer commented on SPARK-29847: --- I am checking this one. > PostgreSQL dialect: cast to varchar >

[jira] [Commented] (SPARK-29840) PostgreSQL dialect: cast to integer

2019-11-11 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971476#comment-16971476 ] Aman Omer commented on SPARK-29840: --- Working on this. > PostgreSQL dialect: cast to integer >

[jira] [Commented] (SPARK-29842) PostgreSQL dialect: cast to double

2019-11-11 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971477#comment-16971477 ] Aman Omer commented on SPARK-29842: --- I will work on this > PostgreSQL dialect: cast to double >

[jira] [Commented] (SPARK-29843) PostgreSQL dialect: cast to float

2019-11-11 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971478#comment-16971478 ] Aman Omer commented on SPARK-29843: --- I will work on this > PostgreSQL dialect: cast to float >

[jira] [Commented] (SPARK-29838) PostgreSQL dialect: cast to timestamp

2019-11-11 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971433#comment-16971433 ] Aman Omer commented on SPARK-29838: --- Already working on this. Thanks [~jobitmathew] > PostgreSQL

[jira] [Commented] (SPARK-29821) Allow calling non-aggregate SQL functions with column name

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971016#comment-16971016 ] Aman Omer commented on SPARK-29821: --- Checking this issue. [~MaxHartwig] > Allow calling non-aggregate

[jira] [Updated] (SPARK-29809) Missing persist in Word2Vec.fit()

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29809: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist in

[jira] [Updated] (SPARK-29818) Missing persist on RDD

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29818: -- Issue Type: Improvement (was: Umbrella) > Missing persist on RDD > -- > >

[jira] [Updated] (SPARK-29810) Missing persist on retaggedInput in RandomForest.run()

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29810: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist on

[jira] [Updated] (SPARK-29811) Missing persist on oldDataset in ml.RandomForestRegressor.train()

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29811: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist on oldDataset

[jira] [Updated] (SPARK-29812) Missing persist on predictionAndLabels in MulticlassClassificationEvaluator

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29812: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist on

[jira] [Updated] (SPARK-29815) Missing persist in ml.tuning.CrossValidator.fit()

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29815: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist in

[jira] [Updated] (SPARK-29814) Missing persist on sources in mllib.feature.PCA

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29814: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist on sources in

[jira] [Updated] (SPARK-29813) Missing persist in mllib.PrefixSpan.findFrequentItems()

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29813: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist in

[jira] [Updated] (SPARK-29816) Missing persist in mllib.evaluation.BinaryClassificationMetrics.recallByThreshold()

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29816: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist in >

[jira] [Updated] (SPARK-29817) Missing persist on docs in mllib.clustering.LDAOptimizer.initialize

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29817: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist on docs in

[jira] [Updated] (SPARK-29818) Missing persist on RDD

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29818: -- External issue ID: (was: SPARK-29817) External issue URL: (was:

[jira] [Updated] (SPARK-29818) Missing persist on RDD

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29818: -- External issue ID: SPARK-29817 > Missing persist on RDD > -- > >

[jira] [Updated] (SPARK-29818) Missing persist on RDD

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29818: -- External issue URL: https://issues.apache.org/jira/browse/SPARK-29817 > Missing persist on RDD >

[jira] [Created] (SPARK-29818) Missing persist on RDD

2019-11-09 Thread Aman Omer (Jira)
Aman Omer created SPARK-29818: - Summary: Missing persist on RDD Key: SPARK-29818 URL: https://issues.apache.org/jira/browse/SPARK-29818 Project: Spark Issue Type: Umbrella Components:

[jira] [Commented] (SPARK-29811) Missing persist on oldDataset in ml.RandomForestRegressor.train()

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970908#comment-16970908 ] Aman Omer commented on SPARK-29811: --- Thanks [~spark_cachecheck] for reporting. I will raise a PR for

[jira] [Commented] (SPARK-29809) Missing persist in Word2Vec.fit()

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970910#comment-16970910 ] Aman Omer commented on SPARK-29809: --- Thanks [~spark_cachecheck] for reporting. I will raise a PR for

[jira] [Commented] (SPARK-29810) Missing persist on retaggedInput in RandomForest.run()

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970909#comment-16970909 ] Aman Omer commented on SPARK-29810: --- Thanks [~spark_cachecheck] for reporting. I will raise a PR for

[jira] [Commented] (SPARK-29812) Missing persist on predictionAndLabels in MulticlassClassificationEvaluator

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970907#comment-16970907 ] Aman Omer commented on SPARK-29812: --- Thanks [~spark_cachecheck] for reporting. I will raise a PR for

[jira] [Commented] (SPARK-29817) Missing persist on docs in mllib.clustering.LDAOptimizer.initialize

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970866#comment-16970866 ] Aman Omer commented on SPARK-29817: --- Thanks [~spark_cachecheck] for reporting. I will raise a PR for

[jira] [Commented] (SPARK-29816) Missing persist in mllib.evaluation.BinaryClassificationMetrics.recallByThreshold()

2019-11-09 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970865#comment-16970865 ] Aman Omer commented on SPARK-29816: --- Thanks [~spark_cachecheck] for reporting. I will raise a PR for

[jira] [Commented] (SPARK-29616) Bankers' rounding for double types

2019-11-04 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967273#comment-16967273 ] Aman Omer commented on SPARK-29616: --- cc [~yumwang] > Bankers' rounding for double types >

[jira] [Comment Edited] (SPARK-29650) Discard a NULL constant in LIMIT

2019-11-04 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967254#comment-16967254 ] Aman Omer edited comment on SPARK-29650 at 11/5/19 6:21 AM: cc [~maropu]

[jira] [Commented] (SPARK-29616) Bankers' rounding for double types

2019-11-04 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967272#comment-16967272 ] Aman Omer commented on SPARK-29616: --- Gentle ping [~maropu] > Bankers' rounding for double types >

[jira] [Commented] (SPARK-29636) Can't parse '11:00 BST' or '2000-10-19 10:23:54+01' signatures to timestamp

2019-11-04 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967271#comment-16967271 ] Aman Omer commented on SPARK-29636: --- cc [~yumwang] > Can't parse '11:00 BST' or '2000-10-19

[jira] [Commented] (SPARK-29650) Discard a NULL constant in LIMIT

2019-11-04 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967254#comment-16967254 ] Aman Omer commented on SPARK-29650: --- cc [~maropu]  > Discard a NULL constant in LIMIT >

[jira] [Commented] (SPARK-29636) Can't parse '11:00 BST' or '2000-10-19 10:23:54+01' signatures to timestamp

2019-11-03 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966414#comment-16966414 ] Aman Omer commented on SPARK-29636: --- For queries (similar to query 2) which is not supported for

[jira] [Commented] (SPARK-29737) Concat for array in Spark SQL is not the one in PostgreSQL but array_cat

2019-11-03 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966396#comment-16966396 ] Aman Omer commented on SPARK-29737: --- Thanks [~Qin Yao] . I will soon raise a PR for this. > Concat

[jira] [Commented] (SPARK-29685) Spark SQL also better to show the column details while doing SELECT * from table, like sparkshell and spark beeline

2019-10-31 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963843#comment-16963843 ] Aman Omer commented on SPARK-29685: --- Thanks [~jobitmathew]. I am checking this one. > Spark SQL also

[jira] [Commented] (SPARK-29616) Bankers' rounding for double types

2019-10-31 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963748#comment-16963748 ] Aman Omer commented on SPARK-29616: --- Banker's algorithm for rounding is already implemented just use

[jira] [Comment Edited] (SPARK-29650) Discard a NULL constant in LIMIT

2019-10-31 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963686#comment-16963686 ] Aman Omer edited comment on SPARK-29650 at 10/31/19 6:33 AM: - {code:java}

[jira] [Commented] (SPARK-29650) Discard a NULL constant in LIMIT

2019-10-31 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963686#comment-16963686 ] Aman Omer commented on SPARK-29650: ---   {code:java} select * from TName limit(int(1));{code}

[jira] [Comment Edited] (SPARK-29650) Discard a NULL constant in LIMIT

2019-10-31 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963683#comment-16963683 ] Aman Omer edited comment on SPARK-29650 at 10/31/19 6:27 AM: - {code:java}

[jira] [Commented] (SPARK-29650) Discard a NULL constant in LIMIT

2019-10-31 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963683#comment-16963683 ] Aman Omer commented on SPARK-29650: ---   {code:java} select * from TName limit (case when random() < 0.5

  1   2   >