[jira] [Commented] (SPARK-44817) SPIP: Incremental Stats Collection

2024-03-16 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827739#comment-17827739 ] Rakesh Raushan commented on SPARK-44817: [~cloud_fan] [~dongjoon]  What do you think about the

[jira] [Updated] (SPARK-44817) SPIP: Incremental Stats Collection

2023-09-25 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-44817: --- Summary: SPIP: Incremental Stats Collection (was: Incremental Stats Collection) > SPIP:

[jira] (SPARK-44817) Incremental Stats Collection

2023-09-25 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44817 ] Rakesh Raushan deleted comment on SPARK-44817: was (Author: rakson): [~gurwls223] [~cloud_fan] [~dongjoon] I have added an SPIP document. Does this feature seem useful to you? >

[jira] [Commented] (SPARK-44817) Incremental Stats Collection

2023-09-17 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766213#comment-17766213 ] Rakesh Raushan commented on SPARK-44817: [~gurwls223] [~cloud_fan] [~dongjoon] I have added an

[jira] [Comment Edited] (SPARK-44817) Incremental Stats Collection

2023-08-26 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759229#comment-17759229 ] Rakesh Raushan edited comment on SPARK-44817 at 8/26/23 9:02 AM: -

[jira] [Updated] (SPARK-44817) Incremental Stats Collection

2023-08-26 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-44817: --- Description: Spark's Cost Based Optimizer is dependent on the table and column statistics.

[jira] [Updated] (SPARK-44817) Incremental Stats Collection

2023-08-26 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-44817: --- Description: Spark's Cost Based Optimizer is dependent on the table and column statistics.

[jira] [Commented] (SPARK-44817) Incremental Stats Collection

2023-08-26 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759229#comment-17759229 ] Rakesh Raushan commented on SPARK-44817: Added SPIP Document. Link for the document :

[jira] [Commented] (SPARK-44817) Incremental Stats Collection

2023-08-22 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757539#comment-17757539 ] Rakesh Raushan commented on SPARK-44817: Sure. I would try to come up with a SPIP by this

[jira] [Updated] (SPARK-44817) Incremental Stats Collection

2023-08-18 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-44817: --- Affects Version/s: 3.5.0 > Incremental Stats Collection > > >

[jira] [Comment Edited] (SPARK-44817) Incremental Stats Collection

2023-08-16 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754694#comment-17754694 ] Rakesh Raushan edited comment on SPARK-44817 at 8/16/23 1:08 PM: -

[jira] [Commented] (SPARK-44817) Incremental Stats Collection

2023-08-15 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754694#comment-17754694 ] Rakesh Raushan commented on SPARK-44817: [~cloud_fan] [~gurwls223] [~maxgekk] What are your

[jira] [Updated] (SPARK-44817) Incremental Stats Collection

2023-08-15 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-44817: --- Description: Spark's Cost Based Optimizer is dependent on the table and column statistics.

[jira] [Created] (SPARK-44817) Incremental Stats Collection

2023-08-15 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-44817: -- Summary: Incremental Stats Collection Key: SPARK-44817 URL: https://issues.apache.org/jira/browse/SPARK-44817 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-37840) Dynamically update the loaded Hive UDF JAR

2022-01-11 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472537#comment-17472537 ] Rakesh Raushan edited comment on SPARK-37840 at 1/11/22, 8:08 AM: --

[jira] [Commented] (SPARK-37840) Dynamically update the loaded Hive UDF JAR

2022-01-11 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472537#comment-17472537 ] Rakesh Raushan commented on SPARK-37840: The problem is with `jarClassLoader`. We need to update

[jira] [Commented] (SPARK-37840) Dynamically update the loaded Hive UDF JAR

2022-01-07 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470793#comment-17470793 ] Rakesh Raushan commented on SPARK-37840: We can dynamically update our UDF jars after loading

[jira] [Comment Edited] (SPARK-32924) Web UI sort on duration is wrong

2020-10-09 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17210977#comment-17210977 ] Rakesh Raushan edited comment on SPARK-32924 at 10/9/20, 1:49 PM: -- I

[jira] [Commented] (SPARK-32924) Web UI sort on duration is wrong

2020-10-09 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17210977#comment-17210977 ] Rakesh Raushan commented on SPARK-32924: I thinking its due to string sorting. One similar issue

[jira] [Commented] (SPARK-32694) Pushdown cast to data sources

2020-08-24 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183719#comment-17183719 ] Rakesh Raushan commented on SPARK-32694: One of the proposed

[jira] [Created] (SPARK-31983) Tables of structured streaming tab show wrong result for duration column

2020-06-13 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31983: -- Summary: Tables of structured streaming tab show wrong result for duration column Key: SPARK-31983 URL: https://issues.apache.org/jira/browse/SPARK-31983

[jira] [Commented] (SPARK-31873) Spark Sql Function year does not extract year from date/timestamp

2020-05-30 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120335#comment-17120335 ] Rakesh Raushan commented on SPARK-31873: Yeah. This is a problem with 2.4.5.  {code:java} scala>

[jira] [Comment Edited] (SPARK-31873) Spark Sql Function year does not extract year from date/timestamp

2020-05-30 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120301#comment-17120301 ] Rakesh Raushan edited comment on SPARK-31873 at 5/30/20, 4:28 PM: --

[jira] [Commented] (SPARK-31873) Spark Sql Function year does not extract year from date/timestamp

2020-05-30 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120301#comment-17120301 ] Rakesh Raushan commented on SPARK-31873: scala> val df = Seq(("1300-01-03 00:00:00")

[jira] [Commented] (SPARK-31763) DataFrame.inputFiles() not Available

2020-05-26 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116738#comment-17116738 ] Rakesh Raushan commented on SPARK-31763: Shall I open a PR for this? > DataFrame.inputFiles()

[jira] [Created] (SPARK-31688) Refactor pagination framework for spark web UI pages

2020-05-12 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31688: -- Summary: Refactor pagination framework for spark web UI pages Key: SPARK-31688 URL: https://issues.apache.org/jira/browse/SPARK-31688 Project: Spark

[jira] [Commented] (SPARK-31104) Add documentation for all new Json Functions

2020-05-08 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102438#comment-17102438 ] Rakesh Raushan commented on SPARK-31104: [~hyukjin.kwon] We can mark this as resolved as this

[jira] [Commented] (SPARK-31470) Introduce SORTED BY clause in CREATE TABLE statement

2020-05-08 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102437#comment-17102437 ] Rakesh Raushan commented on SPARK-31470: If this is required by community and [~yumwang] has not

[jira] [Commented] (SPARK-31642) Support pagination for spark structured streaming tab

2020-05-05 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099961#comment-17099961 ] Rakesh Raushan commented on SPARK-31642: I am working on it   > Support pagination for spark

[jira] [Updated] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31638: --- Description: Clean code for pagination for different pages of spark webUI (was: Clean code

[jira] [Updated] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31638: --- Description: Clean code for pagination for different pages of spark web > Clean code for

[jira] [Created] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31638: -- Summary: Clean code for pagination for all pages Key: SPARK-31638 URL: https://issues.apache.org/jira/browse/SPARK-31638 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31638: --- Environment: (was: Clean code for pagination for different pages of webUI) > Clean

[jira] [Created] (SPARK-31478) Executors Stop() method is not executed when they are killed

2020-04-18 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31478: -- Summary: Executors Stop() method is not executed when they are killed Key: SPARK-31478 URL: https://issues.apache.org/jira/browse/SPARK-31478 Project: Spark

[jira] [Commented] (SPARK-31397) Support json_arrayAgg

2020-04-09 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079268#comment-17079268 ] Rakesh Raushan commented on SPARK-31397: The same functionality can be achieved using

[jira] [Issue Comment Deleted] (SPARK-31397) Support json_arrayAgg

2020-04-09 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31397: --- Comment: was deleted (was: I am working on it.) > Support json_arrayAgg >

[jira] [Commented] (SPARK-31396) Support json_objectAgg function

2020-04-09 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079267#comment-17079267 ] Rakesh Raushan commented on SPARK-31396: We can achieve the same functionality using

[jira] [Issue Comment Deleted] (SPARK-31396) Support json_objectAgg function

2020-04-09 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31396: --- Comment: was deleted (was: I am working on it.) > Support json_objectAgg function >

[jira] [Commented] (SPARK-31397) Support json_arrayAgg

2020-04-09 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079226#comment-17079226 ] Rakesh Raushan commented on SPARK-31397: I am working on it. > Support json_arrayAgg >

[jira] [Created] (SPARK-31397) Support json_arrayAgg

2020-04-09 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31397: -- Summary: Support json_arrayAgg Key: SPARK-31397 URL: https://issues.apache.org/jira/browse/SPARK-31397 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-31396) Support json_objectAgg function

2020-04-09 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079198#comment-17079198 ] Rakesh Raushan commented on SPARK-31396: I am working on it. > Support json_objectAgg function

[jira] [Created] (SPARK-31396) Support json_objectAgg function

2020-04-09 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31396: -- Summary: Support json_objectAgg function Key: SPARK-31396 URL: https://issues.apache.org/jira/browse/SPARK-31396 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-31106) Support is_json function

2020-04-09 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31106: --- Description: This function will allow users to verify whether the given string is valid

[jira] [Updated] (SPARK-31106) Support is_json function

2020-04-09 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31106: --- Summary: Support is_json function (was: Support IS_JSON) > Support is_json function >

[jira] [Updated] (SPARK-31106) Support IS_JSON

2020-04-09 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31106: --- Description: Currently, null is returned when we come across invalid json. We should either

[jira] [Commented] (SPARK-31369) Add Documentation for JSON functions

2020-04-06 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076930#comment-17076930 ] Rakesh Raushan commented on SPARK-31369: I am working on it. > Add Documentation for JSON

[jira] [Updated] (SPARK-31369) Add Documentation for JSON functions

2020-04-06 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31369: --- Parent: SPARK-28588 Issue Type: Sub-task (was: Documentation) > Add Documentation

[jira] [Created] (SPARK-31369) Add Documentation for JSON functions

2020-04-06 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31369: -- Summary: Add Documentation for JSON functions Key: SPARK-31369 URL: https://issues.apache.org/jira/browse/SPARK-31369 Project: Spark Issue Type:

[jira] [Updated] (SPARK-31104) Add documentation for all new Json Functions

2020-04-06 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31104: --- Summary: Add documentation for all new Json Functions (was: Add documentation for all the

[jira] [Commented] (SPARK-31104) Add documentation for all the Json Functions

2020-03-10 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056584#comment-17056584 ] Rakesh Raushan commented on SPARK-31104: I am working on it. > Add documentation for all the

[jira] [Commented] (SPARK-31106) Support IS_JSON

2020-03-10 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055757#comment-17055757 ] Rakesh Raushan commented on SPARK-31106: I am working on it. > Support IS_JSON >

[jira] [Created] (SPARK-31106) Support IS_JSON

2020-03-10 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31106: -- Summary: Support IS_JSON Key: SPARK-31106 URL: https://issues.apache.org/jira/browse/SPARK-31106 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-31104) Add documentation for all the Json Functions

2020-03-10 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31104: -- Summary: Add documentation for all the Json Functions Key: SPARK-31104 URL: https://issues.apache.org/jira/browse/SPARK-31104 Project: Spark Issue Type:

[jira] [Created] (SPARK-31103) Extend Support for useful JSON Functions

2020-03-10 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31103: -- Summary: Extend Support for useful JSON Functions Key: SPARK-31103 URL: https://issues.apache.org/jira/browse/SPARK-31103 Project: Spark Issue Type:

[jira] [Updated] (SPARK-31009) Support json_object_keys function

2020-03-04 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31009: --- Affects Version/s: (was: 3.0.0) 3.1.0 > Support json_object_keys

[jira] [Updated] (SPARK-31008) Support json_array_length function

2020-03-04 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31008: --- Affects Version/s: (was: 3.0.0) 3.1.0 > Support

[jira] [Updated] (SPARK-31009) Support json_object_keys function

2020-03-04 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31009: --- Description: This function will return all the keys from outer json object.   PostgreSQL 

[jira] [Updated] (SPARK-31009) Support json_object_keys function

2020-03-02 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31009: --- Description: This function will return all the keys from outer json object.   PostgreSQL 

[jira] [Commented] (SPARK-31009) Support json_object_keys function

2020-03-02 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17049914#comment-17049914 ] Rakesh Raushan commented on SPARK-31009: [~hyukjin.kwon] I updated the description. PostgreSQL

[jira] [Updated] (SPARK-31009) Support json_object_keys function

2020-03-02 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31009: --- Description: This function will return all the keys from outer json object.   PostgreSQL

[jira] [Commented] (SPARK-28427) Support more Postgres JSON functions

2020-03-02 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17049367#comment-17049367 ] Rakesh Raushan commented on SPARK-28427: I think we should add some of Postgres JSON functions

[jira] [Commented] (SPARK-31009) Support json_object_keys function

2020-03-02 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17049116#comment-17049116 ] Rakesh Raushan commented on SPARK-31009: I am working on this. > Support json_object_keys

[jira] [Created] (SPARK-31009) Support json_object_keys function

2020-03-02 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31009: -- Summary: Support json_object_keys function Key: SPARK-31009 URL: https://issues.apache.org/jira/browse/SPARK-31009 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-31008) Support json_array_length function

2020-03-02 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17049097#comment-17049097 ] Rakesh Raushan commented on SPARK-31008: I will raise a PR soon > Support json_array_length

[jira] [Created] (SPARK-31008) Support json_array_length function

2020-03-02 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31008: -- Summary: Support json_array_length function Key: SPARK-31008 URL: https://issues.apache.org/jira/browse/SPARK-31008 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-30917) The behaviour of UnaryMinus should not depend on SQLConf.get

2020-02-21 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041774#comment-17041774 ] Rakesh Raushan commented on SPARK-30917: I am working on this. > The behaviour of UnaryMinus

[jira] [Created] (SPARK-30917) The behaviour of UnaryMinus should not depend on SQLConf.get

2020-02-21 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-30917: -- Summary: The behaviour of UnaryMinus should not depend on SQLConf.get Key: SPARK-30917 URL: https://issues.apache.org/jira/browse/SPARK-30917 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-30896) The behavior of JsonToStructs should not depend on SQLConf.get

2020-02-21 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-30896: --- Comment: was deleted (was: I am working on this.) > The behavior of JsonToStructs should

[jira] [Commented] (SPARK-30896) The behavior of JsonToStructs should not depend on SQLConf.get

2020-02-21 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041682#comment-17041682 ] Rakesh Raushan commented on SPARK-30896: I am working on this. > The behavior of JsonToStructs

[jira] [Commented] (SPARK-30852) Use Long instead of Int as argument type in Dataset limit method

2020-02-18 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039031#comment-17039031 ] Rakesh Raushan commented on SPARK-30852: Ahh. In that case we cannot allow long values. Tail

[jira] [Comment Edited] (SPARK-30852) Use Long instead of Int as argument type in Dataset limit method

2020-02-17 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038304#comment-17038304 ] Rakesh Raushan edited comment on SPARK-30852 at 2/17/20 12:33 PM: --

[jira] [Commented] (SPARK-30852) Use Long instead of Int as argument type in Dataset limit method

2020-02-17 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038304#comment-17038304 ] Rakesh Raushan commented on SPARK-30852: [~cloud_fan] [~dongjoon] long value can be used as

[jira] [Commented] (SPARK-30852) Use Long instead of Int as argument type in Dataset limit method

2020-02-17 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038278#comment-17038278 ] Rakesh Raushan commented on SPARK-30852: I will check the issue. > Use Long instead of Int as

[jira] [Commented] (SPARK-27619) MapType should be prohibited in hash expressions

2020-02-14 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036831#comment-17036831 ] Rakesh Raushan commented on SPARK-27619: I am working on this. > MapType should be prohibited

[jira] [Commented] (SPARK-27545) Update the Documentation for CACHE TABLE and UNCACHE TABLE

2020-02-11 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034479#comment-17034479 ] Rakesh Raushan commented on SPARK-27545: Please assign this to me. Thanks > Update the

[jira] [Commented] (SPARK-30790) The datatype of map() should be map

2020-02-11 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034461#comment-17034461 ] Rakesh Raushan commented on SPARK-30790: Should i expose a legacy configuration for mapType as

[jira] [Created] (SPARK-30790) The datatype of map() should be map

2020-02-11 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-30790: -- Summary: The datatype of map() should be map Key: SPARK-30790 URL: https://issues.apache.org/jira/browse/SPARK-30790 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30688) Spark SQL Unix Timestamp produces incorrect result with unix_timestamp UDF

2020-01-31 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027330#comment-17027330 ] Rakesh Raushan commented on SPARK-30688: I will check this issue   > Spark SQL Unix Timestamp

[jira] [Commented] (SPARK-30415) Improve Readability of SQLConf Doc

2020-01-04 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007975#comment-17007975 ] Rakesh Raushan commented on SPARK-30415: I didn't knew that earlier. From now onwards I will use

[jira] [Created] (SPARK-30415) Improve Readability of SQLConf Doc

2020-01-03 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-30415: -- Summary: Improve Readability of SQLConf Doc Key: SPARK-30415 URL: https://issues.apache.org/jira/browse/SPARK-30415 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30363) Add Documentation for Refresh Resources

2019-12-26 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003887#comment-17003887 ] Rakesh Raushan commented on SPARK-30363: I am working on it.   > Add Documentation for Refresh

[jira] [Created] (SPARK-30363) Add Documentation for Refresh Resources

2019-12-26 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-30363: -- Summary: Add Documentation for Refresh Resources Key: SPARK-30363 URL: https://issues.apache.org/jira/browse/SPARK-30363 Project: Spark Issue Type:

[jira] [Created] (SPARK-30342) Update LIST JAR/FILE command

2019-12-23 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-30342: -- Summary: Update LIST JAR/FILE command Key: SPARK-30342 URL: https://issues.apache.org/jira/browse/SPARK-30342 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-30288) Failed to write valid Parquet files when column names contains special characters like spaces

2019-12-18 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999349#comment-16999349 ] Rakesh Raushan commented on SPARK-30288: I am working on it. I will raise the PR soon. > Failed

[jira] [Created] (SPARK-30292) Throw Exception when invalid string is cast to decimal in ANSI mode

2019-12-17 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-30292: -- Summary: Throw Exception when invalid string is cast to decimal in ANSI mode Key: SPARK-30292 URL: https://issues.apache.org/jira/browse/SPARK-30292 Project:

[jira] [Comment Edited] (SPARK-30288) Failed to write valid Parquet files when column names contains special characters like spaces

2019-12-17 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998809#comment-16998809 ] Rakesh Raushan edited comment on SPARK-30288 at 12/18/19 4:49 AM: --

[jira] [Comment Edited] (SPARK-30288) Failed to write valid Parquet files when column names contains special characters like spaces

2019-12-17 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998809#comment-16998809 ] Rakesh Raushan edited comment on SPARK-30288 at 12/18/19 4:48 AM: --

[jira] [Commented] (SPARK-30288) Failed to write valid Parquet files when column names contains special characters like spaces

2019-12-17 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998809#comment-16998809 ] Rakesh Raushan commented on SPARK-30288: [~dongjoon] I have checked locally after making

[jira] [Commented] (SPARK-30150) Manage resources (ADD/LIST) does not support quoted path

2019-12-16 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997314#comment-16997314 ] Rakesh Raushan commented on SPARK-30150: Thanks!! > Manage resources (ADD/LIST) does not

[jira] [Updated] (SPARK-30249) Invalid Column Names in parquet tables should not be allowed

2019-12-12 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-30249: --- Description: Column names such as  `a:b` , `??`, `,,`, `^^` , `++`etc are allowed when we

[jira] [Updated] (SPARK-30249) Invalid Column Names in parquet tables should not be allowed

2019-12-12 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-30249: --- Summary: Invalid Column Names in parquet tables should not be allowed (was: Wrong Column

[jira] [Commented] (SPARK-30249) Wrong Column Names in parquet tables should not be allowed

2019-12-12 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995411#comment-16995411 ] Rakesh Raushan commented on SPARK-30249: cc [~dongjoon]. > Wrong Column Names in parquet tables

[jira] [Created] (SPARK-30249) Wrong Column Names in parquet tables should not be allowed

2019-12-12 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-30249: -- Summary: Wrong Column Names in parquet tables should not be allowed Key: SPARK-30249 URL: https://issues.apache.org/jira/browse/SPARK-30249 Project: Spark

[jira] [Commented] (SPARK-30150) Manage resources (ADD/LIST) does not support quoted path

2019-12-12 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994544#comment-16994544 ] Rakesh Raushan commented on SPARK-30150: Can you assign this to me. [~cloud_fan] > Manage

[jira] [Created] (SPARK-30234) ADD FILE can not add folder from Spark-sql

2019-12-12 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-30234: -- Summary: ADD FILE can not add folder from Spark-sql Key: SPARK-30234 URL: https://issues.apache.org/jira/browse/SPARK-30234 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30234) ADD FILE can not add folder from Spark-sql

2019-12-12 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994457#comment-16994457 ] Rakesh Raushan commented on SPARK-30234: I will raise a PR for this soon. > ADD FILE can not

[jira] [Commented] (SPARK-30139) get_json_object does not work correctly

2019-12-12 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994447#comment-16994447 ] Rakesh Raushan commented on SPARK-30139: Was busy with some other work. I will start working on

[jira] [Issue Comment Deleted] (SPARK-30176) Eliminate warnings: part 6

2019-12-09 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-30176: --- Comment: was deleted (was: i will work on this.) > Eliminate warnings: part 6 >

[jira] [Commented] (SPARK-30176) Eliminate warnings: part 6

2019-12-08 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991151#comment-16991151 ] Rakesh Raushan commented on SPARK-30176: i will work on this. > Eliminate warnings: part 6 >

[jira] [Commented] (SPARK-30139) get_json_object does not work correctly

2019-12-05 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988693#comment-16988693 ] Rakesh Raushan commented on SPARK-30139: I will look into this issue. > get_json_object does

  1   2   >