[jira] [Commented] (SPARK-36952) Inline type hints for python/pyspark/resource/information.py and python/pyspark/resource/profile.py

2021-10-07 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425947#comment-17425947 ] dgd_contributor commented on SPARK-36952: - working on this > Inline type hints for

[jira] [Issue Comment Deleted] (SPARK-36952) Inline type hints for python/pyspark/resource/information.py and python/pyspark/resource/profile.py

2021-10-07 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36952: Comment: was deleted (was: working on this) > Inline type hints for

[jira] [Created] (SPARK-36952) Inline type hints for python/pyspark/resource/information.py and python/pyspark/resource/profile.py

2021-10-07 Thread dgd_contributor (Jira)
dgd_contributor created SPARK-36952: --- Summary: Inline type hints for python/pyspark/resource/information.py and python/pyspark/resource/profile.py Key: SPARK-36952 URL:

[jira] [Created] (SPARK-36946) Support time for ps.to_datetime

2021-10-07 Thread dgd_contributor (Jira)
dgd_contributor created SPARK-36946: --- Summary: Support time for ps.to_datetime Key: SPARK-36946 URL: https://issues.apache.org/jira/browse/SPARK-36946 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36902) Migrate CreateTableAsSelectStatement to v2 command

2021-09-30 Thread dgd_contributor (Jira)
dgd_contributor created SPARK-36902: --- Summary: Migrate CreateTableAsSelectStatement to v2 command Key: SPARK-36902 URL: https://issues.apache.org/jira/browse/SPARK-36902 Project: Spark

[jira] [Updated] (SPARK-36886) Inline type hints for python/pyspark/sql/context.py

2021-09-28 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36886: Description: Inline type hints for python/pyspark/sql/context.py from Inline type hints

[jira] [Updated] (SPARK-36886) Inline type hints for python/pyspark/sql/context.py

2021-09-28 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36886: Summary: Inline type hints for python/pyspark/sql/context.py (was: Inline type hints for

[jira] [Commented] (SPARK-36887) Inline type hints for python/pyspark/sql/conf.py

2021-09-28 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421880#comment-17421880 ] dgd_contributor commented on SPARK-36887: - I'm working on this. > Inline type hints for

[jira] [Created] (SPARK-36887) Inline type hints for python/pyspark/sql/conf.py

2021-09-28 Thread dgd_contributor (Jira)
dgd_contributor created SPARK-36887: --- Summary: Inline type hints for python/pyspark/sql/conf.py Key: SPARK-36887 URL: https://issues.apache.org/jira/browse/SPARK-36887 Project: Spark Issue

[jira] [Commented] (SPARK-36886) Inline type hints for python/pyspark/sql/column.py

2021-09-28 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421878#comment-17421878 ] dgd_contributor commented on SPARK-36886: - Working on this. > Inline type hints for

[jira] [Created] (SPARK-36886) Inline type hints for python/pyspark/sql/column.py

2021-09-28 Thread dgd_contributor (Jira)
dgd_contributor created SPARK-36886: --- Summary: Inline type hints for python/pyspark/sql/column.py Key: SPARK-36886 URL: https://issues.apache.org/jira/browse/SPARK-36886 Project: Spark

[jira] [Commented] (SPARK-36845) Inline type hint files

2021-09-28 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421859#comment-17421859 ] dgd_contributor commented on SPARK-36845: - Can i work on this :D ? > Inline type hint files >

[jira] [Commented] (SPARK-36785) Fix ps.DataFrame.isin

2021-09-16 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416283#comment-17416283 ] dgd_contributor commented on SPARK-36785: - I am working on this. > Fix ps.DataFrame.isin >

[jira] [Created] (SPARK-36785) Fix ps.DataFrame.isin

2021-09-16 Thread dgd_contributor (Jira)
dgd_contributor created SPARK-36785: --- Summary: Fix ps.DataFrame.isin Key: SPARK-36785 URL: https://issues.apache.org/jira/browse/SPARK-36785 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-36762) Fix Series.isin when Series has NaN values

2021-09-16 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36762: Affects Version/s: (was: 3.3) 3.3.0 > Fix Series.isin when

[jira] [Updated] (SPARK-36762) Fix Series.isin when Series has NaN values

2021-09-16 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36762: Affects Version/s: 3.2.0 > Fix Series.isin when Series has NaN values >

[jira] [Updated] (SPARK-36779) Error when list of data type tuples has len = 1

2021-09-16 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36779: Summary: Error when list of data type tuples has len = 1 (was: Fix when list of data

[jira] [Created] (SPARK-36779) Fix when list of data type tuples has len = 1

2021-09-16 Thread dgd_contributor (Jira)
dgd_contributor created SPARK-36779: --- Summary: Fix when list of data type tuples has len = 1 Key: SPARK-36779 URL: https://issues.apache.org/jira/browse/SPARK-36779 Project: Spark Issue

[jira] [Updated] (SPARK-36762) Fix Series.isin when Series has NaN values

2021-09-15 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36762: Summary: Fix Series.isin when Series has NaN values (was: Fix Series.isin when it have

[jira] [Updated] (SPARK-36762) Fix Series.isin when it have NaN

2021-09-15 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36762: Summary: Fix Series.isin when it have NaN (was: Fix Series.isin when values have NaN) >

[jira] [Updated] (SPARK-36762) Fix Series.isin when values have NaN

2021-09-15 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36762: Description: {code:python} >>> pser = pd.Series([None, 5, None, 3, 2, 1, None, 0, 0]) >>>

[jira] [Updated] (SPARK-36762) Fix Series.isin when values have NaN

2021-09-15 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36762: Summary: Fix Series.isin when values have NaN (was: Support list-like types for

[jira] [Updated] (SPARK-36762) Support list-like types for pandas/base.isin

2021-09-14 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36762: Summary: Support list-like types for pandas/base.isin (was: Support list-like types for

[jira] [Created] (SPARK-36762) Support list-like types for base.isin

2021-09-14 Thread dgd_contributor (Jira)
dgd_contributor created SPARK-36762: --- Summary: Support list-like types for base.isin Key: SPARK-36762 URL: https://issues.apache.org/jira/browse/SPARK-36762 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36742) Fix ps.to_datetime with plurals of keys like years, months, days

2021-09-13 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414194#comment-17414194 ] dgd_contributor commented on SPARK-36742: - working on this   > Fix ps.to_datetime with plurals

[jira] [Created] (SPARK-36742) Fix ps.to_datetime with plurals of keys like years, months, days

2021-09-13 Thread dgd_contributor (Jira)
dgd_contributor created SPARK-36742: --- Summary: Fix ps.to_datetime with plurals of keys like years, months, days Key: SPARK-36742 URL: https://issues.apache.org/jira/browse/SPARK-36742 Project:

[jira] [Commented] (SPARK-36728) Can't create datetime object from anything other then year column Pyspark - koalas

2021-09-13 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414179#comment-17414179 ] dgd_contributor commented on SPARK-36728: - thanks, pandas API on spark does not work with

[jira] [Commented] (SPARK-36728) Can't create datetime object from anything other then year column Pyspark - koalas

2021-09-12 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17413725#comment-17413725 ] dgd_contributor commented on SPARK-36728: - I think this is not a bug, same behavior in pandas.

[jira] [Updated] (SPARK-36722) Problems with update function in koalas - pyspark pandas.

2021-09-11 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36722: Affects Version/s: 3.2.0 > Problems with update function in koalas - pyspark pandas. >

[jira] [Commented] (SPARK-36722) Problems with update function in koalas - pyspark pandas.

2021-09-11 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17413632#comment-17413632 ] dgd_contributor commented on SPARK-36722: - I will make a PR to fix this one soon > Problems

[jira] [Updated] (SPARK-35823) Spark UI-Stages DAG visualization is empty in IE11

2021-09-10 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-35823: Affects Version/s: (was: 3.1.1) 3.3.0

[jira] [Updated] (SPARK-35821) Spark 3.1.1 Internet Explorer 11 compatibility issues

2021-09-10 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-35821: Affects Version/s: (was: 3.1.1) 3.3.0

[jira] [Updated] (SPARK-35822) Spark UI-Executor tab is empty in IE11

2021-09-10 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-35822: Affects Version/s: 3.3.0 > Spark UI-Executor tab is empty in IE11 >

[jira] [Updated] (SPARK-36685) Fix wrong assert statement

2021-09-10 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36685: Affects Version/s: (was: 3.1.2) 3.3.0

[jira] [Updated] (SPARK-35822) Spark UI-Executor tab is empty in IE11

2021-09-09 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-35822: Affects Version/s: (was: 3.1.1) 3.2.0

[jira] [Updated] (SPARK-35821) Spark 3.1.1 Internet Explorer 11 compatibility issues

2021-09-09 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-35821: Issue Type: Umbrella (was: New Feature) > Spark 3.1.1 Internet Explorer 11 compatibility

[jira] [Updated] (SPARK-35822) Spark UI-Executor tab is empty in IE11

2021-09-09 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-35822: Attachment: Executortab_IE.PNG Executortab_Chrome.png > Spark UI-Executor

[jira] [Commented] (SPARK-35823) Spark UI-Stages DAG visualization is empty in IE11

2021-09-08 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412080#comment-17412080 ] dgd_contributor commented on SPARK-35823: - I'm working on this. > Spark UI-Stages DAG

[jira] [Commented] (SPARK-35822) Spark UI-Executor tab is empty in IE11

2021-09-08 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412079#comment-17412079 ] dgd_contributor commented on SPARK-35822: - I'm working on this. > Spark UI-Executor tab is

[jira] [Updated] (SPARK-36671) Support Series.__and__ for Integral

2021-09-08 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36671: Summary: Support Series.__and__ for Integral (was: Support __and__ in num_ops.py) >

[jira] [Commented] (SPARK-36671) Support __and__ in num_ops.py

2021-09-07 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411009#comment-17411009 ] dgd_contributor commented on SPARK-36671: - working on this > Support __and__ in num_ops.py >

[jira] [Updated] (SPARK-36671) Support __and__ in num_ops.py

2021-09-05 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36671: Description: {code:python} >>> pser1 = pd.Series([1, 2, 3]) >>> pser2 = pd.Series([4, 5,

[jira] [Updated] (SPARK-36671) Support __and__ in num_ops.py

2021-09-05 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36671: Description: {code:python} >>> pser1 = pd.Series([1, 2, 3]) >>> pser2 = pd.Series([4, 5,

[jira] [Created] (SPARK-36671) Support __and__ in num_ops.py

2021-09-05 Thread dgd_contributor (Jira)
dgd_contributor created SPARK-36671: --- Summary: Support __and__ in num_ops.py Key: SPARK-36671 URL: https://issues.apache.org/jira/browse/SPARK-36671 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36402) Implement Series.combine

2021-08-26 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405172#comment-17405172 ] dgd_contributor commented on SPARK-36402: - working on this > Implement Series.combine >

[jira] [Commented] (SPARK-36515) Improve test coverage for groupby.py and window.py.

2021-08-26 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405058#comment-17405058 ] dgd_contributor commented on SPARK-36515: - I'm working on this. > Improve test coverage for

[jira] [Comment Edited] (SPARK-36434) Implement DataFrame.lookup

2021-08-20 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402151#comment-17402151 ] dgd_contributor edited comment on SPARK-36434 at 8/20/21, 10:44 AM:

[jira] [Commented] (SPARK-36434) Implement DataFrame.lookup

2021-08-20 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402151#comment-17402151 ] dgd_contributor commented on SPARK-36434: - should we work on this? this docs show

[jira] [Commented] (SPARK-36387) Fix Series.astype from datetime to nullable string

2021-08-12 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397953#comment-17397953 ] dgd_contributor commented on SPARK-36387: - Sry about my late, please go ahead! this's my first

[jira] [Commented] (SPARK-36387) Fix Series.astype from datetime to nullable string

2021-08-03 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392648#comment-17392648 ] dgd_contributor commented on SPARK-36387: - Can I work on this ? > Fix Series.astype from

[jira] [Commented] (SPARK-36303) Refactor fourteenth set of 20 query execution errors to use error classes

2021-08-01 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391294#comment-17391294 ] dgd_contributor commented on SPARK-36303: - working on this > Refactor fourteenth set of 20

[jira] [Commented] (SPARK-36302) Refactor thirteenth set of 20 query execution errors to use error classes

2021-08-01 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391283#comment-17391283 ] dgd_contributor commented on SPARK-36302: - working on this. > Refactor thirteenth set of 20

[jira] [Commented] (SPARK-36301) Refactor twelfth set of 20 query execution errors to use error classes

2021-08-01 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391279#comment-17391279 ] dgd_contributor commented on SPARK-36301: - working on this > Refactor twelfth set of 20 query

[jira] [Commented] (SPARK-36298) Refactor ninth set of 20 query execution errors to use error classes

2021-08-01 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391277#comment-17391277 ] dgd_contributor commented on SPARK-36298: - working on this. > Refactor ninth set of 20 query

[jira] [Commented] (SPARK-36299) Refactor tenth set of 20 query execution errors to use error classes

2021-08-01 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391278#comment-17391278 ] dgd_contributor commented on SPARK-36299: - working on this. > Refactor tenth set of 20 query

[jira] [Commented] (SPARK-36343) spark 2.4.x spark.sql.extensions support multiple extensions

2021-07-29 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390283#comment-17390283 ] dgd_contributor commented on SPARK-36343: - [~hyukjin.kwon] In my case, i'm using spark  thrift

[jira] [Updated] (SPARK-36343) spark 2.4.x spark.sql.extensions support multiple extensions

2021-07-29 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36343: Description: Like SPARK-26493 (was: Like issue [SPARK-26493]) > spark 2.4.x

[jira] [Created] (SPARK-36343) spark 2.4.x spark.sql.extensions support multiple extensions

2021-07-29 Thread dgd_contributor (Jira)
dgd_contributor created SPARK-36343: --- Summary: spark 2.4.x spark.sql.extensions support multiple extensions Key: SPARK-36343 URL: https://issues.apache.org/jira/browse/SPARK-36343 Project: Spark

[jira] [Commented] (SPARK-36099) Group exception messages in core/util

2021-07-27 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17388387#comment-17388387 ] dgd_contributor commented on SPARK-36099: - Sorry I wasn't checking the comment recently, I've

[jira] [Commented] (SPARK-36099) Group exception messages in core/util

2021-07-27 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17387830#comment-17387830 ] dgd_contributor commented on SPARK-36099: - [~Shockang] how is your progress, I already have the

[jira] [Commented] (SPARK-36291) Refactor second set of 20 query execution errors to use error classes

2021-07-26 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17387720#comment-17387720 ] dgd_contributor commented on SPARK-36291: - working on this > Refactor second set of 20 query

[jira] [Updated] (SPARK-36229) conv() inconsistently handles invalid strings with > 64 invalid characters

2021-07-21 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36229: Description: 1/ SPARK-33428 fixed ArrayIndexOutofBoundsException but introduced a new

[jira] [Comment Edited] (SPARK-36229) conv() inconsistently handles invalid strings with > 64 invalid characters

2021-07-20 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384666#comment-17384666 ] dgd_contributor edited comment on SPARK-36229 at 7/21/21, 5:44 AM: ---

[jira] [Commented] (SPARK-36229) conv() inconsistently handles invalid strings with > 64 invalid characters

2021-07-20 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384666#comment-17384666 ] dgd_contributor commented on SPARK-36229: - After look closely, I found out that the overflow

[jira] [Commented] (SPARK-36229) conv() inconsistently handles invalid strings with > 64 invalid characters

2021-07-20 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384610#comment-17384610 ] dgd_contributor commented on SPARK-36229: - thanks, I will look into this   > conv()

[jira] [Commented] (SPARK-34532) IntervalUtils.add() may result in 'long overflow'

2021-07-14 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380396#comment-17380396 ] dgd_contributor commented on SPARK-34532: - there is addExact func in IntervalUtils to handle

[jira] [Commented] (SPARK-36095) Group exception messages in core/rdd

2021-07-12 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379511#comment-17379511 ] dgd_contributor commented on SPARK-36095: - [~allisonwang-db] I would like to work on this, can

[jira] [Commented] (SPARK-36022) Respect interval fields in extract

2021-07-07 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376334#comment-17376334 ] dgd_contributor commented on SPARK-36022: - as they are calendarInterval, which is presented by

[jira] [Commented] (SPARK-35955) Fix decimal overflow issues for Average

2021-07-01 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372566#comment-17372566 ] dgd_contributor commented on SPARK-35955: - I will raise a pull request soon   > Fix decimal

[jira] [Commented] (SPARK-35841) Casting string to decimal type doesn't work if the sum of the digits is greater than 38

2021-06-21 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366924#comment-17366924 ] dgd_contributor commented on SPARK-35841: - I would like to work on this > Casting string to

[jira] [Commented] (SPARK-33603) Group exception messages in execution/command

2021-06-16 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364629#comment-17364629 ] dgd_contributor commented on SPARK-33603: - [~beliefer] can I work on this, if you don't mind?  

[jira] [Commented] (SPARK-35064) Group exception messages in spark/sql (catalyst)

2021-06-14 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363375#comment-17363375 ] dgd_contributor commented on SPARK-35064: - I would like to work on this > Group exception

[jira] [Commented] (SPARK-35622) DataFrame's count function do not need groupBy and avoid shuffle

2021-06-14 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363336#comment-17363336 ] dgd_contributor commented on SPARK-35622: - Run a benchmark on my computer, df.rdd.count()

[jira] [Commented] (SPARK-35563) [SQL] Window operations with over Int.MaxValue + 1 rows can silently drop rows

2021-06-14 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362824#comment-17362824 ] dgd_contributor commented on SPARK-35563: - After looking to this, I found out rowNumber in 

[jira] [Commented] (SPARK-32891) Enhance UTF8String.trim

2021-06-14 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362766#comment-17362766 ] dgd_contributor commented on SPARK-32891: - After looking into this and run a few benchmark, I

[jira] [Commented] (SPARK-35622) DataFrame's count function do not need groupBy and avoid shuffle

2021-06-13 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362681#comment-17362681 ] dgd_contributor commented on SPARK-35622: - hi, could you explain more of this issue? where