[jira] [Commented] (SPARK-37425) Inline type hints for python/pyspark/mllib/recommendation.py

2022-03-08 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502847#comment-17502847 ] dch nguyen commented on SPARK-37425: raise a pr soon! > Inline type hints for

[jira] [Commented] (SPARK-36969) Inline type hints for SparkContext

2022-02-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488577#comment-17488577 ] dch nguyen commented on SPARK-36969: [~itholic] this was resolved by

[jira] [Commented] (SPARK-37154) Inline type hints for python/pyspark/rdd.py

2022-01-17 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17477611#comment-17477611 ] dch nguyen commented on SPARK-37154: Can I go for this? [~byronhsu]  > Inline type hints for

[jira] [Commented] (SPARK-37930) Fix DataFrame select subset with duplicated columns

2022-01-17 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17477529#comment-17477529 ] dch nguyen commented on SPARK-37930: I'm working on this. Thanks > Fix DataFrame select subset with

[jira] [Commented] (SPARK-37930) Fix DataFrame select subset with duplicated columns

2022-01-17 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17477528#comment-17477528 ] dch nguyen commented on SPARK-37930: {code:java} >>> import pandas as pd >>> pdf =

[jira] [Created] (SPARK-37930) Fix DataFrame select subset with duplicated columns

2022-01-17 Thread dch nguyen (Jira)
dch nguyen created SPARK-37930: -- Summary: Fix DataFrame select subset with duplicated columns Key: SPARK-37930 URL: https://issues.apache.org/jira/browse/SPARK-37930 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37929) Support cascade mode for `dropNamespace` API

2022-01-17 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17477052#comment-17477052 ] dch nguyen commented on SPARK-37929: I'm working on this. > Support cascade mode for

[jira] [Updated] (SPARK-37929) Support cascade mode for `dropNamespace` API

2022-01-17 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37929: --- Description: According to [#cmt,|https://github.com/apache/spark/pull/35202#discussion_r784463563] 

[jira] [Updated] (SPARK-37929) Support cascade mode for `dropNamespace` API

2022-01-17 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37929: --- Description: (was: According to

[jira] [Created] (SPARK-37929) Support cascade mode for `dropNamespace` API

2022-01-17 Thread dch nguyen (Jira)
dch nguyen created SPARK-37929: -- Summary: Support cascade mode for `dropNamespace` API Key: SPARK-37929 URL: https://issues.apache.org/jira/browse/SPARK-37929 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37479) Migrate DROP NAMESPACE to use V2 command by default

2022-01-12 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475156#comment-17475156 ] dch nguyen commented on SPARK-37479: [~imback82] I'm working on this now. I'll create PR soon. Thank

[jira] [Comment Edited] (SPARK-37381) Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-30 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450947#comment-17450947 ] dch nguyen edited comment on SPARK-37381 at 11/30/21, 8:33 AM: ---

[jira] [Commented] (SPARK-37381) Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-30 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450947#comment-17450947 ] dch nguyen commented on SPARK-37381: [~xiaopenglei] it's ok. Thank you. > Unify v1 and v2 SHOW

[jira] [Created] (SPARK-37495) Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled

2021-11-29 Thread dch nguyen (Jira)
dch nguyen created SPARK-37495: -- Summary: Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled Key: SPARK-37495 URL: https://issues.apache.org/jira/browse/SPARK-37495

[jira] [Created] (SPARK-37491) Fix Series.asof when values of the series is not sorted

2021-11-29 Thread dch nguyen (Jira)
dch nguyen created SPARK-37491: -- Summary: Fix Series.asof when values of the series is not sorted Key: SPARK-37491 URL: https://issues.apache.org/jira/browse/SPARK-37491 Project: Spark Issue

[jira] [Created] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check'

2021-11-29 Thread dch nguyen (Jira)
dch nguyen created SPARK-37482: -- Summary: Skip check monotonic increasing for Series.asof with 'compute.eager_check' Key: SPARK-37482 URL: https://issues.apache.org/jira/browse/SPARK-37482 Project:

[jira] [Commented] (SPARK-37055) Apply 'compute.eager_check' across all the codebase

2021-11-28 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450210#comment-17450210 ] dch nguyen commented on SPARK-37055: thanks! I will try to address them > Apply

[jira] [Commented] (SPARK-37055) Apply 'compute.eager_check' across all the codebase

2021-11-28 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450191#comment-17450191 ] dch nguyen commented on SPARK-37055: [~hyukjin.kwon] , no, I am not now. I did not find anywhere to

[jira] [Commented] (SPARK-37479) Migrate DROP NAMESPACE to use V2 command by default

2021-11-28 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450189#comment-17450189 ] dch nguyen commented on SPARK-37479: working on this > Migrate DROP NAMESPACE to use V2 command by

[jira] [Created] (SPARK-37479) Migrate DROP NAMESPACE to use V2 command by default

2021-11-28 Thread dch nguyen (Jira)
dch nguyen created SPARK-37479: -- Summary: Migrate DROP NAMESPACE to use V2 command by default Key: SPARK-37479 URL: https://issues.apache.org/jira/browse/SPARK-37479 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37478) Unify v1 and v2 DROP NAMESPACE tests

2021-11-28 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450188#comment-17450188 ] dch nguyen commented on SPARK-37478: working on this > Unify v1 and v2 DROP NAMESPACE tests >

[jira] [Created] (SPARK-37478) Unify v1 and v2 DROP NAMESPACE tests

2021-11-28 Thread dch nguyen (Jira)
dch nguyen created SPARK-37478: -- Summary: Unify v1 and v2 DROP NAMESPACE tests Key: SPARK-37478 URL: https://issues.apache.org/jira/browse/SPARK-37478 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-37381) Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449352#comment-17449352 ] dch nguyen commented on SPARK-37381: Can I go for it? I want to try to fix it [~xiaopenglei]

[jira] [Commented] (SPARK-37343) Implement createIndex and IndexExists in JDBC (Postgres dialect)

2021-11-15 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444210#comment-17444210 ] dch nguyen commented on SPARK-37343: I'm working on this. > Implement createIndex and IndexExists

[jira] [Created] (SPARK-37343) Implement createIndex and IndexExists in JDBC (Postgres dialect)

2021-11-15 Thread dch nguyen (Jira)
dch nguyen created SPARK-37343: -- Summary: Implement createIndex and IndexExists in JDBC (Postgres dialect) Key: SPARK-37343 URL: https://issues.apache.org/jira/browse/SPARK-37343 Project: Spark

[jira] [Commented] (SPARK-37330) Migrate ReplaceTableStatement to v2 command

2021-11-14 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443609#comment-17443609 ] dch nguyen commented on SPARK-37330: I am working on this > Migrate ReplaceTableStatement to v2

[jira] [Created] (SPARK-37330) Migrate ReplaceTableStatement to v2 command

2021-11-14 Thread dch nguyen (Jira)
dch nguyen created SPARK-37330: -- Summary: Migrate ReplaceTableStatement to v2 command Key: SPARK-37330 URL: https://issues.apache.org/jira/browse/SPARK-37330 Project: Spark Issue Type: Sub-task

[jira] [Comment Edited] (SPARK-37260) PYSPARK Arrow 3.2.0 docs link invalid

2021-11-09 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441494#comment-17441494 ] dch nguyen edited comment on SPARK-37260 at 11/10/21, 4:03 AM: --- ping

[jira] [Commented] (SPARK-37260) PYSPARK Arrow 3.2.0 docs link invalid

2021-11-09 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441494#comment-17441494 ] dch nguyen commented on SPARK-37260: [~hyukjin.kwon] , is this issue resolved by

[jira] [Commented] (SPARK-37236) Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440143#comment-17440143 ] dch nguyen commented on SPARK-37236: working on this > Inline type hints for KernelDensity.pyi,

[jira] [Commented] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440142#comment-17440142 ] dch nguyen commented on SPARK-37235: working on this   > Inline type hints for distribution.py and

[jira] [Updated] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37235: --- Summary: Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/ (was:

[jira] [Updated] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37235: --- Summary: Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat (was:

[jira] [Updated] (SPARK-37236) Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37236: --- Summary: Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/ (was:

[jira] [Created] (SPARK-37236) Inline type hints for distribution.py, __init__.py in python/pyspark/mllib/stat/

2021-11-07 Thread dch nguyen (Jira)
dch nguyen created SPARK-37236: -- Summary: Inline type hints for distribution.py, __init__.py in python/pyspark/mllib/stat/ Key: SPARK-37236 URL: https://issues.apache.org/jira/browse/SPARK-37236

[jira] [Created] (SPARK-37235) Inline type hints for python/pyspark/mllib/distribution.py and __init__.py

2021-11-07 Thread dch nguyen (Jira)
dch nguyen created SPARK-37235: -- Summary: Inline type hints for python/pyspark/mllib/distribution.py and __init__.py Key: SPARK-37235 URL: https://issues.apache.org/jira/browse/SPARK-37235 Project:

[jira] [Updated] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37234: --- Summary: Inline type hints for python/pyspark/mllib/stat/_statistics.py (was: Inline type hints

[jira] [Commented] (SPARK-37234) Inline type hints for python/pyspark/mllib/_statistics.py

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440141#comment-17440141 ] dch nguyen commented on SPARK-37234: working on this. > Inline type hints for

[jira] [Created] (SPARK-37234) Inline type hints for python/pyspark/mllib/_statistics.py

2021-11-07 Thread dch nguyen (Jira)
dch nguyen created SPARK-37234: -- Summary: Inline type hints for python/pyspark/mllib/_statistics.py Key: SPARK-37234 URL: https://issues.apache.org/jira/browse/SPARK-37234 Project: Spark Issue

[jira] [Created] (SPARK-37233) Inline type hints for files in python/pyspark/mllib

2021-11-07 Thread dch nguyen (Jira)
dch nguyen created SPARK-37233: -- Summary: Inline type hints for files in python/pyspark/mllib Key: SPARK-37233 URL: https://issues.apache.org/jira/browse/SPARK-37233 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37180) PySpark.pandas should support __version__

2021-11-04 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438522#comment-17438522 ] dch nguyen commented on SPARK-37180: As Koalas was merged into Pyspark, so Should

[jira] [Comment Edited] (SPARK-37180) PySpark.pandas should support __version__

2021-11-04 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438522#comment-17438522 ] dch nguyen edited comment on SPARK-37180 at 11/4/21, 7:31 AM: -- As Koalas

[jira] [Commented] (SPARK-37094) Inline type hints for files in python/pyspark

2021-10-29 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435810#comment-17435810 ] dch nguyen commented on SPARK-37094: [~ByronHsu]  I have worked on some issues (statcounter,

[jira] [Commented] (SPARK-37146) Inline type hints for python/pyspark/__init__.py

2021-10-28 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435341#comment-17435341 ] dch nguyen commented on SPARK-37146: I am working on this > Inline type hints for

[jira] [Created] (SPARK-37146) Inline type hints for python/pyspark/__init__.py

2021-10-28 Thread dch nguyen (Jira)
dch nguyen created SPARK-37146: -- Summary: Inline type hints for python/pyspark/__init__.py Key: SPARK-37146 URL: https://issues.apache.org/jira/browse/SPARK-37146 Project: Spark Issue Type:

[jira] [Created] (SPARK-37144) Inline type hints for python/pyspark/file.py

2021-10-28 Thread dch nguyen (Jira)
dch nguyen created SPARK-37144: -- Summary: Inline type hints for python/pyspark/file.py Key: SPARK-37144 URL: https://issues.apache.org/jira/browse/SPARK-37144 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37142) Add __all__ to pyspark/pandas/*/__init__.py

2021-10-28 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37142: --- Issue Type: Improvement (was: Bug) > Add __all__ to pyspark/pandas/*/__init__.py >

[jira] [Created] (SPARK-37142) Add __all__ to pyspark/pandas/*/__init__.py

2021-10-28 Thread dch nguyen (Jira)
dch nguyen created SPARK-37142: -- Summary: Add __all__ to pyspark/pandas/*/__init__.py Key: SPARK-37142 URL: https://issues.apache.org/jira/browse/SPARK-37142 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-37140) Inline type hints for python/pyspark/resultiterable.py

2021-10-27 Thread dch nguyen (Jira)
dch nguyen created SPARK-37140: -- Summary: Inline type hints for python/pyspark/resultiterable.py Key: SPARK-37140 URL: https://issues.apache.org/jira/browse/SPARK-37140 Project: Spark Issue

[jira] [Created] (SPARK-37139) Inline type hints for python/pyspark/taskcontext.py and python/pyspark/version.py

2021-10-27 Thread dch nguyen (Jira)
dch nguyen created SPARK-37139: -- Summary: Inline type hints for python/pyspark/taskcontext.py and python/pyspark/version.py Key: SPARK-37139 URL: https://issues.apache.org/jira/browse/SPARK-37139

[jira] [Commented] (SPARK-37116) Allow sequences (tuples and lists) as pivot values argument in PySpark

2021-10-25 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17434107#comment-17434107 ] dch nguyen commented on SPARK-37116: work on this :v   > Allow sequences (tuples and lists) as

[jira] [Created] (SPARK-37116) Allow sequences (tuples and lists) as pivot values argument in PySpark

2021-10-25 Thread dch nguyen (Jira)
dch nguyen created SPARK-37116: -- Summary: Allow sequences (tuples and lists) as pivot values argument in PySpark Key: SPARK-37116 URL: https://issues.apache.org/jira/browse/SPARK-37116 Project: Spark

[jira] [Created] (SPARK-37107) Inline type hints for files in python/pyspark/status.py

2021-10-24 Thread dch nguyen (Jira)
dch nguyen created SPARK-37107: -- Summary: Inline type hints for files in python/pyspark/status.py Key: SPARK-37107 URL: https://issues.apache.org/jira/browse/SPARK-37107 Project: Spark Issue

[jira] [Commented] (SPARK-37095) Inline type hints for files in python/pyspark/broadcast.py

2021-10-21 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17432804#comment-17432804 ] dch nguyen commented on SPARK-37095: working on this > Inline type hints for files in

[jira] [Created] (SPARK-37095) Inline type hints for files in python/pyspark/broadcast.py

2021-10-21 Thread dch nguyen (Jira)
dch nguyen created SPARK-37095: -- Summary: Inline type hints for files in python/pyspark/broadcast.py Key: SPARK-37095 URL: https://issues.apache.org/jira/browse/SPARK-37095 Project: Spark Issue

[jira] [Updated] (SPARK-37083) Inline type hints for python/pyspark/accumulators.py

2021-10-21 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37083: --- Parent: SPARK-37094 Issue Type: Sub-task (was: Bug) > Inline type hints for

[jira] [Updated] (SPARK-36969) Inline type hints for SparkContext

2021-10-21 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-36969: --- Parent: SPARK-37094 Issue Type: Sub-task (was: Bug) > Inline type hints for SparkContext >

[jira] [Updated] (SPARK-36969) Inline type hints for SparkContext

2021-10-21 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-36969: --- Parent: (was: SPARK-36845) Issue Type: Bug (was: Sub-task) > Inline type hints for

[jira] [Created] (SPARK-37094) Inline type hints for files in python/pyspark

2021-10-21 Thread dch nguyen (Jira)
dch nguyen created SPARK-37094: -- Summary: Inline type hints for files in python/pyspark Key: SPARK-37094 URL: https://issues.apache.org/jira/browse/SPARK-37094 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37083) Inline type hints for python/pyspark/accumulators.py

2021-10-21 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37083: --- Parent: (was: SPARK-36845) Issue Type: Bug (was: Sub-task) > Inline type hints for

[jira] [Updated] (SPARK-37093) Inline type hints python/pyspark/streaming

2021-10-21 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37093: --- Issue Type: Umbrella (was: Bug) > Inline type hints python/pyspark/streaming >

[jira] [Updated] (SPARK-37042) Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

2021-10-21 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37042: --- Parent: SPARK-37093 Issue Type: Sub-task (was: Bug) > Inline type hints for kinesis.py and

[jira] [Updated] (SPARK-37042) Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

2021-10-21 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37042: --- Parent: (was: SPARK-36845) Issue Type: Bug (was: Sub-task) > Inline type hints for

[jira] [Updated] (SPARK-37015) Inline type hints for python/pyspark/streaming/dstream.py

2021-10-21 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37015: --- Parent: SPARK-37093 Issue Type: Sub-task (was: Bug) > Inline type hints for

[jira] [Updated] (SPARK-37015) Inline type hints for python/pyspark/streaming/dstream.py

2021-10-21 Thread dch nguyen (Jira)

[jira] [Updated] (SPARK-37014) Inline type hints for python/pyspark/streaming/context.py

2021-10-21 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37014: --- Parent: SPARK-37093 Issue Type: Sub-task (was: Bug) > Inline type hints for

[jira] [Updated] (SPARK-37014) Inline type hints for python/pyspark/streaming/context.py

2021-10-21 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37014: --- Parent: (was: SPARK-36845) Issue Type: Bug (was: Sub-task) > Inline type hints for

[jira] [Created] (SPARK-37093) Inline type hints python/pyspark/streaming

2021-10-21 Thread dch nguyen (Jira)
dch nguyen created SPARK-37093: -- Summary: Inline type hints python/pyspark/streaming Key: SPARK-37093 URL: https://issues.apache.org/jira/browse/SPARK-37093 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-36845) Inline type hint files

2021-10-21 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17432755#comment-17432755 ] dch nguyen commented on SPARK-36845: [~ueshin], yes, i will > Inline type hint files >

[jira] [Created] (SPARK-37083) Inline type hints for python/pyspark/accumulators.py

2021-10-21 Thread dch nguyen (Jira)
dch nguyen created SPARK-37083: -- Summary: Inline type hints for python/pyspark/accumulators.py Key: SPARK-37083 URL: https://issues.apache.org/jira/browse/SPARK-37083 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37055) Apply 'compute.eager_check' across all the codebase

2021-10-19 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37055: --- Description: As [~hyukjin.kwon] guide 1 Make every input validation like this covered by the new

[jira] [Created] (SPARK-37055) Apply 'compute.eager_check' across all the codebase

2021-10-19 Thread dch nguyen (Jira)
dch nguyen created SPARK-37055: -- Summary: Apply 'compute.eager_check' across all the codebase Key: SPARK-37055 URL: https://issues.apache.org/jira/browse/SPARK-37055 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37042) Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

2021-10-18 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37042: --- Summary: Inline type hints for kinesis.py and listener.py in python/pyspark/streaming (was: Inline

[jira] [Created] (SPARK-37042) Inline type hints for python/pyspark/streaming/kinesis.py

2021-10-18 Thread dch nguyen (Jira)
dch nguyen created SPARK-37042: -- Summary: Inline type hints for python/pyspark/streaming/kinesis.py Key: SPARK-37042 URL: https://issues.apache.org/jira/browse/SPARK-37042 Project: Spark Issue

[jira] [Commented] (SPARK-37042) Inline type hints for python/pyspark/streaming/kinesis.py

2021-10-18 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17429918#comment-17429918 ] dch nguyen commented on SPARK-37042: i am working on this > Inline type hints for

[jira] [Updated] (SPARK-37002) Introduce the 'compute.eager_check' option

2021-10-17 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37002: --- Summary: Introduce the 'compute.eager_check' option (was: Introduce the

[jira] [Created] (SPARK-37033) Inline type hints for python/pyspark/resource/requests.py

2021-10-17 Thread dch nguyen (Jira)
dch nguyen created SPARK-37033: -- Summary: Inline type hints for python/pyspark/resource/requests.py Key: SPARK-37033 URL: https://issues.apache.org/jira/browse/SPARK-37033 Project: Spark Issue

[jira] [Commented] (SPARK-37033) Inline type hints for python/pyspark/resource/requests.py

2021-10-17 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17429802#comment-17429802 ] dch nguyen commented on SPARK-37033: working on this! > Inline type hints for

[jira] [Commented] (SPARK-37014) Inline type hints for python/pyspark/streaming/context.py

2021-10-14 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17429112#comment-17429112 ] dch nguyen commented on SPARK-37014: working on this > Inline type hints for

[jira] [Commented] (SPARK-37015) Inline type hints for python/pyspark/streaming/dstream.py

2021-10-14 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17429111#comment-17429111 ] dch nguyen commented on SPARK-37015: working on this > Inline type hints for

[jira] [Created] (SPARK-37015) Inline type hints for python/pyspark/streaming/dstream.py

2021-10-14 Thread dch nguyen (Jira)
dch nguyen created SPARK-37015: -- Summary: Inline type hints for python/pyspark/streaming/dstream.py Key: SPARK-37015 URL: https://issues.apache.org/jira/browse/SPARK-37015 Project: Spark Issue

[jira] [Created] (SPARK-37014) Inline type hints for python/pyspark/streaming/context.py

2021-10-14 Thread dch nguyen (Jira)
dch nguyen created SPARK-37014: -- Summary: Inline type hints for python/pyspark/streaming/context.py Key: SPARK-37014 URL: https://issues.apache.org/jira/browse/SPARK-37014 Project: Spark Issue

[jira] [Commented] (SPARK-36525) DS V2 Index Support

2021-10-14 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17429077#comment-17429077 ] dch nguyen commented on SPARK-36525: [~huaxingao] yes, i'd like to > DS V2 Index Support >

[jira] [Commented] (SPARK-36525) DS V2 Index Support

2021-10-14 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428676#comment-17428676 ] dch nguyen commented on SPARK-36525: [~huaxingao], Should we do these functions for supportsIndex in

[jira] [Updated] (SPARK-37002) Introduce the 'compute.check_identical_indices' option

2021-10-13 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37002: --- Summary: Introduce the 'compute.check_identical_indices' option (was: Introduce the

[jira] [Created] (SPARK-37002) Introduce the 'compute.check_identical_index' option

2021-10-13 Thread dch nguyen (Jira)
dch nguyen created SPARK-37002: -- Summary: Introduce the 'compute.check_identical_index' option Key: SPARK-37002 URL: https://issues.apache.org/jira/browse/SPARK-37002 Project: Spark Issue Type:

[jira] [Created] (SPARK-36973) Deduplicate prepare data method for HistogramPlotBase and KdePlotBase

2021-10-11 Thread dch nguyen (Jira)
dch nguyen created SPARK-36973: -- Summary: Deduplicate prepare data method for HistogramPlotBase and KdePlotBase Key: SPARK-36973 URL: https://issues.apache.org/jira/browse/SPARK-36973 Project: Spark

[jira] [Updated] (SPARK-36969) Inline type hints for SparkContext

2021-10-11 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-36969: --- Summary: Inline type hints for SparkContext (was: Inline type hints for python/pyspark/context.py)

[jira] [Commented] (SPARK-36969) Inline type hints for python/pyspark/context.py

2021-10-10 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426924#comment-17426924 ] dch nguyen commented on SPARK-36969: working on this > Inline type hints for

[jira] [Created] (SPARK-36969) Inline type hints for python/pyspark/context.py

2021-10-10 Thread dch nguyen (Jira)
dch nguyen created SPARK-36969: -- Summary: Inline type hints for python/pyspark/context.py Key: SPARK-36969 URL: https://issues.apache.org/jira/browse/SPARK-36969 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36968) ps.Series.dot raise "matrices are not aligned" if index is not same

2021-10-10 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-36968: --- Summary: ps.Series.dot raise "matrices are not aligned" if index is not same (was: ps.Series.dot

[jira] [Updated] (SPARK-36968) ps.Series.dot raise ValueError "matrices are not aligned" if index is not same

2021-10-10 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-36968: --- Summary: ps.Series.dot raise ValueError "matrices are not aligned" if index is not same (was:

[jira] [Created] (SPARK-36968) ps.Series.dot raise ValueError matrices are not aligned if index is not same

2021-10-10 Thread dch nguyen (Jira)
dch nguyen created SPARK-36968: -- Summary: ps.Series.dot raise ValueError matrices are not aligned if index is not same Key: SPARK-36968 URL: https://issues.apache.org/jira/browse/SPARK-36968 Project:

[jira] [Commented] (SPARK-36952) Inline type hints for python/pyspark/resource/information.py and python/pyspark/resource/profile.py

2021-10-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425949#comment-17425949 ] dch nguyen commented on SPARK-36952: working on this > Inline type hints for

[jira] [Created] (SPARK-36945) Inline type hints for python/pyspark/sql/udf.py

2021-10-06 Thread dch nguyen (Jira)
dch nguyen created SPARK-36945: -- Summary: Inline type hints for python/pyspark/sql/udf.py Key: SPARK-36945 URL: https://issues.apache.org/jira/browse/SPARK-36945 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36945) Inline type hints for python/pyspark/sql/udf.py

2021-10-06 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425301#comment-17425301 ] dch nguyen commented on SPARK-36945: working on this > Inline type hints for

[jira] [Created] (SPARK-36944) Remove unused python/pyspark/sql/__init__.pyi

2021-10-06 Thread dch nguyen (Jira)
dch nguyen created SPARK-36944: -- Summary: Remove unused python/pyspark/sql/__init__.pyi Key: SPARK-36944 URL: https://issues.apache.org/jira/browse/SPARK-36944 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36938) Inline type hints for group.py in python/pyspark/sql

2021-10-06 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-36938: --- Summary: Inline type hints for group.py in python/pyspark/sql (was: nline type hints for

[jira] [Created] (SPARK-36938) nline type hints for group.py in python/pyspark/sql

2021-10-06 Thread dch nguyen (Jira)
dch nguyen created SPARK-36938: -- Summary: nline type hints for group.py in python/pyspark/sql Key: SPARK-36938 URL: https://issues.apache.org/jira/browse/SPARK-36938 Project: Spark Issue

[jira] [Commented] (SPARK-36938) Inline type hints for group.py in python/pyspark/sql

2021-10-06 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424929#comment-17424929 ] dch nguyen commented on SPARK-36938: i am working on this > Inline type hints for group.py in

  1   2   >