[jira] [Assigned] (SPARK-36255) FileNotFound exceptions from the shuffle push can cause the executor to terminate

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36255: Assignee: (was: Apache Spark) > FileNotFound exceptions from the shuffle push can cau

[jira] [Created] (SPARK-36257) Updated the version of TimestampNTZ related changes as 3.3.0

2021-07-21 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-36257: -- Summary: Updated the version of TimestampNTZ related changes as 3.3.0 Key: SPARK-36257 URL: https://issues.apache.org/jira/browse/SPARK-36257 Project: Spark

[jira] [Commented] (SPARK-36255) FileNotFound exceptions from the shuffle push can cause the executor to terminate

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385280#comment-17385280 ] Apache Spark commented on SPARK-36255: -- User 'otterc' has created a pull request fo

[jira] [Assigned] (SPARK-36255) FileNotFound exceptions from the shuffle push can cause the executor to terminate

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36255: Assignee: Apache Spark > FileNotFound exceptions from the shuffle push can cause the exec

[jira] [Commented] (SPARK-36255) FileNotFound exceptions from the shuffle push can cause the executor to terminate

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385279#comment-17385279 ] Apache Spark commented on SPARK-36255: -- User 'otterc' has created a pull request fo

[jira] [Commented] (SPARK-36256) Upgrade lz4-java to 1.8.0

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385278#comment-17385278 ] Apache Spark commented on SPARK-36256: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-36256) Upgrade lz4-java to 1.8.0

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36256: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade lz4-java to 1.8.0 > -

[jira] [Commented] (SPARK-36256) Upgrade lz4-java to 1.8.0

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385277#comment-17385277 ] Apache Spark commented on SPARK-36256: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-36256) Upgrade lz4-java to 1.8.0

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36256: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade lz4-java to 1.8.0 > -

[jira] [Commented] (SPARK-36246) WorkerDecommissionExtendedSuite flakes with GHA

2021-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385275#comment-17385275 ] Hyukjin Kwon commented on SPARK-36246: -- Fixed in https://github.com/apache/spark/pu

[jira] [Resolved] (SPARK-36246) WorkerDecommissionExtendedSuite flakes with GHA

2021-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36246. -- Fix Version/s: 3.1.3 3.2.0 Resolution: Fixed > WorkerDecommissionExt

[jira] [Created] (SPARK-36256) Upgrade lz4-java to 1.8.0

2021-07-21 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36256: -- Summary: Upgrade lz4-java to 1.8.0 Key: SPARK-36256 URL: https://issues.apache.org/jira/browse/SPARK-36256 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-36249) Add remove_categories to CategoricalAccessor and CategoricalIndex

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36249: Assignee: Apache Spark > Add remove_categories to CategoricalAccessor and CategoricalInde

[jira] [Assigned] (SPARK-36249) Add remove_categories to CategoricalAccessor and CategoricalIndex

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36249: Assignee: (was: Apache Spark) > Add remove_categories to CategoricalAccessor and Cate

[jira] [Commented] (SPARK-36249) Add remove_categories to CategoricalAccessor and CategoricalIndex

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385273#comment-17385273 ] Apache Spark commented on SPARK-36249: -- User 'ueshin' has created a pull request fo

[jira] [Updated] (SPARK-36255) FileNotFound exceptions from the shuffle push can cause the executor to terminate

2021-07-21 Thread Chandni Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-36255: -- Summary: FileNotFound exceptions from the shuffle push can cause the executor to terminate (w

[jira] [Updated] (SPARK-36255) FileNotFound exceptions in the Shuffle-push-thread can cause the executor to fail

2021-07-21 Thread Chandni Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-36255: -- Description: When the shuffle files are cleaned up by the executors once a job in a Spark app

[jira] [Updated] (SPARK-36255) FileNotFound exceptions in the Shuffle-push-thread can cause the executor to fail

2021-07-21 Thread Chandni Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-36255: -- Description: When the shuffle files are cleaned up by the executors once a job in a Spark app

[jira] [Resolved] (SPARK-36214) Add add_categories to CategoricalAccessor and CategoricalIndex.

2021-07-21 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36214. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed Issue resolve

[jira] [Updated] (SPARK-36255) FileNotFound exceptions in the Shuffle-push-thread can cause the executor to fail

2021-07-21 Thread Chandni Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-36255: -- Parent: SPARK-30602 Issue Type: Sub-task (was: Bug) > FileNotFound exceptions in the

[jira] [Created] (SPARK-36255) FileNotFound exceptions in the Shuffle-push-thread can cause the executor to fail

2021-07-21 Thread Chandni Singh (Jira)
Chandni Singh created SPARK-36255: - Summary: FileNotFound exceptions in the Shuffle-push-thread can cause the executor to fail Key: SPARK-36255 URL: https://issues.apache.org/jira/browse/SPARK-36255 P

[jira] [Updated] (SPARK-36253) Document added version of pandas-on-Spark support

2021-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36253: - Fix Version/s: 3.2.0 > Document added version of pandas-on-Spark support > -

[jira] [Resolved] (SPARK-36253) Document added version of pandas-on-Spark support

2021-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36253. -- Resolution: Fixed > Document added version of pandas-on-Spark support > --

[jira] [Commented] (SPARK-36253) Document added version of pandas-on-Spark support

2021-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385263#comment-17385263 ] Hyukjin Kwon commented on SPARK-36253: -- Fixed in https://github.com/apache/spark/pu

[jira] [Created] (SPARK-36254) Install mlflow and delta in Github Actions CI

2021-07-21 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-36254: --- Summary: Install mlflow and delta in Github Actions CI Key: SPARK-36254 URL: https://issues.apache.org/jira/browse/SPARK-36254 Project: Spark Issue Type: Sub-t

[jira] [Commented] (SPARK-36253) Document added version of pandas-on-Spark support

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385245#comment-17385245 ] Apache Spark commented on SPARK-36253: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-36253) Document added version of pandas-on-Spark support

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36253: Assignee: Hyukjin Kwon (was: Apache Spark) > Document added version of pandas-on-Spark s

[jira] [Assigned] (SPARK-36253) Document added version of pandas-on-Spark support

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36253: Assignee: Apache Spark (was: Hyukjin Kwon) > Document added version of pandas-on-Spark s

[jira] [Commented] (SPARK-36253) Document added version of pandas-on-Spark support

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385243#comment-17385243 ] Apache Spark commented on SPARK-36253: -- User 'HyukjinKwon' has created a pull reque

[jira] [Created] (SPARK-36253) Document added version of pandas-on-Spark support

2021-07-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-36253: Summary: Document added version of pandas-on-Spark support Key: SPARK-36253 URL: https://issues.apache.org/jira/browse/SPARK-36253 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36252) Add log files rolling policy for driver running in cluster mode with spark standalone cluster

2021-07-21 Thread Jack Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jack Hu updated SPARK-36252: Description: For a long running driver in cluster mode, there is no rolling policy, the log (stdout/stder

[jira] [Created] (SPARK-36252) Add log files rolling policy for driver running in cluster mode with spark standalone cluster

2021-07-21 Thread Jack Hu (Jira)
Jack Hu created SPARK-36252: --- Summary: Add log files rolling policy for driver running in cluster mode with spark standalone cluster Key: SPARK-36252 URL: https://issues.apache.org/jira/browse/SPARK-36252 P

[jira] [Resolved] (SPARK-36063) Optimize OneRowRelation subqueries

2021-07-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36063. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33284 [https://gith

[jira] [Assigned] (SPARK-36063) Optimize OneRowRelation subqueries

2021-07-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36063: --- Assignee: Allison Wang > Optimize OneRowRelation subqueries > -

[jira] [Resolved] (SPARK-36244) Upgrade zstd-jni to 1.5.0-3 to avoid a bug about buffer size calculation

2021-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36244. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33464 [https://

[jira] [Resolved] (SPARK-35912) [SQL] JSON read behavior is different depending on the cache setting when nullable is false.

2021-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35912. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33436 [https://gi

[jira] [Assigned] (SPARK-35912) [SQL] JSON read behavior is different depending on the cache setting when nullable is false.

2021-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35912: Assignee: Fu Chen > [SQL] JSON read behavior is different depending on the cache setting

[jira] [Commented] (SPARK-32666) Install ipython and nbsphinx in Jenkins for Binder integration

2021-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385176#comment-17385176 ] Hyukjin Kwon commented on SPARK-32666: -- Thanks [~shaneknapp]!!! > Install ipython

[jira] [Commented] (SPARK-36251) Cover GitHub Actions runs without SHA in testing script

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385174#comment-17385174 ] Apache Spark commented on SPARK-36251: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-36251) Cover GitHub Actions runs without SHA in testing script

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36251: Assignee: (was: Apache Spark) > Cover GitHub Actions runs without SHA in testing scri

[jira] [Commented] (SPARK-36251) Cover GitHub Actions runs without SHA in testing script

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385173#comment-17385173 ] Apache Spark commented on SPARK-36251: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-36251) Cover GitHub Actions runs without SHA in testing script

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36251: Assignee: Apache Spark > Cover GitHub Actions runs without SHA in testing script > --

[jira] [Created] (SPARK-36251) Cover GitHub Actions runs without SHA in testing script

2021-07-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-36251: Summary: Cover GitHub Actions runs without SHA in testing script Key: SPARK-36251 URL: https://issues.apache.org/jira/browse/SPARK-36251 Project: Spark Issue

[jira] [Created] (SPARK-36250) Add support for running make-distribution without a "clean"

2021-07-21 Thread Holden Karau (Jira)
Holden Karau created SPARK-36250: Summary: Add support for running make-distribution without a "clean" Key: SPARK-36250 URL: https://issues.apache.org/jira/browse/SPARK-36250 Project: Spark

[jira] [Assigned] (SPARK-36248) Add rename_categories to CategoricalAccessor and CategoricalIndex

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36248: Assignee: Apache Spark > Add rename_categories to CategoricalAccessor and CategoricalInde

[jira] [Commented] (SPARK-36248) Add rename_categories to CategoricalAccessor and CategoricalIndex

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385161#comment-17385161 ] Apache Spark commented on SPARK-36248: -- User 'xinrong-databricks' has created a pul

[jira] [Assigned] (SPARK-36248) Add rename_categories to CategoricalAccessor and CategoricalIndex

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36248: Assignee: (was: Apache Spark) > Add rename_categories to CategoricalAccessor and Cate

[jira] [Resolved] (SPARK-33242) Install numpydoc in Jenkins machines

2021-07-21 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-33242. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33469 [https://gith

[jira] [Resolved] (SPARK-32391) Install pydata_sphinx_theme in Jenkins machines

2021-07-21 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-32391. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33469 [https://gith

[jira] [Resolved] (SPARK-32666) Install ipython and nbsphinx in Jenkins for Binder integration

2021-07-21 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-32666. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33469 [https://gith

[jira] [Resolved] (SPARK-32797) Install mypy on the Jenkins CI workers

2021-07-21 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-32797. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33469 [https://gith

[jira] [Commented] (SPARK-32666) Install ipython and nbsphinx in Jenkins for Binder integration

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385132#comment-17385132 ] Apache Spark commented on SPARK-32666: -- User 'shaneknapp' has created a pull reques

[jira] [Commented] (SPARK-32666) Install ipython and nbsphinx in Jenkins for Binder integration

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385133#comment-17385133 ] Apache Spark commented on SPARK-32666: -- User 'shaneknapp' has created a pull reques

[jira] [Assigned] (SPARK-32666) Install ipython and nbsphinx in Jenkins for Binder integration

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32666: Assignee: Shane Knapp (was: Apache Spark) > Install ipython and nbsphinx in Jenkins for

[jira] [Commented] (SPARK-32666) Install ipython and nbsphinx in Jenkins for Binder integration

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385131#comment-17385131 ] Apache Spark commented on SPARK-32666: -- User 'shaneknapp' has created a pull reques

[jira] [Commented] (SPARK-33242) Install numpydoc in Jenkins machines

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385130#comment-17385130 ] Apache Spark commented on SPARK-33242: -- User 'shaneknapp' has created a pull reques

[jira] [Assigned] (SPARK-32666) Install ipython and nbsphinx in Jenkins for Binder integration

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32666: Assignee: Shane Knapp (was: Apache Spark) > Install ipython and nbsphinx in Jenkins for

[jira] [Commented] (SPARK-33242) Install numpydoc in Jenkins machines

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385129#comment-17385129 ] Apache Spark commented on SPARK-33242: -- User 'shaneknapp' has created a pull reques

[jira] [Assigned] (SPARK-32666) Install ipython and nbsphinx in Jenkins for Binder integration

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32666: Assignee: Apache Spark (was: Shane Knapp) > Install ipython and nbsphinx in Jenkins for

[jira] [Assigned] (SPARK-33242) Install numpydoc in Jenkins machines

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33242: Assignee: Shane Knapp (was: Apache Spark) > Install numpydoc in Jenkins machines > -

[jira] [Commented] (SPARK-33242) Install numpydoc in Jenkins machines

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385128#comment-17385128 ] Apache Spark commented on SPARK-33242: -- User 'shaneknapp' has created a pull reques

[jira] [Assigned] (SPARK-33242) Install numpydoc in Jenkins machines

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33242: Assignee: Apache Spark (was: Shane Knapp) > Install numpydoc in Jenkins machines > -

[jira] [Commented] (SPARK-32391) Install pydata_sphinx_theme in Jenkins machines

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385127#comment-17385127 ] Apache Spark commented on SPARK-32391: -- User 'shaneknapp' has created a pull reques

[jira] [Assigned] (SPARK-32391) Install pydata_sphinx_theme in Jenkins machines

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32391: Assignee: Apache Spark (was: Shane Knapp) > Install pydata_sphinx_theme in Jenkins machi

[jira] [Assigned] (SPARK-32391) Install pydata_sphinx_theme in Jenkins machines

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32391: Assignee: Shane Knapp (was: Apache Spark) > Install pydata_sphinx_theme in Jenkins machi

[jira] [Commented] (SPARK-32797) Install mypy on the Jenkins CI workers

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385124#comment-17385124 ] Apache Spark commented on SPARK-32797: -- User 'shaneknapp' has created a pull reques

[jira] [Commented] (SPARK-32391) Install pydata_sphinx_theme in Jenkins machines

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385125#comment-17385125 ] Apache Spark commented on SPARK-32391: -- User 'shaneknapp' has created a pull reques

[jira] [Commented] (SPARK-32391) Install pydata_sphinx_theme in Jenkins machines

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385126#comment-17385126 ] Apache Spark commented on SPARK-32391: -- User 'shaneknapp' has created a pull reques

[jira] [Assigned] (SPARK-32797) Install mypy on the Jenkins CI workers

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32797: Assignee: Apache Spark (was: Shane Knapp) > Install mypy on the Jenkins CI workers > ---

[jira] [Assigned] (SPARK-32797) Install mypy on the Jenkins CI workers

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32797: Assignee: Shane Knapp (was: Apache Spark) > Install mypy on the Jenkins CI workers > ---

[jira] [Commented] (SPARK-32797) Install mypy on the Jenkins CI workers

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385123#comment-17385123 ] Apache Spark commented on SPARK-32797: -- User 'shaneknapp' has created a pull reques

[jira] [Commented] (SPARK-31162) Provide Configuration Parameter to select/enforce the Hive Hash for Bucketing

2021-07-21 Thread Ashish Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385071#comment-17385071 ] Ashish Singh commented on SPARK-31162: -- This is needed for reasons other than suppo

[jira] [Commented] (SPARK-36249) Add remove_categories to CategoricalAccessor and CategoricalIndex

2021-07-21 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385069#comment-17385069 ] Takuya Ueshin commented on SPARK-36249: --- I'm working on this. > Add remove_catego

[jira] [Created] (SPARK-36249) Add remove_categories to CategoricalAccessor and CategoricalIndex

2021-07-21 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-36249: - Summary: Add remove_categories to CategoricalAccessor and CategoricalIndex Key: SPARK-36249 URL: https://issues.apache.org/jira/browse/SPARK-36249 Project: Spark

[jira] [Commented] (SPARK-36214) Add add_categories to CategoricalAccessor and CategoricalIndex.

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385067#comment-17385067 ] Apache Spark commented on SPARK-36214: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-36214) Add add_categories to CategoricalAccessor and CategoricalIndex.

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36214: Assignee: (was: Apache Spark) > Add add_categories to CategoricalAccessor and Categor

[jira] [Assigned] (SPARK-36214) Add add_categories to CategoricalAccessor and CategoricalIndex.

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36214: Assignee: Apache Spark > Add add_categories to CategoricalAccessor and CategoricalIndex.

[jira] [Assigned] (SPARK-35546) Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the state in a better way

2021-07-21 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-35546: --- Assignee: Ye Zhou > Enable push-based shuffle when multiple app attempts ar

[jira] [Commented] (SPARK-36248) Add rename_categories to CategoricalAccessor and CategoricalIndex

2021-07-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385063#comment-17385063 ] Xinrong Meng commented on SPARK-36248: -- I'm working on this. > Add rename_categori

[jira] [Created] (SPARK-36248) Add rename_categories to CategoricalAccessor and CategoricalIndex

2021-07-21 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-36248: Summary: Add rename_categories to CategoricalAccessor and CategoricalIndex Key: SPARK-36248 URL: https://issues.apache.org/jira/browse/SPARK-36248 Project: Spark

[jira] [Resolved] (SPARK-36188) Add categories setter to CategoricalAccessor and CategoricalIndex.

2021-07-21 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36188. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed Issue resolve

[jira] [Assigned] (SPARK-36247) check string length for char/varchar in UPDATE/MERGE command

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36247: Assignee: (was: Apache Spark) > check string length for char/varchar in UPDATE/MERGE

[jira] [Assigned] (SPARK-36247) check string length for char/varchar in UPDATE/MERGE command

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36247: Assignee: Apache Spark > check string length for char/varchar in UPDATE/MERGE command > -

[jira] [Commented] (SPARK-36247) check string length for char/varchar in UPDATE/MERGE command

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385045#comment-17385045 ] Apache Spark commented on SPARK-36247: -- User 'cloud-fan' has created a pull request

[jira] [Updated] (SPARK-36142) Adjust exponentiation between Series with missing values and bool literal to follow pandas

2021-07-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36142: - Summary: Adjust exponentiation between Series with missing values and bool literal to follow pan

[jira] [Commented] (SPARK-32391) Install pydata_sphinx_theme in Jenkins machines

2021-07-21 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385044#comment-17385044 ] Shane Knapp commented on SPARK-32391: - anyways, i installed this via conda and will

[jira] [Created] (SPARK-36247) check string length for char/varchar in UPDATE/MERGE command

2021-07-21 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-36247: --- Summary: check string length for char/varchar in UPDATE/MERGE command Key: SPARK-36247 URL: https://issues.apache.org/jira/browse/SPARK-36247 Project: Spark I

[jira] [Commented] (SPARK-34930) Install PyArrow and pandas on Jenkins

2021-07-21 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385040#comment-17385040 ] Shane Knapp commented on SPARK-34930: - oh yeah, a LOT of those skipped tests are for

[jira] [Commented] (SPARK-32797) Install mypy on the Jenkins CI workers

2021-07-21 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385038#comment-17385038 ] Shane Knapp commented on SPARK-32797: - ill roll this out (and other python package u

[jira] [Assigned] (SPARK-36246) WorkerDecommissionExtendedSuite flakes with GHA

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36246: Assignee: Holden Karau (was: Apache Spark) > WorkerDecommissionExtendedSuite flakes with

[jira] [Commented] (SPARK-36246) WorkerDecommissionExtendedSuite flakes with GHA

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385035#comment-17385035 ] Apache Spark commented on SPARK-36246: -- User 'holdenk' has created a pull request f

[jira] [Assigned] (SPARK-36246) WorkerDecommissionExtendedSuite flakes with GHA

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36246: Assignee: Apache Spark (was: Holden Karau) > WorkerDecommissionExtendedSuite flakes with

[jira] [Resolved] (SPARK-29183) Upgrade JDK 11 Installation to 11.0.6

2021-07-21 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-29183. - Resolution: Fixed this is done and all java11 installs are at 11.0.10 > Upgrade JDK 11 Installa

[jira] [Commented] (SPARK-34930) Install PyArrow and pandas on Jenkins

2021-07-21 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385030#comment-17385030 ] Shane Knapp commented on SPARK-34930: - pandas is installed, so i'm a little curious

[jira] [Commented] (SPARK-32391) Install pydata_sphinx_theme in Jenkins machines

2021-07-21 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385026#comment-17385026 ] Shane Knapp commented on SPARK-32391: - [~hyukjin.kwon] i am able to install this via

[jira] [Commented] (SPARK-32666) Install ipython and nbsphinx in Jenkins for Binder integration

2021-07-21 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385021#comment-17385021 ] Shane Knapp commented on SPARK-32666: - ill roll this out (and other python package u

[jira] [Commented] (SPARK-33242) Install numpydoc in Jenkins machines

2021-07-21 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385022#comment-17385022 ] Shane Knapp commented on SPARK-33242: - ill roll this out (and other python package u

[jira] [Created] (SPARK-36246) WorkerDecommissionExtendedSuite flakes with GHA

2021-07-21 Thread Holden Karau (Jira)
Holden Karau created SPARK-36246: Summary: WorkerDecommissionExtendedSuite flakes with GHA Key: SPARK-36246 URL: https://issues.apache.org/jira/browse/SPARK-36246 Project: Spark Issue Type: B

[jira] [Assigned] (SPARK-36143) Adjust astype of Series with missing values to follow pandas

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36143: Assignee: (was: Apache Spark) > Adjust astype of Series with missing values to follow

[jira] [Assigned] (SPARK-36143) Adjust astype of Series with missing values to follow pandas

2021-07-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36143: Assignee: Apache Spark > Adjust astype of Series with missing values to follow pandas > -

  1   2   >