[spark] branch master updated: [SPARK-43458][SPARK-43561][PS][TESTS] Enable `test_to_latex` for (Series|DataFrame) conversion
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 948fa0e3e6b [SPARK-43458][SPARK-43561][PS][TESTS] Enable
`test_to_latex` for (Series|DataFrame) conversion
948fa0e3e6b is described below
commit 948fa0e3e6b647e37f0a1438086099bb3c141050
Author: Haejoon Lee
AuthorDate: Sat Sep 16 20:59:38 2023 -0700
[SPARK-43458][SPARK-43561][PS][TESTS] Enable `test_to_latex` for
(Series|DataFrame) conversion
### What changes were proposed in this pull request?
This PR proposes to enable `SeriesConversionTests.test_to_latex` and
`DataFrameConversionTests.test_to_latex`.
### Why are the changes needed?
To improve the test coverage.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Enabling the existing tests.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #42954 from itholic/enable_to_latex.
Authored-by: Haejoon Lee
Signed-off-by: Dongjoon Hyun
---
python/pyspark/pandas/tests/test_dataframe_conversion.py | 4
python/pyspark/pandas/tests/test_series_conversion.py| 4
2 files changed, 8 deletions(-)
diff --git a/python/pyspark/pandas/tests/test_dataframe_conversion.py
b/python/pyspark/pandas/tests/test_dataframe_conversion.py
index 655c0970082..283849a06d5 100644
--- a/python/pyspark/pandas/tests/test_dataframe_conversion.py
+++ b/python/pyspark/pandas/tests/test_dataframe_conversion.py
@@ -202,10 +202,6 @@ class DataFrameConversionTestsMixin:
psdf.to_clipboard(sep=";", index=False), pdf.to_clipboard(sep=";",
index=False)
)
-@unittest.skipIf(
-LooseVersion(pd.__version__) >= LooseVersion("2.0.0"),
-"TODO(SPARK-43561): Enable DataFrameConversionTests.test_to_latex for
pandas 2.0.0.",
-)
def test_to_latex(self):
pdf = self.pdf
psdf = self.psdf
diff --git a/python/pyspark/pandas/tests/test_series_conversion.py
b/python/pyspark/pandas/tests/test_series_conversion.py
index 757da167250..b0a97b0a6f8 100644
--- a/python/pyspark/pandas/tests/test_series_conversion.py
+++ b/python/pyspark/pandas/tests/test_series_conversion.py
@@ -49,10 +49,6 @@ class SeriesConversionTestsMixin:
psser.to_clipboard(sep=",", index=False),
pser.to_clipboard(sep=",", index=False)
)
-@unittest.skipIf(
-LooseVersion(pd.__version__) >= LooseVersion("2.0.0"),
-"TODO(SPARK-43458): Enable SeriesConversionTests.test_to_latex for
pandas 2.0.0.",
-)
def test_to_latex(self):
pser = self.pser
psser = self.psser
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.3 updated: [SPARK-45127][DOCS] Exclude README.md from document build
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 6dcab1fe0f6 [SPARK-45127][DOCS] Exclude README.md from document build 6dcab1fe0f6 is described below commit 6dcab1fe0f64458d76060e38fad974d6b84c4ff7 Author: panbingkun AuthorDate: Sat Sep 16 09:04:38 2023 -0500 [SPARK-45127][DOCS] Exclude README.md from document build ### What changes were proposed in this pull request? The pr aims to exclude `README.md` from document build. ### Why are the changes needed? - Currently, our document `README.html` does not have any CSS style applied to it, as shown below: https://spark.apache.org/docs/latest/README.html https://github.com/apache/spark/assets/15246973/1dfe5f69-30d9-4ce4-8d82-1bba5e721ccd;> **If we do not intend to display the above page to users, we should remove it during the document build process.** - As we saw in the project `spark-website`, it has already set the following configuration: https://github.com/apache/spark-website/blob/642d1fb834817014e1799e73882d53650c1c1662/_config.yml#L7 https://github.com/apache/spark/assets/15246973/421b7be5-4ece-407e-9d49-8e7487b74a47;> Let's stay consistent. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? - Manually test. After this pr, the README.html file will no longer be generated ``` (base) panbingkun:~/Developer/spark/spark-community/docs/_site$ls -al README.html ls: README.html: No such file or directory ``` - Pass GA. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #42883 from panbingkun/SPARK-45127. Authored-by: panbingkun Signed-off-by: Sean Owen (cherry picked from commit 804f741453fb146b5261084fa3baf26631badb79) Signed-off-by: Sean Owen --- docs/_config.yml | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/_config.yml b/docs/_config.yml index 82da6b4ddff..c0f752a6155 100644 --- a/docs/_config.yml +++ b/docs/_config.yml @@ -46,3 +46,5 @@ DOCSEARCH_SCRIPT: | }); permalink: 404.html + +exclude: ['README.md'] - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.4 updated: [SPARK-45127][DOCS] Exclude README.md from document build
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 12020943ec9 [SPARK-45127][DOCS] Exclude README.md from document build 12020943ec9 is described below commit 12020943ec95ce3e5dc3aeb2e3ae201cf25e0233 Author: panbingkun AuthorDate: Sat Sep 16 09:04:38 2023 -0500 [SPARK-45127][DOCS] Exclude README.md from document build ### What changes were proposed in this pull request? The pr aims to exclude `README.md` from document build. ### Why are the changes needed? - Currently, our document `README.html` does not have any CSS style applied to it, as shown below: https://spark.apache.org/docs/latest/README.html https://github.com/apache/spark/assets/15246973/1dfe5f69-30d9-4ce4-8d82-1bba5e721ccd;> **If we do not intend to display the above page to users, we should remove it during the document build process.** - As we saw in the project `spark-website`, it has already set the following configuration: https://github.com/apache/spark-website/blob/642d1fb834817014e1799e73882d53650c1c1662/_config.yml#L7 https://github.com/apache/spark/assets/15246973/421b7be5-4ece-407e-9d49-8e7487b74a47;> Let's stay consistent. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? - Manually test. After this pr, the README.html file will no longer be generated ``` (base) panbingkun:~/Developer/spark/spark-community/docs/_site$ls -al README.html ls: README.html: No such file or directory ``` - Pass GA. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #42883 from panbingkun/SPARK-45127. Authored-by: panbingkun Signed-off-by: Sean Owen (cherry picked from commit 804f741453fb146b5261084fa3baf26631badb79) Signed-off-by: Sean Owen --- docs/_config.yml | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/_config.yml b/docs/_config.yml index c0c54b50e80..cb7ce91fa57 100644 --- a/docs/_config.yml +++ b/docs/_config.yml @@ -46,3 +46,5 @@ DOCSEARCH_SCRIPT: | }); permalink: 404.html + +exclude: ['README.md'] - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.5 updated: [SPARK-45127][DOCS] Exclude README.md from document build
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new a3f50e74250 [SPARK-45127][DOCS] Exclude README.md from document build a3f50e74250 is described below commit a3f50e742506e07473c281255d1b13ab8ae78cd6 Author: panbingkun AuthorDate: Sat Sep 16 09:04:38 2023 -0500 [SPARK-45127][DOCS] Exclude README.md from document build ### What changes were proposed in this pull request? The pr aims to exclude `README.md` from document build. ### Why are the changes needed? - Currently, our document `README.html` does not have any CSS style applied to it, as shown below: https://spark.apache.org/docs/latest/README.html https://github.com/apache/spark/assets/15246973/1dfe5f69-30d9-4ce4-8d82-1bba5e721ccd;> **If we do not intend to display the above page to users, we should remove it during the document build process.** - As we saw in the project `spark-website`, it has already set the following configuration: https://github.com/apache/spark-website/blob/642d1fb834817014e1799e73882d53650c1c1662/_config.yml#L7 https://github.com/apache/spark/assets/15246973/421b7be5-4ece-407e-9d49-8e7487b74a47;> Let's stay consistent. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? - Manually test. After this pr, the README.html file will no longer be generated ``` (base) panbingkun:~/Developer/spark/spark-community/docs/_site$ls -al README.html ls: README.html: No such file or directory ``` - Pass GA. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #42883 from panbingkun/SPARK-45127. Authored-by: panbingkun Signed-off-by: Sean Owen (cherry picked from commit 804f741453fb146b5261084fa3baf26631badb79) Signed-off-by: Sean Owen --- docs/_config.yml | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/_config.yml b/docs/_config.yml index afe015b2972..e346833722b 100644 --- a/docs/_config.yml +++ b/docs/_config.yml @@ -46,3 +46,5 @@ DOCSEARCH_SCRIPT: | }); permalink: 404.html + +exclude: ['README.md'] - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated: [SPARK-45127][DOCS] Exclude README.md from document build
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 804f741453f [SPARK-45127][DOCS] Exclude README.md from document build 804f741453f is described below commit 804f741453fb146b5261084fa3baf26631badb79 Author: panbingkun AuthorDate: Sat Sep 16 09:04:38 2023 -0500 [SPARK-45127][DOCS] Exclude README.md from document build ### What changes were proposed in this pull request? The pr aims to exclude `README.md` from document build. ### Why are the changes needed? - Currently, our document `README.html` does not have any CSS style applied to it, as shown below: https://spark.apache.org/docs/latest/README.html https://github.com/apache/spark/assets/15246973/1dfe5f69-30d9-4ce4-8d82-1bba5e721ccd;> **If we do not intend to display the above page to users, we should remove it during the document build process.** - As we saw in the project `spark-website`, it has already set the following configuration: https://github.com/apache/spark-website/blob/642d1fb834817014e1799e73882d53650c1c1662/_config.yml#L7 https://github.com/apache/spark/assets/15246973/421b7be5-4ece-407e-9d49-8e7487b74a47;> Let's stay consistent. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? - Manually test. After this pr, the README.html file will no longer be generated ``` (base) panbingkun:~/Developer/spark/spark-community/docs/_site$ls -al README.html ls: README.html: No such file or directory ``` - Pass GA. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #42883 from panbingkun/SPARK-45127. Authored-by: panbingkun Signed-off-by: Sean Owen --- docs/_config.yml | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/_config.yml b/docs/_config.yml index 8c256af5bb3..fcc50d22e2e 100644 --- a/docs/_config.yml +++ b/docs/_config.yml @@ -46,3 +46,5 @@ DOCSEARCH_SCRIPT: | }); permalink: 404.html + +exclude: ['README.md'] - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (ab46dc048ba -> 33979829db9)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from ab46dc048ba [SPARK-44872][CONNECT][FOLLOWUP] Deflake ReattachableExecuteSuite and increase retry buffer add 33979829db9 [SPARK-45146][DOCS] Update the default value of 'spark.executor.logs.rolling.strategy' No new revisions were added by this update. Summary of changes: docs/configuration.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
