[ https://issues.apache.org/jira/browse/SPARK-37744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-37744: --------------------------------- Summary: Revisit codes in PySpark, SparkR and other docs (was: Remove/update obsolete codes in PySpark, SparkR and other docs) > Revisit codes in PySpark, SparkR and other docs > ----------------------------------------------- > > Key: SPARK-37744 > URL: https://issues.apache.org/jira/browse/SPARK-37744 > Project: Spark > Issue Type: Sub-task > Components: PySpark, Tests > Affects Versions: 3.3.0 > Reporter: Hyukjin Kwon > Priority: Major > > {code} > R/check-cran.sh:# Jenkins installs arrow. See SPARK-29339. > R/pkg/tests/run-all.R: # CRAN machines. For Jenkins we should already have > SPARK_HOME set. > R/run-tests.sh: # We have 2 NOTEs: for RoxygenNote and one in Jenkins only > "No repository set" > dev/run-pip-tests:# Jenkins has PySpark installed under user sitepackages > shared for some reasons. > python/pyspark/sql/tests/test_streaming.py: # Jenkins is very > slow, we don't assert it. If there is something wrong, "lastProgress" > python/pyspark/streaming/tests/test_kinesis.py: # Don't start the > StreamingContext because we cannot test it in Jenkins > dev/create-release/release-build.sh:# This is a band-aid fix to avoid the > failure of Maven nightly snapshot in some Jenkins > docs/building-spark.md:## Running Jenkins tests with GitHub Enterprise > docs/building-spark.md:To run tests with Jenkins: > dev/tests/pr_merge_ability.sh:# found at dev/run-tests-jenkins. > dev/tests/pr_merge_ability.sh:# known as `ghprbActualCommit` in > `run-tests-jenkins` > dev/tests/pr_merge_ability.sh:# known as `sha1` in `run-tests-jenkins` > dev/tests/pr_public_classes.sh:# found at dev/run-tests-jenkins. > dev/tests/pr_public_classes.sh:# known as `ghprbActualCommit` in > `run-tests-jenkins` > docs/building-spark.md: ./dev/run-tests-jenkins > {code} -- This message was sent by Atlassian Jira (v8.20.1#820001) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org