Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/18984
Here is the context I got:
https://github.com/apache/spark/pull/18702 broke the documentation build in
https://amplab.cs.berkeley.edu/jenkins/job/spark-master-docs/.
```
...
Moving back into docs dir.
Moving to SQL directory and building docs.
Missing mkdocs in your path, skipping SQL documentation generation.
Moving back into docs dir.
Making directory api/sql
cp -r ../sql/site/. api/sql
jekyll 2.5.3 | Error: unknown file type: ../sql/site/.
Deleting credential directory
/home/jenkins/workspace/spark-master-docs/spark-utils/new-release-scripts/jenkins/jenkins-credentials-scUXuITy
Build step 'Execute shell' marked build as failure
[WS-CLEANUP] Deleting project workspace...[WS-CLEANUP] done
Finished: FAILURE
```
It failed in this way roughly about 20ish days.
That PR adds SQL documentation build but with the dependency, `mkdocs`
package. I completely forgot we actually build it in Jenkins.
To fix this, in this PR, I manually added some install command here to
install `mkdocs` if missing in the path; however, it looks failed to install
this with the error message:
```
...
Installing collected packages: singledispatch, certifi, backports-abc,
tornado, livereload, click, Markdown, mkdocs
Exception:
Traceback (most recent call last):
File "/home/anaconda/lib/python2.7/site-packages/pip/basecommand.py",
line 215, in main
status = self.run(options, args)
File
"/home/anaconda/lib/python2.7/site-packages/pip/commands/install.py", line 342,
in run
prefix=options.prefix_path,
File "/home/anaconda/lib/python2.7/site-packages/pip/req/req_set.py",
line 784, in install
**kwargs
File "/home/anaconda/lib/python2.7/site-packages/pip/req/req_install.py",
line 851, in install
self.move_wheel_files(self.source_dir, root=root, prefix=prefix)
File "/home/anaconda/lib/python2.7/site-packages/pip/req/req_install.py",
line 1064, in move_wheel_files
isolated=self.isolated,
File "/home/anaconda/lib/python2.7/site-packages/pip/wheel.py", line 345,
in move_wheel_files
clobber(source, lib_dir, True)
File "/home/anaconda/lib/python2.7/site-packages/pip/wheel.py", line 323,
in clobber
shutil.copyfile(srcfile, destfile)
File "/home/anaconda/lib/python2.7/shutil.py", line 83, in copyfile
with open(dst, 'wb') as fdst:
IOError: [Errno 13] Permission denied:
'/home/anaconda/lib/python2.7/site-packages/singledispatch_helpers.pyc
...
```
It has failed in this way roughly about 1 day.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
