Re: Still struggling with building documentation

2014-11-11 Thread Alessandro Baretta
Nichols and Patrick,

Thanks for your help, but, no, it still does not work. The latest master
produces the following scaladoc errors:

[error]
/home/alex/git/spark/network/shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/UploadBlock.java:55:
not found: type Type
[error]   protected Type type() { return Type.UPLOAD_BLOCK; }
[error] ^
[error]
/home/alex/git/spark/network/shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/StreamHandle.java:39:
not found: type Type
[error]   protected Type type() { return Type.STREAM_HANDLE; }
[error] ^
[error]
/home/alex/git/spark/network/shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/OpenBlocks.java:40:
not found: type Type
[error]   protected Type type() { return Type.OPEN_BLOCKS; }
[error] ^
[error]
/home/alex/git/spark/network/shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/RegisterExecutor.java:44:
not found: type Type
[error]   protected Type type() { return Type.REGISTER_EXECUTOR; }
[error] ^

...

[error] four errors found
[error] (spark/javaunidoc:doc) javadoc returned nonzero exit code
[error] (spark/scalaunidoc:doc) Scaladoc generation failed
[error] Total time: 140 s, completed Nov 11, 2014 10:20:53 AM
Moving back into docs dir.
Making directory api/scala
cp -r ../target/scala-2.10/unidoc/. api/scala
Making directory api/java
cp -r ../target/javaunidoc/. api/java
Moving to python/docs directory and building sphinx.
Makefile:14: *** The 'sphinx-build' command was not found. Make sure you
have Sphinx installed, then set the SPHINXBUILD environment variable to
point to the full path of the 'sphinx-build' executable. Alternatively you
can add the directory with the executable to your PATH. If you don't have
Sphinx installed, grab it from http://sphinx-doc.org/.  Stop.

Moving back into home dir.
Making directory api/python
cp -r python/docs/_build/html/. docs/api/python
/usr/lib/ruby/1.9.1/fileutils.rb:1515:in `stat': No such file or directory
- python/docs/_build/html/. (Errno::ENOENT)
from /usr/lib/ruby/1.9.1/fileutils.rb:1515:in `block in fu_each_src_dest'
from /usr/lib/ruby/1.9.1/fileutils.rb:1529:in `fu_each_src_dest0'
from /usr/lib/ruby/1.9.1/fileutils.rb:1513:in `fu_each_src_dest'
from /usr/lib/ruby/1.9.1/fileutils.rb:436:in `cp_r'
from /home/alex/git/spark/docs/_plugins/copy_api_dirs.rb:79:in `top
(required)'
from /usr/lib/ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /usr/lib/ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:76:in `block in setup'
from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:75:in `each'
from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:75:in `setup'
from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:30:in `initialize'
from /usr/bin/jekyll:224:in `new'
from /usr/bin/jekyll:224:in `main'

What next?

Alex




On Fri, Nov 7, 2014 at 12:54 PM, Nicholas Chammas 
nicholas.cham...@gmail.com wrote:

 I believe the web docs need to be built separately according to the
 instructions here
 https://github.com/apache/spark/blob/master/docs/README.md.

 Did you give those a shot?

 It's annoying to have a separate thing with new dependencies in order to
 build the web docs, but that's how it is at the moment.

 Nick

 On Fri, Nov 7, 2014 at 3:39 PM, Alessandro Baretta alexbare...@gmail.com
 wrote:

 I finally came to realize that there is a special maven target to build
 the scaladocs, although arguably a very unintuitive on: mvn verify. So now
 I have scaladocs for each package, but not for the whole spark project.
 Specifically, build/docs/api/scala/index.html is missing. Indeed the whole
 build/docs/api directory referenced in api.html is missing. How do I build
 it?

 Alex Baretta





Re: Still struggling with building documentation

2014-11-11 Thread Patrick Wendell
The doc build appears to be broken in master. We'll get it patched up
before the release:

https://issues.apache.org/jira/browse/SPARK-4326

On Tue, Nov 11, 2014 at 10:50 AM, Alessandro Baretta
alexbare...@gmail.com wrote:
 Nichols and Patrick,

 Thanks for your help, but, no, it still does not work. The latest master
 produces the following scaladoc errors:

 [error]
 /home/alex/git/spark/network/shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/UploadBlock.java:55:
 not found: type Type
 [error]   protected Type type() { return Type.UPLOAD_BLOCK; }
 [error] ^
 [error]
 /home/alex/git/spark/network/shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/StreamHandle.java:39:
 not found: type Type
 [error]   protected Type type() { return Type.STREAM_HANDLE; }
 [error] ^
 [error]
 /home/alex/git/spark/network/shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/OpenBlocks.java:40:
 not found: type Type
 [error]   protected Type type() { return Type.OPEN_BLOCKS; }
 [error] ^
 [error]
 /home/alex/git/spark/network/shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/RegisterExecutor.java:44:
 not found: type Type
 [error]   protected Type type() { return Type.REGISTER_EXECUTOR; }
 [error] ^

 ...

 [error] four errors found
 [error] (spark/javaunidoc:doc) javadoc returned nonzero exit code
 [error] (spark/scalaunidoc:doc) Scaladoc generation failed
 [error] Total time: 140 s, completed Nov 11, 2014 10:20:53 AM
 Moving back into docs dir.
 Making directory api/scala
 cp -r ../target/scala-2.10/unidoc/. api/scala
 Making directory api/java
 cp -r ../target/javaunidoc/. api/java
 Moving to python/docs directory and building sphinx.
 Makefile:14: *** The 'sphinx-build' command was not found. Make sure you
 have Sphinx installed, then set the SPHINXBUILD environment variable to
 point to the full path of the 'sphinx-build' executable. Alternatively you
 can add the directory with the executable to your PATH. If you don't have
 Sphinx installed, grab it from http://sphinx-doc.org/.  Stop.

 Moving back into home dir.
 Making directory api/python
 cp -r python/docs/_build/html/. docs/api/python
 /usr/lib/ruby/1.9.1/fileutils.rb:1515:in `stat': No such file or directory -
 python/docs/_build/html/. (Errno::ENOENT)
 from /usr/lib/ruby/1.9.1/fileutils.rb:1515:in `block in fu_each_src_dest'
 from /usr/lib/ruby/1.9.1/fileutils.rb:1529:in `fu_each_src_dest0'
 from /usr/lib/ruby/1.9.1/fileutils.rb:1513:in `fu_each_src_dest'
 from /usr/lib/ruby/1.9.1/fileutils.rb:436:in `cp_r'
 from /home/alex/git/spark/docs/_plugins/copy_api_dirs.rb:79:in `top
 (required)'
 from /usr/lib/ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
 from /usr/lib/ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
 from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:76:in `block in setup'
 from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:75:in `each'
 from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:75:in `setup'
 from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:30:in `initialize'
 from /usr/bin/jekyll:224:in `new'
 from /usr/bin/jekyll:224:in `main'

 What next?

 Alex




 On Fri, Nov 7, 2014 at 12:54 PM, Nicholas Chammas
 nicholas.cham...@gmail.com wrote:

 I believe the web docs need to be built separately according to the
 instructions here.

 Did you give those a shot?

 It's annoying to have a separate thing with new dependencies in order to
 build the web docs, but that's how it is at the moment.

 Nick

 On Fri, Nov 7, 2014 at 3:39 PM, Alessandro Baretta alexbare...@gmail.com
 wrote:

 I finally came to realize that there is a special maven target to build
 the scaladocs, although arguably a very unintuitive on: mvn verify. So now I
 have scaladocs for each package, but not for the whole spark project.
 Specifically, build/docs/api/scala/index.html is missing. Indeed the whole
 build/docs/api directory referenced in api.html is missing. How do I build
 it?

 Alex Baretta




-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org



Re: Still struggling with building documentation

2014-11-11 Thread Sean Owen
(I don't think that's the same issue. This looks like some local problem
with tool installation?)

On Tue, Nov 11, 2014 at 9:56 PM, Patrick Wendell pwend...@gmail.com wrote:

 The doc build appears to be broken in master. We'll get it patched up
 before the release:

 https://issues.apache.org/jira/browse/SPARK-4326

 On Tue, Nov 11, 2014 at 10:50 AM, Alessandro Baretta
 alexbare...@gmail.com wrote:
  Nichols and Patrick,
 
  Thanks for your help, but, no, it still does not work. The latest master
  produces the following scaladoc errors:
 
  [error]
 
 /home/alex/git/spark/network/shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/UploadBlock.java:55:
  not found: type Type
  [error]   protected Type type() { return Type.UPLOAD_BLOCK; }
  [error] ^
  [error]
 
 /home/alex/git/spark/network/shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/StreamHandle.java:39:
  not found: type Type
  [error]   protected Type type() { return Type.STREAM_HANDLE; }
  [error] ^
  [error]
 
 /home/alex/git/spark/network/shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/OpenBlocks.java:40:
  not found: type Type
  [error]   protected Type type() { return Type.OPEN_BLOCKS; }
  [error] ^
  [error]
 
 /home/alex/git/spark/network/shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/RegisterExecutor.java:44:
  not found: type Type
  [error]   protected Type type() { return Type.REGISTER_EXECUTOR; }
  [error] ^
 
  ...
 
  [error] four errors found
  [error] (spark/javaunidoc:doc) javadoc returned nonzero exit code
  [error] (spark/scalaunidoc:doc) Scaladoc generation failed
  [error] Total time: 140 s, completed Nov 11, 2014 10:20:53 AM
  Moving back into docs dir.
  Making directory api/scala
  cp -r ../target/scala-2.10/unidoc/. api/scala
  Making directory api/java
  cp -r ../target/javaunidoc/. api/java
  Moving to python/docs directory and building sphinx.
  Makefile:14: *** The 'sphinx-build' command was not found. Make sure you
  have Sphinx installed, then set the SPHINXBUILD environment variable to
  point to the full path of the 'sphinx-build' executable. Alternatively
 you
  can add the directory with the executable to your PATH. If you don't have
  Sphinx installed, grab it from http://sphinx-doc.org/.  Stop.
 
  Moving back into home dir.
  Making directory api/python
  cp -r python/docs/_build/html/. docs/api/python
  /usr/lib/ruby/1.9.1/fileutils.rb:1515:in `stat': No such file or
 directory -
  python/docs/_build/html/. (Errno::ENOENT)
  from /usr/lib/ruby/1.9.1/fileutils.rb:1515:in `block in fu_each_src_dest'
  from /usr/lib/ruby/1.9.1/fileutils.rb:1529:in `fu_each_src_dest0'
  from /usr/lib/ruby/1.9.1/fileutils.rb:1513:in `fu_each_src_dest'
  from /usr/lib/ruby/1.9.1/fileutils.rb:436:in `cp_r'
  from /home/alex/git/spark/docs/_plugins/copy_api_dirs.rb:79:in `top
  (required)'
  from /usr/lib/ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
  from /usr/lib/ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
  from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:76:in `block in setup'
  from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:75:in `each'
  from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:75:in `setup'
  from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:30:in `initialize'
  from /usr/bin/jekyll:224:in `new'
  from /usr/bin/jekyll:224:in `main'
 
  What next?
 
  Alex
 
 
 
 
  On Fri, Nov 7, 2014 at 12:54 PM, Nicholas Chammas
  nicholas.cham...@gmail.com wrote:
 
  I believe the web docs need to be built separately according to the
  instructions here.
 
  Did you give those a shot?
 
  It's annoying to have a separate thing with new dependencies in order to
  build the web docs, but that's how it is at the moment.
 
  Nick
 
  On Fri, Nov 7, 2014 at 3:39 PM, Alessandro Baretta 
 alexbare...@gmail.com
  wrote:
 
  I finally came to realize that there is a special maven target to build
  the scaladocs, although arguably a very unintuitive on: mvn verify. So
 now I
  have scaladocs for each package, but not for the whole spark project.
  Specifically, build/docs/api/scala/index.html is missing. Indeed the
 whole
  build/docs/api directory referenced in api.html is missing. How do I
 build
  it?
 
  Alex Baretta
 
 
 

 -
 To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
 For additional commands, e-mail: user-h...@spark.apache.org




Re: Still struggling with building documentation

2014-11-07 Thread Nicholas Chammas
I believe the web docs need to be built separately according to the
instructions here
https://github.com/apache/spark/blob/master/docs/README.md.

Did you give those a shot?

It's annoying to have a separate thing with new dependencies in order to
build the web docs, but that's how it is at the moment.

Nick

On Fri, Nov 7, 2014 at 3:39 PM, Alessandro Baretta alexbare...@gmail.com
wrote:

 I finally came to realize that there is a special maven target to build
 the scaladocs, although arguably a very unintuitive on: mvn verify. So now
 I have scaladocs for each package, but not for the whole spark project.
 Specifically, build/docs/api/scala/index.html is missing. Indeed the whole
 build/docs/api directory referenced in api.html is missing. How do I build
 it?

 Alex Baretta