[jira] [Commented] (COUCHDB-2008) CI: Create repeatable images for different operating system configurations
[ https://issues.apache.org/jira/browse/COUCHDB-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13940384#comment-13940384 ] Dave Cottlehuber commented on COUCHDB-2008: --- [~crigor] these requirements are listed in /DEVELOPERS in the source tree. Also, I finally got around to using packer to build some test boxes. This is working pretty nicely. If you want to work on these together and use ansible to drive the configuration let's do that on the dev@ mailing list next week. For packer, I used the templates here https://github.com/opscode/bento and built my own boxes. How about we use these images as a base for automating these builds? > CI: Create repeatable images for different operating system configurations > -- > > Key: COUCHDB-2008 > URL: https://issues.apache.org/jira/browse/COUCHDB-2008 > Project: CouchDB > Issue Type: New Feature > Components: Infrastructure >Reporter: Jan Lehnardt > > Dave suggests to look into Ansible & Packer to create images for CI. > The idea would be to run these configurations on the CI server and controlled > by Jenkins. It should also be possible to set up a configuration locally that > matches the CI box exactly, so one can do debugging under the same > circumstances the CI server runs tests. > The requirement for now is that it all needs to work with a set of VMs that > we have SSH access to, but we don’t manage the host. I’m not too familiar > with all the automation and VM image packaging tools, so I don’t know if one > or another is useful in that context or not. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (COUCHDB-2008) CI: Create repeatable images for different operating system configurations
[ https://issues.apache.org/jira/browse/COUCHDB-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13939102#comment-13939102 ] Jan Lehnardt commented on COUCHDB-2008: --- [~crigor] From APT. > CI: Create repeatable images for different operating system configurations > -- > > Key: COUCHDB-2008 > URL: https://issues.apache.org/jira/browse/COUCHDB-2008 > Project: CouchDB > Issue Type: New Feature > Components: Infrastructure >Reporter: Jan Lehnardt > > Dave suggests to look into Ansible & Packer to create images for CI. > The idea would be to run these configurations on the CI server and controlled > by Jenkins. It should also be possible to set up a configuration locally that > matches the CI box exactly, so one can do debugging under the same > circumstances the CI server runs tests. > The requirement for now is that it all needs to work with a set of VMs that > we have SSH access to, but we don’t manage the host. I’m not too familiar > with all the automation and VM image packaging tools, so I don’t know if one > or another is useful in that context or not. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (COUCHDB-2008) CI: Create repeatable images for different operating system configurations
[ https://issues.apache.org/jira/browse/COUCHDB-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13938780#comment-13938780 ] Christopher Rigor commented on COUCHDB-2008: I had texlive-latex-base but I needed to install texlive-latex-recommended and texlive-latex-extra as well. Jan, how did you install latex on the current VMs? From APT or source? > CI: Create repeatable images for different operating system configurations > -- > > Key: COUCHDB-2008 > URL: https://issues.apache.org/jira/browse/COUCHDB-2008 > Project: CouchDB > Issue Type: New Feature > Components: Infrastructure >Reporter: Jan Lehnardt > > Dave suggests to look into Ansible & Packer to create images for CI. > The idea would be to run these configurations on the CI server and controlled > by Jenkins. It should also be possible to set up a configuration locally that > matches the CI box exactly, so one can do debugging under the same > circumstances the CI server runs tests. > The requirement for now is that it all needs to work with a set of VMs that > we have SSH access to, but we don’t manage the host. I’m not too familiar > with all the automation and VM image packaging tools, so I don’t know if one > or another is useful in that context or not. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (COUCHDB-2008) CI: Create repeatable images for different operating system configurations
[ https://issues.apache.org/jira/browse/COUCHDB-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882715#comment-13882715 ] Andy Wenk commented on COUCHDB-2008: you need to have a running LaTex installation running. Can you please recheck if that's the case? > CI: Create repeatable images for different operating system configurations > -- > > Key: COUCHDB-2008 > URL: https://issues.apache.org/jira/browse/COUCHDB-2008 > Project: CouchDB > Issue Type: New Feature > Components: Infrastructure >Reporter: Jan Lehnardt > > Dave suggests to look into Ansible & Packer to create images for CI. > The idea would be to run these configurations on the CI server and controlled > by Jenkins. It should also be possible to set up a configuration locally that > matches the CI box exactly, so one can do debugging under the same > circumstances the CI server runs tests. > The requirement for now is that it all needs to work with a set of VMs that > we have SSH access to, but we don’t manage the host. I’m not too familiar > with all the automation and VM image packaging tools, so I don’t know if one > or another is useful in that context or not. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (COUCHDB-2008) CI: Create repeatable images for different operating system configurations
[
https://issues.apache.org/jira/browse/COUCHDB-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882502#comment-13882502
]
Christopher Rigor commented on COUCHDB-2008:
I'm running make distcheck manually first to test if the VM setup is correct. I
am using Example 2 (with minimal dependencies) on
https://wiki.apache.org/couchdb/Installing_on_Ubuntu
I have 3 questions so far:
Do I need to set BUILD_MAN?
Do you know why building the docs is hanging (see below)?
Are the packages I installed correct?
I am using the 1.5.x branch from the apache git repo. make install works but
make distcheck hangs. It succeeds if I comment out distcheck-hook. I ran into
an error with couchdb.1.
{code}
make[1]: Entering directory `/root/couchdb'
make -C bin distcheck-hook
make[2]: Entering directory `/root/couchdb/bin'
if test ! -s couchdb.1; then \
../build-aux/dist-error couchdb.1; \
else \
if test ! `cat couchdb.1 | wc -l` -gt 1; then \
../build-aux/dist-error couchdb.1; \
fi \
fi
ERROR: This file is missing or incomplete:
couchdb.1
This file is optional at build and install time,
but is required when preparing a distribution.
make[2]: *** [distcheck-hook] Error 1
make[2]: Leaving directory `/root/couchdb/bin'
make[1]: *** [distcheck-hook] Error 2
make[1]: Leaving directory `/root/couchdb'
make: *** [distcheck] Error 1
{code}
Looking at the Makefiles, I have to set BUILD_MAN correct? I didn't see this
set on the jenkins build. With that set, make distcheck hangs in generating
some docs. make -C share/doc/build latex/CouchDB.pdf.gz reproduces the issue.
{code}
/usr/share/texmf/web2c/mktexnam: Could not map source abbreviation for
ecrm1000.
/usr/share/texmf/web2c/mktexnam: Need to update ?
mktextfm: Running mf-nowin -progname=mf \mode:=ljfour; mag:=1; nonstopmode;
input ecrm1000
This is METAFONT, Version 2.718281 (TeX Live 2009/Debian)
kpathsea: Running mktexmf ecrm1000
! I can't find file `ecrm1000'.
<*> ...ljfour; mag:=1; nonstopmode; input ecrm1000
Please type another input file name
! Emergency stop.
<*> ...ljfour; mag:=1; nonstopmode; input ecrm1000
Transcript written on mfput.log.
grep: ecrm1000.log: No such file or directory
mktextfm: `mf-nowin -progname=mf \mode:=ljfour; mag:=1; nonstopmode; input
ecrm1000' failed to make ecrm1000.tfm.
kpathsea: Appending font creation commands to missfont.log.
! Font T1/cmr/m/n/10=ecrm1000 at 10.0pt not loadable: Metric (TFM) file not fou
nd.
relax
l.100 \fontencoding\encodingdefault\selectfont
?
{code}
Perhaps I need to install a missing package? Here are the packages I installed
on Ubuntu 12.04. The packages are not exactly the same as Example 2 on the wiki.
Spidermonkey is installed from source. JavaScript-C 1.7.0 2007-10-03.
Erlang R14B04 is installed from apt.
{quote}
3 apt-get install erlang
8 apt-get install git-core
17 apt-get install libtool
23 apt-get install automake
27 apt-get install autoconf-archive
29 apt-get install pkg-config
32 apt-get install -y g++
49 apt-get install make
63 apt-get install libicu-dev
127 apt-get install help2man
162 apt-get install sphinx-build
170 apt-get install makeinfo
171 apt-get install python-sphinx
176 apt-get install texinfo
181 apt-get install locale
203 apt-get install pdflatex
205 apt-get install texlive-latex-base
{quote}
> CI: Create repeatable images for different operating system configurations
> --
>
> Key: COUCHDB-2008
> URL: https://issues.apache.org/jira/browse/COUCHDB-2008
> Project: CouchDB
> Issue Type: New Feature
> Components: Infrastructure
>Reporter: Jan Lehnardt
>
> Dave suggests to look into Ansible & Packer to create images for CI.
> The idea would be to run these configurations on the CI server and controlled
> by Jenkins. It should also be possible to set up a configuration locally that
> matches the CI box exactly, so one can do debugging under the same
> circumstances the CI server runs tests.
> The requirement for now is that it all needs to work with a set of VMs that
> we have SSH access to, but we don’t manage the host. I’m not too familiar
> with all the automation and VM image packaging tools, so I don’t know if one
> or another is useful in that context or not.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
[jira] [Commented] (COUCHDB-2008) CI: Create repeatable images for different operating system configurations
[ https://issues.apache.org/jira/browse/COUCHDB-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13857664#comment-13857664 ] Jan Lehnardt commented on COUCHDB-2008: --- [~crigor] sounds good, looking forward to your Ansible work! We can get new VMs with any OS configuration on demand, I opted for the older ones since they are still supported and the current CI system and many devs cover the current ubuntus. > CI: Create repeatable images for different operating system configurations > -- > > Key: COUCHDB-2008 > URL: https://issues.apache.org/jira/browse/COUCHDB-2008 > Project: CouchDB > Issue Type: New Feature > Components: Infrastructure >Reporter: Jan Lehnardt > > Dave suggests to look into Ansible & Packer to create images for CI. > The idea would be to run these configurations on the CI server and controlled > by Jenkins. It should also be possible to set up a configuration locally that > matches the CI box exactly, so one can do debugging under the same > circumstances the CI server runs tests. > The requirement for now is that it all needs to work with a set of VMs that > we have SSH access to, but we don’t manage the host. I’m not too familiar > with all the automation and VM image packaging tools, so I don’t know if one > or another is useful in that context or not. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (COUCHDB-2008) CI: Create repeatable images for different operating system configurations
[ https://issues.apache.org/jira/browse/COUCHDB-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13854059#comment-13854059 ] Christopher Rigor commented on COUCHDB-2008: Packer can create images. It uses provisioners like Ansible (other options are Chef and Puppet). Since we don't manage the host we won't be able to use the images created by Packer. We can and should still use Ansible to set up the VMs. Either way we'll start with Ansible. I have some experience with it so definitely want to help out. I'm adding here the list of VMs that are currently available (from dev@couchdb.apache.org) ubuntu64-1004 ubuntu32-1004 debian64-7 debian32-7 fedora64-17 fedora32-17 centos32-6 centos64-6 fedora32-18 fedora64-18 We should probably add newer Ubuntu VMs. > CI: Create repeatable images for different operating system configurations > -- > > Key: COUCHDB-2008 > URL: https://issues.apache.org/jira/browse/COUCHDB-2008 > Project: CouchDB > Issue Type: New Feature > Components: Infrastructure >Reporter: Jan Lehnardt > > Dave suggests to look into Ansible & Packer to create images for CI. > The idea would be to run these configurations on the CI server and controlled > by Jenkins. It should also be possible to set up a configuration locally that > matches the CI box exactly, so one can do debugging under the same > circumstances the CI server runs tests. > The requirement for now is that it all needs to work with a set of VMs that > we have SSH access to, but we don’t manage the host. I’m not too familiar > with all the automation and VM image packaging tools, so I don’t know if one > or another is useful in that context or not. -- This message was sent by Atlassian JIRA (v6.1.4#6159)
