[ 
https://issues.apache.org/jira/browse/MESOS-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14494526#comment-14494526
 ] 

Vinod Kone commented on MESOS-2233:
-----------------------------------

Definitely looks like an "apparmor" permissions issue (though it is weird that 
it only happens intermittently).

Here's the relevant kernel log output from the latest failed build

https://builds.apache.org/job/vinod-docker-multi/COMPILER=gcc,LABEL=docker%7C%7CHadoop,OS=ubuntu:14.10/113/consoleFull

configure fails due to perm issue for 'sed'.

{code}
config.status: creating include/Makefile
config.status: creating 3rdparty/Makefile
sed: error while loading shared libraries: libpthread.so.0: failed to map 
segment from shared object: Permission denied
config.status: creating 3rdparty/gmock_sources.cc
config.status: executing depfiles commands
config.status: executing libtool commands
=== configuring in 3rdparty/stout (/mesos/3rdparty/libprocess/3rdparty/stout)
configure: running /bin/bash ./configure --disable-option-checking 
'--prefix=/usr/local'  'CC=gcc' 'CXX=g++' '--enable-shared=no' '--with-pic' 
--cache-file=/dev/null --srcdir=.
{code}

apparmor denies 'sed'
{code}
[16654475.072801] type=1400 audit(1429008557.507:152643): apparmor="DENIED" 
operation="file_mmap" profile="docker-default" 
name="s-0.23.0/_build/confwWH8Lp/subs.awk" pid=15083 comm="sed" 
requested_mask="mr" denied_mask="mr" fsuid=1000 ouid=0
[16657331.416018] docker0: port 1(vethad50be3) entered disabled state
[16657331.416570] device vethad50be3 left promiscuous mode
[16657331.416581] docker0: port 1(vethad50be3) entered disabled state
[16658694.375946] device veth9c2198d entered promiscuous mode
[16658694.376446] IPv6: ADDRCONF(NETDEV_UP): veth9c2198d: link is not ready
[16658694.406234] IPv6: ADDRCONF(NETDEV_CHANGE): veth9c2198d: link becomes ready
[16658694.406272] docker0: port 1(veth9c2198d) entered forwarding state
[16658694.406277] docker0: port 1(veth9c2198d) entered forwarding state
[16658695.048564] docker0: port 1(veth9c2198d) entered disabled state
[16658695.049197] device veth9c2198d left promiscuous mode
[16658695.049227] docker0: port 1(veth9c2198d) entered disabled state
[16658698.266384] device veth3b62949 entered promiscuous mode
[16658698.266793] IPv6: ADDRCONF(NETDEV_UP): veth3b62949: link is not ready
[16658698.305110] IPv6: ADDRCONF(NETDEV_CHANGE): veth3b62949: link becomes ready
[16658698.305145] docker0: port 1(veth3b62949) entered forwarding state
[16658698.305152] docker0: port 1(veth3b62949) entered forwarding state
[16658713.370021] docker0: port 1(veth3b62949) entered forwarding state
[16662827.593876] docker0: port 1(veth3b62949) entered disabled state
[16662827.594835] device veth3b62949 left promiscuous mode
[16662827.594848] docker0: port 1(veth3b62949) entered disabled state
[16662848.574731] device veth51c14c8 entered promiscuous mode
[16662848.575105] IPv6: ADDRCONF(NETDEV_UP): veth51c14c8: link is not ready
[16662848.606153] IPv6: ADDRCONF(NETDEV_CHANGE): veth51c14c8: link becomes ready
[16662848.606193] docker0: port 1(veth51c14c8) entered forwarding state
[16662848.606200] docker0: port 1(veth51c14c8) entered forwarding state
[16662849.211224] docker0: port 1(veth51c14c8) entered disabled state
[16662849.212002] device veth51c14c8 left promiscuous mode
[16662849.212015] docker0: port 1(veth51c14c8) entered disabled state
[16662852.417932] device veth1fa6472 entered promiscuous mode
[16662852.418403] IPv6: ADDRCONF(NETDEV_UP): veth1fa6472: link is not ready
[16662852.444529] IPv6: ADDRCONF(NETDEV_CHANGE): veth1fa6472: link becomes ready
[16662852.444578] docker0: port 1(veth1fa6472) entered forwarding state
[16662852.444586] docker0: port 1(veth1fa6472) entered forwarding state
[16662867.497495] docker0: port 1(veth1fa6472) entered forwarding state
[16666968.777955] docker0: port 1(veth1fa6472) entered disabled state
[16666968.778929] device veth1fa6472 left promiscuous mode
[16666968.778942] docker0: port 1(veth1fa6472) entered disabled state
[16671013.616616] device veth98fd1d3 entered promiscuous mode
[16671013.617074] IPv6: ADDRCONF(NETDEV_UP): veth98fd1d3: link is not ready
[16671013.658662] IPv6: ADDRCONF(NETDEV_CHANGE): veth98fd1d3: link becomes ready
[16671013.658709] docker0: port 1(veth98fd1d3) entered forwarding state
[16671013.658715] docker0: port 1(veth98fd1d3) entered forwarding state
[16671014.251222] docker0: port 1(veth98fd1d3) entered disabled state
[16671014.252164] device veth98fd1d3 left promiscuous mode
[16671014.252177] docker0: port 1(veth98fd1d3) entered disabled state
[16671017.698131] device veth40c3c60 entered promiscuous mode
[16671017.698709] IPv6: ADDRCONF(NETDEV_UP): veth40c3c60: link is not ready
[16671017.742416] IPv6: ADDRCONF(NETDEV_CHANGE): veth40c3c60: link becomes ready
[16671017.742465] docker0: port 1(veth40c3c60) entered forwarding state
[16671017.742473] docker0: port 1(veth40c3c60) entered forwarding state
[16671032.789731] docker0: port 1(veth40c3c60) entered forwarding state
[16671064.160966] type=1400 audit(1429025133.242:152644): apparmor="DENIED" 
operation="file_mmap" profile="docker-default" 
name="ib/docker/aufs/diff/0b9bbb13df911867a01de32a0e594a57e9897138799e70b3af94ff9e4fe58cff/mesos/3rdparty/libprocess/confvb2Zor/subs.awk"
 pid=17001 comm="sed" requested_mask="mr" denied_mask="mr" fsuid=1000 ouid=0
{code}

> Run ASF CI mesos builds inside docker
> -------------------------------------
>
>                 Key: MESOS-2233
>                 URL: https://issues.apache.org/jira/browse/MESOS-2233
>             Project: Mesos
>          Issue Type: Task
>          Components: technical debt
>            Reporter: Vinod Kone
>            Assignee: Vinod Kone
>              Labels: twitter
>         Attachments: Dockerfile, supervisord.conf
>
>
> There are several limitations to mesos projects current state of CI, which is 
> run on builds.a.o
> --> Only runs on Ubuntu
> --> Doesn't run any tests that deal with cgroups
> --> Doesn't run any tests that need root permissions
> Now that ASF CI supports docker 
> (https://issues.apache.org/jira/browse/BUILDS-25), it would be great for the 
> Mesos project to use it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to