Re: Mesos 1.0 WebUI does not display cluster name

[Haripriya Ayyalasomayajula]

Well yes, I use the configuration file with name cluster, and use systemctl
start mesos-master.
So it picks up --cluster. It was a typo in my earlier mail.

On Tue, Aug 30, 2016 at 2:10 PM, Joseph Wu  wrote:

> Try "--cluster" instead of "—cluster".
>
> On Tue, Aug 30, 2016 at 2:01 PM, Haripriya Ayyalasomayajula <
> aharipriy...@gmail.com> wrote:
>
>> Hi all,
>>
>>
>> Mesos Web UI does not display the name of the cluster.
>>
>> I have a config file named cluster under /etc/mesos-master/ along with
>> other configuration files. It worked well with Mesos 0.28.0. I've upgraded
>> the cluster to Mesos 1.0 and this doesn't seem to work.
>>
>> /usr/sbin/mesos-master --zk=zk://192.168.0.1:2181,192.168.0.17:2181,
>> 192.168.0.33:2181/mesos --port=5050 --log_dir=/var/log/mesos
>> --acls=/etc/mesos_acls.json --authenticate_frameworks=true
>> —cluster=testcluster --credentials=/etc/mesos-auth/credentials
>> --quorum=2 --work_dir=/var/lib/mesos
>>
>>
>> I greatly appreciate any help!
>>
>> --
>> Regards,
>> Haripriya Ayyalasomayajula
>>
>>
>


-- 
Regards,
Haripriya Ayyalasomayajula

Re: Mesos 1.0 WebUI does not display cluster name

[Joseph Wu]

Try "--cluster" instead of "—cluster".

On Tue, Aug 30, 2016 at 2:01 PM, Haripriya Ayyalasomayajula <
aharipriy...@gmail.com> wrote:

> Hi all,
>
>
> Mesos Web UI does not display the name of the cluster.
>
> I have a config file named cluster under /etc/mesos-master/ along with
> other configuration files. It worked well with Mesos 0.28.0. I've upgraded
> the cluster to Mesos 1.0 and this doesn't seem to work.
>
> /usr/sbin/mesos-master --zk=zk://192.168.0.1:2181,192.168.0.17:2181,
> 192.168.0.33:2181/mesos --port=5050 --log_dir=/var/log/mesos
> --acls=/etc/mesos_acls.json --authenticate_frameworks=true
> —cluster=testcluster --credentials=/etc/mesos-auth/credentials --quorum=2
> --work_dir=/var/lib/mesos
>
>
> I greatly appreciate any help!
>
> --
> Regards,
> Haripriya Ayyalasomayajula
>
>

missing documentation: view_frameworks, view_tasks etc in mesos 1.0

[Haripriya Ayyalasomayajula]

Hi all,

I've upgraded my mesos cluster to 1.0.
I have spark and Marathon registered as frameworks and have no problem
running jobs.
I am unable to see any frameworks nor any tasks on the web UI.

I found out that the following fields have been added to acls.
 view_frameworks, view_tasks, view_executors, access_sandboxes,
access_mesos_logs
and there are no examples related to these in:
http://mesos.apache.org/documentation/latest/authorization/
Can someone help me understand where I'm going wrong?

Looking at the JIRA https://issues.apache.org/jira/browse/MESOS-5746
I tried to come up with this json configuration, but that doesn't seem to
work either.
Here is my mesos_acls.json file:

  "get_endpoints": [  {

  "principals": {  "type": "ANY" },

  "paths": {  "type": "ANY"  }  }

   ],


  "view_frameworks": [  {

  "principals": {  "type": "ANY" },

  "users": {  "type": "ANY"  }  }

   ],


  "view_tasks": [  {

  "principals": {  "type": "ANY" },

  "users": {  "type": "ANY"  }  }

   ],

 "view_executors": [  {

  "principals": {  "type": "ANY" },

  "users": {  "type": "ANY"  }  }

   ],

 "access_sandboxes": [  {

  "principals": {  "type": "ANY" },

  "users": {  "type": "ANY"  }  }

   ],

 "access_mesos_logs": [  {

  "principals": {  "type": "ANY" },

  "logs": {  "type": "ANY"  }  }

   ],



-- 
Regards,
Haripriya Ayyalasomayajula

Re: Is this a CI system for is it a development system

[Joseph Wu]

The Windows CI can be found here:
https://builds.apache.org/job/Mesos-Windows/

On Tue, Aug 30, 2016 at 7:14 AM, Alexander Rojas 
wrote:

> Didn’t take it as such, I’m just trying to help you as good as I can :)
>
>
> On 30 Aug 2016, at 16:11, DiGiorgio, Mr. Rinaldo S. 
> wrote:
>
>
> On Aug 30, 2016, at 9:39 AM, Alexander Rojas 
> wrote:
>
> Hi,
>
> As far as I know, the machine that did the OS-X builds has been down for
> more than a year. Likewise, I don’t think there has ever been a windows job.
>
> So far Alex Clemmer has been directing the efforts of the windows build so
> you may want to contact him, it you are interested. I would also recommend
> to use the list d...@mesos.apache.org for development related questions.
>
> Thank you and that was by no means a critique.
>
>
> best,
>
> Alexander
>
> On 30 Aug 2016, at 11:50, DiGiorgio, Mr. Rinaldo S. 
> wrote:
>
> Hi,
>
> I don’t know what the expectation is when looking at mesos jobs here:
>
> https://builds.apache.org/view/Incubator%20Projects/job/
> Mesos-OSX/COMPILER=gcc,CONFIGURATION=--verbose%20--
> enable-libevent%20--enable-ssl,ENVIRONMENT=GLOG_v=1%
> 20MESOS_VERBOSE=1,label_exp=mac/
>
> has been waiting for six days.
>
> I can’t find any windows build jobs.
>
>
> Rinaldo
>
>
>
>
>

ApacheCon Seville CFP closes September 9th

[Rich Bowen]

It's traditional. We wait for the last minute to get our talk proposals
in for conferences.

Well, the last minute has arrived. The CFP for ApacheCon Seville closes
on September 9th, which is less than 2 weeks away. It's time to get your
talks in, so that we can make this the best ApacheCon yet.

It's also time to discuss with your developer and user community whether
there's a track of talks that you might want to propose, so that you
have more complete coverage of your project than a talk or two.

For Apache Big Data, the relevant URLs are:
Event details:
http://events.linuxfoundation.org/events/apache-big-data-europe
CFP:
http://events.linuxfoundation.org/events/apache-big-data-europe/program/cfp

For ApacheCon Europe, the relevant URLs are:
Event details: http://events.linuxfoundation.org/events/apachecon-europe
CFP: http://events.linuxfoundation.org/events/apachecon-europe/program/cfp

This year, we'll be reviewing papers "blind" - that is, looking at the
abstracts without knowing who the speaker is. This has been shown to
eliminate the "me and my buddies" nature of many tech conferences,
producing more diversity, and more new speakers. So make sure your
abstracts clearly explain what you'll be talking about.

For further updated about ApacheCon, follow us on Twitter, @ApacheCon,
or drop by our IRC channel, #apachecon on the Freenode IRC network.

-- 
Rich Bowen
WWW: http://apachecon.com/
Twitter: @ApacheCon

Re: Windows Agent Build Issues

[DiGiorgio, Mr. Rinaldo S.]

On Aug 30, 2016, at 9:42 AM, Alexander Rojas 
> wrote:

Just out of the box, what do you get if you set DPATCHEXE_PATH to 
`/c/GnuWin32/bin/patch.exe`?

I had tried that no change. I tried the combinations to see if PATH really 
means path and not binary.

I also added patch.exe to the PATH.

I am wondering if my issue is with proxies and perhaps a load of dependencies 
is required first.

I don’t understand what this output from cmake is about

-- INSTALLATION PREFIX: C:/Program Files/Mesos



Maybe it is the mix of 32 and 64 bit tools.

I had all of this working before the change to use support/windows.bat


Rinaldo


On 30 Aug 2016, at 11:40, DiGiorgio, Mr. Rinaldo S. 
> wrote:

Hi,

Trying to build Windows Agent on Windows 2010 R2

Windows VS 2015 installed and working /c/Program\ Files\ \(x86\)/Microsoft\ 
Visual\ Studio\ 14.0/
Make installed and working — cmake version 3.6.1
patch.exe installed and working — patch 2.5.9
Jenkins 2+ installed and working
Workspace set to a directory without spaces in the name
vcvarsall.bat is run

I am getting the following error, in both GitBash and MS-DOS

$ /c/CMake/bin/cmake .. -G "Visual Studio 14 2015 Win64" -DENABLE_LIBEVENT=1 
-DPATCHEXE_PATH="C:\GnuWin32\bin\patch.exe"
CMake Warning at CMakeLists.txt:52 (message):
  Both `ENABLE_LIBEVENT` and `REBUNDLED` (set to TRUE by default) flags have
  been set.  But, libevent does not come rebundled in Mesos, so it must be
  downloaded.


CMake Warning at CMakeLists.txt:61 (message):
  The current supported version of ZK does not compile on Windows, and does
  not come rebundled in the Mesos repository.  It must be downloaded from the
  Internet, even though the `REBUNDLED` flag was set.


-- 
-- * Beginning Mesos CMake configuration step *
-- 
-- INSTALLATION PREFIX: C:/Program Files/Mesos
-- MACHINE SPECS:
-- Hostname:
-- OS:   WINDOWS(6.2.9200)
-- Arch: AMD64
-- BitMode:
-- BuildID:
-- 
CMake Error at 3rdparty/cmake/Mesos3rdpartyConfigure.cmake:74 (message):
  GnuWin32 patch.exe was not found.  Use -DPATCHEXE_PATH to provide the local
  path of GnuWin32 patch.exe.  Mesos for Windows requires GnuWin32 patch.exe
  to apply updates.  You may get it from
  http://gnuwin32.sourceforge.net/packages/patch.htm
Call Stack (most recent call first):
  cmake/MesosConfigure.cmake:50 (include)
  CMakeLists.txt:102 (include)


-- Configuring incomplete, errors occurred!

Re: Is this a CI system for is it a development system

[Alexander Rojas]

Hi,

As far as I know, the machine that did the OS-X builds has been down for more 
than a year. Likewise, I don’t think there has ever been a windows job.

So far Alex Clemmer has been directing the efforts of the windows build so you 
may want to contact him, it you are interested. I would also recommend to use 
the list d...@mesos.apache.org for development related questions.

best,

Alexander

> On 30 Aug 2016, at 11:50, DiGiorgio, Mr. Rinaldo S.  
> wrote:
> 
> Hi,
> 
> I don’t know what the expectation is when looking at mesos jobs here:
> 
> https://builds.apache.org/view/Incubator%20Projects/job/Mesos-OSX/COMPILER=gcc,CONFIGURATION=--verbose%20--enable-libevent%20--enable-ssl,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1,label_exp=mac/
>  
> 
> 
> has been waiting for six days.
> 
> I can’t find any windows build jobs.
> 
> 
> Rinaldo
> 

Is this a CI system for is it a development system

[DiGiorgio, Mr. Rinaldo S.]

Hi,

I don’t know what the expectation is when looking at mesos jobs here:

https://builds.apache.org/view/Incubator%20Projects/job/Mesos-OSX/COMPILER=gcc,CONFIGURATION=--verbose%20--enable-libevent%20--enable-ssl,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1,label_exp=mac/

has been waiting for six days.

I can’t find any windows build jobs.


Rinaldo

Re: how to enable force_pull_image on docker containerizer

[Alexander Rojas]

Hey John,

When you launch a task you do so by filling a `TaskInfo` protobuf message with 
all the information necessary to run your task. Among the fields of this 
`TaskInfo` message there is one called `container` of type `ContainerInfo` 
which in turn has a field called `docker` of type `DockerInfo`. The latter is 
the one with the field `force_pull_image` of type `bool`.

An example of how to do so would look like in C++ using libmesos:

```
TaskInfo task;
task.set_name(“Test task”);
task.mutable_task_id()->set_value(“Test task 1”);
task.mutable_slave_id()->CopyFrom(offers.get()[0].slave_id());
task.mutable_resources()->CopyFrom(offers.get()[0].resources());

CommandInfo command;
command.set_value(“while true; do echo ‘Hello World’; sleep 2; done");
task.mutable_command()->CopyFrom(command);

ContainerInfo::DockerInfo docker;
docker.set_image(“images/test-image”);
docker.set_force_pull_image(true);

ContainerInfo container;
container.set_type(ContainerInfo::DOCKER);
container.mutable_docker()->CopyFrom(docker);
task.mutable_container()->CopyFrom(container);

driver.launchTasks(offers.get()[0].id(), {task});
```

> On 27 Aug 2016, at 06:10, John Wetherill  wrote:
> 
> According to this docker-containerizer doc 
> :
> 
> "The containerizer also supports optional force pulling of the image. It is 
> set disabled as default, so the docker image will only be updated again if 
> it’s not available on the host. To enable force pulling an image, 
> force_pull_image has to be set as true."
> 
> I haven't been able to figure out how to enable force_pull_image for 
> mesos-slave. There are hints here 
>  but still not clear to me.
> 
> Any additional hints appreciated.
> 
>