Re: How does Mesos parse hadoop command??

As a follow up, a place you would typically set the JAVA_HOME environment variable would be in /etc/default/mesos-slave on Ubuntu On Wed, Nov 4, 2015 at 11:38 AM, Elizabeth Lingg wrote: > Ah, yes. I have seen this issue. Typically, it is because you have > JAVA_HOME set

Re: spark mesos shuffle service failing under marathon

Can you find anything in the logs that would indicate a failure? On Wed, Nov 4, 2015 at 9:23 PM, Rodrick Brown wrote: > Starting the mesos shuffle service seems to background the process so when > ever marathon tries to bring up this process it constantly keeps trying

Re: Apache Mesos Community Sync

It's been a while since our last community sync, and tomorrow, Thursday Nov 5th shows up on my calendar as a 3pm Twitter-hosted meeting, since those have traditionally been "Monthly on the first Thursday". After this, the other meetings (third Thursday, or every other week?) can alternate between

Join the Apache Aurora + Mesos Meetup next Tuesday in Palo Alto

Join the Bay Area Apache Aurora and Apache Mesos communities for our November meetup, scheduled for Tuesday, November 10th, 2015 and hosted by our friends at Medallia in Palo Alto. Register here: http://www.meetup.com/Bay-Area-Apache-Aurora-Users-Group/events/225412389/ The meetup will

Re: Apache Mesos Community Sync

Adam, since most of the Twitter folks are OOO this week. I chatted with Artem/Vinod. we think it makes sense to host the sync at Mesosphere tomorrow. - Jie On Wed, Nov 4, 2015 at 4:22 PM, Adam Bordelon wrote: > It's been a while since our last community sync, and tomorrow,

Re: Apache Mesos Community Sync

Sounds great! Please join us at Mesosphere HQ, 88 Stevenson St., SF at 3pm Pacific tomorrow. We will use youtube-onair again, links to be posted to IRC/email shortly before the meeting. Please add agenda items:

spark mesos shuffle service failing under marathon

Starting the mesos shuffle service seems to background the process so when ever marathon tries to bring up this process it constantly keeps trying to start and never registers as started? Is there a fix for this? -- Rodrick Brown / DevOPs Engineer +1 917

Re: Docker Multi-Host Networking and Mesos Isolation Strategies

I created a basic stub at https://issues.apache.org/jira/browse/MESOS-3828 Thanks! John On Wed, Nov 4, 2015 at 8:32 AM, haosdent wrote: > This new docker feature looks excited! To integrated with this, my quick > idea is we could implement it as a pluggable module and let

Re: How is Mesos doing certificate verification for resources in URIs?

Kamil, It’s perfect, thank you. Kind regards,
 Radek Gruchalski 
ra...@gruchalski.com (mailto:ra...@gruchalski.com)
 (mailto:ra...@gruchalski.com) de.linkedin.com/in/radgruchalski/ (http://de.linkedin.com/in/radgruchalski/) Confidentiality: This communication is intended for the

Re: How does Mesos parse hadoop command??

Ah, yes. I have seen this issue. Typically, it is because you have JAVA_HOME set on your host,but not on your Mesos Agent. If you run a Marathon job and output "env" you will see the JAVA_HOME environment variable is missing. You would need to set it in your agent init configurations as export

Re: Docker Multi-Host Networking and Mesos Isolation Strategies

This new docker feature looks excited! To integrated with this, my quick idea is we could implement it as a pluggable module and let user choose which network isolator should used. But this is just my opinion. Could you create a story for this in https://issues.apache.org/jira/browse/MESOS so we

Re: How does Mesos parse hadoop command??

What OS are you running this with? And I assume if you run /bin/sh and try to run hadoop it can be found in your PATH as well? Tim On Wed, Nov 4, 2015 at 12:34 AM, Du, Fan wrote: > Hi Mesos experts > > I setup a small mesos cluster with 1 master and 6 slaves, > and deploy

Re: How does Mesos parse hadoop command??

I notice ``` "user":"root" ``` Do you make sure could execute `hadoop version` under root? On Wed, Nov 4, 2015 at 4:56 PM, Du, Fan wrote: > > > On 2015/11/4 16:40, Tim Chen wrote: > >> What OS are you running this with? >> >> And I assume if you run /bin/sh and try to run

Re: How does Mesos parse hadoop command??

On 2015/11/4 17:09, haosdent wrote: I notice ``` "user":"root" ``` Do you make sure could execute `hadoop version` under root? [root@tylersburg spark-1.5.1-bin-hadoop2.6]# whoami root [root@tylersburg spark-1.5.1-bin-hadoop2.6]# hadoop version Hadoop 2.6.0 Subversion

Re: How does Mesos parse hadoop command??

On 2015/11/4 16:40, Tim Chen wrote: What OS are you running this with? And I assume if you run /bin/sh and try to run hadoop it can be found in your PATH as well? I'm using CentOS-7.2 # /bin/sh hadoop version Hadoop 2.6.0 Subversion https://git-wip-us.apache.org/repos/asf/hadoop.git -r

Re: How does Mesos parse hadoop command??

how about add this flag when launch slave --executor_environment_variables='{"HADOOP_HOME": "/opt/hadoop-2.6.0"}' ? On Wed, Nov 4, 2015 at 5:13 PM, Du, Fan wrote: > > > On 2015/11/4 17:09, haosdent wrote: > >> I notice >> ``` >> "user":"root" >> ``` >> Do you make sure could

How does Mesos parse hadoop command??

Hi Mesos experts I setup a small mesos cluster with 1 master and 6 slaves, and deploy hdfs on the same cluster topology, both with root user role. #cat spark-1.5.1-bin-hadoop2.6/conf/spark-env.sh export MESOS_NATIVE_JAVA_LIBRARY=/usr/local/lib/libmesos.so export

How is Mesos doing certificate verification for resources in URIs?

Hi everyone, I’ve added the following URI to the URIs for the task: https://raw.githubusercontent.com/apache/spark/master/pom.xml. However, my task has failed because of: Failed to fetch 'https://raw.githubusercontent.com/apache/spark/master/pom.xml': Error downloading resource: Peer

Re: How is Mesos doing certificate verification for resources in URIs?

Could you curl https://raw.githubusercontent.com/apache/spark/master/pom.xml success in your slave? On Wed, Nov 4, 2015 at 6:50 PM, Rad Gruchalski wrote: > Hi everyone, > > I’ve added the following URI to the URIs for the task: >

Re: How is Mesos doing certificate verification for resources in URIs?

Yes, this is from the agent: ~$ curl -i https://raw.githubusercontent.com/apache/spark/master/pom.xml HTTP/1.1 200 OK Content-Security-Policy: default-src 'none' X-XSS-Protection: 1; mode=block X-Frame-Options: deny X-Content-Type-Options: nosniff Strict-Transport-Security: max-age=31536000