On Jan. 27, 2014, 7:53 a.m., Ian Downes wrote:
What about supporting environment variables specific to the child process?
This is necessary for distinct environments between different subprocesses
and the parent. This could be done by prepending the command with 'env' but
it'll be
Hi,
I ran a map-only job on hadoop. But on every tasktracker, it had only 7 map
slots running. How to let it be 8 map slots?
Hi,
I ran a map-only job on hadoop. Every node has 8 cores, but on every
tasktracker, it had only 7 map slots running. How to let tasktracker run 8 map
slots on every node?
Thank you
Another question,
The tasktracker can not stop after the hadoop job is done. Why?
-原始邮件-
发件人: HUO Jing huoj...@ihep.ac.cn
发送时间: 2014年1月27日 星期一
收件人: dev@mesos.apache.org
抄送: Brenden Matthews bren...@diddyinc.com
主题: Re: question about hadoop on mesos
Hi,
I ran a map-only job on
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17343/#review32782
---
Ship it!
src/log/coordinator.hpp
I have some questions about running hadoop on top of Mesos, please help me.
1. when a tasktracker is launched, if n cpu core are allocated to it, it
can only launch n-1 map tasks. Could someone tell me why? And, if I want to
run map-only job, what should I do to run n map tasks on a n cpu
[
https://issues.apache.org/jira/browse/MESOS-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Niklas Quarfot Nielsen resolved MESOS-799.
--
Resolution: Fixed
Fix Version/s: 0.17.0
Python issues should be resolved
[
https://issues.apache.org/jira/browse/MESOS-798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13883017#comment-13883017
]
Niklas Quarfot Nielsen commented on MESOS-798:
--
Bernardo, can we mark this are
[
https://issues.apache.org/jira/browse/MESOS-775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Niklas Quarfot Nielsen resolved MESOS-775.
--
Resolution: Duplicate
Duplicate of MESOS-772
expose count of running tasks
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17345/#review32851
---
src/java/jni/org_apache_mesos_Log.cpp
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17346/#review32858
---
src/java/jni/org_apache_mesos_Log.cpp
Connor Doyle created MESOS-948:
--
Summary: Docs for Java interfaces
Key: MESOS-948
URL: https://issues.apache.org/jira/browse/MESOS-948
Project: Mesos
Issue Type: Documentation
Kevin Sweeney created MESOS-949:
---
Summary: slave should wipe meta directory on startup if bootid
changes
Key: MESOS-949
URL: https://issues.apache.org/jira/browse/MESOS-949
Project: Mesos
On Mon, Jan 27, 2014 at 10:07 AM, HUO Jing huoj...@ihep.ac.cn wrote:
So, at the very beginning, if all the resource are assigned to hadoop, and
after that, there are always enough jobs in jobtracker, is that meanning
that the other framework will never get resource?
Is it fair to do so ?
[
https://issues.apache.org/jira/browse/MESOS-949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kone resolved MESOS-949.
--
Resolution: Duplicate
Assignee: Benjamin Mahler
slave should wipe meta directory on startup if
[
https://issues.apache.org/jira/browse/MESOS-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Connor Doyle updated MESOS-948:
---
Description:
There is some great user documentation embedded in the Java API sources (see:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17423/
---
Review request for mesos, Ben Mahler and Jie Yu.
Repository: mesos-git
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17424/
---
Review request for mesos, Ben Mahler and Jie Yu.
Repository: mesos-git
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17423/
---
(Updated Jan. 27, 2014, 9:33 p.m.)
Review request for mesos, Ben Mahler and
[
https://issues.apache.org/jira/browse/MESOS-950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13883371#comment-13883371
]
Benjamin Hindman commented on MESOS-950:
YES PLEASE YES PLEASE YES PLEASE!
Do you
On Jan. 24, 2014, 7:47 a.m., Benjamin Hindman wrote:
src/launcher/executor.cpp, line 298
https://reviews.apache.org/r/17305/diff/1/?file=447761#file447761line298
I think it makes sense to have a global reaper just like we do with
statistics. Having multiple libprocess processes
[
https://issues.apache.org/jira/browse/MESOS-950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13883416#comment-13883416
]
Niklas Quarfot Nielsen commented on MESOS-950:
--
Do you think we should put
[
https://issues.apache.org/jira/browse/MESOS-829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dave Lester closed MESOS-829.
-
Resolution: Fixed
Fixed. Thanks for your help, [~jfarrell]!
Switch website CMS from Jekyll to Middleman
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17427/
---
Review request for mesos, Benjamin Hindman, Ian Downes, and Vinod Kone.
On Jan. 24, 2014, 6:16 p.m., Ian Downes wrote:
3rdparty/libprocess/include/process/subprocess.hpp, line 120
https://reviews.apache.org/r/17306/diff/1/?file=447773#file447773line120
should we check their exit codes since dup2 can fail even with valid
descriptors.
I've handled
On Jan. 24, 2014, 8:12 p.m., Jie Yu wrote:
3rdparty/libprocess/include/process/subprocess.hpp, lines 163-165
https://reviews.apache.org/r/17306/diff/1/?file=447773#file447773line163
Instead of killing the subprocess when 'status' is discarded, what
about having an explicit
On Jan. 27, 2014, 7:53 a.m., Ian Downes wrote:
What about supporting environment variables specific to the child process?
This is necessary for distinct environments between different subprocesses
and the parent. This could be done by prepending the command with 'env' but
it'll be
On Jan. 24, 2014, 10:39 p.m., Ian Downes wrote:
3rdparty/libprocess/include/process/subprocess.hpp, line 133
https://reviews.apache.org/r/17306/diff/1/?file=447773#file447773line133
I don't think strlen() is async-signal-safe.
I'd like to use it for convenience, my rationale is
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17306/
---
(Updated Jan. 27, 2014, 10:42 p.m.)
Review request for mesos, Benjamin Hindman
On Jan. 24, 2014, 7:47 a.m., Benjamin Hindman wrote:
src/launcher/executor.cpp, line 298
https://reviews.apache.org/r/17305/diff/1/?file=447761#file447761line298
I think it makes sense to have a global reaper just like we do with
statistics. Having multiple libprocess processes
[
https://issues.apache.org/jira/browse/MESOS-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kone updated MESOS-496:
-
Fix Version/s: 0.16.0
Refactor the MasterDetector (with 'bool contend' option) into new
MasterDetector
[
https://issues.apache.org/jira/browse/MESOS-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kone updated MESOS-496:
-
Issue Type: Story (was: Improvement)
Refactor the MasterDetector (with 'bool contend' option) into new
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17427/#review32908
---
Ship it!
Ship It!
- Benjamin Hindman
On Jan. 27, 2014, 10:16
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17304/
---
(Updated Jan. 27, 2014, 11:25 p.m.)
Review request for mesos, Benjamin Hindman
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17305/
---
(Updated Jan. 27, 2014, 11:25 p.m.)
Review request for mesos, Benjamin Hindman
[
https://issues.apache.org/jira/browse/MESOS-930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13883520#comment-13883520
]
Benjamin Mahler commented on MESOS-930:
---
I think we should step back a bit and think
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/
---
Review request for mesos.
Repository: mesos-git
Description
---
Enabled
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/
---
(Updated Jan. 27, 2014, 11:47 p.m.)
Review request for mesos.
Repository:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/
---
(Updated Jan. 27, 2014, 11:50 p.m.)
Review request for mesos.
Repository:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17427/#review32914
---
According to Linus the file descriptor has been closed even if
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/
---
(Updated Jan. 27, 2014, 11:55 p.m.)
Review request for mesos and Ross Allen.
On Jan. 27, 2014, 11:54 p.m., Ian Downes wrote:
According to Linus the file descriptor has been closed even if EINTR is
returned and it should not be closed again. Later in the thread he
explicitly says that the glibc macro is incorrect.
On Jan. 27, 2014, 11:54 p.m., Ian Downes wrote:
According to Linus the file descriptor has been closed even if EINTR is
returned and it should not be closed again. Later in the thread he
explicitly says that the glibc macro is incorrect.
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/#review32919
---
src/webui/master/static/config.html
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/#review32921
---
src/webui/master/static/config.html
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/#review32922
---
src/webui/master/static/index.html
Bernd Mathiske created MESOS-951:
Summary: Build failure: in log/catchup.cpp on Clang
Key: MESOS-951
URL: https://issues.apache.org/jira/browse/MESOS-951
Project: Mesos
Issue Type: Bug
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/#review32924
---
src/webui/master/static/config.html
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/
---
(Updated Jan. 28, 2014, 12:34 a.m.)
Review request for mesos and Ross Allen.
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/#review32925
---
src/webui/master/static/js/app.js
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/#review32927
---
Screenshots? :)
If we were to have a way to spin up the webui
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/
---
(Updated Jan. 28, 2014, 12:52 a.m.)
Review request for mesos and Ross Allen.
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/
---
(Updated Jan. 28, 2014, 12:53 a.m.)
Review request for mesos and Ross Allen.
On Jan. 28, 2014, 12:45 a.m., Ben Mahler wrote:
Screenshots? :)
If we were to have a way to spin up the webui standalone, perhaps that's
the only time we would want to expose this?
I suspect that you're right. The impetus for the feature is having the UI be
standalone at least.
In
On Jan. 24, 2014, 7:47 a.m., Benjamin Hindman wrote:
src/launcher/executor.cpp, line 298
https://reviews.apache.org/r/17305/diff/1/?file=447761#file447761line298
I think it makes sense to have a global reaper just like we do with
statistics. Having multiple libprocess processes
On Jan. 28, 2014, 12:45 a.m., Ben Mahler wrote:
Screenshots? :)
If we were to have a way to spin up the webui standalone, perhaps that's
the only time we would want to expose this?
Thomas Rampelberg wrote:
I suspect that you're right. The impetus for the feature is having the
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/#review32931
---
src/webui/master/static/index.html
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17435/
---
Review request for mesos and Benjamin Hindman.
Repository: mesos-git
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/#review32932
---
src/webui/master/static/js/controllers.js
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17435/#review32933
---
Ship it!
Ship It!
- Benjamin Hindman
On Jan. 28, 2014, 1:14
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17435/
---
(Updated Jan. 28, 2014, 1:16 a.m.)
Review request for mesos and Benjamin
[
https://issues.apache.org/jira/browse/MESOS-951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13883609#comment-13883609
]
Benjamin Hindman commented on MESOS-951:
Thanks for reporting Bernd!
Build
[
https://issues.apache.org/jira/browse/MESOS-951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benjamin Hindman resolved MESOS-951.
Resolution: Fixed
Fix Version/s: 0.17.0
Assignee: Jie Yu
[
https://issues.apache.org/jira/browse/MESOS-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Connor Doyle resolved MESOS-948.
Resolution: Duplicate
Docs for Java interfaces
Key:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/
---
(Updated Jan. 28, 2014, 1:44 a.m.)
Review request for mesos and Ross Allen.
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/#review32935
---
src/Makefile.am
https://reviews.apache.org/r/17431/#comment61972
Benjamin Mahler created MESOS-952:
-
Summary: Clock::resume should adjust timeouts that were created in
a paused/advanced Clock context.
Key: MESOS-952
URL: https://issues.apache.org/jira/browse/MESOS-952
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/16432/#review32889
---
Ship it!
Looks good, just some minor nits.
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17431/
---
(Updated Jan. 28, 2014, 1:48 a.m.)
Review request for mesos and Ross Allen.
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17440/
---
Review request for mesos, Benjamin Hindman, Ben Mahler, and Vinod Kone.
Bugs:
[
https://issues.apache.org/jira/browse/MESOS-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880178#comment-13880178
]
Yan Xu edited comment on MESOS-937 at 1/28/14 1:59 AM:
---
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17442/
---
Review request for mesos, Benjamin Hindman, Ben Mahler, David Robinson, and
[
https://issues.apache.org/jira/browse/MESOS-772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kone reassigned MESOS-772:
Assignee: Vinod Kone
https://reviews.apache.org/r/17442/
expose count of running tasks
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17442/#review32942
---
Ship it!
Looks great! Thanks
src/master/http.cpp
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17442/
---
(Updated Jan. 28, 2014, 2:59 a.m.)
Review request for mesos, Benjamin Hindman,
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17443/
---
Review request for mesos, Adam B, Benjamin Hindman, Ben Mahler, David Robinson,
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17443/
---
(Updated Jan. 28, 2014, 3:02 a.m.)
Review request for mesos, Adam B, Benjamin
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17443/
---
(Updated Jan. 28, 2014, 3:02 a.m.)
Review request for mesos, Adam B, Benjamin
[
https://issues.apache.org/jira/browse/MESOS-772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13883664#comment-13883664
]
Vinod Kone edited comment on MESOS-772 at 1/28/14 3:02 AM:
---
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17445/
---
Review request for mesos, Benjamin Hindman, Ben Mahler, and Vinod Kone.
Bugs:
[
https://issues.apache.org/jira/browse/MESOS-950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13883713#comment-13883713
]
Niklas Quarfot Nielsen commented on MESOS-950:
--
Added in
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17442/#review32952
---
Ship it!
I hope the past vs present tense will be enough to not
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/16724/#review32949
---
Ship it!
src/master/master.cpp
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17445/#review32954
---
Ship it!
Ship It!
- Benjamin Hindman
On Jan. 28, 2014, 3:41
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17440/#review32956
---
src/state/zookeeper.cpp
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17442/#review32962
---
Ship it!
src/master/http.cpp
On Jan. 28, 2014, 4:55 a.m., Ben Mahler wrote:
I hope the past vs present tense will be enough to not make the monotonic
vs instantaneous stats confusing for those consuming this data.
I'd find it confusing. active_tasks_gauge is preferrable.
- David
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17443/#review32964
---
Ship it!
src/slave/http.cpp
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/16724/#review32961
---
Can we add a test for this please?
src/master/master.cpp
On Jan. 28, 2014, 6:31 a.m., David Robinson wrote:
src/master/http.cpp, line 349
https://reviews.apache.org/r/17442/diff/2/?file=452628#file452628line349
s/launched_tasks/launched_tasks_gauge/ ? (or active_tasks_gauge, please
yourself)
All the other *_tasks are
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17442/
---
(Updated Jan. 28, 2014, 6:57 a.m.)
Review request for mesos, Benjamin Hindman,
On Jan. 28, 2014, 5:08 a.m., Benjamin Hindman wrote:
src/slave/http.cpp, line 309
https://reviews.apache.org/r/17443/diff/1/?file=452630#file452630line309
Any reason not to use 'active_tasks' here instead of 'launched_tasks'
too?
I went back and forth on the naming. This is my
92 matches
Mail list logo
