Ralph,
Do you have any YARN or Mesos performance comparison against HOD? I suppose
since it was customer requirement you might not have explored it. MPI support
seems to be active issue for Mesos now.
Charles
On May 21, 2012, at 10:36 AM, Ralph Castain r...@open-mpi.org wrote:
Not quite yet,
If you've got existing R code, you might want to look at this
http://www.quora.com/How-can-R-and-Hadoop-be-used-together.
Quora posting, also by Cloudera, or the rhipe R Hadoop package
https://github.com/saptarshiguha/RHIPE/wiki
Mahout and Lucene/Solr offer some level of text analysis, although
Also bear in mind that there is a kind of detour involved, in the sense that a
pipes map must send key,value data back to the Java process and then to reduce
(more or less).
I think that the Hadoop C Extension (HCE, there is a patch) is supposed to be
faster.
Would be interested to know if
How was your experience of starfish?
C
On Mar 1, 2012, at 12:35 AM, Mark question wrote:
Thank you for your time and suggestions, I've already tried starfish, but
not jmap. I'll check it out.
Thanks again,
Mark
On Wed, Feb 29, 2012 at 1:17 PM, Charles Earl charles.ce...@gmail.comwrote
Mark,
Both streaming and pipes allow this, perhaps more so pipes at the level of the
mapreduce task. Can you provide more details on the application?
On Feb 29, 2012, at 1:56 PM, Mark question wrote:
Hi guys, thought I should ask this before I use it ... will using C over
Hadoop give me the
eventually?
Thanks,
Mark
On Wed, Feb 29, 2012 at 11:03 AM, Charles Earl charles.ce...@gmail.comwrote:
Mark,
Both streaming and pipes allow this, perhaps more so pipes at the level of
the mapreduce task. Can you provide more details on the application?
On Feb 29, 2012, at 1:56 PM, Mark question
is what I'm trying to
avoid.
So basically, is there a way to assign a port to child processes to monitor
them remotely (asked before by Xun) or would you recommend another
monitoring tool?
Thank you,
Mark
On Wed, Feb 29, 2012 at 11:35 AM, Charles Earl charles.ce...@gmail.comwrote:
Mark
tool?
Thank you,
Mark
On Wed, Feb 29, 2012 at 11:35 AM, Charles Earl charles.ce...@gmail.comwrote:
Mark,
So if I understand, it is more the memory management that you are
interested in, rather than a need to run an existing C or C++ application
in MapReduce platform?
Have you done
Hi,
I'm trying to extend the pipes interface as defined in Pipes.hh to
support the read of binary input data.
I believe that would mean extending the getInputValue() method of
context to return char *, which would then be memcpy'd to appropriate
type inside the C++ pipes program.
I'm guessing the
