h looks like:
f:rate 171455.11
f:sqrate2981174.8
l:size 1048576
l:tasks 10
l:time 590537
If you take f:rate/1000/l:tasks, that should give you the average MB/sec.
E.g. for the example above, that would be 171455/1000/10 = 17MB/sec.
-- Ken
--
Ken Krugler
+1
ms. With
this third day you'll get one-on-one help to better assimilate the
concepts covered during the first two days.
As always, feel free to ping me if you've got any questions.
Thanks!
-- Ken
----------
Ken Krugler
kkrug...@scaleunlimited.com
lems. With this
third day you'll get one-on-one help to better assimilate the concepts
covered during the first two days.
As always, feel free to ping me if you've got any questions.
Thanks!
-- Ken
--------
Ken Krugler
kkrug...@scaleunlimited.com
t 8:10am, Mark Kerzner wrote:
Awesome course - I took the historic first one, and benefited a lot.
Great
that Ken is going to teach it.
Mark
On Fri, Jul 9, 2010 at 9:31 AM, Ken Krugler >wrote:
Hi all,
A quick note that I'll be the instructor for the next Hadoop Bootcamp
training c
generating
search indexes, and data processing workflows with Cascading.
See http://www.scaleunlimited.com/courses/hadoop-bootcamp-santaclara
for more details, or ping me if you've got specific questions.
Thanks!
-- Ken
------------
Ke
g. questions you think should
be there, answers you think aren't very clear (though mea culpa in
advance, I jotted these down quickly so I realize they're pretty rough).
Thanks,
-- Ken
----
Ken Krugler
+1 530-210-6378
http://bixolabs.com
e l a s t i c w e b m i n i n g
ven that the JobTracker waits for slaves to self-report, there
doesn't seem to be a totally reliable, automatic solution to this
issue, but I thought I'd ask to see if there's something I'm missing.
Thanks,
-- Ken
------------
Ken Krugler
where under very heavy io pressure, and may have
been
paging also. The code and configuration issues that triggered this
have been
resolved, so I don't see it anymore.
On Tue, Dec 8, 2009 at 8:32 AM, Ken Krugler >wrote:
Hi all,
In searching the mail/web archives, I see occasionally q
lient.java:1745
)
at
org.apache.hadoop.dfs.DFSClient$DFSOutputStream
$DataStreamer.run(DFSClient.java:1922
)
Ken Krugler
+1 530-210-6378
http://bixolabs.com
e l a s t i c w e b m i n i n g
Ken
I expect it to process
large data very fast.
It processes small amount of data (< 5MB) very quickly.
Now 5 GB of input data is provided; and the fun starts :)
It goes out of memory.
--
Ken Krugler
+1 530-210-6378
10 matches
Mail list logo
