Re: About block splitting, input split and TextInputFormat in MapReduce

2013-10-18 Thread Harsh J
Yoonmin, Please give http://wiki.apache.org/hadoop/HadoopMapReduce a read, it covers the read-records-across-blocks scenario. On Thu, Oct 17, 2013 at 8:47 PM, Yoonmin Nam wrote: > Hi. > > Let we consider this situation: > > 1. Block size = 67108864 (64MB) > > 2. Data size = 2.2GB… (large

Re: Managing docs with hadoop-1 & hadoop-2

2013-10-18 Thread Akira AJISAKA
# Have stable1/stable2 links: http://hadoop.apache.org/docs/stable1 -> hadoop-1.x http://hadoop.apache.org/docs/stable2 -> hadoop-2.x +1, would also make: current -> stable2(since v2 is the latest) stable -> stable1 (for compatibility) +1, Eli's proposal looks good to me. - T

Re: Managing docs with hadoop-1 & hadoop-2

2013-10-18 Thread Tsuyoshi OZAWA
>> # Have stable1/stable2 links: >> http://hadoop.apache.org/docs/stable1 -> hadoop-1.x >> http://hadoop.apache.org/docs/stable2 -> hadoop-2.x > +1, would also make: > current -> stable2(since v2 is the latest) > stable -> stable1 (for compatibility) +1, Eli's proposal looks good to

Re: Managing docs with hadoop-1 & hadoop-2

2013-10-18 Thread Roman Shaposhnik
On Fri, Oct 18, 2013 at 2:10 PM, Arun C Murthy wrote: > Folks, > > Currently http://hadoop.apache.org/docs/stable/ points to hadoop-1. With > hadoop-2 going GA, should we just point that to hadoop-2? > > Couple of options: > # Have stable1/stable2 links: >http://hadoop.apache.org/docs/stab

Re: Managing docs with hadoop-1 & hadoop-2

2013-10-18 Thread Eli Collins
On Fri, Oct 18, 2013 at 2:10 PM, Arun C Murthy wrote: > Folks, > > Currently http://hadoop.apache.org/docs/stable/ points to hadoop-1. With > hadoop-2 going GA, should we just point that to hadoop-2? > > Couple of options: > # Have stable1/stable2 links: >http://hadoop.apache.org/docs/stab

Managing docs with hadoop-1 & hadoop-2

2013-10-18 Thread Arun C Murthy
Folks, Currently http://hadoop.apache.org/docs/stable/ points to hadoop-1. With hadoop-2 going GA, should we just point that to hadoop-2? Couple of options: # Have stable1/stable2 links: http://hadoop.apache.org/docs/stable1 -> hadoop-1.x http://hadoop.apache.org/docs/stable2 -> hadoop

Re: How to modify the Map-Reduce execution order?

2013-10-18 Thread Arun C Murthy
You might be interested in Apache Tez which provides native support for these sort of scenarios by being a super-set of MapReduce: http://tez.incubator.apache.org/ Arun On Oct 16, 2013, at 1:16 AM, Anh Pham wrote: > (Please correct me if I am wrong) So the original chain is: > InputSplits-->M

Hadoop-Mapreduce-trunk - Build # 1582 - Still Failing

2013-10-18 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1582/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 31726 lines...] Running org.apache.hadoop.mapreduce.