Fwd: [Vote] Merge branch-trunk-win to trunk

2013-02-28 Thread Matt Foley
+1 (binding) Apache is supposed to be about the community. We have here a community of developers, who have actively and openly worked to add a major improvement to Hadoop: the ability to work cross-platform. Furthermore, the size of the substantive part of the needed patch is only about 1500 li

Re: [Vote] Merge branch-trunk-win to trunk

2013-02-28 Thread Konstantin Boudnik
On Thu, Feb 28, 2013 at 03:08PM, sanjay Radia wrote: > +1 > Java has done the bulk of the work in making Hadoop multi-platform. > Windows specific code is a tiny percentage of the code. > Jeninks support for windows is going help us keep the platform portable going > forward. > I expect that the v

Re: [Vote] Merge branch-trunk-win to trunk

2013-02-28 Thread Ramya Sunil
+1 for the merge. As someone who has been testing the code for many months now, both on singlenode and multinode clusters, I am very confident about the stability and the quality of the code. I have run several regression tests to verify distributed cache, streaming, compression, capacity schedule

[jira] [Created] (MAPREDUCE-5038) mapred CombineFileInputFormat does not work on non-splittable files

2013-02-28 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5038: - Summary: mapred CombineFileInputFormat does not work on non-splittable files Key: MAPREDUCE-5038 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5038 Project:

Re: [Vote] Merge branch-trunk-win to trunk

2013-02-28 Thread Chris Nauroth
> Is there a jira for resolving the outstanding TODOs in the code base > (similar to HDFS-2148)? Looks like this merge doesn't introduce many > which is great (just did a quick diff and grep). I found 2 remaining TODOs introduced in the current merge patch. One is in ContainerLaunch.java. The c

Re: [Vote] Merge branch-trunk-win to trunk

2013-02-28 Thread Robert Evans
My initial question was mostly intended to understand the desired new classification of Windows after the merge, and how we plan to maintain Windows support. I am happy to hear that hardware for Jenkins will be provided. I am also fine, at least initially, with us trying to treat Windows as a fir

Re: [Vote] Merge branch-trunk-win to trunk

2013-02-28 Thread Chris Nauroth
I'd like to share a few anecdotes about developing cross-platform, hopefully to address some of the concerns about adding overhead to the development process. By reviewing past cases of cross-platform Linux vs. Windows bugs, we can get a sense for how the development process could look in the futu

[jira] [Created] (MAPREDUCE-5037) JobControl logging when a job completes

2013-02-28 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5037: - Summary: JobControl logging when a job completes Key: MAPREDUCE-5037 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5037 Project: Hadoop Map/Reduce I

Hadoop-Mapreduce-trunk - Build # 1358 - Failure

2013-02-28 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1358/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 27587 lines...] Tests run: 4, Failures: 0, Errors: 0

RE: [Vote] Merge branch-trunk-win to trunk

2013-02-28 Thread John Gordon
+1 (non-binding) I want to share my vote of confidence in this community. If motivated to do so, this community can keep this project cross-platform and continue to rapidly innovate without breaking a sweat. The day we started working on this, I saw the foundations of greatness in the quality

Re: is it possible to ignore http Mapoutput get by feed mapoutput file and index file diirectly to reducer?

2013-02-28 Thread Ling Kun
After search the hadoop maillist again, I found this link which trying to optimize hadoop based on Lustre using Hardlink instead of http( http://search-hadoop.com/m/JkHSa17oHp12 ). Any other suggestion ? Thanks all yours, Ling Kun On Thu, Feb 28, 2013 at 4:57 PM, Ling Kun wrote: > Dear Aru