Re: [VOTE] Abandon hdfsproxy HDFS contrib

2011-02-18 Thread Bernd Fondermann
On Thu, Feb 17, 2011 at 19:43, Roy T. Fielding field...@gbiv.com wrote: On Feb 17, 2011, at 4:43 AM, Bernd Fondermann wrote: We have the very unfortunate situation here at Hadoop where Apache Hadoop is not the primary and foremost place of Hadoop development. Instead, code is developed

Re: simple map reduce

2011-02-18 Thread Alessandro Binhara
I need extend ArrayWritable ??? like this : public class IntArrayWritable extends ArrayWritable { public IntArrayWritable() { super(IntWritable.class); } } On Fri, Feb 18, 2011 at 1:15 AM, Harsh J qwertyman...@gmail.com wrote: Hello, On Fri, Feb 18, 2011 at 12:17 AM, Alessandro Binhara

Re: [VOTE] Abandon hdfsproxy HDFS contrib

2011-02-18 Thread Eric Baldeschwieler
Well put Allen. My thinking is to move this API into HDFS removing the need for HDFS proxy. Then you can use the http proxy of your choice if you have needs for a proxy (we do this for external bandwidth management, security and ip space preservation reasons). I'm +1 for removing it. We

Re: dfs.datanode.du.pct question

2011-02-18 Thread Mag Gam
Aaron, Thanks for following up on this issue for us. Has dfs.datanode.du.pct been depreciated? On Mon, Jan 3, 2011 at 6:06 PM, Aaron T. Myers a...@cloudera.com wrote: Filed https://issues.apache.org/jira/browse/HDFS-1564 -- Aaron T. Myers Software Engineer, Cloudera On Sun, Jan 2, 2011

Re: [VOTE] Abandon hdfsproxy HDFS contrib

2011-02-18 Thread Eric Baldeschwieler
Hi Bernd, Apache Hadoop is about scale. Most clusters will always be small, but Hadoop is going mainstream precisely because it scales to huge data and cluster sizes. There are lots of systems that work well on 10 node clusters. People select Hadoop because they are confident that as their

Re: [VOTE] Abandon hdfsproxy HDFS contrib

2011-02-18 Thread Bernd Fondermann
Hi Eric, On Fri, Feb 18, 2011 at 13:46, Eric Baldeschwieler eri...@yahoo-inc.com wrote: Hi Bernd, Apache Hadoop is about scale. Most clusters will always be small, but Hadoop is going mainstream precisely because it scales to huge data and cluster sizes. There are lots of systems that

Re: [VOTE] Abandon hod Common contrib

2011-02-18 Thread Simone Leo
I am the co-author (with Gianluigi Zanetti) of HADOOP-6369 -- add Grid Engine support to HOD. At CRS4 we've been using (our patched version of) HOD since 2008 and we still use it in production. We use Hadoop 0.20.2 since it was released one year ago. Simone On 02/12/11 06:15, Owen O'Malley

Re: [VOTE] Abandon hdfsproxy HDFS contrib

2011-02-18 Thread Allen Wittenauer
On Feb 18, 2011, at 2:11 AM, Bernd Fondermann wrote: I don't know how many Y-employees are working on H internally. Only the contributors can sort that out. Did Carol Bartz run over your puppy or something? You don't appear to realize that pretty much all the major companies that

Re: simple map reduce

2011-02-18 Thread Owen O'Malley
Please keep user questions on mapreduce-user as per http://hadoop.apache.org/mailing_lists.html . On Feb 18, 2011, at 2:42 AM, Alessandro Binhara wrote: I need extend ArrayWritable ??? like this : public class IntArrayWritable extends ArrayWritable { public IntArrayWritable() {

Re: pdf design documents

2011-02-18 Thread Owen O'Malley
On Feb 18, 2011, at 8:40 AM, Doug Cutting wrote: I feel PDF discourages collaboration. Either plain text or HTML would permit folks to more easily provide feedback, either as patches or as alternate drafts. Ok, I've upload the latex files. -- Owen

Re: pdf design documents

2011-02-18 Thread Mahadev Konar
I am unsure why this is being discussed on general. I havent seen any contributor to ignore request for source of the design document. If someone wants to edit or submit a new one, just commenting on the jira and asking for it should be enough. no? thanks mahadev On Fri, Feb 18, 2011 at 9:12 AM,

Re: dfs.datanode.du.pct question

2011-02-18 Thread Aaron T. Myers
Hi Mag, Per http://hadoop.apache.org/mailing_lists.html, general@ is not the best place for this discussion. Let's continue this on the actual JIRA: https://issues.apache.org/jira/browse/HDFS-1564 -- Aaron T. Myers Software Engineer, Cloudera On Fri, Feb 18, 2011 at 4:24 AM, Mag Gam

Re: Hadoop testing project

2011-02-18 Thread Eric Yang
On 2/18/11 8:24 AM, Steve Loughran ste...@apache.org wrote: On 17/02/2011 18:36, Eric Yang wrote: I think the bigger concern is that Hadoop ecosystem does not have a standard method in linking dependencies. Hbase depends on Zookeeper, and Pig depends on Hadoop and Hbase. Then pig

Re: pdf design documents

2011-02-18 Thread Doug Cutting
On 02/18/2011 09:12 AM, Owen O'Malley wrote: Ok, I've upload the latex files. Thanks, Owen! Doug

Re: pdf design documents

2011-02-18 Thread Doug Cutting
On 02/18/2011 09:48 AM, Mahadev Konar wrote: I am unsure why this is being discussed on general. I feel this is an issue of general interest and wanted to find out how others felt about it, not just those following those two particular issues. Over the years, on several projects, I've expressed

Re: pdf design documents

2011-02-18 Thread Eric Yang
FYI, Owen's design doc for HADOOP-6255 is also available in xml format in the proposed patch. I think as long as there is a mean to edit/revise the design doc, it should be fine right? Regards, Eric On 2/18/11 10:39 AM, Doug Cutting cutt...@apache.org wrote: On 02/18/2011 09:48 AM, Mahadev

Re: pdf design documents

2011-02-18 Thread Doug Cutting
On 02/18/2011 11:09 AM, Eric Yang wrote: FYI, Owen's design doc for HADOOP-6255 is also available in xml format in the proposed patch. I think as long as there is a mean to edit/revise the design doc, it should be fine right? Yes, that looks great to me. I am just proposing that, when a

Re: [VOTE] Abandon hdfsproxy HDFS contrib

2011-02-18 Thread Bernd Fondermann
On 18.02.11 17:11, Allen Wittenauer wrote: On Feb 18, 2011, at 2:11 AM, Bernd Fondermann wrote: I don't know how many Y-employees are working on H internally. Only the contributors can sort that out. Did Carol Bartz run over your puppy or something? Something, definitively. I assume EOR.

Re: pdf design documents

2011-02-18 Thread Eric Yang
The editable proposal is good advice. It would be nice to present both editable version and read-only version to track the history of the proposal. If it comes down to streamline efficiency, having editable proposal is preferred. Hence, I will use editable document next time. Regards, Eric On