Re: LimitedPrivate and HBase

2011-06-16 Thread Sanjay Radia
I have updated https://issues.apache.org/jira/browse/HADOOP-7391 with a html file that is for adding as an overview.html to the classification package. The text is mostly what was in HADOOP-5073; i have added 3 FAQs.

Re: LimitedPrivate and HBase

2011-06-15 Thread Tom White
No offense taken. Sanjay and I chatted offline. We disagree on whether Private should be scoped to the whole project (Hadoop), or to subprojects (Common, HDFS, MapReduce). The intent of HADOOP-5073 was for the latter, but I'm not convinced it buys us anything really, which is why I've been

Re: LimitedPrivate and HBase

2011-06-14 Thread Sanjay Radia
On Jun 9, 2011, at 10:27 AM, Tom White wrote: Looking at current usage in Hadoop, there are only 4 LimitedPrivate references to HBase (the http, io.retry, ipc, and metrics packages in Common), and 2 references to Pig (the two LineRecordReader classes in MapReduce). The other LimitedPrivate

Re: LimitedPrivate and HBase (thoughts from the build and test world)

2011-06-10 Thread Steve Loughran
On 06/09/2011 08:23 PM, Stack wrote: Nice reality check and thanks for the how it was addressed elsewhere Steve. As you say, it sounds like a large undertaking but it would be a sweet service for the downstreamers. as an aside, the thing that usually prevents you using Java apps as libraries

Re: LimitedPrivate and HBase (thoughts from the build and test world)

2011-06-09 Thread Steve Loughran
projects that are closely tied to Hadoop as projects eligible for LimitedPrivate. {HBase, HDFS, Hive, MapReduce, Pig}. This list could grow in the future. I'm going to talk about my experience on the Ant team. One of the lessons of that project is that in the open source world, you can't predict

Re: LimitedPrivate and HBase

2011-06-09 Thread Tom White
Looking at current usage in Hadoop, there are only 4 LimitedPrivate references to HBase (the http, io.retry, ipc, and metrics packages in Common), and 2 references to Pig (the two LineRecordReader classes in MapReduce). The other LimitedPrivate references are all to HDFS or MapReduce. Given

Re: LimitedPrivate and HBase

2011-06-09 Thread Suresh Srinivas
AM, Tom White tom.e.wh...@gmail.com wrote: Looking at current usage in Hadoop, there are only 4 LimitedPrivate references to HBase (the http, io.retry, ipc, and metrics packages in Common), and 2 references to Pig (the two LineRecordReader classes in MapReduce). The other LimitedPrivate

Re: LimitedPrivate and HBase

2011-06-09 Thread Konstantin Boudnik
usage in Hadoop, there are only 4 LimitedPrivate references to HBase (the http, io.retry, ipc, and metrics packages in Common), and 2 references to Pig (the two LineRecordReader classes in MapReduce). The other LimitedPrivate references are all to HDFS or MapReduce. Given that Private means

Re: LimitedPrivate and HBase

2011-06-09 Thread Stack
On Mon, Jun 6, 2011 at 1:45 PM, Allen Wittenauer a...@apache.org wrote: On Jun 6, 2011, at 11:34 AM, Stack wrote: On Mon, Jun 6, 2011 at 9:45 AM, Allen Wittenauer a...@apache.org wrote:        I have some concerns over the recent usage of LimitedPrivate being opened up to HBase.  

Re: LimitedPrivate and HBase (thoughts from the build and test world)

2011-06-09 Thread Stack
to Hadoop as projects eligible for LimitedPrivate. {HBase, HDFS, Hive, MapReduce, Pig}. This list could grow in the future. I'm going to talk about my experience on the Ant team. One of the lessons of that project is that in the open source world, you can't predict how your code gets used

Re: LimitedPrivate and HBase (thoughts from the build and test world)

2011-06-09 Thread Milind Bhandarkar
comes with a cost. That is what we are avoiding with LimitedPrivate. The intention was to include the following projects that are closely tied to Hadoop as projects eligible for LimitedPrivate. {HBase, HDFS, Hive, MapReduce, Pig}. This list could grow in the future. I'm going to talk about my

RE: LimitedPrivate and HBase (thoughts from an observer)

2011-06-08 Thread Doug Meil
: Monday, June 06, 2011 9:33 PM To: general@hadoop.apache.org Subject: Re: LimitedPrivate and HBase On Jun 6, 2011, at 6:23 PM, Todd Lipcon wrote: Nah, I just think these meta discussions waste an awful lot of time that's better spent making real progress on the code, or reviewing the complex

Re: LimitedPrivate and HBase

2011-06-08 Thread Andrew Purtell
From: Allen Wittenauer a...@apache.org     OK.  That's make it easier to just -1 changes like this with reasoning such as HBase is not a related project. Then we can go back working on core Hadoop. Seriously? Forget what I said about filing a JIRA (and working on it) to give HttpServer an

Re: LimitedPrivate and HBase (thoughts from an observer)

2011-06-08 Thread Allen Wittenauer
something be marked LimitedPrivate to HBase instead of just making it Public and being done with it?

Re: LimitedPrivate and HBase (thoughts from an observer)

2011-06-08 Thread Dhruba Borthakur
was to include the following projects that are closely tied to Hadoop as projects eligible for LimitedPrivate. {HBase, HDFS, Hive, MapReduce, Pig}. This list could grow in the future. When such projects break because of API change, we can co-ordinate as community and fix the issues

Re: LimitedPrivate and HBase (thoughts from an observer)

2011-06-08 Thread Suresh Srinivas
that are closely tied to Hadoop as projects eligible for LimitedPrivate. {HBase, HDFS, Hive, MapReduce, Pig}. This list could grow in the future. When such projects break because of API change, we can co-ordinate as community and fix the issues. This is not true for some application that we do not know

Re: LimitedPrivate and HBase (thoughts from an observer)

2011-06-08 Thread Eli Collins
public comes with a cost. That is what we are avoiding with LimitedPrivate. The intention was to include the following projects that are closely tied to Hadoop as projects eligible for LimitedPrivate. {HBase, HDFS, Hive, MapReduce, Pig}. This list could grow in the future. When such projects

Re: LimitedPrivate and HBase

2011-06-07 Thread Steve Loughran
On 06/06/2011 05:45 PM, Allen Wittenauer wrote: I have some concerns over the recent usage of LimitedPrivate being opened up to HBase. Shouldn't HBase really be sticking to public APIs rather than poking through some holes? If HBase needs an API, wouldn't other clients as well?

Re: LimitedPrivate and HBase

2011-06-07 Thread Ted Dunning
Not really. It isn't part of any Hadoop release. And no official Hadoop release will run hbase reliably. On Tue, Jun 7, 2011 at 2:09 AM, Steve Loughran ste...@apache.org wrote: On 06/06/2011 05:45 PM, Allen Wittenauer wrote: I have some concerns over the recent usage of

LimitedPrivate and HBase

2011-06-06 Thread Allen Wittenauer
I have some concerns over the recent usage of LimitedPrivate being opened up to HBase. Shouldn't HBase really be sticking to public APIs rather than poking through some holes? If HBase needs an API, wouldn't other clients as well?

Re: LimitedPrivate and HBase

2011-06-06 Thread Todd Lipcon
other clients as well? IMO LimitedPrivate can be used to open an API for a specific project when it's not clear that the API is generally useful, and/or we anticipate the API might be pretty unstable. Marking it LimitedPrivate to HBase gives us the opportunity to talk to the HBase team and say hey

Re: LimitedPrivate and HBase

2011-06-06 Thread Allen Wittenauer
through some holes? If HBase needs an API, wouldn't other clients as well? IMO LimitedPrivate can be used to open an API for a specific project when it's not clear that the API is generally useful, and/or we anticipate the API might be pretty unstable. Marking it LimitedPrivate to HBase gives

Re: LimitedPrivate and HBase

2011-06-06 Thread Allen Wittenauer
On Jun 6, 2011, at 11:34 AM, Stack wrote: On Mon, Jun 6, 2011 at 9:45 AM, Allen Wittenauer a...@apache.org wrote: I have some concerns over the recent usage of LimitedPrivate being opened up to HBase. Shouldn't HBase really be sticking to public APIs rather than poking through

Re: LimitedPrivate and HBase

2011-06-06 Thread Allen Wittenauer
On Jun 6, 2011, at 4:22 PM, Andrew Purtell wrote: Perhaps opening a jira for a cleaner framework for HttpServer extension could be useful? Sure. That's probably what should have happened to begin with rather than the quickly changing the API to a different classification. I was a

Re: LimitedPrivate and HBase

2011-06-06 Thread Todd Lipcon
On Mon, Jun 6, 2011 at 6:05 PM, Allen Wittenauer a...@apache.org wrote: On Jun 6, 2011, at 5:56 PM, Todd Lipcon wrote: Or because this is the sort of thing that could take weeks of discussion or just 5 minutes to unblock HBase from moving on to trunk. I'd rather have the weeks of

Re: LimitedPrivate and HBase

2011-06-06 Thread Allen Wittenauer
On Jun 6, 2011, at 6:08 PM, Todd Lipcon wrote: Let's face it: this happened because it was HBase. If it was almost anyone else, it would have sat there and *that's* the point where I'm mainly concerned. If you want to feel better, take a look at HDFS-941, HDFS-347, and