Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-13 Thread Upayavira
Diversity as has been discussed has generally been about contributors not mentors, but while we should be able to expect mentors to act primarily in the best interests of the ASF not their employer, having some diversity of mentors is going to be a good thing. The flaws in the initial landgrab

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-12 Thread Alex Karasulu
I thought about this a bit last night. If y'all are interested I too could also mentor the project. That should add some diversity to the mentors list. I see value in it and would like to see this community succeed. I'm not affiliated with any company. On Mon, Feb 11, 2013 at 9:23 PM, Eric

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-12 Thread Tom White
This looks like an interesting and useful project. I'd like to volunteer as a mentor on it. Thanks, Tom On 11 Feb 2013 14:56, Kevin Minder kevin.min...@hortonworks.com wrote: Knox Gateway Proposal == Abstract == Knox Gateway is a system that provides a single point of secure access for

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-12 Thread Kevin Minder
Hi Hadrian, Currently I would like to keep the focus on Hadoop services to make sure that we can produce a useful product in a reasonable time frame. We have been careful with the initial code however to treat all Hadoop integrations as modular plugins. So we have and will consider

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-12 Thread Alejandro Abdelnur
Hi Kevin, I'd like to offer joining the project if accepted for incubation. I'm actively working in Hadoop (PMC member) and Oozie (PMC member), helped driving Oozie through incubation and graduation. I'm also the initial developer of hadoop-auth and httpfs (standalone WebHDFS gateway). In, Oozie

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-12 Thread Devaraj Das
Hi folks, Happy to see such a hugely positive response on the proposal. I'll put up a vote tomorrow. Now, on the mentors, I think we have enough at this point and we have also addressed the diversity concern. I had got the confirmation from Chris Douglas and Chris Mattmann yesterday afternoon

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-12 Thread Josh Wills
I thought that the need for diversity referred to the community, not to the mentors. I strongly advocate for newly incubating projects choosing their own initial members (you need only search for the epic thread that resulted from the Crunch Proposal circa May 2012), but it seems like recent data

[PROPOSAL] Knox Hadoop Gateway Project

2013-02-11 Thread Kevin Minder
Knox Gateway Proposal == Abstract == Knox Gateway is a system that provides a single point of secure access for Apache Hadoop clusters. == Proposal == The Knox Gateway (“Gateway” or “Knox”) is a system that provides a single point of authentication and access for Apache Hadoop services in

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-11 Thread Kevin Minder
Hi Bertrand, Currently all of the mentors are affiliated with Hortonworks as well. We can reach out to a number of other people and organizations that are interested in the project to diversify if this is an important consideration at this stage. One other question I have is about creating

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-11 Thread Bertrand Delacretaz
Hi, On Mon, Feb 11, 2013 at 5:07 PM, Kevin Minder kevin.min...@hortonworks.com wrote: ...Currently all of the mentors are affiliated with Hortonworks as well. We can reach out to a number of other people and organizations that are interested in the project to diversify if this is an important

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-11 Thread Eric Sammer
Kevin: Interesting proposal. Can you explain a bit more about what the target use case is? It sounds like there's SSO-ish functionality (presumably a doAs() machine) with integration with directory services, but the proposal also mentions a single point for data and jobs. Is it your intention to

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-11 Thread Kevin Minder
Hi Eric, Let me answer your second question first. Q: Is it your intention to provide job submissions and data ingestion APIs for MR and HDFS, respectively? A: Yes we plan to progress the project to cover all existing ecosystem projects. In addition the project is based on a modular framework

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-11 Thread Alex Karasulu
Hi Kevin, This sounds like a much needed project. I endorse the concept but as Bertrand pointed out you need a bit more diversity. Otherwise I see no problem with moving forward. Good luck! On Mon, Feb 11, 2013 at 4:55 PM, Kevin Minder kevin.min...@hortonworks.comwrote: Knox Gateway Proposal

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-11 Thread Jakob Homan
When do you expect the github to be made available? -Jakob On Mon, Feb 11, 2013 at 10:21 AM, Alex Karasulu akaras...@apache.orgwrote: Hi Kevin, This sounds like a much needed project. I endorse the concept but as Bertrand pointed out you need a bit more diversity. Otherwise I see no

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-11 Thread Eric Sammer
Kevin: Makes complete sense. I'd like to offer to join the project, if it's accepted for incubation. I'm a committer on MRUnit and Flume, and on the PMC for both. I've helped both projects through the incubation phase, and I also know a little bit about this Hadoop thing. ;) Thanks! On Mon,

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-11 Thread Kevin Minder
I hope to have the repo converted from private to public today (2/11). On 2/11/13 1:44 PM, Jakob Homan wrote: When do you expect the github to be made available? -Jakob On Mon, Feb 11, 2013 at 10:21 AM, Alex Karasulu akaras...@apache.orgwrote: Hi Kevin, This sounds like a much needed

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-11 Thread Kevin Minder
The proposal is now hosted on the wiki. http://wiki.apache.org/incubator/knox Currently just the initial proposal. I'll be incorporating feedback/clarifications shortly. On 2/11/13 11:35 AM, Bertrand Delacretaz wrote: Hi, On Mon, Feb 11, 2013 at 5:07 PM, Kevin Minder

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-11 Thread Kevin Minder
The current Knox source is now publicly readable. https://github.com/hortonworks/knox.git On 2/11/13 1:44 PM, Jakob Homan wrote: When do you expect the github to be made available? -Jakob On Mon, Feb 11, 2013 at 10:21 AM, Alex Karasulu akaras...@apache.orgwrote: Hi Kevin, This sounds like

Re: [PROPOSAL] Knox Hadoop Gateway Project

2013-02-11 Thread Hadrian Zbarcea
+1 on the idea. +1 (strong) on the need to increase diversity. I would suggest to open a bit the scope of the project to target other apache projects that act as services. I know it was mentioned, but it sounded to me more like a possibility than a focus. I would also volunteer as a