Re: TL;DR; of the first KIP hangout

2015-03-08 Thread Jay Kreps
I took a pass on these and tried to update our summary table based on
Gwen's summary. There are a couple that are just waiting on the owner to
hold their vote.

There are a number that are still very sparse on detail. I really want to
encourage everyone to take a look at the python PEPs, I think they are
doing a great job of doing high quality design docs. I really think they do
a good job of writing at a level where any advanced python user can come
away from the document understanding the proposed change, the problem it
solves, etc.
  https://www.python.org/dev/peps/pep-0238/
I know this stuff is annoying to do when you are the one doing the proposal
as it slows you down and requires writing. But I think getting the new
proposed state into all the other committers heads is really valuable to do
and this will actually be more efficient and lead to much higher quality.
By having us all thinking about all the up coming changes I think we will
get to an end-state that makes a lot more sense. Thanks!

Current KIP status:
KIP
State
KIP-1 - Remove support of request.required.acks
https://cwiki.apache.org/confluence/display/KAFKA/KIP-1+-+Remove+support+of+request.required.acks
ClosedKIP-2 - Refactor brokers to allow listening on multiple ports and IPs
https://cwiki.apache.org/confluence/display/KAFKA/KIP-2+-+Refactor+brokers+to+allow+listening+on+multiple+ports+and+IPs
DiscussKIP-3 - Mirror Maker Enhancement
https://cwiki.apache.org/confluence/display/KAFKA/KIP-3+-+Mirror+Maker+Enhancement
ClosedKIP-4 - Command line and centralized administrative operations
https://cwiki.apache.org/confluence/display/KAFKA/KIP-4+-+Command+line+and+centralized+administrative+operationsNeeds
more detailKIP-5 - Broker Configuration Management
https://cwiki.apache.org/confluence/display/KAFKA/KIP-5+-+Broker+Configuration+ManagementNeeds
more detailKIP-6 - New reassignment partition logic for rebalancing
https://cwiki.apache.org/confluence/display/KAFKA/KIP-6+-+New+reassignment+partition+logic+for+rebalancingNeeds
more detailKIP-7 - Security - IP Filtering
https://cwiki.apache.org/confluence/display/KAFKA/KIP-7+-+Security+-+IP+Filtering
DiscussKIP-8 - Add a flush method to the producer API
https://cwiki.apache.org/confluence/display/KAFKA/KIP-8+-+Add+a+flush+method+to+the+producer+API
ClosedKIP-12 - Kafka Sasl/Kerberos implementation
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=51809888
DiscussKIP-13 - Quota Design
https://cwiki.apache.org/confluence/display/KAFKA/KIP-13+-+QuotasDiscussKIP-14
- Tools standardization
https://cwiki.apache.org/confluence/display/KAFKA/KIP-14+-+Tools+StandardizationNeeds
more detailKIP-15 - Add a close method with a timeout in the producer
https://cwiki.apache.org/confluence/display/KAFKA/KIP-15+-+Add+a+close+method+with+a+timeout+in+the+producerNeeds
more detail

On Tue, Mar 3, 2015 at 3:44 PM, Joel Koshy jjkosh...@gmail.com wrote:

 Thanks Gwen!

 On Tue, Mar 03, 2015 at 12:12:24PM -0800, Gwen Shapira wrote:
  Hi,
 
  I put together a (very) short summary of the discussion and decisions:
 
  KIPs:
  We reviewed the list of KIPs posted here:
 
 https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals
 
  * KIP-2: Ready for formal vote
  * KIP-3: Discussion closed. There’s a new KIP (14) for standardizing
  command line options.
  * KIP-4: Need to think about and document APIs in detail, update KIP
  and discuss.
  * KIP-5: Need some fleshing out in the KIP - open questions about how
  exactly it will be used
  * KIP-6: Everyone should go back to review the KIP.
  * KIP-7:  Ready for vote
  * KIP-12: Sriharsha will put in a blueprint for discussion
  * KIP-13: Need more discussion in mailing list about specific details
 
  * Ewen had good suggestion on how to fix the port binding in tests.
  * Create KIP to remove JDK6 support
 
  Gwen




Re: TL;DR; of the first KIP hangout

2015-03-03 Thread Guozhang Wang
Thanks Gwen!

One thing that I forgot to mention during the meeting is that we need to
create a KIP for another producer API change also (KAFKA-1660). The code is
almost ready and we just need to figure out some details about interacting
with concurrent flush() calls.

Guozhang

On Tue, Mar 3, 2015 at 12:12 PM, Gwen Shapira gshap...@cloudera.com wrote:

 Hi,

 I put together a (very) short summary of the discussion and decisions:

 KIPs:
 We reviewed the list of KIPs posted here:

 https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals

 * KIP-2: Ready for formal vote
 * KIP-3: Discussion closed. There’s a new KIP (14) for standardizing
 command line options.
 * KIP-4: Need to think about and document APIs in detail, update KIP
 and discuss.
 * KIP-5: Need some fleshing out in the KIP - open questions about how
 exactly it will be used
 * KIP-6: Everyone should go back to review the KIP.
 * KIP-7:  Ready for vote
 * KIP-12: Sriharsha will put in a blueprint for discussion
 * KIP-13: Need more discussion in mailing list about specific details

 * Ewen had good suggestion on how to fix the port binding in tests.
 * Create KIP to remove JDK6 support

 Gwen




-- 
-- Guozhang


TL;DR; of the first KIP hangout

2015-03-03 Thread Gwen Shapira
Hi,

I put together a (very) short summary of the discussion and decisions:

KIPs:
We reviewed the list of KIPs posted here:
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals

* KIP-2: Ready for formal vote
* KIP-3: Discussion closed. There’s a new KIP (14) for standardizing
command line options.
* KIP-4: Need to think about and document APIs in detail, update KIP
and discuss.
* KIP-5: Need some fleshing out in the KIP - open questions about how
exactly it will be used
* KIP-6: Everyone should go back to review the KIP.
* KIP-7:  Ready for vote
* KIP-12: Sriharsha will put in a blueprint for discussion
* KIP-13: Need more discussion in mailing list about specific details

* Ewen had good suggestion on how to fix the port binding in tests.
* Create KIP to remove JDK6 support

Gwen


Re: TL;DR; of the first KIP hangout

2015-03-03 Thread Jay Kreps
Thanks Gwen!

-Jay

On Tue, Mar 3, 2015 at 12:12 PM, Gwen Shapira gshap...@cloudera.com wrote:

 Hi,

 I put together a (very) short summary of the discussion and decisions:

 KIPs:
 We reviewed the list of KIPs posted here:

 https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals

 * KIP-2: Ready for formal vote
 * KIP-3: Discussion closed. There’s a new KIP (14) for standardizing
 command line options.
 * KIP-4: Need to think about and document APIs in detail, update KIP
 and discuss.
 * KIP-5: Need some fleshing out in the KIP - open questions about how
 exactly it will be used
 * KIP-6: Everyone should go back to review the KIP.
 * KIP-7:  Ready for vote
 * KIP-12: Sriharsha will put in a blueprint for discussion
 * KIP-13: Need more discussion in mailing list about specific details

 * Ewen had good suggestion on how to fix the port binding in tests.
 * Create KIP to remove JDK6 support

 Gwen



Re: TL;DR; of the first KIP hangout

2015-03-03 Thread Joel Koshy
Thanks Gwen!

On Tue, Mar 03, 2015 at 12:12:24PM -0800, Gwen Shapira wrote:
 Hi,
 
 I put together a (very) short summary of the discussion and decisions:
 
 KIPs:
 We reviewed the list of KIPs posted here:
 https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals
 
 * KIP-2: Ready for formal vote
 * KIP-3: Discussion closed. There’s a new KIP (14) for standardizing
 command line options.
 * KIP-4: Need to think about and document APIs in detail, update KIP
 and discuss.
 * KIP-5: Need some fleshing out in the KIP - open questions about how
 exactly it will be used
 * KIP-6: Everyone should go back to review the KIP.
 * KIP-7:  Ready for vote
 * KIP-12: Sriharsha will put in a blueprint for discussion
 * KIP-13: Need more discussion in mailing list about specific details
 
 * Ewen had good suggestion on how to fix the port binding in tests.
 * Create KIP to remove JDK6 support
 
 Gwen