Re: [DISCUSS] KIP-335 Consider configurations for Kafka Streams

[Richard Yu]

 Hi Matthias,
It would be nice to get your opinions on this.

On Monday, July 9, 2018, 12:17:33 PM GMT+8, Richard Yu 
 wrote:  
 
 Hi all,


Eversince KIP-266 was concluded, there has been a pressing need to migrate 
Kafka Streams as well. For the link, please click here:


https://cwiki.apache.org/confluence/display/KAFKA/KIP-335%3A+Consider+configurations+for+KafkaStreams


Thanks,
Richard Yu  

[DISCUSS] KIP-335 Consider configurations for Kafka Streams

[Richard Yu]

Hi all,


Eversince KIP-266 was concluded, there has been a pressing need to migrate 
Kafka Streams as well. For the link, please click here:


https://cwiki.apache.org/confluence/display/KAFKA/KIP-335%3A+Consider+configurations+for+KafkaStreams


Thanks,
Richard Yu

Re: [VOTE] KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde

[Bill Bejeck]

Thanks for the KIP! +1 from me.

-Bill

On Sun, Jul 8, 2018 at 9:55 PM Ismael Juma  wrote:

> The KIP needs 3 binding votes to pass. I still think we should include the
> details of how things will look like with the headers being passed to
> serializers/deserializers to ensure things actually make sense as a whole.
>
> Ismael
>
>
> On Sun, 8 Jul 2018, 18:31 Chia-Ping Tsai,  wrote:
>
> > All,
> >
> > The 72 hours has passed. The vote result of KIP-313 is shown below.
> >
> > 1 binding vote (Matthias J. Sax)
> > 4 non-binding votes (John Roesler, Richard Yu, vito jeng and Chia-Ping)
> >
> > Cheers,
> > Chia-Ping
> >
> > On 2018/07/05 14:45:01, Chia-Ping Tsai  wrote:
> > > hi all,
> > >
> > > I would like to start voting on "KIP-331 Add default implementation to
> > close() and configure() for Serializer, Deserializer and Serde"
> > >
> > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-331+Add+default+implementation+to+close%28%29+and+configure%28%29+for+Serializer%2C+Deserializer+and+Serde
> > >
> > > Cheers,
> > > Chia-Ping
> > >
> >
>

Re: [VOTE] KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde

[Ismael Juma]

The KIP needs 3 binding votes to pass. I still think we should include the
details of how things will look like with the headers being passed to
serializers/deserializers to ensure things actually make sense as a whole.

Ismael


On Sun, 8 Jul 2018, 18:31 Chia-Ping Tsai,  wrote:

> All,
>
> The 72 hours has passed. The vote result of KIP-313 is shown below.
>
> 1 binding vote (Matthias J. Sax)
> 4 non-binding votes (John Roesler, Richard Yu, vito jeng and Chia-Ping)
>
> Cheers,
> Chia-Ping
>
> On 2018/07/05 14:45:01, Chia-Ping Tsai  wrote:
> > hi all,
> >
> > I would like to start voting on "KIP-331 Add default implementation to
> close() and configure() for Serializer, Deserializer and Serde"
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-331+Add+default+implementation+to+close%28%29+and+configure%28%29+for+Serializer%2C+Deserializer+and+Serde
> >
> > Cheers,
> > Chia-Ping
> >
>

Re: [VOTE] KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde

[Chia-Ping Tsai]

All,

The 72 hours has passed. The vote result of KIP-313 is shown below.

1 binding vote (Matthias J. Sax)
4 non-binding votes (John Roesler, Richard Yu, vito jeng and Chia-Ping)

Cheers,
Chia-Ping

On 2018/07/05 14:45:01, Chia-Ping Tsai  wrote: 
> hi all,
> 
> I would like to start voting on "KIP-331 Add default implementation to 
> close() and configure() for Serializer, Deserializer and Serde"
> 
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-331+Add+default+implementation+to+close%28%29+and+configure%28%29+for+Serializer%2C+Deserializer+and+Serde
> 
> Cheers,
> Chia-Ping
> 

[VOTE] 1.1.1 RC3

[Dong Lin]

Hello Kafka users, developers and client-developers,

This is the fourth candidate for release of Apache Kafka 1.1.1.

Apache Kafka 1.1.1 is a bug-fix release for the 1.1 branch that was first
released with 1.1.0 about 3 months ago. We have fixed about 25 issues since
that release. A few of the more significant fixes include:

KAFKA-6925  - Fix memory
leak in StreamsMetricsThreadImpl
KAFKA-6937  - In-sync
replica delayed during fetch if replica throttle is exceeded
KAFKA-6917  - Process txn
completion asynchronously to avoid deadlock
KAFKA-6893  - Create
processors before starting acceptor to avoid ArithmeticException
KAFKA-6870  -
Fix ConcurrentModificationException in SampledStat
KAFKA-6878  - Fix
NullPointerException when querying global state store
KAFKA-6879  - Invoke
session init callbacks outside lock to avoid Controller deadlock
KAFKA-6857  - Prevent
follower from truncating to the wrong offset if undefined leader epoch is
requested
KAFKA-6854  - Log cleaner
fails with transaction markers that are deleted during clean
KAFKA-6747  - Check
whether there is in-flight transaction before aborting transaction
KAFKA-6748  - Double
check before scheduling a new task after the punctuate call
KAFKA-6739  -
Fix IllegalArgumentException when down-converting from V2 to V0/V1
KAFKA-6728  -
Fix NullPointerException when instantiating the HeaderConverter

Kafka 1.1.1 release plan:
https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+1.1.1

Release notes for the 1.1.1 release:
http://home.apache.org/~lindong/kafka-1.1.1-rc3/RELEASE_NOTES.html

*** Please download, test and vote by Thursday, July 12, 12pm PT ***

Kafka's KEYS file containing PGP keys we use to sign the release:
http://kafka.apache.org/KEYS

* Release artifacts to be voted upon (source and binary):
http://home.apache.org/~lindong/kafka-1.1.1-rc3/

* Maven artifacts to be voted upon:
https://repository.apache.org/content/groups/staging/

* Javadoc:
http://home.apache.org/~lindong/kafka-1.1.1-rc3/javadoc/

* Tag to be voted upon (off 1.1 branch) is the 1.1.1-rc3 tag:
https://github.com/apache/kafka/tree/1.1.1-rc3

* Documentation:
http://kafka.apache.org/11/documentation.html

* Protocol:
http://kafka.apache.org/11/protocol.html

* Successful Jenkins builds for the 1.1 branch:
Unit/integration tests: *https://builds.apache.org/job/kafka-1.1-jdk7/162
*
System tests:
https://jenkins.confluent.io/job/system-test-kafka/job/1.1/156/

Please test and verify the release artifacts and submit a vote for this RC,
or report any issues so we can fix them and get a new RC out ASAP. Although
this release vote requires PMC votes to pass, testing, votes, and bug
reports are valuable and appreciated from everyone.


Regards,
Dong

Re: [kafka-clients] [VOTE] 1.0.2 RC1

[Matthias J. Sax]

This vote passes with 6 +1 votes (3 bindings) and no 0 or -1 votes.

+1 votes PMC Members:
* Ismael
* Jun
* Rajini

Committers:
* Harash
* Matthias

Community:
* Manikumar

0 votes
* No votes

-1 votes
* No votes

Vote thread:
http://search-hadoop.com/m/uyzND1jdiCf2ByEaI1=+VOTE+1+0+2+RC1

I'll continue with the release process and the release announcement will
follow in the next few days.


-Matthias

On 7/3/18 8:54 AM, Rajini Sivaram wrote:
> Hi Matthias,
> 
> +1 (binding)
> 
> Thank you for running the release.
> 
> Ran quick start with binary, tests with source, checked javadocs.
> 
> Regards,
> 
> Rajini
> 
> On Mon, Jul 2, 2018 at 9:34 PM, Harsha  > wrote:
> 
> +1.
>     
> 1) Ran unit tests
> 2) 3 node cluster , tested basic operations.
> 
> Thanks,
> Harsha
> 
> On Mon, Jul 2nd, 2018 at 11:57 AM, Jun Rao  > wrote:
> 
> >
> >
> >
> > Hi, Matthias,
> >
> > Thanks for the running the release. Verified quickstart on scala 2.12
> > binary. +1
> >
> > Jun
> >
> > On Fri, Jun 29, 2018 at 10:02 PM, Matthias J. Sax <
> matth...@confluent.io  >
> >
> > wrote:
> >
> > > Hello Kafka users, developers and client-developers,
> > >
> > > This is the second candidate for release of Apache Kafka 1.0.2.
> > >
> > > This is a bug fix release addressing 27 tickets:
> > >
> https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+1.0.2
> 
> > >
> > > Release notes for the 1.0.2 release:
> > > http://home.apache.org/~mjsax/kafka-1.0.2-rc1/RELEASE_NOTES.html
> 
> > >
> > > *** Please download, test and vote by end of next week (7/6/18).
> > >
> > > Kafka's KEYS file containing PGP keys we use to sign the release:
> > > http://kafka.apache.org/KEYS
> > >
> > > * Release artifacts to be voted upon (source and binary):
> > > http://home.apache.org/~mjsax/kafka-1.0.2-rc1/
> 
> > >
> > > * Maven artifacts to be voted upon:
> > > https://repository.apache.org/content/groups/staging/
> 
> > >
> > > * Javadoc:
> > > http://home.apache.org/~mjsax/kafka-1.0.2-rc1/javadoc/
> 
> > >
> > > * Tag to be voted upon (off 1.0 branch) is the 1.0.2 tag:
> > > https://github.com/apache/kafka/releases/tag/1.0.2-rc1
> 
> > >
> > > * Documentation:
> > > http://kafka.apache.org/10/documentation.html
> 
> > >
> > > * Protocol:
> > > http://kafka.apache.org/10/protocol.html
> 
> > >
> > > * Successful Jenkins builds for the 1.0 branch:
> > > Unit/integration tests:
> https://builds.apache.org/job/kafka-1.0-jdk7/214/
> 
> >
> > > System tests:
> > > https://jenkins.confluent.io/job/system-test-kafka/job/1.0/225/
> 
> > >
> > > /**
> > >
> > > Thanks,
> > > -Matthias
> > >
> > >
> > > --
> > > You received this message because you are subscribed to the Google
> > Groups
> > > "kafka-clients" group.
> > > To unsubscribe from this group and stop receiving emails from
> it, send
> > an
> > > email to kafka-clients+ unsubscr...@googlegroups.com
> .
> > > To post to this group, send email to
> kafka-clie...@googlegroups.com .
> > > Visit this group at
> https://groups.google.com/group/kafka-clients
> .
> > > To view this discussion on the web visit
> https://groups.google.com/d/
> > >
> msgid/kafka-clients/ca183ad4-9285-e423-3850-261f9dfec044%40confluent.io
> .
> >
> > > For more options, visit https://groups.google.com/d/optout
> .
> > >
> >
> >
> >
> >
> 
> 



signature.asc
Description: OpenPGP digital signature

Re: [kafka-clients] [VOTE] 1.0.2 RC1

[Matthias J. Sax]

+1

-Matthias

On 7/3/18 8:54 AM, Rajini Sivaram wrote:
> Hi Matthias,
> 
> +1 (binding)
> 
> Thank you for running the release.
> 
> Ran quick start with binary, tests with source, checked javadocs.
> 
> Regards,
> 
> Rajini
> 
> On Mon, Jul 2, 2018 at 9:34 PM, Harsha  > wrote:
> 
> +1.
>     
> 1) Ran unit tests
> 2) 3 node cluster , tested basic operations.
> 
> Thanks,
> Harsha
> 
> On Mon, Jul 2nd, 2018 at 11:57 AM, Jun Rao  > wrote:
> 
> >
> >
> >
> > Hi, Matthias,
> >
> > Thanks for the running the release. Verified quickstart on scala 2.12
> > binary. +1
> >
> > Jun
> >
> > On Fri, Jun 29, 2018 at 10:02 PM, Matthias J. Sax <
> matth...@confluent.io  >
> >
> > wrote:
> >
> > > Hello Kafka users, developers and client-developers,
> > >
> > > This is the second candidate for release of Apache Kafka 1.0.2.
> > >
> > > This is a bug fix release addressing 27 tickets:
> > >
> https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+1.0.2
> 
> > >
> > > Release notes for the 1.0.2 release:
> > > http://home.apache.org/~mjsax/kafka-1.0.2-rc1/RELEASE_NOTES.html
> 
> > >
> > > *** Please download, test and vote by end of next week (7/6/18).
> > >
> > > Kafka's KEYS file containing PGP keys we use to sign the release:
> > > http://kafka.apache.org/KEYS
> > >
> > > * Release artifacts to be voted upon (source and binary):
> > > http://home.apache.org/~mjsax/kafka-1.0.2-rc1/
> 
> > >
> > > * Maven artifacts to be voted upon:
> > > https://repository.apache.org/content/groups/staging/
> 
> > >
> > > * Javadoc:
> > > http://home.apache.org/~mjsax/kafka-1.0.2-rc1/javadoc/
> 
> > >
> > > * Tag to be voted upon (off 1.0 branch) is the 1.0.2 tag:
> > > https://github.com/apache/kafka/releases/tag/1.0.2-rc1
> 
> > >
> > > * Documentation:
> > > http://kafka.apache.org/10/documentation.html
> 
> > >
> > > * Protocol:
> > > http://kafka.apache.org/10/protocol.html
> 
> > >
> > > * Successful Jenkins builds for the 1.0 branch:
> > > Unit/integration tests:
> https://builds.apache.org/job/kafka-1.0-jdk7/214/
> 
> >
> > > System tests:
> > > https://jenkins.confluent.io/job/system-test-kafka/job/1.0/225/
> 
> > >
> > > /**
> > >
> > > Thanks,
> > > -Matthias
> > >
> > >
> > > --
> > > You received this message because you are subscribed to the Google
> > Groups
> > > "kafka-clients" group.
> > > To unsubscribe from this group and stop receiving emails from
> it, send
> > an
> > > email to kafka-clients+ unsubscr...@googlegroups.com
> .
> > > To post to this group, send email to
> kafka-clie...@googlegroups.com .
> > > Visit this group at
> https://groups.google.com/group/kafka-clients
> .
> > > To view this discussion on the web visit
> https://groups.google.com/d/
> > >
> msgid/kafka-clients/ca183ad4-9285-e423-3850-261f9dfec044%40confluent.io
> .
> >
> > > For more options, visit https://groups.google.com/d/optout
> .
> > >
> >
> >
> >
> >
> 
> 



signature.asc
Description: OpenPGP digital signature

[jira] [Resolved] (KAFKA-6335) SimpleAclAuthorizerTest#testHighConcurrencyModificationOfResourceAcls fails intermittently

[Ted Yu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/KAFKA-6335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu resolved KAFKA-6335.
---
Resolution: Cannot Reproduce

> SimpleAclAuthorizerTest#testHighConcurrencyModificationOfResourceAcls fails 
> intermittently
> --
>
> Key: KAFKA-6335
> URL: https://issues.apache.org/jira/browse/KAFKA-6335
> Project: Kafka
>  Issue Type: Test
>Reporter: Ted Yu
>Assignee: Manikumar
>Priority: Major
>
> From 
> https://builds.apache.org/job/kafka-pr-jdk9-scala2.12/3045/testReport/junit/kafka.security.auth/SimpleAclAuthorizerTest/testHighConcurrencyModificationOfResourceAcls/
>  :
> {code}
> java.lang.AssertionError: expected acls Set(User:36 has Allow permission for 
> operations: Read from hosts: *, User:7 has Allow permission for operations: 
> Read from hosts: *, User:21 has Allow permission for operations: Read from 
> hosts: *, User:39 has Allow permission for operations: Read from hosts: *, 
> User:43 has Allow permission for operations: Read from hosts: *, User:3 has 
> Allow permission for operations: Read from hosts: *, User:35 has Allow 
> permission for operations: Read from hosts: *, User:15 has Allow permission 
> for operations: Read from hosts: *, User:16 has Allow permission for 
> operations: Read from hosts: *, User:22 has Allow permission for operations: 
> Read from hosts: *, User:26 has Allow permission for operations: Read from 
> hosts: *, User:11 has Allow permission for operations: Read from hosts: *, 
> User:38 has Allow permission for operations: Read from hosts: *, User:8 has 
> Allow permission for operations: Read from hosts: *, User:28 has Allow 
> permission for operations: Read from hosts: *, User:32 has Allow permission 
> for operations: Read from hosts: *, User:25 has Allow permission for 
> operations: Read from hosts: *, User:41 has Allow permission for operations: 
> Read from hosts: *, User:44 has Allow permission for operations: Read from 
> hosts: *, User:48 has Allow permission for operations: Read from hosts: *, 
> User:2 has Allow permission for operations: Read from hosts: *, User:9 has 
> Allow permission for operations: Read from hosts: *, User:14 has Allow 
> permission for operations: Read from hosts: *, User:46 has Allow permission 
> for operations: Read from hosts: *, User:13 has Allow permission for 
> operations: Read from hosts: *, User:5 has Allow permission for operations: 
> Read from hosts: *, User:29 has Allow permission for operations: Read from 
> hosts: *, User:45 has Allow permission for operations: Read from hosts: *, 
> User:6 has Allow permission for operations: Read from hosts: *, User:37 has 
> Allow permission for operations: Read from hosts: *, User:23 has Allow 
> permission for operations: Read from hosts: *, User:19 has Allow permission 
> for operations: Read from hosts: *, User:24 has Allow permission for 
> operations: Read from hosts: *, User:17 has Allow permission for operations: 
> Read from hosts: *, User:34 has Allow permission for operations: Read from 
> hosts: *, User:12 has Allow permission for operations: Read from hosts: *, 
> User:42 has Allow permission for operations: Read from hosts: *, User:4 has 
> Allow permission for operations: Read from hosts: *, User:47 has Allow 
> permission for operations: Read from hosts: *, User:18 has Allow permission 
> for operations: Read from hosts: *, User:31 has Allow permission for 
> operations: Read from hosts: *, User:49 has Allow permission for operations: 
> Read from hosts: *, User:33 has Allow permission for operations: Read from 
> hosts: *, User:1 has Allow permission for operations: Read from hosts: *, 
> User:27 has Allow permission for operations: Read from hosts: *) but got 
> Set(User:36 has Allow permission for operations: Read from hosts: *, User:7 
> has Allow permission for operations: Read from hosts: *, User:21 has Allow 
> permission for operations: Read from hosts: *, User:39 has Allow permission 
> for operations: Read from hosts: *, User:43 has Allow permission for 
> operations: Read from hosts: *, User:3 has Allow permission for operations: 
> Read from hosts: *, User:35 has Allow permission for operations: Read from 
> hosts: *, User:15 has Allow permission for operations: Read from hosts: *, 
> User:16 has Allow permission for operations: Read from hosts: *, User:22 has 
> Allow permission for operations: Read from hosts: *, User:26 has Allow 
> permission for operations: Read from hosts: *, User:11 has Allow permission 
> for operations: Read from hosts: *, User:38 has Allow permission for 
> operations: Read from hosts: *, User:8 has Allow permission for operations: 
> Read from hosts: *, User:28 has Allow permission for operations: Read from 
> hosts: *, User:32 has Allow permission for