[GitHub] kafka pull request #4094: MINOR: Correct KafkaProducer Javadoc spelling of p...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4094 ---

[GitHub] kafka pull request #4097: MINOR: Update docs with regards to max.in.flight a...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4097 MINOR: Update docs with regards to max.in.flight and idempotent producer The idempotent producer doesn't change that setting any more and the accepted range has changed. You can merge this pull re

Jenkins build is back to normal : kafka-trunk-jdk9 #135

See

[jira] [Created] (KAFKA-6089) Transient failure in kafka.network.SocketServerTest.configureNewConnectionException

Rajini Sivaram created KAFKA-6089: - Summary: Transient failure in kafka.network.SocketServerTest.configureNewConnectionException Key: KAFKA-6089 URL: https://issues.apache.org/jira/browse/KAFKA-6089 P

Build failed in Jenkins: kafka-trunk-jdk7 #2902

See Changes: [ismael] MINOR: Correct KafkaProducer Javadoc spelling of property -- [...truncated 1.83 MB...] org.apache.kafka.streams.KafkaStreamsTest > testStateGlobalThr

Build failed in Jenkins: kafka-trunk-jdk8 #2148

See Changes: [ismael] MINOR: Correct KafkaProducer Javadoc spelling of property -- [...truncated 3.30 MB...] kafka.utils.json.JsonValueTest > testDecodeBoolean STARTED k

[jira] [Created] (KAFKA-6090) Upgrade the Scala recommendation to 2.12

Lionel Cons created KAFKA-6090: -- Summary: Upgrade the Scala recommendation to 2.12 Key: KAFKA-6090 URL: https://issues.apache.org/jira/browse/KAFKA-6090 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-204 : adding records deletion operation to the new Admin Client API

@Colin Yes you are right I'll update the KIP-204 mentioning the related ACL permission DELETE on TOPIC @Dong @Ismael Considering future improvements on this, it makes sense to me using a class instead of a Long. Maybe the name could be just "DeleteRecords" (as "NewPartitions") having a dele

[GitHub] kafka pull request #4098: verifiable_consumer: fix var typo in assert

GitHub user edenhill opened a pull request: https://github.com/apache/kafka/pull/4098 verifiable_consumer: fix var typo in assert @hachikuji You can merge this pull request into a Git repository by running: $ git pull https://github.com/edenhill/kafka verfcons_var_fix Alterna

[GitHub] kafka pull request #1542: KAFKA-3892 prune metadata response to subscribed t...

Github user iamnoah closed the pull request at: https://github.com/apache/kafka/pull/1542 ---

[GitHub] kafka pull request #4081: KAFKA-6069: Properly tag KafkaStreams metrics with...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4081 ---

[jira] [Resolved] (KAFKA-6069) Streams metrics tagged incorrectly

[ https://issues.apache.org/jira/browse/KAFKA-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-6069. --- Resolution: Fixed Fix Version/s: 1.0.1 1.1.0 Issue resolved by pull request

Build failed in Jenkins: kafka-trunk-jdk9 #136

See Changes: [damian.guy] KAFKA-6069: Properly tag KafkaStreams metrics with the client id. -- [...truncated 1.02 MB...] org.apache.kafka.clients.producer.MockProducerTest

Re: [kafka-clients] [VOTE] 1.0.0 RC2

just a minor observation: Kafka binary contains two versions of javasist library (javassist-3.20.0-GA.jar, javassist-3.21.0-GA.jar). This dependency is coming from connect project. On Thu, Oct 19, 2017 at 2:16 AM, Guozhang Wang wrote: > Thanks for pointing out, Jun, Ismael. > > Will update the s

Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

I think it would be helpful to clarify what happens if consumers rejoin an empty group. I would presume that the expiration timer is stopped and reset back to offsets.retention.minutes when it is empty again but the KIP doesn't say. On Wed, 2017-10-18 at 16:45 -0700, Vahid S Hashemian wrote: H

Doubt about developing a kafka connect with avro

Hello to everyone, First I would like to give thanks in advantage to everyone willing to help my in this issue. I have been coding a custom kafka connector that read from the twitter api and write in a kafka topic, I have been trying to use avro coding to write those message and i found that it w

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

Github user efeg closed the pull request at: https://github.com/apache/kafka/pull/4093 ---

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

GitHub user efeg reopened a pull request: https://github.com/apache/kafka/pull/4093 KAFKA-6083: The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found. You can merge this pull request into a Git repository by running: $

Build failed in Jenkins: kafka-1.0-jdk7 #43

See Changes: [damian.guy] KAFKA-6069: Properly tag KafkaStreams metrics with the client id. -- [...truncated 368.56 KB...] kafka.server.epoch.LeaderEpochFileCacheTest > shou

[GitHub] kafka pull request #4098: verifiable_consumer: fix var typo in assert

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4098 ---

[GitHub] kafka pull request #4099: MINOR: Use ObjectName.quote instead of URL-encodin...

GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/4099 MINOR: Use ObjectName.quote instead of URL-encoding for JMX metric tags You can merge this pull request into a Git repository by running: $ git pull https://github.com/rajinisivaram/kafk

[GitHub] kafka-site issue #100: MINOR: Pinterest link correction

Github user manjuapu commented on the issue: https://github.com/apache/kafka-site/pull/100 @guozhangwang I am working on arranging the logos on powered-by page. It is still work in progress in this PR. ---

Build failed in Jenkins: kafka-trunk-jdk7 #2903

See Changes: [damian.guy] KAFKA-6069: Properly tag KafkaStreams metrics with the client id. -- [...truncated 1.83 MB...] org.apache.kafka.streams.KafkaStreamsTest > shou

Jenkins build is back to normal : kafka-1.0-jdk7 #44

See

Jenkins build is back to normal : kafka-trunk-jdk8 #2149

See

Build failed in Jenkins: kafka-trunk-jdk9 #137

See Changes: [jason] MINOR: Fix var typo in verifiable_consumer assertion -- [...truncated 1.41 MB...] kafka.controller.PartitionStateMachineTest > testInvalidNonexistentP

Jenkins build is back to normal : kafka-trunk-jdk7 #2904

See

Re: [DISCUSS] KIP-209 Connection String Support

Do I have to do anything here? I wonder how long I need to wait before proposing the vote. On Tue, Oct 17, 2017 at 1:17 PM, Clebert Suconic wrote: > I had these updates in already... you just changed the names at the > string.. but it was pretty much the same thing I think... I had taken > you s

Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

Thanks Thomas for the suggestion. I updated the KIP to explicitly describe that situation. --Vahid From: Thomas Becker To: "dev@kafka.apache.org" Date: 10/19/2017 08:23 AM Subject:Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets I think it would

Build failed in Jenkins: kafka-trunk-jdk8 #2150

See Changes: [jason] MINOR: Fix var typo in verifiable_consumer assertion -- [...truncated 1.78 MB...] org.apache.kafka.streams.kstream.internals.KTableAggregateTest > t

Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

Thanks Ted. I filled out that section. --Vahid From: Ted Yu To: dev@kafka.apache.org Date: 10/18/2017 04:59 PM Subject:Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets Please fill out 'Rejected Alternatives' section. Thanks On Wed, Oct 18, 2017

Re: [DISCUSS] KIP 145 - Expose Record Headers in Kafka Connect

@rhauch Here is the previous discussion thread, just reigniting so we can discuss against the original kip thread Cheers Mike Sent from my iPhone > On 5 May 2017, at 02:21, Michael Pearce wrote: > > Hi Ewen, > > Did you get a chance to look at the updated sample showing the idea? > > Did

[GitHub] kafka-site pull request #100: MINOR: Pinterest link correction

Github user asfgit closed the pull request at: https://github.com/apache/kafka-site/pull/100 ---

[GitHub] kafka-site issue #100: MINOR: Pinterest link correction

Github user guozhangwang commented on the issue: https://github.com/apache/kafka-site/pull/100 LGTM. Merged to asf-site. ---

[GitHub] kafka pull request #4097: MINOR: Update docs with regards to max.in.flight a...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4097 ---

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

Github user efeg closed the pull request at: https://github.com/apache/kafka/pull/4093 ---

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

GitHub user efeg reopened a pull request: https://github.com/apache/kafka/pull/4093 KAFKA-6083: The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found. You can merge this pull request into a Git repository by running: $

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

Github user efeg closed the pull request at: https://github.com/apache/kafka/pull/4093 ---

[jira] [Created] (KAFKA-6091) Authorization API is called hundred's of times when there are no privileges

kalyan kumar kalvagadda created KAFKA-6091: -- Summary: Authorization API is called hundred's of times when there are no privileges Key: KAFKA-6091 URL: https://issues.apache.org/jira/browse/KAFKA-6091

[jira] [Created] (KAFKA-6092) Time passed in punctuate call is currentTime, not punctuate schedule time.

Stephane Maarek created KAFKA-6092: -- Summary: Time passed in punctuate call is currentTime, not punctuate schedule time. Key: KAFKA-6092 URL: https://issues.apache.org/jira/browse/KAFKA-6092 Project

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

GitHub user efeg reopened a pull request: https://github.com/apache/kafka/pull/4093 KAFKA-6083: The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found. You can merge this pull request into a Git repository by running: $

Build failed in Jenkins: kafka-trunk-jdk7 #2905

See Changes: [jason] MINOR: Update docs with regards to max.in.flight and idempotent producer -- [...truncated 1.39 MB...] org.apache.kafka.common.security.JaasContextTest

[GitHub] kafka pull request #4092: KAFKA-6087: Scanning plugin.path needs to support ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4092 ---

[jira] [Resolved] (KAFKA-6087) Scanning plugin.path needs to support relative symlinks

[ https://issues.apache.org/jira/browse/KAFKA-6087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-6087. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 409

Build failed in Jenkins: kafka-1.0-jdk7 #45

See Changes: [jason] MINOR: Update docs with regards to max.in.flight and idempotent producer -- [...truncated 1.81 MB...] org.apache.kafka.streams.TopologyTest > singleSour

Jenkins build is back to normal : kafka-trunk-jdk9 #138

See

Build failed in Jenkins: kafka-trunk-jdk9 #139

See Changes: [me] KAFKA-6087: Scanning plugin.path needs to support relative symlinks. -- Started by an SCM change [EnvInject] - Loading node environment variables. Buildin

Re: [VOTE] 1.0.0 RC2

Hi Guozhang, I was able to successfully build the jars on Ubuntu (Java 8 and 9) and Mac (Java 8) and run the quickstart (incl. streams quickstart). On Windows 10, build worked fine with both Java 8 and 9. Quickstarts worked well too, except for streams quickstart, where the following command

Build failed in Jenkins: kafka-trunk-jdk7 #2906

See Changes: [me] KAFKA-6087: Scanning plugin.path needs to support relative symlinks. -- [...truncated 379.33 KB...] kafka.security.auth.SimpleAclAuthorizerTest > testAcl

Jenkins build is back to normal : kafka-trunk-jdk8 #2151

See

Jenkins build is back to normal : kafka-1.0-jdk7 #46

See

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

Thanks for the KIP. Are you familiar with KIP-161? https://cwiki.apache.org/confluence/display/KAFKA/KIP-161%3A+streams+deserialization+exception+handlers I thinks, we should align the design (parameter naming, return types, class names etc) of KIP-210 to KIP-161 to get a unified user experience

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

Ah good idea. Hmmm. I can line up the naming and return type but I’m not sure if I can get my hands on the context and the record itself without other changes. Let me dig in and follow up here tomorrow. On Thu, Oct 19, 2017 at 7:14 PM Matthias J. Sax wrote: > Thanks for the KIP. > > Are you fami

Build failed in Jenkins: kafka-trunk-jdk7 #2907

See -- [...truncated 380.30 KB...] kafka.api.SaslPlainSslEndToEndAuthorizationTest > testNoProduceWithoutDescribeAcl PASSED kafka.api.TransactionsTest > testBasicTransactions STARTED k

Re: Doubt about developing a kafka connect with avro

Sounds like you're using Kafka Connect and trying to write a source connector. The Connect framework separates responsibilities: 1. Your source connector is responsible for generating the SourceRecord objects and returning them to the Connect framework via your task's "poll()" method. 2. The Conne

Re: [DISCUSS] KIP-209 Connection String Support

Hi Clebert Great kip! Instead of ‘;’ to separate the host sections with the params section could it be a ‘?’ And like wise ‘,’ param separator could this be ‘&’ (keep the ‘,’ for host separator just makes easier to distinguish) Also this was it makes it easier to encode params etc as can just

Build failed in Jenkins: kafka-trunk-jdk8 #2152

See Changes: [me] KAFKA-6087: Scanning plugin.path needs to support relative symlinks. -- [...truncated 3.30 MB...] kafka.security.auth.SimpleAclAuthorizerTest > testAclIn

Re: [DISCUSS] KIP-209 Connection String Support

Just another point to why I’d propose the below change to the string format I propose , is an ability to encode the strings easily. We should note that it’s quite typical for serializers to user a schematic registry where one of their properties they will need to set would be in some form like:

[jira] [Created] (KAFKA-6093) replica dir not deleted after topic deletion

Jun Rao created KAFKA-6093: -- Summary: replica dir not deleted after topic deletion Key: KAFKA-6093 URL: https://issues.apache.org/jira/browse/KAFKA-6093 Project: Kafka Issue Type: Bug Comp

[jira] [Created] (KAFKA-6094) transient failure in testMultipleMarkersOneLeader

Jun Rao created KAFKA-6094: -- Summary: transient failure in testMultipleMarkersOneLeader Key: KAFKA-6094 URL: https://issues.apache.org/jira/browse/KAFKA-6094 Project: Kafka Issue Type: Bug

[GitHub] kafka pull request #4089: KAFKA-6071: Use ZookeeperClient in LogManager

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4089 ---

[jira] [Resolved] (KAFKA-6071) Use ZookeeperClient in LogManager

[ https://issues.apache.org/jira/browse/KAFKA-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-6071. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 4089 [https://github.com/apache

[GitHub] kafka pull request #4099: MINOR: Use ObjectName.quote instead of URL-encodin...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4099 ---

[GitHub] kafka pull request #4100: KAFKA-6093; log.close() should not prevent log fro...

GitHub user lindong28 opened a pull request: https://github.com/apache/kafka/pull/4100 KAFKA-6093; log.close() should not prevent log from being accessed You can merge this pull request into a Git repository by running: $ git pull https://github.com/lindong28/kafka KAFKA-6093

Jenkins build is back to normal : kafka-trunk-jdk7 #2908

See

Build failed in Jenkins: kafka-1.0-jdk7 #47

See Changes: [me] MINOR: Use ObjectName.quote instead of URL-encoding for JMX metric tags -- [...truncated 368.59 KB...] kafka.server.epoch.LeaderEpochFileCacheTest > shouldU

Re: [VOTE] 1.0.0 RC2

Vahid, Thanks for testing the RC! Really appreciate it. Could you file another JIRA for the Streams quickstart issue on Windows? Folks, While working on a flaky unit test we happen to find a topic-deletion issue (https://github.com/apache/kafka/pull/4095), marked as a blocker for the release.

Re: [VOTE] 1.0.0 RC2

Sent the email too quick.. The filed blocker JIRA is this one: https://issues.apache.org/jira/browse/KAFKA-6093 Guozhang On Thu, Oct 19, 2017 at 8:58 PM, Guozhang Wang wrote: > Vahid, > > Thanks for testing the RC! Really appreciate it. > > Could you file another JIRA for the Streams quickstar

Jenkins build is back to normal : kafka-trunk-jdk9 #140

See

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

Github user efeg closed the pull request at: https://github.com/apache/kafka/pull/4093 ---

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

GitHub user efeg reopened a pull request: https://github.com/apache/kafka/pull/4093 KAFKA-6083: The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found. You can merge this pull request into a Git repository by running: $

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

Github user efeg closed the pull request at: https://github.com/apache/kafka/pull/4093 ---

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

GitHub user efeg reopened a pull request: https://github.com/apache/kafka/pull/4093 KAFKA-6083: The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found. You can merge this pull request into a Git repository by running: $

Build failed in Jenkins: kafka-trunk-jdk8 #2153

See Changes: [junrao] KAFKA-6071; Use ZookeeperClient in LogManager -- [...truncated 3.70 MB...] org.apache.kafka.streams.integration.RegexSourceIntegrationTest > testSho

Build failed in Jenkins: kafka-trunk-jdk7 #2909

See Changes: [me] MINOR: Use ObjectName.quote instead of URL-encoding for JMX metric tags -- [...truncated 380.77 KB...] kafka.api.SaslPlainSslEndToEndAuthorizationTest >

[GitHub] kafka pull request #4101: MINOR: Add missing ";" to example jaas configuarti...

GitHub user omkreddy opened a pull request: https://github.com/apache/kafka/pull/4101 MINOR: Add missing ";" to example jaas configuartion You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/kafka SCRAM-DOCS Alternatively y