[jira] [Created] (KAFKA-12524) Remove deprecated WindowBytesStoreSupplier#segments

2021-03-22 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-12524: - Summary: Remove deprecated WindowBytesStoreSupplier#segments Key: KAFKA-12524 URL: https://issues.apache.org/jira/browse/KAFKA-12524 Project: Kafka Issue

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #601

2021-03-22 Thread Apache Jenkins Server
See Changes: [github] MINOR: Remove duplicate definition about 'the' from kafka project (#10370) -- [...truncated 3.68 MB...] LogTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #629

2021-03-22 Thread Apache Jenkins Server
See Changes: [github] MINOR: Remove duplicate definition about 'the' from kafka project (#10370) -- [...truncated 3.69 MB...] SocketServerTest >

[GitHub] [kafka-site] AdilHoumadi opened a new pull request #341: MINOR: Fix typo in MirrorMaker v2 documentation

2021-03-22 Thread GitBox
AdilHoumadi opened a new pull request #341: URL: https://github.com/apache/kafka-site/pull/341 Fix typo in code example - s/enable/enabled -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #660

2021-03-22 Thread Apache Jenkins Server
See Changes: [github] MINOR: Remove duplicate definition about 'the' from kafka project (#10370) -- [...truncated 3.70 MB...] DefaultMessageFormatterTest >

[jira] [Created] (KAFKA-12523) Need to improve handling of TimeoutException when committing offsets

2021-03-22 Thread A. Sophie Blee-Goldman (Jira)
A. Sophie Blee-Goldman created KAFKA-12523: -- Summary: Need to improve handling of TimeoutException when committing offsets Key: KAFKA-12523 URL: https://issues.apache.org/jira/browse/KAFKA-12523

[jira] [Resolved] (KAFKA-12366) Performance regression in stream-table joins on trunk

2021-03-22 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-12366. -- Resolution: Fixed > Performance regression in stream-table joins on trunk >

[jira] [Resolved] (KAFKA-8372) Remove deprecated RocksDB#compactRange API

2021-03-22 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-8372. --- Resolution: Fixed We can just close this since we removed bulk loading, and

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #600

2021-03-22 Thread Apache Jenkins Server
See

Re: [VOTE] 2.6.2 RC0

2021-03-22 Thread Justin Mclean
HI, > - On the first point, the only thing I see is zstd, which we do not, in > fact, ship the library itself, just the jni bindings. Was there anything > else you saw? As far as I can see all of the software mentioned is not in the source release so shouldn't be mentioned in LICENSE, but I'm

Re: Kafka logos and branding

2021-03-22 Thread Justin Mclean
Hi, > Yes, we confirmed from ASF branding that this is the correct logo (i.e. > without the word Apache and the registered trademark symbol). Thanks for that, just odd that I've see it with the Apache and R symbol elsewhere and assumed that was the official one. It doesn't match the logo on

[jira] [Resolved] (KAFKA-10172) [Kafka connect] connectors, tasks metrics doubled

2021-03-22 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-10172. Resolution: Duplicate Closing as duplicate since this issue describes the

Re: [VOTE] 2.6.2 RC0

2021-03-22 Thread Ewen Cheslack-Postava
Hey Justin, Can you clarify a few things? - On the first point, the only thing I see is zstd, which we do not, in fact, ship the library itself, just the jni bindings. Was there anything else you saw? - On the second point, I checked the src download from the RC and afaict we use this header and

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #659

2021-03-22 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12181; Loosen raft fetch offset validation of remote replicas (#10309) -- [...truncated 3.68 MB...] LogCleanerTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #628

2021-03-22 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12181; Loosen raft fetch offset validation of remote replicas (#10309) -- [...truncated 3.71 MB...]

Re: Kafka logos and branding

2021-03-22 Thread Jun Rao
Hi, Justin, Yes, we confirmed from ASF branding that this is the correct logo (i.e. without the word Apache and the registered trademark symbol). Thanks, Jun On Thu, Mar 18, 2021 at 9:24 PM Justin Mclean wrote: > HI, > > > The high resolution logo is now available at > >

Re: [DISCUSS] KIP-693: Client-side Circuit Breaker for Partition Write Errors

2021-03-22 Thread Guozhang Wang
Thanks for the updated KIP! Some more comments inlined. On Sun, Mar 7, 2021 at 6:43 PM Guoqiang Shu wrote: > > > Guozhang, many thanks for taking a look! Sorry for the late reply, we have > iterated the prototype on our production setup with your question in mind > and updated the KIP

[jira] [Resolved] (KAFKA-12181) Loosen monotonic fetch offset validation by raft leader

2021-03-22 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-12181. - Resolution: Fixed > Loosen monotonic fetch offset validation by raft leader >

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #599

2021-03-22 Thread Apache Jenkins Server
See Changes: [github] (Cherry-pick) KAFKA-9274: handle TimeoutException on task reset (#1) (#10372) -- [...truncated 3.68 MB...] LogTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #627

2021-03-22 Thread Apache Jenkins Server
See Changes: [github] (Cherry-pick) KAFKA-9274: handle TimeoutException on task reset (#1) (#10372) -- [...truncated 3.68 MB...] SocketServerTest >

[jira] [Created] (KAFKA-12522) Cast SMT should allow null values to pass through

2021-03-22 Thread Daniel Osvath (Jira)
Daniel Osvath created KAFKA-12522: - Summary: Cast SMT should allow null values to pass through Key: KAFKA-12522 URL: https://issues.apache.org/jira/browse/KAFKA-12522 Project: Kafka Issue

[jira] [Created] (KAFKA-12521) Expand coverage of integration tests with more realistic applications

2021-03-22 Thread A. Sophie Blee-Goldman (Jira)
A. Sophie Blee-Goldman created KAFKA-12521: -- Summary: Expand coverage of integration tests with more realistic applications Key: KAFKA-12521 URL: https://issues.apache.org/jira/browse/KAFKA-12521

Re: Request to Create KIP

2021-03-22 Thread Konstantine Karantasis
Added. Thanks for your interest in Apache Kafka. Looking forward to your contributions! Konstantine On Mon, Mar 22, 2021 at 3:15 PM Soumyajit Sahu wrote: > Hello, > Please allow my wiki id (soumyajit-sahu) to create Kafka Improvement > Proposals. > > Thank you. > Regards > Soumyajit Sahu >

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #658

2021-03-22 Thread Apache Jenkins Server
See Changes: [github] (Cherry-pick) KAFKA-9274: handle TimeoutException on task reset (#1) (#10372) -- [...truncated 3.70 MB...]

Request to Create KIP

2021-03-22 Thread Soumyajit Sahu
Hello, Please allow my wiki id (soumyajit-sahu) to create Kafka Improvement Proposals. Thank you. Regards Soumyajit Sahu

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #77

2021-03-22 Thread Apache Jenkins Server
See Changes: [A. Sophie Blee-Goldman] KAFKA-12508: Emit records with same value and same timestamp (#10360) -- [...truncated 3.62 MB...] SocketServerTest >

Re: [DISCUSS] KIP-723: Add socket.tcp.no.delay property to Kafka Config

2021-03-22 Thread Colin McCabe
Hi Andrei, Kafka intentionally sets TCP_NODELAY in order to disable Nagle's algorithm. The reason is because Nagle's algorithm can cause to long latencies in Kafka RPC. Wikipedia explains the problem: > [Nagle's] algorithm interacts badly with TCP delayed acknowledgments > (delayed ACK),

Re: [DISCUSS] KIP-618: Atomic commit of source connector records and offsets

2021-03-22 Thread Chris Egerton
Hi Randall, No complaints about email size from me. Let's dive in! 1. Sure! Especially important in my mind is that this is already possible with Connect as it is today, and users can benefit from this with or without the expanded exactly-once souce support we're trying to add with this KIP.

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #76

2021-03-22 Thread Apache Jenkins Server
See Changes: [John Roesler] MINOR: update notice year to 2021 -- [...truncated 7.24 MB...] ControllerEventManagerTest > testSuccessfulEvent() STARTED

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #657

2021-03-22 Thread Apache Jenkins Server
See Changes: [John Roesler] MINOR: bump documentation.html to 3.0 -- [...truncated 3.69 MB...] SocketServerTest > testConnectionRatePerIp() STARTED

[jira] [Resolved] (KAFKA-12514) NPE in SubscriptionState

2021-03-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-12514. --- Fix Version/s: 3.0.0 Resolution: Fixed > NPE in SubscriptionState >

Re: [DISCUSS] KIP-712: Shallow Mirroring

2021-03-22 Thread Henry Cai
If there are no additional comments you’d start a vote in a couple of days. On Sat, Feb 27, 2021 at 9:26 AM A S wrote: > +1 to adding latency metrics. > > To add context on why CPU, memory and GC has a bigger impact than network > in a Mirror for compressed topics without KIP-712 is: *a failing

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #598

2021-03-22 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12383: Get RaftClusterTest.java and other KIP-500 junit tests working (#10220) [John Roesler] MINOR: bump documentation.html to 3.0

[jira] [Created] (KAFKA-12520) Producer state is needlessly rebuilt on startup

2021-03-22 Thread Dhruvil Shah (Jira)
Dhruvil Shah created KAFKA-12520: Summary: Producer state is needlessly rebuilt on startup Key: KAFKA-12520 URL: https://issues.apache.org/jira/browse/KAFKA-12520 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-10749) Add throttling of IPs by connection rate

2021-03-22 Thread David Mao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mao resolved KAFKA-10749. --- Resolution: Fixed > Add throttling of IPs by connection rate >

[jira] [Resolved] (KAFKA-12367) RaftReplicaManager needs to propagate isr version to Partition

2021-03-22 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-12367. - Resolution: Fixed > RaftReplicaManager needs to propagate isr version to Partition >

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #656

2021-03-22 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12383: Get RaftClusterTest.java and other KIP-500 junit tests working (#10220) -- [...truncated 3.68 MB...]

[jira] [Resolved] (KAFKA-12268) System tests broken because consumer returns early without records

2021-03-22 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-12268. Resolution: Fixed > System tests broken because consumer returns early without records >

Regarding Data Ingestion from Kafka to Postgres DB

2021-03-22 Thread Avinash Srivastava
Hi, I am new to Kafka and since last 1 week i am trying to ingest data from Kafka to my PostgreSQL DB but somehow i couldn't get success. Basically my requirement is like i am already receiving some IOT data in form of a JSON and pushing them to Kafka. Till this everything is fine. But as an

Re: [DISCUSS] KIP-618: Atomic commit of source connector records and offsets

2021-03-22 Thread Chris Egerton
Hi Randall, Thanks for taking a look! Responses inline: > This would seem to make the transactions based upon time rather than record count. Is that really the intent? Did you consider using one transaction per "batch" of records, whatever number of records that means? One issue with the

[jira] [Created] (KAFKA-12519) Consider Removing Streams Old Built-in Metrics Version

2021-03-22 Thread Bruno Cadonna (Jira)
Bruno Cadonna created KAFKA-12519: - Summary: Consider Removing Streams Old Built-in Metrics Version Key: KAFKA-12519 URL: https://issues.apache.org/jira/browse/KAFKA-12519 Project: Kafka

[jira] [Created] (KAFKA-12518) Ensure register broker metadata records BrokerMetadataListenerTest

2021-03-22 Thread YI-CHEN WANG (Jira)
YI-CHEN WANG created KAFKA-12518: Summary: Ensure register broker metadata records BrokerMetadataListenerTest Key: KAFKA-12518 URL: https://issues.apache.org/jira/browse/KAFKA-12518 Project: Kafka

Re: [VOTE] KIP-720 Deprecate MirrorMaker v1

2021-03-22 Thread Ismael Juma
I am in favor of this change, but the KIP doesn't include proper motivation. It says "While the original MirrorMaker remains useful, we want to take advantage of the upcoming 3.0 major release to officially deprecate this legacy code". I would hope we would explain why it's no longer useful

Re: [VOTE] KIP-720 Deprecate MirrorMaker v1

2021-03-22 Thread Mickael Maison
+1 (binding) Thanks Ryanne On Mon, Mar 22, 2021 at 10:18 AM David Jacot wrote: > > +1 (binding) > > Thanks for the KIP! > > On Mon, Mar 22, 2021 at 8:29 AM Manikumar wrote: > > > +1 (binding) > > > > > > > > On Mon, Mar 22, 2021 at 9:42 AM Gwen Shapira > > wrote: > > > > > Woot! > > > +1 > > >

[DISCUSS] KIP-725: Streamlining configurations for TimeWindowedDeserializer.

2021-03-22 Thread Sagar
Hi All, I would like to start a discussion on the following KIP: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=177047930 Thanks! Sagar.

Re: [VOTE] KIP-720 Deprecate MirrorMaker v1

2021-03-22 Thread David Jacot
+1 (binding) Thanks for the KIP! On Mon, Mar 22, 2021 at 8:29 AM Manikumar wrote: > +1 (binding) > > > > On Mon, Mar 22, 2021 at 9:42 AM Gwen Shapira > wrote: > > > Woot! > > +1 > > > > On Sat, Mar 20, 2021, 10:41 AM Ryanne Dolan > wrote: > > > > > Hey y'all, I'm starting the vote on

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #625

2021-03-22 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-12517) Kafka's readme should provide Run configurations in the BUILD with IDE Section

2021-03-22 Thread Aviral Srivastava (Jira)
Aviral Srivastava created KAFKA-12517: - Summary: Kafka's readme should provide Run configurations in the BUILD with IDE Section Key: KAFKA-12517 URL: https://issues.apache.org/jira/browse/KAFKA-12517

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #597

2021-03-22 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix log statement whose placeholders are inconsistent with arguments (#10312) -- [...truncated 3.68 MB...] LogValidatorTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #655

2021-03-22 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix log statement whose placeholders are inconsistent with arguments (#10312) -- [...truncated 3.70 MB...] AclAuthorizerTest >

Re: [VOTE] KIP-720 Deprecate MirrorMaker v1

2021-03-22 Thread Manikumar
+1 (binding) On Mon, Mar 22, 2021 at 9:42 AM Gwen Shapira wrote: > Woot! > +1 > > On Sat, Mar 20, 2021, 10:41 AM Ryanne Dolan wrote: > > > Hey y'all, I'm starting the vote on KIP-720, which proposes to deprecate > > the original MirrorMaker in the upcoming 3.0 major release. > > > > > > >