Proxy Support For Kafka Clients Java

Hello,  I would like to know if there any ways to use kafka clients with proxy. Note: Broker URLs cannot be fetched before running consumer and connections are made to multiple kafka clusters.

Re: Java 8 support in Kafka 3.1.1 release

Hi Deepak, Yes, you can continue to use Java 8 until Kafka v4.0 released. You can check the KIP-750 for more detail: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=181308223 Thank you. Luke On Thu, Apr 7, 2022 at 3:05 AM Deepak Jain wrote: > Hi Luke, > > > > Our application

Java 8 support in Kafka 3.1.1 release

Hi Luke, Our application uses Java 8 but it seems the java 8 support is deprecated from Kafka 3.0.0 release onwards. Please let us know can we still use Java 8 in Kafka upcoming release 3.1.1? Regards, Deepak

Re: ARM support for Kafka

ll/9872]. I don't have permission to configure it to work. Can you help me? Thanks Lei Peng Peng Lei 于2021年1月18日周一 上午10:43写道： > Hi Kafka > I'm pushing kafka to support arm ci. I think this is a very > meaningful work because of it helps kafka get better. If Kafka supports > arm

ARM support for Kafka

Hi Kafka I'm pushing kafka to support arm ci. I think this is a very meaningful work because of it helps kafka get better. If Kafka supports arm, the following benefits are provided: 1. Kafka can be easily used by arm users. They do not need to worry about kafka being unavailable

Support of Kafka version 2.5 with SLES 12 SP3

Hello, We are planning to install apache kafka latest stable version 2.5.0 on our OS SLES 12 SP3 version. Is this supported ? Thanks, Chethan

SOCKS5 proxy support for Kafka Producers

​Hi, Is there a way for a kafka producer running inside an enterprise network *without* any direct access to the Internet to connect and send messages to a kafka cluster running in the cloud? Is it possible to configure the producer to use a SOCKS5 proxy? If not, is there any other possible

SOCKS5 proxy support for Kafka Producers

​Hi, Is there a way for a kafka producer running inside an enterprise network *without* any direct access to the Internet to connect and send messages to a kafka cluster running in the cloud? Is it possible to configure the producer to use a SOCKS5 proxy? If not, is there any other possible

Re: [DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

t; >> > > > > > > >> 3. Agreed. I think that's the real sharp edge here. I actually > > > think > > > > > it > > > > > > >> would be neat to auto-trigger those scheduled punctuators, but > &g

Re: [DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

ssorContext the scheduled punctuator will never by > > >>> auto-triggered, > > >>> and hence it is only for testing people's code that some punctuators > > are > > >>> indeed registered, and if people want full auto punctuation testing > > they > &g

Re: [DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

> Guozhang > >>> > >>> > >>> On Wed, Mar 7, 2018 at 8:04 PM, John Roesler <j...@confluent.io> > wrote: > >>> > >>>> On Wed, Mar 7, 2018 at 8:03 PM, John Roesler <j...@confluent.io> > wrote: > >>>> >

Re: [DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

re thing; I updated the example code in the KIP with a little > >> snippet. > >> > > > >> > > -John > >> > > > >> > > On Wed, Mar 7, 2018 at 7:18 PM, Ted Yu <yuzhih...@gmail.com> wrote: > >> > > > >> >

Re: [DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

gt; Sure thing; I updated the example code in the KIP with a little > >> snippet. > >>>> > >>>> -John > >>>> > >>>> On Wed, Mar 7, 2018 at 7:18 PM, Ted Yu <yuzhih...@gmail.com> wrote: > >>>> > >>>>> Looks g

Re: [DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

Roesler <j...@confluent.io> wrote: >>>> >>>>> Thanks Ted, >>>>> >>>>> Sure thing; I updated the example code in the KIP with a little >>> snippet. >>>>> >>>>> -John >>>>> >>>>&

Re: [DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

at 7:18 PM, Ted Yu <yuzhih...@gmail.com> wrote: >>>> >>>>> Looks good. >>>>> >>>>> See if you can add punctuator into the sample code. >>>>> >>>>> On Wed, Mar 7, 2018 at 7:10 PM, John Roesler <j...@confl

Re: [DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

t;> snippet. >> > > >> > > -John >> > > >> > > On Wed, Mar 7, 2018 at 7:18 PM, Ted Yu <yuzhih...@gmail.com> wrote: >> > > >> > >> Looks good. >> > >> >> > >> See if you can add punctuat

Re: [DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

> > >> > > >> > Dear Kafka community, > > >> > > > >> > I am proposing KIP-267 to augment the public Streams test utils API. > > >> > The goal is to simplify testing of Kafka Streams applications. > > >> > > > >

Re: [DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

test utils API. >> > The goal is to simplify testing of Kafka Streams applications. >> > >> > Please find details in the >> > wiki:https://cwiki.apache.org/confluence/display/KAFKA/KIP- >> > 267%3A+Add+Processor+Unit+Test+Support+to+Kafka+Streams+Test+U

Re: [DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

ki:https://cwiki.apache.org/confluence/display/KAFKA/KIP- > > 267%3A+Add+Processor+Unit+Test+Support+to+Kafka+Streams+Test+Utils > > > > An initial WIP PR can be found here:https://github.com/ > > apache/kafka/pull/4662 > > > > I also included the user-list (please hit "reply-all" to include both > > lists in this KIP discussion). > > > > Thanks, > > > > -John > > >

Re: [DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

g of Kafka Streams applications. > > Please find details in the > wiki:https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 267%3A+Add+Processor+Unit+Test+Support+to+Kafka+Streams+Test+Utils > > An initial WIP PR can be found here:https://github.com/ > apache/kafka/pull/4662 > &

[DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

Dear Kafka community, I am proposing KIP-267 to augment the public Streams test utils API. The goal is to simplify testing of Kafka Streams applications. Please find details in the wiki:https://cwiki.apache.org/confluence/display/KAFKA/KIP-267%3A+Add+Processor+Unit+Test+Support+to+Kafka+Streams

Re: Support for Kafka

Actually, I wanted to include the following link for the JVM docs (the information matches what's written in the earlier link I shared): http://kafka.apache.org/documentation#java On Tue, Oct 11, 2016 at 11:21 AM, Michael Noll wrote: > Regarding the JVM, we recommend

Re: Support for Kafka

Regarding the JVM, we recommend running the latest version of JDK 1.8 with the G1 garbage collector: http://docs.confluent.io/current/kafka/deployment.html#jvm And yes, Kafka does run on Ubuntu 16.04, too. (Confluent provides .deb packages [1] for Apache Kafka if you are looking for these to

Re: Support for Kafka

Hi Syed, Apache Kafka runs on a JVM. I think the question you should ask is -- which JVM does Apache Kafka require in production*? It doesn't really depend on anything on a specific Linux distribution. * ...and I don't have that answer ;-) Cheers, Jens On Wednesday, October 5, 2016, Syed

Support for Kafka

Dear Kafka team. I am in the Implementation stage of Kafka cluster and looking to find out does Apache Kafka supported for Ubuntu 16.04 LTS - Xenial. Would be great if you please let us know. [The Exchange Lab] Syed Hussaini Infrastructure Engineer 1

Re: Does the Kafka Streams DSL support non-Kafka sources/sinks?

Last time I checked (maybe 10 month ago), Camel was using the old async producer, which is not reliable (no callbacks!). Make sure they improved this before using it in a system where reliability is important. On Mon, Jun 6, 2016 at 9:44 PM, Asaf Mesika wrote: > I'd stay

Re: Does the Kafka Streams DSL support non-Kafka sources/sinks?

I'd stay off the Camel. It's performance is quite low. Up to 5-10 mb/sec it׳s ok but above that it will be your bottleneck. The problem with Camel is that sometime it's Endpoints have special behavior which is hard to understand and debugging it is a mess. We are now migrating away from it. On

Re: Does the Kafka Streams DSL support non-Kafka sources/sinks?

And to add yet more, re: usage of Connect. You're right that the custom websocket API would require a custom connector. I'd still suggest considering it, it takes care of all the Kafka pieces for you so all you need to do is write the WebSocket API adapter. For the database side, custom schemas

Re: Does the Kafka Streams DSL support non-Kafka sources/sinks?

On 6/3/16, 05:24, "Michael Noll" wrote: > If you are using the DSL, you can use the `process()` method to "do > whatever you want". Ah, perfect — thank you! > Alternatively, you can also use the low-level Processor API directly. > Here, you'd implement the `Processor`

Re: Does the Kafka Streams DSL support non-Kafka sources/sinks?

On 6/2/16, 22:26, "Christian Posta" wrote: > Hate to bring up "non-flashy" technology... but Apache Camel would be a > great fit for something like this. Two java libraries each with very strong > suits. Thanks for the tip! BTW, I love boring technology! One of my

Re: Does the Kafka Streams DSL support non-Kafka sources/sinks?

Avi, just adding a bit to what Gwen and Eno said, and providing a few pointers. If you are using the DSL, you can use the `process()` method to "do whatever you want". See "Applying a custom processor" in the Kafka Streams DSL chapter of the Developer Guide at

Re: Does the Kafka Streams DSL support non-Kafka sources/sinks?

Hate to bring up "non-flashy" technology... but Apache Camel would be a great fit for something like this. Two java libraries each with very strong suits. On Thu, Jun 2, 2016 at 6:09 PM, Avi Flax wrote: > On 6/2/16, 07:03, "Eno Thereska"

Re: Does the Kafka Streams DSL support non-Kafka sources/sinks?

On 6/2/16, 07:03, "Eno Thereska" wrote: > Using the low-level streams API you can definitely read or write to arbitrary > locations inside the process() method. Ah, good to know — thank you! > However, back to your original question: even with the low-level streams >

Re: Does the Kafka Streams DSL support non-Kafka sources/sinks?

Hi Avi, Using the low-level streams API you can definitely read or write to arbitrary locations inside the process() method. However, back to your original question: even with the low-level streams API the sources and sinks can only be Kafka topics for now. So, as Gwen mentioned, Connect

Re: Does the Kafka Streams DSL support non-Kafka sources/sinks?

On 6/1/16, 18:59, "Gwen Shapira" wrote: >This would be Michael and Guozhang job to answer I look forward to hearing from them ;) > but I'd look at two options if I were you: > > 1) If the connector you need exists ( > http://www.confluent.io/product/connectors), then you

Re: Does the Kafka Streams DSL support non-Kafka sources/sinks?

This would be Michael and Guozhang job to answer, but I'd look at two options if I were you: 1) If the connector you need exists ( http://www.confluent.io/product/connectors), then you just need to run it. It is just a simple REST API (submit job, job status, etc), so I wouldn't count it as

Re: Does the Kafka Streams DSL support non-Kafka sources/sinks?

On 6/1/16, 11:53, "Gwen Shapira" wrote: > Currently this is not part of the DSL and needs to be done separately > through KafkaConnect. Here's an example: > http://www.confluent.io/blog/hello-world-kafka-connect-kafka-streams Ah, I see! Thank you! And thanks for the

Re: Does the Kafka Streams DSL support non-Kafka sources/sinks?

Currently this is not part of the DSL and needs to be done separately through KafkaConnect. Here's an example: http://www.confluent.io/blog/hello-world-kafka-connect-kafka-streams In the future we want to integrate Connect and Streams better, so you could do something like

Does the Kafka Streams DSL support non-Kafka sources/sinks?

Hi all, Is it possible to use the Kafka Streams DSL to build a topology that has a source and/or sink that is/are not Kafka Topic(s)? As an example, I would like to consume some events from an API via WebSockets and use that as a source in a Kafka Streams topology — ideally one defined with

Re: KafkaSpout support for Kafka 0.9 version

com> wrote: > Hi, > > Does Apache Storm KafkaSpout support 0.9 kafka version? > > Thanks > Kanagha > > > > -- > Kanagha >

KafkaSpout support for Kafka 0.9 version

Hi, Does Apache Storm KafkaSpout support 0.9 kafka version? Thanks Kanagha -- Kanagha

Dead letter queue support in Kafka

Hi everyone, Since Kafka doesn’t have a dead-letter queue support built in - I’m looking for advice and best approaches to handle bad messages or cases when system is going crazy, once you receive an exception it basically means you’re blocking the whole kaka-stream from consuming other

Dead letter queue support in Kafka

Hi everyone, Since Kafka doesn’t have a dead-letter queue support built in - I’m looking for advice and best approaches to handle bad messages or cases when system is going crazy, once you receive an exception it basically means you’re blocking the whole kaka-stream from consuming other

Fwd: Spooling support for kafka publishers !

-- Forwarded message -- From: sunil kalva kalva.ka...@gmail.com Date: Fri, Aug 7, 2015 at 2:12 PM Subject: Spooling support for kafka publishers ! To: d...@kafka.apache.org Hi What are the best practises to achieve spooling support on producer end if the kafka cluster

backoff.increment.ms support in kafka 0.8

We are looking at using kafka 0.8-beta1 and high level consumer. kafka 0.7 consumer supported backoff.increment.ms to avoid repeatedly polling a broker node which has no new data. It appears that this property is no longer supported in 0.8. What is the reason? Instead there is fetch.wait.max.ms