Re: Re: kafka-console-consumer.sh: Port already in use Exception after enable JMX

[wangl...@geekplus.com.cn]

Hi rohit，

Surely  unset jmx report can solve my issue 
Exit and login again not work. 
But i can execute the consumer.sh on others hosts.

Thanks,
Lei


wangl...@geekplus.com.cn 

 
From: rohit garg
Date: 2020-05-11 13:24
To: users
CC: wanglei2
Subject: Re: kafka-console-consumer.sh: Port already in use Exception after 
enable JMX
There are two ways to solve this issue,

Exit and relogin again ,

Or again after broker is started , unset jmx port and you are good to go .

Thanks and Regards,
Rohit Garg

On Mon, May 11, 2020, 10:10  wrote:
Please share the consumer.sh .
Are you using Apache kafka  and what version ?

From: "wangl...@geekplus.com.cn" 
Date: Sunday, May 10, 2020 at 9:38 PM
To: users 
Cc: "Agrawal, Manoj (Cognizant)" 
Subject: Re: Re: kafka-console-consumer.sh: Port already in use Exception after 
enable JMX

[External]
Hi Manoj，

I have tried, not work.

When i changed to 9998, the consumer.sh tells me Port already in use: 9998

Thanks,
Lei



wangl...@geekplus.com.cn


From: manoj.agraw...@cognizant.com
Date: 2020-05-11 12:04
To: users@kafka.apache.org
Subject: Re: kafka-console-consumer.sh: Port already in use Exception after 
enable JMX
You can change jmx-port to any available port - 9992

On 5/10/20, 7:49 PM, "wangl...@geekplus.com.cn"  
wrote:

[External]


Add  JMX_PORT=9988 to kafka-run-class.sh  to enable JMX

After execute bin/kafka-console-consumer.sh there‘s exception：

Error: Exception thrown by the agent : java.rmi.server.ExportException: 
Port already in use: 9988; nested exception is:
java.net.BindException: Address already in use (Bind failed)




wangl...@geekplus.com.cn



This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored.
This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored.
This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored. This e-mail and any files transmitted with it are for the sole 
use of the intended recipient(s) and may contain confidential and privileged 
information. If you are not the intended recipient(s), please reply to the 
sender and destroy all copies of the original message. Any unauthorized review, 
use, disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored.

Re: Re: kafka-console-consumer.sh: Port already in use Exception after enable JMX

[wangl...@geekplus.com.cn]

bin/kafka-console-consumer.sh --bootstrap-server 172.19.78.32:9092 --topic 
tapicName 
I am using kafka_2.11-2.4.1



wangl...@geekplus.com.cn 
 
From: manoj.agraw...@cognizant.com
Date: 2020-05-11 12:39
To: wangl...@geekplus.com.cn; users@kafka.apache.org
Subject: Re: kafka-console-consumer.sh: Port already in use Exception after 
enable JMX
Please share the consumer.sh . 
Are you using Apache kafka  and what version ? 
 
From: "wangl...@geekplus.com.cn" 
Date: Sunday, May 10, 2020 at 9:38 PM
To: users 
Cc: "Agrawal, Manoj (Cognizant)" 
Subject: Re: Re: kafka-console-consumer.sh: Port already in use Exception after 
enable JMX
 
[External]
Hi Manoj， 
 
I have tried, not work.
 
When i changed to 9998, the consumer.sh tells me Port already in use: 9998
 
Thanks,
Lei 
 
 


wangl...@geekplus.com.cn
 
 
From: manoj.agraw...@cognizant.com
Date: 2020-05-11 12:04
To: users@kafka.apache.org
Subject: Re: kafka-console-consumer.sh: Port already in use Exception after 
enable JMX
You can change jmx-port to any available port - 9992
 
On 5/10/20, 7:49 PM, "wangl...@geekplus.com.cn"  
wrote:
 
[External]
 
 
Add  JMX_PORT=9988 to kafka-run-class.sh  to enable JMX
 
After execute bin/kafka-console-consumer.sh there‘s exception：
 
Error: Exception thrown by the agent : java.rmi.server.ExportException: 
Port already in use: 9988; nested exception is:
java.net.BindException: Address already in use (Bind failed)
 
 
 
 
wangl...@geekplus.com.cn
 
 
 
This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored.
This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored.
This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored. This e-mail and any files transmitted with it are for the sole 
use of the intended recipient(s) and may contain confidential and privileged 
information. If you are not the intended recipient(s), please reply to the 
sender and destroy all copies of the original message. Any unauthorized review, 
use, disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored. 

Re: kafka-console-consumer.sh: Port already in use Exception after enable JMX

[rohit garg]

There are two ways to solve this issue,

Exit and relogin again ,

Or again after broker is started , unset jmx port and you are good to go .

Thanks and Regards,
Rohit Garg

On Mon, May 11, 2020, 10:10  wrote:

> Please share the consumer.sh .
> Are you using Apache kafka  and what version ?
>
> From: "wangl...@geekplus.com.cn" 
> Date: Sunday, May 10, 2020 at 9:38 PM
> To: users 
> Cc: "Agrawal, Manoj (Cognizant)" 
> Subject: Re: Re: kafka-console-consumer.sh: Port already in use Exception
> after enable JMX
>
> [External]
> Hi Manoj，
>
> I have tried, not work.
>
> When i changed to 9998, the consumer.sh tells me Port already in use: 9998
>
> Thanks,
> Lei
>
>
> 
> wangl...@geekplus.com.cn
>
>
> From: manoj.agraw...@cognizant.com
> Date: 2020-05-11 12:04
> To: users@kafka.apache.org
> Subject: Re: kafka-console-consumer.sh: Port already in use Exception
> after enable JMX
> You can change jmx-port to any available port - 9992
>
> On 5/10/20, 7:49 PM, "wangl...@geekplus.com.cn" 
> wrote:
>
> [External]
>
>
> Add  JMX_PORT=9988 to kafka-run-class.sh  to enable JMX
>
> After execute bin/kafka-console-consumer.sh there‘s exception：
>
> Error: Exception thrown by the agent :
> java.rmi.server.ExportException: Port already in use: 9988; nested
> exception is:
> java.net.BindException: Address already in use (Bind failed)
>
>
>
>
> wangl...@geekplus.com.cn
>
>
>
> This e-mail and any files transmitted with it are for the sole use of the
> intended recipient(s) and may contain confidential and privileged
> information. If you are not the intended recipient(s), please reply to the
> sender and destroy all copies of the original message. Any unauthorized
> review, use, disclosure, dissemination, forwarding, printing or copying of
> this email, and/or any action taken in reliance on the contents of this
> e-mail is strictly prohibited and may be unlawful. Where permitted by
> applicable law, this e-mail and other e-mail communications sent to and
> from Cognizant e-mail addresses may be monitored.
> This e-mail and any files transmitted with it are for the sole use of the
> intended recipient(s) and may contain confidential and privileged
> information. If you are not the intended recipient(s), please reply to the
> sender and destroy all copies of the original message. Any unauthorized
> review, use, disclosure, dissemination, forwarding, printing or copying of
> this email, and/or any action taken in reliance on the contents of this
> e-mail is strictly prohibited and may be unlawful. Where permitted by
> applicable law, this e-mail and other e-mail communications sent to and
> from Cognizant e-mail addresses may be monitored.
> This e-mail and any files transmitted with it are for the sole use of the
> intended recipient(s) and may contain confidential and privileged
> information. If you are not the intended recipient(s), please reply to the
> sender and destroy all copies of the original message. Any unauthorized
> review, use, disclosure, dissemination, forwarding, printing or copying of
> this email, and/or any action taken in reliance on the contents of this
> e-mail is strictly prohibited and may be unlawful. Where permitted by
> applicable law, this e-mail and other e-mail communications sent to and
> from Cognizant e-mail addresses may be monitored. This e-mail and any files
> transmitted with it are for the sole use of the intended recipient(s) and
> may contain confidential and privileged information. If you are not the
> intended recipient(s), please reply to the sender and destroy all copies of
> the original message. Any unauthorized review, use, disclosure,
> dissemination, forwarding, printing or copying of this email, and/or any
> action taken in reliance on the contents of this e-mail is strictly
> prohibited and may be unlawful. Where permitted by applicable law, this
> e-mail and other e-mail communications sent to and from Cognizant e-mail
> addresses may be monitored.
>

Re: kafka-console-consumer.sh: Port already in use Exception after enable JMX

[Manoj.Agrawal2]

Please share the consumer.sh .
Are you using Apache kafka  and what version ?

From: "wangl...@geekplus.com.cn" 
Date: Sunday, May 10, 2020 at 9:38 PM
To: users 
Cc: "Agrawal, Manoj (Cognizant)" 
Subject: Re: Re: kafka-console-consumer.sh: Port already in use Exception after 
enable JMX

[External]
Hi Manoj，

I have tried, not work.

When i changed to 9998, the consumer.sh tells me Port already in use: 9998

Thanks,
Lei



wangl...@geekplus.com.cn


From: manoj.agraw...@cognizant.com
Date: 2020-05-11 12:04
To: users@kafka.apache.org
Subject: Re: kafka-console-consumer.sh: Port already in use Exception after 
enable JMX
You can change jmx-port to any available port - 9992

On 5/10/20, 7:49 PM, "wangl...@geekplus.com.cn"  
wrote:

[External]


Add  JMX_PORT=9988 to kafka-run-class.sh  to enable JMX

After execute bin/kafka-console-consumer.sh there‘s exception：

Error: Exception thrown by the agent : java.rmi.server.ExportException: 
Port already in use: 9988; nested exception is:
java.net.BindException: Address already in use (Bind failed)




wangl...@geekplus.com.cn



This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored.
This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored.
This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored. This e-mail and any files transmitted with it are for the sole 
use of the intended recipient(s) and may contain confidential and privileged 
information. If you are not the intended recipient(s), please reply to the 
sender and destroy all copies of the original message. Any unauthorized review, 
use, disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored.

Re: Re: kafka-console-consumer.sh: Port already in use Exception after enable JMX

[wangl...@geekplus.com.cn]

Hi Manoj， 

I have tried, not work.

When i changed to 9998, the consumer.sh tells me Port already in use: 9998

Thanks,
Lei 




wangl...@geekplus.com.cn

 
From: manoj.agraw...@cognizant.com
Date: 2020-05-11 12:04
To: users@kafka.apache.org
Subject: Re: kafka-console-consumer.sh: Port already in use Exception after 
enable JMX
You can change jmx-port to any available port - 9992
 
On 5/10/20, 7:49 PM, "wangl...@geekplus.com.cn"  
wrote:
 
[External]
 
 
Add  JMX_PORT=9988 to kafka-run-class.sh  to enable JMX
 
After execute bin/kafka-console-consumer.sh there‘s exception：
 
Error: Exception thrown by the agent : java.rmi.server.ExportException: 
Port already in use: 9988; nested exception is:
java.net.BindException: Address already in use (Bind failed)
 
 
 
 
wangl...@geekplus.com.cn
 
 
 
This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored.
This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored.

Re: kafka-console-consumer.sh: Port already in use Exception after enable JMX

[Manoj.Agrawal2]

You can change jmx-port to any available port - 9992

On 5/10/20, 7:49 PM, "wangl...@geekplus.com.cn"  
wrote:

[External]


Add  JMX_PORT=9988 to kafka-run-class.sh  to enable JMX

After execute bin/kafka-console-consumer.sh there‘s exception：

Error: Exception thrown by the agent : java.rmi.server.ExportException: 
Port already in use: 9988; nested exception is:
java.net.BindException: Address already in use (Bind failed)




wangl...@geekplus.com.cn



This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored.
This e-mail and any files transmitted with it are for the sole use of the 
intended recipient(s) and may contain confidential and privileged information. 
If you are not the intended recipient(s), please reply to the sender and 
destroy all copies of the original message. Any unauthorized review, use, 
disclosure, dissemination, forwarding, printing or copying of this email, 
and/or any action taken in reliance on the contents of this e-mail is strictly 
prohibited and may be unlawful. Where permitted by applicable law, this e-mail 
and other e-mail communications sent to and from Cognizant e-mail addresses may 
be monitored.

kafka-console-consumer.sh: Port already in use Exception after enable JMX

[wangl...@geekplus.com.cn]

Add  JMX_PORT=9988 to kafka-run-class.sh  to enable JMX 

After execute bin/kafka-console-consumer.sh there‘s exception： 

Error: Exception thrown by the agent : java.rmi.server.ExportException: Port 
already in use: 9988; nested exception is: 
java.net.BindException: Address already in use (Bind failed)
 



wangl...@geekplus.com.cn

TransactionalIdAuthorizationException

[Cenk Oguz]

Hi,

I have a peculiar problem when using reactor-kafka client with
authentication and transactions enabled.

I get an exception:
org.apache.kafka.common.errors.TransactionalIdAuthorizationException:
Transactional Id authorization failed.

This happens while the client initializes the transactions manager.
There is barely any documentation on this as far as I can tell.
Transactional ID has been set on the producer, as well as the
enable_idempotence property.

Is there a server side property that needs configuring or is the
client misconfigured somehow?
The user is fully authorized to write to the topic.

Br,
Cenk

Re: Is there any difference between conflunt kafka and apache kafka？

[Blake Miller]

I will chip in my 2c here as we use open source Kafka stuff in production,
and we use some of the Confluent and community additions.

Thus far we have not paid for anything other than cloud metal.

The Confluent team seems super legit to me. They are making a lot of useful
stuff freely available to the community. I think the Kafka they distribute
is just vanilla Apache Kafka. That is, they do not patch the broker code
just for "Confluent Kafka". They add things atop Kafka: the schema
registry, Kafka Connect, KSQL... and most interesting for our purposes, the
Kafka Streams java library (which is open source).

I would recommend using their stuff because:

1) there is no vendor lock-in that I can spot (you can go on using only the
free parts indefinitely)
2) these extra Confluent things are potentially quite useful

It might be a little more convenient, too. You would be in good company
running the confluent suite of kafka-related stuff.


On Sat, May 9, 2020 at 4:03 PM Mich Talebzadeh 
wrote:

> Sure we agree to differ.
>
> That is indeed a sign of civilised mind to entertain an idea without
> accepting it.
>
> HTH,
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn *
> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <
> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> >*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Sat, 9 May 2020 at 16:14, Steven Miller 
> wrote:
>
> > At the risk of starting a uh-huh-uhnt-uh battle, I would have to
> disagree.
> > There are seriously good people at Confluent, many of whom have been
> > pivotal to Kafka’s development. You can decide whether or not Confluent
> > makes sense for you for other reasons, but I wouldn’t go for a blanket
> no,
> > by any means.
> >
> > -Steve
> >
> > > On May 9, 2020, at 9:20 AM, Mich Talebzadeh  >
> > wrote:
> > >
> > > Hi,
> > >
> > > I would say stick to Apache Kafka.
> > >
> > > These days every start-up sees some opportunities to grab a piece of
> > cake.
> > > Often ending up re-inventing the wheel to create an add-on that mimics
> > what
> > > already exists and charge license fees.
> > >
> > > One of the most pertinent exception is Apache HBase that has been
> around
> > > for 10 years. It is only supported as part of third-party suits of
> > products
> > > on Hadoop like Cloudera or Hortonworks. The great Apache community
> > supports
> > > it and I believe that is the reason it is so successful and widely
> used.
> > >
> > > HTH
> > >
> > > Dr Mich Talebzadeh
> > >
> > >
> > >
> > > LinkedIn *
> >
> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> > > <
> >
> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> > >*
> > >
> > >
> > >
> > > http://talebzadehmich.wordpress.com
> > >
> > >
> > > *Disclaimer:* Use it at your own risk. Any and all responsibility for
> any
> > > loss, damage or destruction of data or any other property which may
> arise
> > > from relying on this email's technical content is explicitly
> disclaimed.
> > > The author will in no case be liable for any monetary damages arising
> > from
> > > such loss, damage or destruction.
> > >
> > >
> > >
> > >
> > >> On Sat, 9 May 2020 at 09:46, wangl...@geekplus.com.cn <
> > >> wangl...@geekplus.com.cn> wrote:
> > >>
> > >>
> > >> I want to know if there's any difference between apache kafka and the
> > open
> > >> sourced confluent kafka ?
> > >>
> > >>
> > >> Thanks,
> > >> Lei
> > >>
> > >>
> > >> wangl...@geekplus.com.cn
> > >>
> > >>
> >
>

Kafka Streams, WindowBy, Grace Period, Late events, Suppres operation

[Baki Hayat]

Hello Friends,

I wrote into stackoverflow but also i am writing here,

I have couple of questions about window operation, grace period and late
events.

Could you please check my problem about group by with adding time field as
a key or window by and group by without time field ?

Here is detail explanation...

https://stackoverflow.com/questions/61680407/kafka-streams-groupby-late-event-persistentwindowstore-windowby-with-gra