Kafka Issue

[Roel Angeles]

Hi Kafka Dev Team,

We are requesting on your help about on our encountered issue about kafka.
Please see below screenshot of error. It says partition does not exist but on 
our event hub it is active.

[cid:image002.png@01D792AA.4A6BBFB0]

[cid:image003.png@01D792AA.834C99D0]

Hoping for your kind response about this and big help for our team. Thanks.

All the best,

[lingarogroup.com]
Roel Angeles
Consultant

+63 9157163557
roel.ange...@lingarogroup.com
www.lingarogroup.com



Lingaro Philippines Inc.
41F Philamlife Tower
8767 Paseo de Roxas
Makati City, 1226
+63 2753 8865


Next OOO planned:

Jenkins build is back to stable : Kafka » Kafka Branch Builder » 3.0 #95

[Apache Jenkins Server]

See 

Re: [DISCUSS] Apache Kafka 2.8.1 release

[Konstantine Karantasis]

Thanks for volunteering David! +1.

Konstantine

On Thu, Aug 12, 2021 at 1:00 AM David Jacot 
wrote:

> Hi,
>
> I'd like to volunteer to be the release manager for the next bugfix
> release, 2.8.1.
>
> I created the release plan on the wiki:
> https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+2.8.1
>
> Best,
> David
>

Making topic validation public

[Boyang Chen]

Hey there,

Kafka has an internal topic validation logic

which
is very useful and effective. Do you think it's possible to make it part of
the public agreement, so that 3rd party integration with Kafka could
validate the topic upfront instead of waiting until the application has
been set up end-to-end?

Boyang

[jira] [Created] (KAFKA-13203) GlobalTopic is added to main consumer subscription

[Matthias J. Sax (Jira)]

Matthias J. Sax created KAFKA-13203:
---

 Summary: GlobalTopic is added to main consumer subscription
 Key: KAFKA-13203
 URL: https://issues.apache.org/jira/browse/KAFKA-13203
 Project: Kafka
  Issue Type: Bug
  Components: streams
Reporter: Matthias J. Sax


>From [https://github.com/confluentinc/kafka-streams-examples/issues/351]
{quote}I have the following topology.


 {{Topology topology = new Topology();}}

{{//WS connection processor}}
{{topology}}
{{  .addSource(SOURCE1, new StringDeserializer(), new 
WebSocketConnectionEventDeserializer(), "topic1")}}
{{  .addProcessor(PROCESSOR1, Processor1::new, SOURCE1)}}
{{  .addStateStore(sessionStoreBuilder, PROCESSOR1)}}
{{  .addSink(WS_STATUS_SINK, "sinktopic", stringSerializer, stringSerializer, 
PROCESSOR1)}}
{{}}
{{//Service discovery}}
{{  .addGlobalStore(nodeTopicDiscoveryStoreBuilder, SOURCE3, new 
StringDeserializer(),
new ServiceDiscoveryEventDeserializer(), "compacttopic", 
GLOBALSTOREPROCESSOR,
GlobalStateStoreBuilder::new)}}
{{}}
{{//WS session routing}}
{{  .addSource(SOURCE2, new StringDeserializer(), new StringDeserializer(),
"topic2")}}
{{  .addProcessor(PROCESSOR2, Processor2::new,
SOURCE2)}}
{{  .addStateStore(userConnectedNodesStoreBuilder, PROCESSOR2, PROCESSOR1);}}
{{}}
{{streams = new KafkaStreams(topology, kafkaStreamProperties);  }}
While running the application, I get the following error

{{Consumer 
clientId=ws-stream-processor-6115be26-b6e0-49d7-9c47-d9215bfcfea8-StreamThread-1-consumer,
 groupId=ws-stream-processor] The following subscribed topics are not assigned 
to any members: [compacttopic]}}
{quote}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Contributor List

[Bill Bejeck]

Dominic,

You're all set now.  Thanks for your interest in Apache Kafka.

Regards,
Bill

On Sat, Aug 14, 2021 at 11:21 AM Dominic Lukaszewicz 
wrote:

> Hi,
>
> I would like to be added to the contributor list for kafka developers.
> My Jira Account details are below:
> domtoml
>
> Let me know if you need any extra information.
>
> Kind Regards,
> Dominic
>

Re: [DISCUSS] KIP-747 Add support for basic aggregation APIs

[Alexandre Brasil]

> I am not sure why we would want to pass `Function>
> func` into `min()`?

I guess I misread/misunderstood your earlier suggestion.

My line of thought was that, instead of using a method signature that
demands a Comparator in
min()/max(), we might use a property extractor (like the FK extractors on
some join() overloads) to
return a Comparable property that min()/max() could use to compare the
values.

The benefit of this approach is that It would be simpler than implementing
comparators when most
use cases would probably compare properties of the values that already
implement Comparable (like
Numbers, Strings, Dates, etc), but on the other hand it would be more
limiting in disallowing the usage
of multiple properties of  or on defining how null property values
should be handled.

On Tue, Aug 3, 2021 at 10:55 PM Matthias J. Sax  wrote:

> I was playing with the code a little bit, but it seems not to be easy to
> use generics to enforce that V is `Comparable`...
>
> We would need to introduce a new interface
>
>  interface ComparableStream>
> extends KStream
>  {
> KTable min();
>  }
>
> But it also requires a nasty cast to actually use it:
>
>   KStream stream =
> new StreamsBuilder().stream("");
>   KTable table =
> ((ComparableStream) stream).min();
>
> If the value-type does not implement `Comparable` the cast would not
> compile... Or would there be a simpler way to ensure that min() can only
> be called _if_ V is `Comparable`?
>
>
> So maybe passing in a `Comparator` might be the right way to go;
> might also be more flexible anyway. -- My original idea was just to
> maybe avoid the `Comparator` argument, as it would make the API nicer
> IMHO; fewer parameters is usually better...
>
>
> I am not sure why we would want to pass `Function>
> func` into `min()`?
>
>
>
> -Matthias
>
>
>
> On 6/21/21 11:23 AM, Mohan Parthasarathy wrote:
> > Alex,
> >
> >
> > On Wed, Jun 16, 2021 at 8:07 AM Alexandre Brasil <
> alexandre.bra...@gmail.com>
> > wrote:
> >
> >> Mohan / Mathias,
> >>
>  I think extending min/max to non-numeric types makes sense. Wondering
>  why we should require a `Comparator` or if we should require that the
>  types implement `Comparable` instead?
> 
> >>> Good question. This is what it would look like:
> >>>
> >>> KTable min_comparable()
> >>> KTable min_comparator(Comparator comp)
> >>
> >> Not sure if I understood Mathias' proposal correctly, but I think that
> >> instead of going with
> >> your original proposal ( KTable
> min(Function >> VR> func...)
> >> or mine (KTable min(Comparator comparator...), we could
> simplify
> >> it a
> >> bit by using a function to extract a Comparable property from the
> original
> >> value:
> >>
> >> KTable min(Function> func...)
> >>
> >> I will let Matthias clarify. I am not sure why it is simpler than the
> > comparator one. Comparable is implemented by the type and not sure
> exposing
> > it this way makes it any better.
> >
> >> I also think, that min/max should not change the value type. Using
> >>> `Long` for sum() make sense though, and also to require a ` >>> Number>`.
> >>
> >> Are there any reasons to limit the sum() to integers? Why not use a
> Double
> >> instead?
> >>
> >> Yeah, if the precision is important, then we should stick with Double.
> >
> > -mohan
> >
> > Best regards,
> >> Alexandre
> >>
> >> On Wed, Jun 16, 2021 at 1:01 AM Mohan Parthasarathy <
> mposde...@gmail.com>
> >> wrote:
> >>
> >>> Matthias,
> >>>
> >>> On Mon, Jun 14, 2021 at 9:18 PM Matthias J. Sax
> >>  
> >>> wrote:
> >>>
>  Hi,
> 
>  I think extending min/max to non-numeric types makes sense. Wondering
>  why we should require a `Comparator` or if we should require that the
>  types implement `Comparable` instead?
> 
>  Good question. This is what it would look like:
> >>>
> >>> KTable min_comparable()
> >>> KTable min_comparator(Comparator comp)
> >>>
> >>> For min_comparable to work, you still need the bounds "V extends
> >>> Comparable<
> >>> V>". AFAICT, to avoid the "type parameter V hiding the type V" warning,
> >> it
> >>> has to be at the interface level like this:
> >>>
> >>>  KStream>
> >>>
> >>> which is a little messy unless there is a different way to do the same.
> >> The
> >>> comparator gives a simple way to define an anonymous function.
> >>>
> >>> What do you think ?
> >>>
> >>>
>  I also think, that min/max should not change the value type. Using
>  `Long` for sum() make sense though, and also to require a `  Number>`.
> 
>  I guess these are the two possibilities:
> >>>
> >>>  Long sum(Function func)
> >>> Long sum(Function func)
> >>>
> >>> Both should work. "func" can return any subtypes of Number and I don't
> >> see
> >>> any advantages with the first version. Can you clarify ?
> >>>
> >>> Thanks
> >>> Mohan
> >>>
> >>>
> 
>  -Matthias
> 
>  On 6/8/21 5:00 PM, Mohan Parthasarathy wrote:
> > Hi Alex,
> >
> > On Tue, Jun 8, 2021 at 2

Re: Request for permissions to contribute to Apache Kafka

[Mickael Maison]

Hi Tomer,

I granted you permissions. Thanks for your interest and welcome!

On Sun, Aug 15, 2021 at 7:31 AM Tomer Wizman  wrote:
>
> Hi,
> I'd like to contribute to Apache Kafka
>
> my Jira ID is: TomerWizman
>
> Thanks!