ng
>> > > > > `setRecordMetadata` API. Since this class is part of the public
>> > > > test-utils
>> > > > > package we should claim it in the wiki as well.
>> > > > >
>> > > > >
>> > > >
e are also adding one additional API plus modifying the existing
> > > > > `setRecordMetadata` API. Since this class is part of the public
> > > > test-utils
> > > > > package we should claim it in the wiki as well.
> > > > >
> > > >
> > > > package we should claim it in the wiki as well.
> > > >
> > > >
> > > > Guozhang
> > > >
> > > > On Mon, May 14, 2018 at 8:43 AM, Ted Yu <yuzhih...@gmail.com> wrote:
> > > >
> > > >>
the public
> > test-utils
> > > package we should claim it in the wiki as well.
> > >
> > >
> > > Guozhang
> > >
> > > On Mon, May 14, 2018 at 8:43 AM, Ted Yu <yuzhih...@gmail.com> wrote:
> > >
> > >> +1
> > >
gt; +1
> >>
> >> On Mon, May 14, 2018 at 8:31 AM, Jorge Esteban Quilcate Otoya <
> >> quilcate.jo...@gmail.com> wrote:
> >>
> >>> Hi everyone,
> >>>
> >>> I would like to start a vote on KIP-244: Add Record Header support
t 8:43 AM, Ted Yu <yuzhih...@gmail.com> wrote:
>
>> +1
>>
>> On Mon, May 14, 2018 at 8:31 AM, Jorge Esteban Quilcate Otoya <
>> quilcate.jo...@gmail.com> wrote:
>>
>>> Hi everyone,
>>>
>>> I would like to start a vote on KIP-244: Add
m> wrote:
>
> > Hi everyone,
> >
> > I would like to start a vote on KIP-244: Add Record Header support to
> Kafka
> > Streams
> >
> > KIP wiki page:
> > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > 244%3A+Add+Record+Header+su
t;>>> proposal.
> > > > >>>>>>>>>>>> The current one pass it as part of `RecordContext`, so
> if
> > > it's
> > > > >>>>>>> forward
> > > > >>>>>>>>> it
> &
ié., 2 may. 2018 a las 22:56, Guozhang Wang (<
> > > >>>>> wangg...@gmail.com
> > > >>>>>>>> )
> > > >>>>>>>>>>>> escribió:
> > > >>>>>>>>>>&
+1
On Mon, May 14, 2018 at 8:31 AM, Jorge Esteban Quilcate Otoya <
quilcate.jo...@gmail.com> wrote:
> Hi everyone,
>
> I would like to start a vote on KIP-244: Add Record Header support to Kafka
> Streams
>
> KIP wiki page:
> https://cwiki.apache.org/confluence/disp
Hi everyone,
I would like to start a vote on KIP-244: Add Record Header support to Kafka
Streams
KIP wiki page:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-244%3A+Add+Record+Header+support+to+Kafka+Streams+Processor+API
The discussion thread is here:
http://mail-archives.apache.org
h John's):
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> 1. We need to have a clear inheritance protocol of headers
> in
> > >>> our
> > >>>>>>>>>>>> topology:
> > >>>>>>
e headers then in order to be sent downstreams?
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> 3. In future work "Adding DSL Processors to use Headers to
> >>>>>>>>>>>>> filter/map/branc
ders headers)",
>> this
>>>>>>> should
>>>>>>>>>>> be
>>>>>>>>>>>>> removed?
>>>>>>>>>>>>>
>>>>>>>>>>>>> 5. MINOR: it seems to be the
gt; I agree that de-scoping the work to just the Processor API
> will
> > >>>> help
> > >>>>>>>>>>> contain the design and implementation complexity.
> > >>>>>>>>>>>
> > >>>>>>>>>>> In
quot;process", since it wouldn't be necessary in
> >> conjunction
> >>>>>>>> with
> >>>>>>>>>> the
> >>>>>>>>>>> ProcessorContext change, and it's not represented in your PR.
> make
>>>>>>>> the
>>>>>>>>>> API
>>>>>>>>>>> changes, while promising to drop all headers from input records.
>>>>>>>>>>>
>>>>>>>>>>>
n having a complex list of operators that do or don't
> >>>>>> forward
> >>>>>>>>> them. Plus, I think it might be tricky to define this behavior
> >> while
> >>>>>>> not
> >>>>&
;>>>>>>>
>>>>>>>>>> Hi Matthias,
>>>>>>>>>>
>>>>>>>>>> I've created a new JIRA to track this, updated the KIP and create
>> a
>>>>>>> PR.
>>>>>>>
>>>> question of this work, seems to be how to expose headers at DSL
> >>>>>> level.
> >>>>>>>>> This related to KIP-149 and KIP-159. However, for Processor API,
> >>>> it
> >>>>>>>>> seems to be
and KIP accordingly. Note,
>>>>> that
>>>>>> we
>>>>>>>>> have two JIRA that are duplicates atm. We can scope them
>>>>> accordingly:
>>>>>>>>> one for PAPI only,
t;> key/value
> >>>>>> and
> >>>>>>>> then group using current KeyValue structure.
> >>>>>>>>
> >>>>>>>> 2. Yes. IMO key/value stores, like RocksDB, rely on KV as
> >&g
e
>>> that
>>>>>> need
>>>>>>>> this).
>>>>>>>>
>>>>>>>> 3. and 4. Changes on 1. will solve this issue.
>>>>>>>>
>>>>>>>> Probably I rush a bit proposing this change
> > > >> As Bill pointed out already, we should be careful with adding
> > new
> > > > > > >> overloads as this contradicts the work done via KIP-182.
> > > > > > >>
> > > > > > >> This KIP also s
; > > > >>
> > > > > >> - why do you want to add the headers to `KeyValue`? I am not
> sure
> > > if
> > > > we
> > > > > >> should consider headers as optional metadata and add it to
> > > > > >> `
l. Do you suggest that all other operator just drop headers on
> > the
> > > > >> floor?
> > > > >>
> > > > >> - Why do you only want to put headers into in-memory and cache
> but
> > > not
> > > >
ed to store record header in state in the first
> place,
> > if
> > > >> we exclude stateful operator at DSL level?
> > > >>
> > > >>
> > > >> What is the motivation for the "border lines" you choose?
> > &
tthias
> > >>
> > >>
> > >> On 12/21/17 8:18 AM, Bill Bejeck wrote:
> > >>> Jorge,
> > >>>
> > >>> Thanks for the KIP, I know this is a feature others in the community
> > have
> > >>> been interes
gt;> I took a quick pass over it, and I have one initial question.
> >>>
> >>> We recently reduced overloads with KIP-182, and in this KIP we are
> >>> increasing them again.
> >>>
> >>> I can see from the KIP why they are necessa
Jorge Quilcate created KAFKA-6850:
-
Summary: KIP-244: Add Record Header support to Kafka Streams
Processor API
Key: KAFKA-6850
URL: https://issues.apache.org/jira/browse/KAFKA-6850
Project: Kafka
t;>> don't have any sound suggestions ATM, so I'll have to think about it some
>>> more, but I wanted to put the thought out there.
>>>
>>> Thanks,
>>> Bill
>>>
>>> On Thu, Dec 21, 2017 at 9:06 AM, Jorge Esteban Quilcate Otoya <
>&
,
> > Bill
> >
> > On Thu, Dec 21, 2017 at 9:06 AM, Jorge Esteban Quilcate Otoya <
> > quilcate.jo...@gmail.com> wrote:
> >
> >> Hi all,
> >>
> >> I have created a KIP to add Record Headers support to Kafka Streams API:
> >> https://cwik
ght out there.
>
> Thanks,
> Bill
>
> On Thu, Dec 21, 2017 at 9:06 AM, Jorge Esteban Quilcate Otoya <
> quilcate.jo...@gmail.com> wrote:
>
>> Hi all,
>>
>> I have created a KIP to add Record Headers support to Kafka Streams API:
>> https://cwiki.
AM, Jorge Esteban Quilcate Otoya <
quilcate.jo...@gmail.com> wrote:
> Hi all,
>
> I have created a KIP to add Record Headers support to Kafka Streams API:
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> 244%3A+Add+Record+Header+support+to+Kafka+Streams
>
>
&g
Hi all,
I have created a KIP to add Record Headers support to Kafka Streams API:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-244%3A+Add+Record+Header+support+to+Kafka+Streams
The main goal is to be able to use headers to filter, map and process
records as streams. Stateful processing
35 matches
Mail list logo
