> One question I would have is, what is the benefit of adding
>> these
>> > > > >> > > custom metadata in the rlmMetadata rather than letting the
>> plugin
>> > > > >> > > manage access and persistence to them?
>> >
l topic?
> > > > >> >
> > > > >> > > It would be possible for a user
> > > > >> > > to use custom metadata large enough to adversely impact
> access to
> > > and
> > > > >> > > caching of the rlmMetadata b
his risk and put it under control, the RSM plugin
> > > >> > implementations could document what custom metadata they use and
> > > >> estimate
> > > >> > their size.
> > > >> >
> > > >> > Best,
> > > >
exandre,
>> > > > >> >
>> > > > >> > Thank you for your feedback!
>> > > > >> >
>> > > > >> > > One question I would have is, what is the benefit of adding
>> these
>> > > &
gt; > > > >> that
> > > > >> > the plugin will have its own storage for those custom metadata,
> for
> > > > >> example
> > > > >> > a special topic?
> > > > >> >
> > > > >> > > It would be possible for a user
> > > > >> > > to use custom metadata lar
mitigate this risk and put it under control, the RSM plugin
> > > >> > implementations could document what custom metadata they use and
> > > >> estimate
> > > >> > their size.
> > > >> >
> > > >> > Best,
> >
gt;
> > >> >
> > >> > On Mon, 17 Apr 2023 at 18:14, Alexandre Dupriez <
> > >> alexandre.dupr...@gmail.com>
> > >> > wrote:
> > >> >
> > >> > > Hi Ivan,
> > >> > >
> > >> &
remote storage manager.
> >> > > One question I would have is, what is the benefit of adding these
> >> > > custom metadata in the rlmMetadata rather than letting the plugin
> >> > > manage access and persistence to them?
> >> >
proach proposed
>> > > in the KIP is that the rlmMetadata is not of a predefined, relatively
>> > > constant size (although corner cases with thousands of leader epochs
>> > > in the leader epoch map are possible). It would be possible for a user
>> > &g
map are possible). It would be possible for a user
> > > to use custom metadata large enough to adversely impact access to and
> > > caching of the rlmMetadata by Kafka.
> > >
> > > Thanks,
> > > Alexandre
> > >
> > > Le jeu. 6 av
tore remote segments in
> > different buckets
> > >
> > >
> > >
> > > | |
> > > hzhka...@163.com
> > > |
> > > |
> > > 邮箱：hzhka...@163.com
> > > |
> > >
> > >
> > >
> > >
>
> 邮箱：hzhka...@163.com
> > |
> >
> >
> >
> >
> > ---- 回复的原邮件 ----
> > | 发件人 | Ivan Yurchenko |
> > | 日期 | 2023年04月06日 22:37 |
> > | 收件人 | dev@kafka.apache.org |
> > | 抄送至 | |
> > | 主题 | [DISCUSS] KIP-917: Additional custom metadat
; buckets
>
>
>
> | |
> hzhka...@163.com
> |
> |
> 邮箱：hzhka...@163.com
> |
>
>
>
>
> 回复的原邮件
> | 发件人 | Ivan Yurchenko |
> | 日期 | 2023年04月06日 22:37 |
> | 收件人 | dev@kafka.apache.org |
> | 抄送至 | |
> | 主题 | [DISCUSS] KIP-917: Additional custom me
I think it's a good idea as we may want to store remote segments in different
buckets
| |
hzhka...@163.com
|
|
邮箱：hzhka...@163.com
|
回复的原邮件
| 发件人 | Ivan Yurchenko |
| 日期 | 2023年04月06日 22:37 |
| 收件人 | dev@kafka.apache.org |
| 抄送至 | |
| 主题 | [DISCUSS] KIP-917: Additional custom
Hello!
I would like to start the discussion thread on KIP-917: Additional custom
metadata for remote log segment [1]
This KIP is fairly small and proposes to add a new field to the remote
segment metadata.
Thank you!
Best,
Ivan
[1]
15 matches
Mail list logo
