Re: [VOTE] KIP-714: Client Metrics and Observability

2022-01-26 Thread rifer...@riferrei.com
+1

I think this KIP solves a problem that has been around for some time with Kafka 
deployments, which is the ability to assess the current state of a Kafka 
architecture but looking at the whole picture. I also share other folks' 
concerns regarding adding runtime dependencies to the clients; this may be 
problematic for large deployments. Still, I think it is worth refactoring.

IMHO, it is a fair trade-off.

— Ricardo

> On Jan 26, 2022, at 9:34 AM, Magnus Edenhill  wrote:
> 
> Hi all,
> 
> it's been a while and there's been some more discussions of the KIP which
> have been
> addressed on the KIP page.
> 
> I think it's a good time to revive this vote thread and get things moving.
> 
> We're currently at +3 (non-binding) and -1 (non-binding) votes.
> 
> Regards,
> Magnus
> 
> 
> Den mån 1 nov. 2021 kl 21:19 skrev J Rivers :
> 
>> +1
>> 
>> Thank you for the KIP!
>> 
>> Our organization runs kafka at large scale in a multi-tenant configuration.
>> We actually have many other enterprises connecting up to our system to
>> retrieve stream data. These feeds vary greatly in volume and velocity. The
>> peak rates are a multiplicative factor of the nominal.  There is extreme
>> skew in our datasets in a number of ways.
>> 
>> We don't have time to work with every new internal/external client to tune
>> their feeds. They need to be able to take one of the many kafka clients and
>> go off to the races.
>> 
>> Being able to retrieve client metrics would be invaluable here as it's hard
>> and time consuming to communicate out of the enterprise walls.
>> 
>> This KIP is important to us to expand the use of our datasets internally
>> and outside the borders of the enterprise. Our clients like the performance
>> and data safeties related to the kafka connection. The observability has
>> been a problem...
>> 
>> Jonathan Rivers
>> jrivers...@gmail.com
>> 
>> 
>> 
>> 
>> On Mon, Oct 18, 2021 at 11:56 PM Ryanne Dolan 
>> wrote:
>> 
>>> -1
>>> 
>>> Ryanne
>>> 
>>> On Mon, Oct 18, 2021, 4:30 AM Magnus Edenhill 
>> wrote:
>>> 
 Hi all,
 
 I'd like to start a vote on KIP-714.
 https://cwiki.apache.org/confluence/x/2xRRCg
 
 Discussion thread:
 https://www.mail-archive.com/dev@kafka.apache.org/msg119000.html
 
 Thanks,
 Magnus
 
>>> 
>> 



Status of KIP-714: Client Metrics and Observability

2022-01-19 Thread rifer...@riferrei.com
Hi there,

I want to get up to speed in what is going on with this KIP and how it works, 
so I would like to ask where can I get more information on it? I know it still 
being discussed, but I would appreciate if there are any code branches that I 
could use to see the design changes and understand the implementation behavior 
proposed.

Thanks,

— Ricardo