Kafka Streams

[Nick Quinn]

There has been a lot of talk around town about Confluent's new stream 
processing engine, Kafka Streams. We are currently using Samza and I want to 
get some feedback for myself and other developers on this group list about the 
differences and possible advantages to using Samza when compared to Kafka 
Streams. I would appreciate any and all feedback.

Thanks!
Nick Quinn

RE: Enabling Core Dumps

[Nick Quinn]

Thanks Chris and Jagadish!
Nick

-Original Message-
From: Chris Pettitt [mailto:cpett...@linkedin.com.INVALID] 
Sent: Wednesday, May 18, 2016 11:30 AM
To: dev@samza.apache.org
Subject: Re: Enabling Core Dumps

ulimit sets limits for the shell and subprocesses, so you'd want to call it 
from the startup script for the samza container.

On Wed, May 18, 2016 at 2:25 PM, Jagadish Venkatraman < jagadish1...@gmail.com> 
wrote:

> Can this be enabled by passing a command line option to the jvm?
>
> If so, you can pass the option to task.opts. They will be passed on 
> during spawning the container.
>
> On Wednesday, May 18, 2016, Nick Quinn <nqu...@objectivity.com> wrote:
>
> > I am getting an intermittent crash on one of my samza tasks.  How 
> > would I go about enabling a core dump? Do I just add "ulimit -c 
> > unlimited" to the java configuration in the properties file?  Any 
> > assistance would be appreciated.
> > Thanks!
> > Nick
> >
>
>
> --
> Sent from my iphone.
>

Enabling Core Dumps

[Nick Quinn]

I am getting an intermittent crash on one of my samza tasks.  How would I go 
about enabling a core dump? Do I just add "ulimit -c unlimited" to the java 
configuration in the properties file?  Any assistance would be appreciated.
Thanks!
Nick

RE: Kafka dependency

[Nick Quinn]

Thanks Yi! 

One more question, if I may:  I saw that you dropped a 0.10.0 in December of 
2015, but the version in Github is still 0.10.0-rc. Do you guys plan on an 
official release of 0.10.0 or are you settling for a simple rc release? The 
reason I ask is that it is hard to match the git commits to the release when 
there is no official 0.10.0 release.

Thanks!
Nick


-Original Message-
From: Yi Pan [mailto:nickpa...@gmail.com] 
Sent: Tuesday, May 10, 2016 11:22 AM
To: dev@samza.apache.org
Subject: Re: Kafka dependency

Hi, Nick,

We do have plan to update the Kafka dependency in Samza. However, Samza only 
uses Kafka client library. We have confirmed that any Kafka 0.8.2 clients 
should be supported by Kafka 0.9 brokers. Hence, it should not block you if you 
are thinking of upgrading Kafka broker versions (e.g.
LinkedIn has been running with this combination for a long time). The main 
reason that we are taking a bit careful path on the upgrading of Kafka client 
version is that there are Samza users who are still running Kafka
0.8.2 broker version and if we force upgrade the client version to 0.9, it 
would likely not be supported by a lower version of Kafka broker.

If you have any specific use case that requires Kafka client version 0.9 and 
above, please speak up. We will put into consideration in our upgrade plan and 
timeline.

Thanks a lot!

-Yi

On Tue, May 10, 2016 at 10:28 AM, Nick Quinn <nqu...@objectivity.com> wrote:

> Hi guys-
>
>
>
> I was wondering why Samza still has a dependency on Kafka 0.8.2. Does 
> your development team have any plans to update the Kafka dependency 
> version that Samza is using?
>
> Best,
>
> Nick
>
>

Kafka dependency

[Nick Quinn]

Hi guys-



I was wondering why Samza still has a dependency on Kafka 0.8.2. Does your 
development team have any plans to update the Kafka dependency version that 
Samza is using?

Best,

Nick