Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

2016-08-30 Thread Navina Ramesh
> On Aug. 25, 2016, 12:30 a.m., Navina Ramesh wrote: > > docs/learn/documentation/versioned/container/event-loop.md, line 24 > > <https://reviews.apache.org/r/50174/diff/2/?file=1455860#file1455860line24> > > > > There is no sharing of task state in Samza. E

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

2016-08-30 Thread Navina Ramesh
trict conventions for config names listed anywhere. Since we use period as a delimiter to distinguish configs belonging to a namespace, I think we should try to avoid using the same in the actual config part. For example, job.container.single.thread.mode can be job.container.single-thread-m

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

2016-08-30 Thread Navina Ramesh
> On Aug. 25, 2016, 12:30 a.m., Navina Ramesh wrote: > > docs/learn/documentation/versioned/container/event-loop.md, line 49 > > <https://reviews.apache.org/r/50174/diff/2/?file=1455860#file1455860line49> > > > > Does anything change with respect to a

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

2016-08-30 Thread Navina Ramesh
> On Aug. 25, 2016, 12:30 a.m., Navina Ramesh wrote: > > docs/learn/documentation/versioned/jobs/configuration-table.html, line 360 > > <https://reviews.apache.org/r/50174/diff/2/?file=1455861#file1455861line360> > > > > Isn't there a performance impac

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

2016-08-30 Thread Navina Ramesh
> On Aug. 25, 2016, 12:31 a.m., Navina Ramesh wrote: > > Not that I intend to give you more work. However, adding an example of > > AsyncStreamTask to samza's hello-world will give a quick idea to the user > > on when to use it and how to use it. This can be augment

Re: Review Request 51252: SAMZA-1004: Fix some logging and javadoc issues for AsyncStreamTask

2016-08-30 Thread Navina Ramesh
2016, 10:01 p.m., Xinyu Liu wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/51252/ > --- > > (Updated Aug. 30, 2016, 10:01 p.m.) > > > Review r

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

2016-08-31 Thread Navina Ramesh
<https://reviews.apache.org/r/51142/#comment214572> If it is not implemented, I suggest removing it and simply adding a comment that another potential readertype could be "PLAIN" text - Navina Ramesh On Aug. 29, 2016, 5:27 p.m., Hai Lu wrote: > > --

Re: [DISCUSS] End of Stream Feature in Samza

2016-08-31 Thread Navina Ramesh
Hi Jagadish, Thanks for sharing the design with the community. I have a couple of questions that were not very clear from the design document. 1. Under mechanism for indicating the end-of-stream to Samza, you mention "The offset in the partition that the message was received from. If this is the l

Re: Review Request 51516: SAMZA-702: Document the significance of all the different metrics emitted by Samza out of the box

2016-08-31 Thread Navina Ramesh
(line 247) <https://reviews.apache.org/r/51516/#comment214698> I actually don't see any difference between "send-calls" and "messages-sent". Both are technically the same. We should consider removing one of them. At least, deprecating one of them in the current v

Re: Review Request 51516: SAMZA-702: Document the significance of all the different metrics emitted by Samza out of the box

2016-08-31 Thread Navina Ramesh
particular system stream partition docs/learn/documentation/versioned/container/metrics-table.html (line 379) <https://reviews.apache.org/r/51516/#comment214705> nit: Average time spent polling all underlying systems for new messages (in nanoseconds) - Navina Ramesh On Aug. 30, 201

Re: Review Request 51516: SAMZA-702: Document the significance of all the different metrics emitted by Samza out of the box

2016-08-31 Thread Navina Ramesh
container/metrics-table.html (line 795) <https://reviews.apache.org/r/51516/#comment214711> did you mean per-system here? - Navina Ramesh On Aug. 30, 2016, 7:36 a.m., Branislav Cogic wrote: > > --- > This is an automatically ge

Re: [DISCUSS] End of Stream Feature in Samza

2016-09-01 Thread Navina Ramesh
sk ? > > > > >> Nope, It does not. However, the container would not terminate (if you > > have a source that has not reached end of stream yet) > > > > 3. During checkpoint, let's say some of the partitions have reached EOF. > Do > > we write a specia

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

2016-09-01 Thread Navina Ramesh
e name of the file represent the file length ? (in suffix string) Or did you just add it for testing? - Navina Ramesh On Aug. 29, 2016, 5:27 p.m., Hai Lu wrote: > > ---

Re: Review Request 51630: SAMZA-1007: Pass job config from factory to grouper

2016-09-05 Thread Navina Ramesh
thanks! - Navina Ramesh On Sept. 5, 2016, 6:05 p.m., Neil Fordyce wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.

Re: Periodic cleanup of unused local stores

2016-09-06 Thread Navina Ramesh
Hi Santhosh, Thanks for picking SAMZA-656. This is long overdue and will help make our host-affinity based solution more robust. I have a couple of thoughts on your design proposal. 1. It is always very useful to provide more context to the reader, esp. in explaining what the different terms mean

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

2016-09-08 Thread Navina Ramesh
-- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/50174/ > --- > > (Updated Sept. 7, 2016, 5:16 p.m.) > > > Review request for samza, Chris Petti

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

2016-09-08 Thread Navina Ramesh
> On Aug. 31, 2016, 12:54 a.m., Navina Ramesh wrote: > > docs/learn/documentation/versioned/jobs/configuration-table.html, line 357 > > <https://reviews.apache.org/r/50174/diff/3/?file=1488352#file1488352line357> > > > > Is it too late to comment on the conf

Re: Question about Samza Metrcis

2016-09-08 Thread Navina Ramesh
Hi ShuQi, Auto-creation of streams depends on your Kafka server configuration. In case of coordinator stream and checkpoint stream, samza explicitly creates a stream with 1 partition before publishing to it. This doesn't apply for metrics. So, if auto-creation is turned off in kafka server, then y

Re: Review Request 51726: SAMZA-1005: Refactor class instantiation code to a helper class.

2016-09-10 Thread Navina Ramesh
occurrences of Class loaders :) Thanks for the patch! - Navina Ramesh On Sept. 8, 2016, 12:44 p.m., Branislav Cogic wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache

Re: Review Request 51630: SAMZA-1007: Pass job config from factory to grouper

2016-09-10 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51630/#review148404 --- Ship it! Ship It! - Navina Ramesh On Sept. 6, 2016, 8:41

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

2016-09-13 Thread Navina Ramesh
easier for you to complete this documentation :) - Navina Ramesh On Sept. 13, 2016, 9 p.m., Xinyu Liu wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.

Re: Review Request 51516: SAMZA-702: Document the significance of all the different metrics emitted by Samza out of the box

2016-09-13 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51516/#review148832 --- Ship it! Ship It! - Navina Ramesh On Sept. 2, 2016, 9:10

Re: Issue with consuming non-existent topics in 0.10.1

2016-09-15 Thread Navina Ramesh
Hi Tommy, Yi and I discussed about it and initially, we thought it could have something to do with the topic auto-creation setting on your Kafka server. Is it enabled or disabled in your case? I kind of suspect that the request timeout is insufficient. However, we do have retries on Samza to fetc

Re: Question about Samza Metrics

2016-09-16 Thread Navina Ramesh
Hi Shuqi, It depends on the type of metric you are looking for. Most counters and gauges are cumulative. Timer is the only metrics that works within a sliding window (if I am not mistaken). What usecase are you trying to solve? Thanks! Navina On Mon, Sep 12, 2016 at 11:50 PM, 舒琦 wrote: > Hi, >

Re: Issue with consuming non-existent topics in 0.10.1

2016-09-16 Thread Navina Ramesh
shed creating the topic and returns the correct partition > metadata. The optimized path introduced by the SAMZA-971 fix goes into > KafkaSystemAdmin.getSystemStreamPartitionCounts() which does not check > this errorCode, and simply returns an empty set of partitions. Does that > make sense?

Re: Review Request 51962: SAMZA-1021 Remove the redundent poll waiting inside AsyncRunLoop blockIfBusy

2016-09-16 Thread Navina Ramesh
changing :) yes. We should not block in 2 places for the same cause. +1 ! - Navina Ramesh On Sept. 16, 2016, 5:56 p.m., Xinyu Liu wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache

Re: Review Request 52066: change warn about loopback address to a debug

2016-09-21 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/52066/#review149877 --- Ship it! Ship It! - Navina Ramesh On Sept. 19, 2016, 8:55

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

2016-09-27 Thread Navina Ramesh
------ > > (Updated Sept. 20, 2016, 11:22 p.m.) > > > Review request for samza, Chris Pettitt, Yi Pan (Data Infrastructure), and > Navina Ramesh. > > > Bugs: SAMZA-967 > https://issues.apache.org/jira/browse/SAMZA-967 > >

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

2016-09-27 Thread Navina Ramesh
- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/51142/ > --- > > (Updated Sept. 20, 2016, 11:22 p.m.) > > > Review request for samza, Chris Pettitt, Yi Pan (Data Infrastructure),

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

2016-09-27 Thread Navina Ramesh
pache.org/r/51142/ > ----------- > > (Updated Sept. 20, 2016, 11:22 p.m.) > > > Review request for samza, Chris Pettitt, Yi Pan (Data Infrastructure), and > Navina Ramesh. > > > Bugs: SAMZA-967 > https://issues.a

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

2016-09-27 Thread Navina Ramesh
etween samza-hdfs and samza-kafka? It seems to have been introduced by the HdfsSystemProducer. Can we please fix it forward? Or as Yi suggested, please create a JIRA and add a TODO comment here referring to the JIRA Thanks! - Navina Ramesh On Sept. 2

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

2016-09-27 Thread Navina Ramesh
lemented the bucketized locking as a > > built-in method already: > > http://www.tutorialspoint.com/guava/guava_caching_utilities.htm > > Navina Ramesh wrote: > What was the resolution here? Was there any change to the IO pattern to > use caching? > > Hai Lu wrote:

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

2016-09-27 Thread Navina Ramesh
s what are the set of compatible APIs! So, I > guess that we just enforce avro-1.4 when compiling samza-hdfs module? I > remember that I tried last time and got a build failure in samza-hdfs w/ > AvroDataFileHdfsWriter in samza-li build. I am curious how you made it work. >

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

2016-09-27 Thread Navina Ramesh
h (line 27) <https://reviews.apache.org/r/51142/#comment218688> If we want to use this only for the azkaban runner, we should perhaps rename the file as run-job-for-azkaban.sh or something on those lines. - Navina Ramesh On Sept. 20, 2016,

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

2016-09-29 Thread Navina Ramesh
> On Sept. 28, 2016, 12:28 a.m., Navina Ramesh wrote: > > build.gradle, line 308 > > <https://reviews.apache.org/r/51142/diff/6/?file=1506732#file1506732line308> > > > > why is this dependency needed here? It seems like this compile > > dependency i

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

2016-09-29 Thread Navina Ramesh
https://reviews.apache.org/r/51142/#review150883 --- On Sept. 28, 2016, 9:57 p.m., Hai Lu wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/51142/ > -----

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

2016-09-29 Thread Navina Ramesh
--- > > (Updated Sept. 28, 2016, 9:57 p.m.) > > > Review request for samza, Yi Pan (Data Infrastructure) and Navina Ramesh. > > > Bugs: SAMZA-967 > https://issues.apache.org/jira/browse/SAMZA-967 > > > Rep

Re: [VOTE] Apache Samza 0.11.0 RC2

2016-10-12 Thread Navina Ramesh
Validated MD5 and build. Ran check-all and integration test on Mac. +1 (binding) Thanks! Navina On Tue, Oct 11, 2016 at 1:16 PM, Yi Pan wrote: > Build, validated MD5, test w/ integration tests and passed. Thanks! > > +1 (binding) > > On Mon, Oct 10, 2016 at 4:07 PM, xinyu liu wrote: > > > Hey

Re: Review Request 52960: SAMZA-1029: Prepare release candidate for 0.11.0

2016-10-17 Thread Navina Ramesh
(line 51) <https://reviews.apache.org/r/52960/#comment06> Shouldn't this be 0.11.1-SNAPSHOT as well? - Navina Ramesh On Oct. 17, 2016, 11:45 p.m., Xinyu Liu wrote: > > --- > This is an automatically generated e-m

Re: Review Request 52962: SAMZA-1029: Prepare release candidate for 0.11.0

2016-10-17 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/52962/#review153001 --- Ship it! Ship It! - Navina Ramesh On Oct. 18, 2016

Re: Review Request 52168: Tasks endpoint to list the complete details of all tasks related to a job

2016-10-25 Thread Navina Ramesh
ern for constructing an instance of ConfigFactory. Why not use the ClassLoaderHelper directly whereever this is used? - Navina Ramesh On Oct. 24, 2016, 10 p.m., Shanthoosh Venkataraman wrote: > > --- > This is an automatica

Re: Review Request 53453: Add optional interface for SystemConsumer checkpontListener() for checkpoint notifications

2016-11-09 Thread Navina Ramesh
stemStreamPartition, offset: String) => ssp.getSystem() } and skip the comments fully?? samza-core/src/test/scala/org/apache/samza/checkpoint/TestOffsetManager.scala (line 292) <https://reviews.apache.org/r/53453/#comment225466> offsetManager.stop is missing - Navina Ramesh

Re: SAMZA-469 - scala 2.11 / move to java?

2016-11-10 Thread Navina Ramesh
Hi Thunder, Sorry about the late response. I was refreshing my memory of SAMZA-469 :) Is there something preventing this from getting into a release? > Seems to me like the main roadblock on upgrading to scala 2.11 was related to JDK6. We have already moved away from JDK6 and JDK7. So, I don't see

Re: SAMZA-469 - scala 2.11 / move to java?

2016-11-16 Thread Navina Ramesh
s! > Thunder > > > -Original Message----- > From: Navina Ramesh [mailto:nram...@linkedin.com.INVALID] > Sent: Thursday, November 10, 2016 2:19 PM > To: dev@samza.apache.org > Subject: Re: SAMZA-469 - scala 2.11 / move to java? > > Hi Thunder, > Sorry about the late resp

Re: Review Request 53826: added user document for Checkpoint callbacks

2016-11-17 Thread Navina Ramesh
https://reviews.apache.org/r/53826/#comment226473> suggestion: Highlight "not" in "not atomic" -> **not** atomic - Navina Ramesh On Nov. 16, 2016, 11:28 p.m., Boris Shkolnik wrote: > > --- > This is an a

Re: [DISCUSS] Samza 0.12.0 release

2016-12-23 Thread Navina Ramesh
+1 Navina On Fri, Dec 23, 2016 at 2:53 PM, xinyu liu wrote: > +1 on the new release. > > Thanks, > Xinyu > > On Fri, Dec 23, 2016 at 2:50 PM, Yi Pan wrote: > > > Yep! Thanks for pointing it out! @Shanthoosh, can you update the list > > accordingly? > > > > Thanks! > > > > On Fri, Dec 23, 2016

Upcoming Stream Processing Meetup in February!

2017-01-24 Thread Navina Ramesh
Hi everyone, We would like to invite you to a Stream Processing Meetup at LinkedIn’s Sunnyvale campus on Thursday, February 16 at 6pm. Please RSVP here (if you intend to attend in person): https://www.meetup.com/Stream-Processing-Meetup-LinkedIn/events/237171557/

Re: Review Request 52570: SAMZA-1025: documentation for hdfs system consumer

2017-01-25 Thread Navina Ramesh
Looks like there are more configurations that are mentioned in the configuration table. Can you please add the link to configuration table to imply that? docs/learn/documentation/versioned/hdfs/consumer.md (line 105) <https://reviews.apache.org/r/52570/#comment234466> You ca

Re: Review Request 52570: SAMZA-1025: documentation for hdfs system consumer

2017-01-27 Thread Navina Ramesh
> On Jan. 25, 2017, 10:50 p.m., Navina Ramesh wrote: > > docs/learn/documentation/versioned/hdfs/consumer.md, line 26 > > <https://reviews.apache.org/r/52570/diff/2/?file=1613256#file1613256line26> > > > > Can you include the diagram from your design docume

Re: Review Request 52570: SAMZA-1025: documentation for hdfs system consumer

2017-01-27 Thread Navina Ramesh
> On Jan. 25, 2017, 10:36 p.m., Jagadish Venkatraman wrote: > > docs/learn/documentation/versioned/hdfs/consumer.md, line 67 > > > > > > The relationship between whitelist and blacklist was not very obvious > > to me

Re: Review Request 52570: SAMZA-1025: documentation for hdfs system consumer

2017-01-27 Thread Navina Ramesh
mphasize the reserved term note by doing -> **note** , when it is outside the code block docs/learn/documentation/versioned/jobs/configuration-table.html (line 1822) <https://reviews.apache.org/r/52570/#comment234763> Look like a typo. It should "systems.*, instead of "sys

Re: [VOTE] Apache Samza 0.12.0 RC2

2017-02-13 Thread Navina Ramesh
I ran check-all against Mac and integration tests on Linux. Looks good with no concerning issues. +1 (binding) Thanks! Navina On Fri, Feb 10, 2017 at 9:25 AM, Boris S wrote: > I also successfully ran the integration tests on Linux. All passed. > +1 non-binding > > On Wed, Feb 8, 2017 at 4:57 P

Re: [DISCUSS] SAMZA-1141 - Apache Samza Development Process Improvements

2017-03-14 Thread Navina Ramesh
Venkatraman < jagadish1...@gmail.com> wrote: > Thanks for writing this up. > > I'm +1 on this proposal. > > > > On Tue, Mar 14, 2017 at 3:15 PM, Navina Ramesh (Apache) > > wrote: > > > Hi everyone, > > > > We switched to using Pull Requests

Re: [DISCUSS] SAMZA-1141 - Apache Samza Development Process Improvements

2017-03-14 Thread Navina Ramesh
ke SEP-0), so it serves an example of how it will look like in > practice? > > Xinyu > > On Tue, Mar 14, 2017 at 3:34 PM, Navina Ramesh > > wrote: > > > Just to clarify: The proposal for code and design process change is > > attached as a PDF/markdown to the JIRA

Re: [DISCUSS] SEP-1: Semantics of ProcessorId in Samza

2017-03-16 Thread Navina Ramesh
> I am working on the ApplicationRunner SEP right now. Will send out the > discussion email once I am done. > > Thanks, > Xinyu > > On Thu, Mar 16, 2017 at 4:50 PM, Navina Ramesh (Apache) > > wrote: > > > > One minor thing I found is that the name of the config

Re: [DISCUSS] Support Scala 2.12

2017-03-17 Thread Navina Ramesh
Thanks for creating the DISCUSS email! This is good. It's a good idea to update to 2.12 since it looks like we are fully backward compatible with older versions. +1 from me. Cheers! Navina On Fri, Mar 17, 2017 at 1:34 PM, Jagadish Venkatraman < jagadish1...@gmail.com> wrote: > Thanks for starti

Re: [DISCUSS] SEP-1: Semantics of ProcessorId in Samza

2017-03-21 Thread Navina Ramesh
na On Tue, Mar 21, 2017 at 10:33 AM, Navina Ramesh (Apache) wrote: > Hi Jagadish, > Thanks for the suggestion. You are right in that it should be the > responsibility of the JobCoordinator to assign identifiers. > > > 'm only wondering if this logic could instead reside

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

2017-03-28 Thread Navina Ramesh
This is a blocker for > > integrating fluent API with StreamProcessor, and hopefully we can get it > > resolved soon :). > > > > Thanks, > > Xinyu > > > > On Tue, Mar 28, 2017 at 11:28 AM, Navina Ramesh (Apache) < > > nav...@apache.org> > &g

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

2017-03-29 Thread Navina Ramesh
> > > +1 on my side. Very happy to see this proposal. This is a blocker for > > > > integrating fluent API with StreamProcessor, and hopefully we can get > > it > > > > resolved soon :). > > > > > > > > Thanks, > > > > Xiny

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

2017-03-30 Thread Navina Ramesh
etting. > > Otherwise, the proposal looks good. > > -Yi > > On Wed, Mar 29, 2017 at 7:57 PM, Navina Ramesh > > wrote: > > > Good to hear from you, Yan. Thanks! :) > > > > On Wed, Mar 29, 2017 at 7:48 PM, Yan Fang wrote: > > > > > +1 . Tha

Re: Steps to Upgrading Samza (0.9 to 0.12)

2017-03-30 Thread Navina Ramesh
Hi everyone, Apologize for re-chiming in late on this issue. > I'm not sure I agree with the policy (removing migration code and wanting people to upgrade seem at odds to me), but minimally I think we should not assume people are upgrading to each new Samza version. I agree that we should not ass

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

2017-03-30 Thread Navina Ramesh
st, > > Renato M. > > 2017-03-30 20:45 GMT+02:00 Navina Ramesh : > > > Hi Yi, > > Good question. Three reasons: > > > > 1. In SAMZA-881, we came up with a set of responsibilities for the > > JobCoordinator. One of them was to generate/assign proces

Re: Samza Logo designs

2017-04-10 Thread Navina Ramesh
Hi Nacho, I rated on the designcrowd website directly. In terms of feedback: 1. I like the concept of using a butterfly to indicate "metamorphosis". However, a lot of the designs there look like a bow-tie :) 2. I think we should stick with a red theme for the name. Sorry about the late response.

Re: [VOTE] Samza Logo

2017-04-14 Thread Navina Ramesh
Hi Nacho, Do you want us to vote on this mail thread or directly at design crowd? Thanks! Navina On Fri, Apr 14, 2017 at 2:19 PM, Ignacio Solis wrote: > Hi folks. > > After some feedback and culling, we are down to 4 candidates. Please > vote on your favorite designs. We will be able to make m

Re: [VOTE] Samza Logo

2017-04-14 Thread Navina Ramesh
t feel free to leave comments here, > maybe you can try to persuade people or argue for your favorite. :-) > > Nacho > > On Fri, Apr 14, 2017 at 2:31 PM, Navina Ramesh > wrote: > > Hi Nacho, > > Do you want us to vote on this mail thread or directly at design crowd?

Re: [VOTE] Samza Logo

2017-04-18 Thread Navina Ramesh
t > > > vote does not get factored in. It assumes you have no opinion. So if > > > somebody votes 5 stars on A and 1 start on B. And second person only > > > votes 5 stars on B, then the ranking would be A-5 stars, B-3 stars. > > > (or something along those lines). So if

Re: [DISCUSS] SEP-2: ApplicationRunner Design

2017-04-21 Thread Navina Ramesh
Hey Yi, Thanks for lot for your work on this document. I know it must have been crazy trying to put-together everything in a single doc :) Here are my comments. Sorry about the delay :( 1. It will be useful to set some background for the benefit of the community members who haven't been following

Re: [DISCUSS] SEP-3: Heart-beat mechanism between JobCoordinator and all running containers

2017-05-03 Thread Navina Ramesh
ne > is > > more of an implementation detail. You may want to split it up or just > > discard one of them. I got confused reading them together because one > talks > > about adding to container and the other about the ContainerRunner. > > > > Fixed the SEP to mak

Re: [VOTE] SEP 3 : Heart-beat mechanism between JobCoordinator and all running containers

2017-05-03 Thread Navina Ramesh
+1 (binding) Awesome work. Cheers! Navina On Wed, May 3, 2017 at 12:01 PM, Jagadish Venkatraman < jagadish1...@gmail.com> wrote: > +1 from my side (as described in my previous email). > > Thanks for incorporating all feedback from my previous review. > > Nice work! > > On Wed, May 3, 2017 at 11

Re: [VOTE] Apache Samza 0.13.0 RC0

2017-05-15 Thread Navina Ramesh
I will try to get the patch out today. Work doesn't look trivial. I am on it. Navina On May 14, 2017 23:10, "Ignacio Solis" wrote: > We should hold off until it is solved. How long will it take to fix this? > > On Sun, May 14, 2017 at 10:13 PM, Navina Ramesh (Apac

Re: [VOTE] Apache Samza 0.13.0 RC0

2017-05-17 Thread Navina Ramesh
icially cancel this vote? > > Thanks! > > -Yi > > On Mon, May 15, 2017 at 9:31 AM, Ignacio Solis wrote: > > > Thanks! > > > > On Mon, May 15, 2017 at 8:00 AM, Navina Ramesh > > wrote: > > > I will try to get the patch out today. Work doesn'

Re: Wiki Spam

2017-06-07 Thread Navina Ramesh
Hi Mark, Thanks for letting us know. We will re-asses our permissions and set them up. Should we reach out to Gavin to set them up? It will be great to have one or more of the PMCs have access to assign permission to reduce the turn-over time. Please let us know the procedure. Thanks! Navina On

Re: Wiki Spam

2017-06-07 Thread Navina Ramesh
> Given that admin privs are handed out to PMCs along with explicit instructions not to change the permissions for the anonymous user, I'd like to understand what went wrong in this case (with a view to ensuring it doesn't happen again) before re-enabling admin permissions. Agreed. Afaik, there ar

Re: [DISCUSS] SEP-5: Enable partition expansion of input streams

2017-06-23 Thread Navina Ramesh
pointLogKey > > class validates the current grouper factory class == the previous grouper > > factory class in previous checkpoint. We need to make sure that we allow > > the compatible change from GroupByPartition to > FixedTasksGroupByPartition, > > etc. Since FixedTa

Re: [VOTE] SEP-5: Enable partition expansion of input streams

2017-06-23 Thread Navina Ramesh
After a lot of Q&A, let's get this done :) +1 (binding) Thanks! Navina On Tue, Jun 20, 2017 at 10:31 AM, xinyu liu wrote: > +1 (non-binding) on this design. > > To me the task-count based groupers should work well in practice for > partition expansion of system using hash for partitions, e.g.

Re: [Discuss] Samza 0.13.1 release

2017-08-12 Thread Navina Ramesh
Fred, Thanks for starting the release process. I am unable to open the link you have provided, though. It opens the JIRA SAMZA-1165, instead of the entire list of 0.13.1 bug fixes. Can you please re-check? Navina On 8/11/17, 6:13 PM, "ignacio.so...@gmail.com on behalf of Ignacio Solis" wrote:

Re: [VOTE] Apache Samza 0.13.1 RC0

2017-08-22 Thread Navina Ramesh
Ran check-all on Mac. Build looks good. +1 (binding) Thanks! Navina From: Fred Haifeng Ji Sent: Tuesday, August 22, 2017 11:19 AM To: dev@samza.apache.org Subject: Re: [VOTE] Apache Samza 0.13.1 RC0 [You don't often get email from haifeng...@gmail.com. Learn

Re: [VOTE] SEP-8: Add in-memory system consumer & producer

2017-09-06 Thread Navina Ramesh
Hi Bharath, Really good design! 1. Based on your SEP, you have listed 3 implementation approaches. Do you know which one we are choosing? I suspect it is Approach C. Can you please confirm and update the SEP? 2. Perhaps rename "Test Plan" to "Proposed Usage" or "Usage Example" Overall,

Re: Connection timed out error while installing "Hello Samza"

2017-09-12 Thread Navina Ramesh
Hi Anantharaman, It looks like a transient connection failure to connect to Apache's git. I tried on my host and it seems to be working. Can you give it another shot? If it still doesn't work, please let me know if you are running the command under the "master" or "latest" branch of samza-hel

Re: Connection timed out error while installing "Hello Samza"

2017-09-12 Thread Navina Ramesh
za.apache.org Subject: RE: Connection timed out error while installing "Hello Samza" Navina, I tried again but still same error While installing it says "Building samza from master..." But when after I cloned I executed " git checkout latest" Regards, ~Sri --

Re: Connection timed out error while installing "Hello Samza"

2017-09-12 Thread Navina Ramesh
AM To: dev@samza.apache.org Subject: RE: Connection timed out error while installing "Hello Samza" Navina, Is there any other way we can install Hello Samza? Regards, ~Sri -Original Message- From: Navina Ramesh [mailto:nram...@linkedin.com] Sent: Tuesday, September 12, 2017 11:42 AM To:

Re: Connection timed out error while installing "Hello Samza"

2017-09-14 Thread Navina Ramesh
sessionid:0x15e770d6192 type:setData cxid:0x25 >> >> > zxid:0x15 >> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch >> >> > Error:KeeperErrorCode = NoNode for /controller_epoch >> >> > 2017-09-12 17:18:07,050 [myid:] - INF

Re: Connection timed out error while installing "Hello Samza"

2017-09-14 Thread Navina Ramesh
e of Firewall issue. I am able to clone Samza files from Apache git. I can download any external files on this server ~Sri -Original Message- From: Navina Ramesh [mailto:nram...@linkedin.com] Sent: Thursday, September 14, 2017 2:51 PM To: dev@samza.apache.org Subject: Re: Connection t

Re: Historical container logs in YARN UI

2017-10-02 Thread Navina Ramesh
+Jon (Adding Jon to cc) From: Yi Pan Sent: Monday, October 2, 2017 2:10:27 AM To: dev@samza.apache.org Subject: Re: Historical container logs in YARN UI Hi, XiaoChuan, Our SRE team have been using timeline server in YARN at LinkedIn to get the historical contain

Re: [DISCUSS] Samza 0.14.0 release

2017-11-28 Thread Navina Ramesh
The list looks awesome! :) From: Jacob Maes Sent: Tuesday, November 28, 2017 10:03:58 AM To: dev@samza.apache.org Subject: Re: [DISCUSS] Samza 0.14.0 release +1 On Mon, Nov 27, 2017 at 8:15 PM, Fred Haifeng Ji wrote: > +1! Thanks Bharath! > > Fred > > On Mon,

Re: [VOTE] Apache Samza 0.14.0 RC5

2017-12-22 Thread Navina Ramesh
+1 on RC5. Verified signature and checksum. Ran ./bin/check-all.sh Cheers! Navina From: xinyu liu Sent: Friday, December 22, 2017 2:50:48 PM To: dev@samza.apache.org Subject: [VOTE] Apache Samza 0.14.0 RC5 This is a call for a vote on a release of Apache Samz

Re: Welcome Xinyu as new Samza PMC!

2018-01-17 Thread Navina Ramesh
Congratulations, Xinyu! Thanks for all your contribution and looking forward to more 😊 Cheers! Navina From: Yi Pan Sent: Wednesday, January 17, 2018 10:26:54 AM To: dev@samza.apache.org Subject: Welcome Xinyu as new Samza PMC! Finally all the documentation proc

Re: [VOTE] SEP-12: Integration Test Framework

2018-05-17 Thread Navina Ramesh
+1 can't wait to have this in! :) From: Jacob Maes Sent: Thursday, May 17, 2018 10:13:57 AM To: dev@samza.apache.org Subject: Re: [VOTE] SEP-12: Integration Test Framework +1 On Thu, May 17, 2018 at 9:56 AM, Jagadish Venkatraman < jagadish1...@gmail.com> wrote:

Re: [VOTE] Migration of Samza git repo to gitbox.apache.org

2019-01-23 Thread Navina Ramesh
It looks like a mandatory migration. Why do we need a vote for this? Thanks! Navina From: Pawas Chhokra Sent: Wednesday, January 23, 2019 11:50:32 AM To: dev@samza.apache.org Subject: [VOTE] Migration of Samza git repo to gitbox.apache.org Hi all, This is a ca

Re: [ANNOUNCE] Please welcome Boris Shkolnik to the Samza PMC

2019-06-07 Thread Navina Ramesh
Yaay, Boris! Congrats! 🙂 From: Daniel Nishimura Sent: Friday, June 7, 2019 3:40 PM To: dev@samza.apache.org Subject: Re: [ANNOUNCE] Please welcome Boris Shkolnik to the Samza PMC Congrats! On Fri, Jun 7, 2019 at 3:35 PM Ignacio Solis wrote: > Congrats Boris! >

Re: Testing dev@samza.apache.org

2015-01-23 Thread Navina Ramesh
Yep! On 1/23/15, 9:56 AM, "Yi Pan" wrote: >Yes! > >On Fri, Jan 23, 2015 at 9:49 AM, Chris Riccomini >wrote: > >> Hey all, >> >> Could you please confirm that you're seeing this? I'm trying to verify >>the >> TLP migration for: >> >> https://issues.apache.org/jira/browse/INFRA-9055 >> >> Cheer

Re: Review Request 29899: Changes for Kafka producer upgrade

2015-01-23 Thread Navina Ramesh
-- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29899/#review69423 --- On Jan. 23, 2015, 12:42 a.m., Navina Ramesh wrote: > > ---

Re: Review Request 29899: Changes for Kafka producer upgrade

2015-01-23 Thread Navina Ramesh
sure no other > > configs need to be changed? I already did a grep for this config and replaced them. - Navina --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2989

Re: Review Request 29899: Changes for Kafka producer upgrade

2015-01-23 Thread Navina Ramesh
clean build - SUCCESSFUL Thanks, Navina Ramesh

Re: Review Request 29899: Changes for Kafka producer upgrade

2015-01-23 Thread Navina Ramesh
.kafka.clients.producer.MockProducer be configured to > > satisfy the requests here? > > Navina Ramesh wrote: > I have addresssed the same question in > https://reviews.apache.org/r/29899/#comment113812 Created a follow-up task here - ht

Re: Review Request 29899: Changes for Kafka producer upgrade

2015-01-27 Thread Navina Ramesh
negate-number.properties 4989b279a22ffd8acdb2c31ca4813f6768edc75b samza-test/src/test/scala/org/apache/samza/test/integration/TestStatefulTask.scala ca25258217e5ebc44b34fbc4d69ecb28c81df618 Diff: https://reviews.apache.org/r/29899/diff/ Testing --- ./gradlew clean build - SUCCESSFUL Thanks, Navina Ramesh

Review Request 30634: Serde for Stream Tuples

2015-02-04 Thread Navina Ramesh
/java/org/apache/samza/task/sql/StreamSqlTask.java PRE-CREATION settings.gradle 3a01fd66359b8c79954ae8f34eeaf4b2e3fdc0b4 Diff: https://reviews.apache.org/r/30634/diff/ Testing --- Thanks, Navina Ramesh

Re: Review Request 30634: Serde for Stream Tuples

2015-02-04 Thread Navina Ramesh
://reviews.apache.org/r/30627/ . Main changes are: SqlStringSerde, SqlStringSerdeFactory, StringData and StringSchema - Navina Ramesh On Feb. 4, 2015, 7:39 p.m., Navina Ramesh wrote: > > --- > This is an automatically generated e-mail.

Re: [DISCUSS] SQL workflow

2015-02-04 Thread Navina Ramesh
I have updates SAMZA-484 and RB is here - https://reviews.apache.org/r/30634/diff/# Navina On 2/4/15, 11:13 AM, "Yi Pan" wrote: >Just did the update w/ SAMZA-482. > >On Wed, Feb 4, 2015 at 10:31 AM, Chris Riccomini >wrote: > >> I think so. There was some RB downtime, but it just got fixed. Yi,

Re: Review Request 30634: Serde for Stream Tuples

2015-02-04 Thread Navina Ramesh
rializers.StringSerdeFactory", the key is string and the value is an instance of StringSerdeFactory. - Navina --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30634/#review71121 --

  1   2   3   4   5   6   >