[jira] [Commented] (SAMZA-754) Race condition between coordinator stream producer and coordinator stream consumer in JobRunner

2015-11-17 Thread Yi Pan (Data Infrastructure) (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1500#comment-1500 ] Yi Pan (Data Infrastructure) commented on SAMZA-754: RB available: http

[jira] [Commented] (SAMZA-740) Add ElasticsearchProducer example to samza-hello-samza

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009988#comment-15009988 ] Navina Ramesh commented on SAMZA-740: - No worries, Stuart ! Let's table this for the n

[jira] [Commented] (SAMZA-740) Add ElasticsearchProducer example to samza-hello-samza

2015-11-17 Thread Stuart Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009986#comment-15009986 ] Stuart Davidson commented on SAMZA-740: --- Sorry to let you and the team down Navina bu

[jira] [Commented] (SAMZA-753) BrokerProxy stop should stop the Kafka consumer first

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009978#comment-15009978 ] Navina Ramesh commented on SAMZA-753: - +1 Committed the changes. Thanks! > BrokerProx

samza git commit: SAMZA-753 - BrokerProxy stop should stop the Kafka consumer first

2015-11-17 Thread navina
Repository: samza Updated Branches: refs/heads/master bc7a07a1a -> 74aa516fd SAMZA-753 - BrokerProxy stop should stop the Kafka consumer first Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/74aa516f Tree: http://git-wip-u

[jira] [Updated] (SAMZA-807) Need a configuration variable to ignore SystemStreamPartitionGrouperFactory changes in checkpoint topic

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-807: Fix Version/s: (was: 0.10.0) > Need a configuration variable to ignore SystemStreamPartitionGroup

[jira] [Assigned] (SAMZA-255) Rewinding Streams within a StreamTask

2015-11-17 Thread Jagadish (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadish reassigned SAMZA-255: -- Assignee: Jagadish > Rewinding Streams within a StreamTask > - > >

[jira] [Commented] (SAMZA-740) Add ElasticsearchProducer example to samza-hello-samza

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009775#comment-15009775 ] Navina Ramesh commented on SAMZA-740: - [~Spedge] It will really great to have this tuto

[jira] [Commented] (SAMZA-689) When Kafka has topic auto-creation turned on, checkpoint topics may be created w/ wrong partition numbers

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009763#comment-15009763 ] Navina Ramesh commented on SAMZA-689: - [~nickpan47] Now that we are back with checkpoin

[jira] [Updated] (SAMZA-676) Implement Broadcast Stream

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-676: Fix Version/s: 0.10.0 > Implement Broadcast Stream > -- > > K

[jira] [Updated] (SAMZA-469) Support Scala 2.11

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-469: Fix Version/s: (was: 0.10.0) > Support Scala 2.11 > -- > > Key: S

[jira] [Updated] (SAMZA-767) yarn.queue option is not used anywhere

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-767: Fix Version/s: (was: 0.10.0) > yarn.queue option is not used anywhere >

[jira] [Updated] (SAMZA-767) yarn.queue option is not used anywhere

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-767: Fix Version/s: 0.10.0 > yarn.queue option is not used anywhere > ---

[jira] [Updated] (SAMZA-713) TestStatefulTask hanging

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-713: Fix Version/s: (was: 0.10.0) > TestStatefulTask hanging > > >

[jira] [Updated] (SAMZA-679) Optimize CoordinatorStream's bootstrap mechanism

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-679: Fix Version/s: (was: 0.10.0) > Optimize CoordinatorStream's bootstrap mechanism > ---

[jira] [Updated] (SAMZA-678) Integrate CoordinatorStream to use SystemConsumers and SystemProducers

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-678: Fix Version/s: (was: 0.10.0) > Integrate CoordinatorStream to use SystemConsumers and SystemProdu

[jira] [Updated] (SAMZA-623) Samza torture test Checker has a race condition

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-623: Fix Version/s: (was: 0.10.0) > Samza torture test Checker has a race condition >

[jira] [Updated] (SAMZA-635) KafkaSystemProducer may get exceptions out-of-order

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-635: Fix Version/s: (was: 0.10.0) > KafkaSystemProducer may get exceptions out-of-order >

[jira] [Updated] (SAMZA-609) Properties not encoded properly

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-609: Fix Version/s: (was: 0.10.0) > Properties not encoded properly > ---

[jira] [Updated] (SAMZA-603) Expose more consumer controls to developers

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-603: Fix Version/s: (was: 0.10.0) > Expose more consumer controls to developers >

[jira] [Updated] (SAMZA-580) Migrate legacy integration join test to Zopkio

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-580: Fix Version/s: (was: 0.10.0) > Migrate legacy integration join test to Zopkio > -

[jira] [Updated] (SAMZA-578) Validate SamzaContainer performance

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-578: Fix Version/s: (was: 0.10.0) > Validate SamzaContainer performance >

[jira] [Updated] (SAMZA-570) Poll for new Kafka input topics when using wildcards

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-570: Fix Version/s: (was: 0.10.0) > Poll for new Kafka input topics when using wildcards > --

[jira] [Updated] (SAMZA-553) Add validation before integration test starts

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-553: Fix Version/s: (was: 0.10.0) > Add validation before integration test starts > -

[jira] [Updated] (SAMZA-542) CheckpointTool NPE's when a partition is empty

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-542: Fix Version/s: (was: 0.10.0) > CheckpointTool NPE's when a partition is empty > -

[jira] [Updated] (SAMZA-539) Add generic lag metric from high watermark - last processed message

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-539: Labels: newbie++ (was: ) > Add generic lag metric from high watermark - last processed message > ---

[jira] [Updated] (SAMZA-539) Add generic lag metric from high watermark - last processed message

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-539: Fix Version/s: (was: 0.10.0) > Add generic lag metric from high watermark - last processed messag

[jira] [Updated] (SAMZA-519) Support for Yarn High Availability (HA RM)

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-519: Fix Version/s: (was: 0.10.0) > Support for Yarn High Availability (HA RM) > -

[jira] [Updated] (SAMZA-524) Update KafkaSystemProducer after Kafka provides a flush behavior

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-524: Fix Version/s: (was: 0.10.0) > Update KafkaSystemProducer after Kafka provides a flush behavior >

[jira] [Updated] (SAMZA-478) Logs in StreamAppender sometimes appear in different order from how they do in regular log file

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-478: Fix Version/s: (was: 0.10.0) > Logs in StreamAppender sometimes appear in different order from ho

[jira] [Updated] (SAMZA-476) Container fails due to port in use

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-476: Fix Version/s: (was: 0.10.0) > Container fails due to port in use > -

[jira] [Updated] (SAMZA-476) Container fails due to port in use

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-476: Labels: newbie++ (was: ) > Container fails due to port in use > -- >

[jira] [Updated] (SAMZA-471) Make config easy to specify default values and validation

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-471: Fix Version/s: (was: 0.10.0) > Make config easy to specify default values and validation > --

[jira] [Updated] (SAMZA-467) Add latency metrics to the different KeyValueStore layers in Samza

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-467: Fix Version/s: (was: 0.10.0) > Add latency metrics to the different KeyValueStore layers in Samza

[jira] [Updated] (SAMZA-459) Explicit flush for individual output streams

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-459: Fix Version/s: (was: 0.10.0) > Explicit flush for individual output streams > ---

[jira] [Updated] (SAMZA-421) Test the performance before and after adding the Timer metric

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-421: Fix Version/s: (was: 0.10.0) > Test the performance before and after adding the Timer metric > --

[jira] [Commented] (SAMZA-754) Race condition between coordinator stream producer and coordinator stream consumer in JobRunner

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009689#comment-15009689 ] Navina Ramesh commented on SAMZA-754: - Yeah.. This issue is not really specific to coor

[jira] [Updated] (SAMZA-36) Define and enforce coding style

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-36?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-36: --- Fix Version/s: (was: 0.10.0) > Define and enforce coding style > --- > >

[jira] [Commented] (SAMZA-754) Race condition between coordinator stream producer and coordinator stream consumer in JobRunner

2015-11-17 Thread Yi Pan (Data Infrastructure) (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009670#comment-15009670 ] Yi Pan (Data Infrastructure) commented on SAMZA-754: Noticed that [~cri

[jira] [Updated] (SAMZA-644) Add endpoint for RPC/Tracking ports

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-644: Fix Version/s: (was: 0.10.0) > Add endpoint for RPC/Tracking ports >

[jira] [Updated] (SAMZA-449) Expose Rocksdb stats

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-449: Fix Version/s: (was: 0.10.0) > Expose Rocksdb stats > > > Ke

[jira] [Updated] (SAMZA-817) Add metrics to gauge effectiveness of host-affinity solution

2015-11-17 Thread Navina Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navina Ramesh updated SAMZA-817: Attachment: SAMZA-817-0.patch RB link for review -> https://reviews.apache.org/r/40407/ > Add metri

[jira] [Created] (SAMZA-817) Add metrics to gauge effectiveness of host-affinity solution

2015-11-17 Thread Navina Ramesh (JIRA)
Navina Ramesh created SAMZA-817: --- Summary: Add metrics to gauge effectiveness of host-affinity solution Key: SAMZA-817 URL: https://issues.apache.org/jira/browse/SAMZA-817 Project: Samza Issue

[jira] [Assigned] (SAMZA-754) Race condition between coordinator stream producer and coordinator stream consumer in JobRunner

2015-11-17 Thread Yi Pan (Data Infrastructure) (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Pan (Data Infrastructure) reassigned SAMZA-754: -- Assignee: Yi Pan (Data Infrastructure) > Race condition between

[jira] [Commented] (SAMZA-754) Race condition between coordinator stream producer and coordinator stream consumer in JobRunner

2015-11-17 Thread Yi Pan (Data Infrastructure) (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009562#comment-15009562 ] Yi Pan (Data Infrastructure) commented on SAMZA-754: Turns out that thi

[jira] [Updated] (SAMZA-754) Race condition between coordinator stream producer and coordinator stream consumer in JobRunner

2015-11-17 Thread Yi Pan (Data Infrastructure) (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Pan (Data Infrastructure) updated SAMZA-754: --- Summary: Race condition between coordinator stream producer and coordina

[jira] [Resolved] (SAMZA-671) Disable checkpoint in coordinator stream

2015-11-17 Thread Yi Pan (Data Infrastructure) (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Pan (Data Infrastructure) resolved SAMZA-671. Resolution: Won't Fix With SAMZA-798 fixes, this is no longer needed.

[jira] [Commented] (SAMZA-793) Configure rewriter should be moved back to JobRunner

2015-11-17 Thread Yi Pan (Data Infrastructure) (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009225#comment-15009225 ] Yi Pan (Data Infrastructure) commented on SAMZA-793: Per RB comment, me

samza git commit: SAMZA-793 static config rewriter should be invoked in JobRunner

2015-11-17 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 8c7e2eb04 -> bc7a07a1a SAMZA-793 static config rewriter should be invoked in JobRunner Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/bc7a07a1 Tree: http://git-wip-us.

[jira] [Commented] (SAMZA-815) CoordinatorStream - Errors in JobRunner

2015-11-17 Thread Rick Mangi (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15008884#comment-15008884 ] Rick Mangi commented on SAMZA-815: -- Ok. This was my fault. It was in fact AWS security gro

[jira] [Resolved] (SAMZA-815) CoordinatorStream - Errors in JobRunner

2015-11-17 Thread Rick Mangi (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rick Mangi resolved SAMZA-815. -- Resolution: Invalid > CoordinatorStream - Errors in JobRunner > --- >

[jira] [Commented] (SAMZA-815) CoordinatorStream - Errors in JobRunner

2015-11-17 Thread Rick Mangi (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15008832#comment-15008832 ] Rick Mangi commented on SAMZA-815: -- So I went ahead and deleted all of the samza topics in