[jira] [Updated] (SAMZA-2334) ProxyGrouper selection based on Host Affinity not whether job is stateful

2019-10-03 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2334: Description: Changes in partition count of input Kafka topic that is not a multiple of

[jira] [Created] (SAMZA-2334) ProxyGrouper selection based on Host Affinity not whether job is stateful

2019-09-27 Thread Daniel Nishimura (Jira)
Daniel Nishimura created SAMZA-2334: --- Summary: ProxyGrouper selection based on Host Affinity not whether job is stateful Key: SAMZA-2334 URL: https://issues.apache.org/jira/browse/SAMZA-2334

[jira] [Updated] (SAMZA-1990) Samza framework should let using the same system stream as both input and output.

2019-09-23 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-1990: Description: Consider the following scenario: A StreamApplication containing two pipelines

[jira] [Created] (SAMZA-2323) Provide option to stop/fail single containers

2019-09-16 Thread Daniel Nishimura (Jira)
Daniel Nishimura created SAMZA-2323: --- Summary: Provide option to stop/fail single containers Key: SAMZA-2323 URL: https://issues.apache.org/jira/browse/SAMZA-2323 Project: Samza Issue

[jira] [Created] (SAMZA-2322) Startpoints ZK Standalone Integration test.

2019-09-16 Thread Daniel Nishimura (Jira)
Daniel Nishimura created SAMZA-2322: --- Summary: Startpoints ZK Standalone Integration test. Key: SAMZA-2322 URL: https://issues.apache.org/jira/browse/SAMZA-2322 Project: Samza Issue Type:

[jira] [Created] (SAMZA-2317) ProcessJobFactory does not hook in CoordinatorStreamStore#stop()

2019-09-10 Thread Daniel Nishimura (Jira)
Daniel Nishimura created SAMZA-2317: --- Summary: ProcessJobFactory does not hook in CoordinatorStreamStore#stop() Key: SAMZA-2317 URL: https://issues.apache.org/jira/browse/SAMZA-2317 Project: Samza

[jira] [Closed] (SAMZA-2149) Generalize startpoint SSP to task fanout API

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2149. --- > Generalize startpoint SSP to task fanout API > >

[jira] [Closed] (SAMZA-2143) NPE in CoordinatorStreamMessage#equals and some clean-up to CoordinatorStreamSystemConsumer

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2143. --- > NPE in CoordinatorStreamMessage#equals and some clean-up to > CoordinatorStreamSystemConsumer

[jira] [Closed] (SAMZA-2138) Incorrect logging when task to container mapping is written.

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2138. --- > Incorrect logging when task to container mapping is written. >

[jira] [Closed] (SAMZA-2144) In TaskInstance, bypass "SSP caught-up" check if offset is set by a startpoint

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2144. --- > In TaskInstance, bypass "SSP caught-up" check if offset is set by a > startpoint >

[jira] [Closed] (SAMZA-2215) StartpointManager fix for previous CoordinatorStreamStore refactor

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2215. --- > StartpointManager fix for previous CoordinatorStreamStore refactor >

[jira] [Closed] (SAMZA-2171) Encapsulate creation and loading of metadata streams

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2171. --- > Encapsulate creation and loading of metadata streams >

[jira] [Closed] (SAMZA-2266) Introduce a backoff when there are repeated failures for host-affinity allocations

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2266. --- > Introduce a backoff when there are repeated failures for host-affinity > allocations >

[jira] [Closed] (SAMZA-2260) Standalone: Share metadata store between StreamProcessor and JobCoordinator

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2260. --- > Standalone: Share metadata store between StreamProcessor and JobCoordinator >

[jira] [Closed] (SAMZA-2220) Startpoints - Fully encapsulate resolution of starting offsets in OffsetManager

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2220. --- > Startpoints - Fully encapsulate resolution of starting offsets in > OffsetManager >

[jira] [Closed] (SAMZA-2296) Metadata streams not created in Standalone

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2296. --- > Metadata streams not created in Standalone > -- > >

[jira] [Closed] (SAMZA-2294) LocalApplicationRunner support for missing coordinator stream

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2294. --- > LocalApplicationRunner support for missing coordinator stream >

[jira] [Closed] (SAMZA-2277) Semantics for cluster-manager.container.retry.window.ms not reflected in code

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2277. --- > Semantics for cluster-manager.container.retry.window.ms not reflected in code >

[jira] [Closed] (SAMZA-2278) Add a "delete all" for startpoint manager

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2278. --- > Add a "delete all" for startpoint manager > - > >

[jira] [Closed] (SAMZA-2298) Fix CoordinatorStreamStore creation for LocalApplicationRunner

2019-08-30 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2298. --- > Fix CoordinatorStreamStore creation for LocalApplicationRunner >

[jira] [Assigned] (SAMZA-2310) Samza framework should differentiate between implicit and explicit intermediate streams

2019-08-27 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura reassigned SAMZA-2310: --- Assignee: (was: Daniel Nishimura) > Samza framework should differentiate

[jira] [Commented] (SAMZA-2310) Samza framework should differentiate between implicit and explicit intermediate streams

2019-08-27 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916893#comment-16916893 ] Daniel Nishimura commented on SAMZA-2310: - Thanks [~atoomula] . Will create a mirror ticket in LI

[jira] [Commented] (SAMZA-1990) Samza framework should let using the same system stream as both input and output.

2019-08-23 Thread Daniel Nishimura (Jira)
[ https://issues.apache.org/jira/browse/SAMZA-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914336#comment-16914336 ] Daniel Nishimura commented on SAMZA-1990: - Thanks @Aditya for the investigation. Can you create a

[jira] [Updated] (SAMZA-2298) Fix CoordinatorStreamStore creation for LocalApplicationRunner

2019-08-09 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2298: Summary: Fix CoordinatorStreamStore creation for LocalApplicationRunner (was: Underlying

[jira] [Created] (SAMZA-2298) Underlying coordinator stream needs to be created with CoordinatorStreamStore for LocalApplicationRunner

2019-08-09 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2298: --- Summary: Underlying coordinator stream needs to be created with CoordinatorStreamStore for LocalApplicationRunner Key: SAMZA-2298 URL:

[jira] [Updated] (SAMZA-2296) Metadata streams not created in Standalone

2019-08-08 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2296: Summary: Metadata streams not created in Standalone (was: Checkpoint Manager not created

[jira] [Updated] (SAMZA-2296) Checkpoint Manager not created in Standalone

2019-08-08 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2296: Description: The config to create the checkpoint manager is being read from the job model

[jira] [Created] (SAMZA-2296) Checkpoint Manager not created in Standalone

2019-08-08 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2296: --- Summary: Checkpoint Manager not created in Standalone Key: SAMZA-2296 URL: https://issues.apache.org/jira/browse/SAMZA-2296 Project: Samza Issue Type:

[jira] [Created] (SAMZA-2294) LocalApplicationRunner support for missing coordinator stream

2019-08-07 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2294: --- Summary: LocalApplicationRunner support for missing coordinator stream Key: SAMZA-2294 URL: https://issues.apache.org/jira/browse/SAMZA-2294 Project: Samza

[jira] [Closed] (SAMZA-2273) ZkJobCoordinator: Async publishing of configs to coordinator stream store.

2019-07-31 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura closed SAMZA-2273. --- > ZkJobCoordinator: Async publishing of configs to coordinator stream store. >

[jira] [Created] (SAMZA-2286) Integrate MetadataStore#putAll where appropriate

2019-07-31 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2286: --- Summary: Integrate MetadataStore#putAll where appropriate Key: SAMZA-2286 URL: https://issues.apache.org/jira/browse/SAMZA-2286 Project: Samza Issue

[jira] [Updated] (SAMZA-2049) Startpoints user documentation

2019-07-22 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2049: Fix Version/s: (was: 1.1) > Startpoints user documentation >

[jira] [Created] (SAMZA-2278) Add a "delete all" for startpoint manager

2019-07-22 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2278: --- Summary: Add a "delete all" for startpoint manager Key: SAMZA-2278 URL: https://issues.apache.org/jira/browse/SAMZA-2278 Project: Samza Issue Type:

[jira] [Created] (SAMZA-2276) Metadata store putAll

2019-07-18 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2276: --- Summary: Metadata store putAll Key: SAMZA-2276 URL: https://issues.apache.org/jira/browse/SAMZA-2276 Project: Samza Issue Type: Improvement

[jira] [Created] (SAMZA-2273) ZkJobCoordinator: Async publishing of configs to coordinator stream store.

2019-07-16 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2273: --- Summary: ZkJobCoordinator: Async publishing of configs to coordinator stream store. Key: SAMZA-2273 URL: https://issues.apache.org/jira/browse/SAMZA-2273

[jira] [Assigned] (SAMZA-2273) ZkJobCoordinator: Async publishing of configs to coordinator stream store.

2019-07-16 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura reassigned SAMZA-2273: --- Assignee: Daniel Nishimura > ZkJobCoordinator: Async publishing of configs to

[jira] [Created] (SAMZA-2272) Metadata store: Consolidate metadata store types in ZkJobCoordinator standalone jobs

2019-07-16 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2272: --- Summary: Metadata store: Consolidate metadata store types in ZkJobCoordinator standalone jobs Key: SAMZA-2272 URL: https://issues.apache.org/jira/browse/SAMZA-2272

[jira] [Created] (SAMZA-2266) Introduce a backoff when there are repeated failures for host-affinity allocations

2019-07-08 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2266: --- Summary: Introduce a backoff when there are repeated failures for host-affinity allocations Key: SAMZA-2266 URL: https://issues.apache.org/jira/browse/SAMZA-2266

[jira] [Updated] (SAMZA-2260) Standalone: Share metadata store between StreamProcessor and JobCoordinator

2019-06-26 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2260: Description: Currently the coordinator stream metadata store init() method is expensive

[jira] [Created] (SAMZA-2260) Standalone: Share metadata store between StreamProcessor and JobCoordinator

2019-06-24 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2260: --- Summary: Standalone: Share metadata store between StreamProcessor and JobCoordinator Key: SAMZA-2260 URL: https://issues.apache.org/jira/browse/SAMZA-2260

[jira] [Resolved] (SAMZA-2214) KafkaSystemConsumer: Log seek position directly from the underlying consumer

2019-06-17 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura resolved SAMZA-2214. - Resolution: Not A Problem > KafkaSystemConsumer: Log seek position directly from the

[jira] [Resolved] (SAMZA-1983) SEP-18 : Startpoints implementation in the core framework

2019-06-06 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura resolved SAMZA-1983. - Resolution: Fixed Fix Version/s: (was: 1.1) > SEP-18 : Startpoints

[jira] [Updated] (SAMZA-2220) Startpoints - Fully encapsulate resolution of starting offsets in OffsetManager

2019-05-24 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2220: Summary: Startpoints - Fully encapsulate resolution of starting offsets in OffsetManager

[jira] [Updated] (SAMZA-2220) Startpoints - Fully encapsulate resolution of starting offsets in OffsetManager

2019-05-24 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2220: Description: Currently when a startpoint is set, the consumers are registered with the

[jira] [Created] (SAMZA-2220) Startpoints - sync TaskInstance offset caught up logic with Startpoints

2019-05-24 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2220: --- Summary: Startpoints - sync TaskInstance offset caught up logic with Startpoints Key: SAMZA-2220 URL: https://issues.apache.org/jira/browse/SAMZA-2220 Project:

[jira] [Updated] (SAMZA-2215) StartpointManager fix for previous CoordinatorStreamStore refactor

2019-05-23 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2215: Summary: StartpointManager fix for previous CoordinatorStreamStore refactor (was:

[jira] [Updated] (SAMZA-2215) StartpointManager fix for previous CoordinatorStreamStore refactoring

2019-05-23 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2215: Summary: StartpointManager fix for previous CoordinatorStreamStore refactoring (was:

[jira] [Created] (SAMZA-2216) Reintegrate MetadataStoreFactory for creating metadata store objects.

2019-05-23 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2216: --- Summary: Reintegrate MetadataStoreFactory for creating metadata store objects. Key: SAMZA-2216 URL: https://issues.apache.org/jira/browse/SAMZA-2216 Project:

[jira] [Updated] (SAMZA-2215) StartpointManager fix due to CoordinatorStreamStore refactoring

2019-05-23 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2215: Description: StartpointManager does not instantiate in the ContainerLaunchUtil due to the

[jira] [Updated] (SAMZA-2215) StartpointManager fix due to CoordinatorStreamStore refactoring

2019-05-23 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2215: Summary: StartpointManager fix due to CoordinatorStreamStore refactoring (was:

[jira] [Updated] (SAMZA-2215) Instantiate metadata stores from factory

2019-05-23 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2215: Description: The metadata store is currently instantiated directly due to some near term

[jira] [Updated] (SAMZA-2215) Instantiate metadata stores from factory

2019-05-23 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2215: Summary: Instantiate metadata stores from factory (was: Removal of unused MetadataStore

[jira] [Created] (SAMZA-2215) Removal of unused MetadataStore factories

2019-05-23 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2215: --- Summary: Removal of unused MetadataStore factories Key: SAMZA-2215 URL: https://issues.apache.org/jira/browse/SAMZA-2215 Project: Samza Issue Type:

[jira] [Created] (SAMZA-2214) KafkaSystemConsumer: Log seek position directly from the underlying consumer

2019-05-23 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2214: --- Summary: KafkaSystemConsumer: Log seek position directly from the underlying consumer Key: SAMZA-2214 URL: https://issues.apache.org/jira/browse/SAMZA-2214

[jira] [Resolved] (SAMZA-2149) Generalize startpoint SSP to task fanout API

2019-05-20 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura resolved SAMZA-2149. - Resolution: Fixed > Generalize startpoint SSP to task fanout API >

[jira] [Created] (SAMZA-2201) Startpoints - Integrate fan out with job coordinators

2019-05-20 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2201: --- Summary: Startpoints - Integrate fan out with job coordinators Key: SAMZA-2201 URL: https://issues.apache.org/jira/browse/SAMZA-2201 Project: Samza

[jira] [Resolved] (SAMZA-2144) In TaskInstance, bypass "SSP caught-up" check if offset is set by a startpoint

2019-05-09 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura resolved SAMZA-2144. - Resolution: Won't Do API enhancements will make this no longer required. > In

[jira] [Updated] (SAMZA-2182) Metadata store: disconnect between creation and usage of the underlying storage

2019-05-01 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2182: Description: The issue with the current implementation of the metadata store is that the

[jira] [Updated] (SAMZA-2182) Metadata store: disconnect between creation and usage of the underlying storage

2019-05-01 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2182: Description: The issue with the current implementation of the metadata store is that the

[jira] [Updated] (SAMZA-2181) Ensure consistency of coordinator store creation and initialization

2019-05-01 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2181: Summary: Ensure consistency of coordinator store creation and initialization (was: Ensure

[jira] [Updated] (SAMZA-2181) Ensure consistency of metadata store creation and initialization

2019-05-01 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2181: Description: Ensure that the metadata store is instantiated consistently and the

[jira] [Updated] (SAMZA-2181) Ensure consistency of metadata store creation and initialization

2019-05-01 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2181: Summary: Ensure consistency of metadata store creation and initialization (was: Ensure

[jira] [Created] (SAMZA-2182) Metadata store: disconnect between creation and usage of the underlying storage

2019-05-01 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2182: --- Summary: Metadata store: disconnect between creation and usage of the underlying storage Key: SAMZA-2182 URL: https://issues.apache.org/jira/browse/SAMZA-2182

[jira] [Created] (SAMZA-2181) Ensure consistency of metadata store usage across all Job Coordinators

2019-04-30 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2181: --- Summary: Ensure consistency of metadata store usage across all Job Coordinators Key: SAMZA-2181 URL: https://issues.apache.org/jira/browse/SAMZA-2181 Project:

[jira] [Created] (SAMZA-2171) Encapsulate creation and loading of metadata streams

2019-04-22 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2171: --- Summary: Encapsulate creation and loading of metadata streams Key: SAMZA-2171 URL: https://issues.apache.org/jira/browse/SAMZA-2171 Project: Samza

[jira] [Created] (SAMZA-2149) Generalize startpoint SSP to task fanout API

2019-03-26 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2149: --- Summary: Generalize startpoint SSP to task fanout API Key: SAMZA-2149 URL: https://issues.apache.org/jira/browse/SAMZA-2149 Project: Samza Issue Type:

[jira] [Created] (SAMZA-2144) In TaskInstance, bypass "SSP caught-up" check if offset is set by a startpoint

2019-03-24 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2144: --- Summary: In TaskInstance, bypass "SSP caught-up" check if offset is set by a startpoint Key: SAMZA-2144 URL: https://issues.apache.org/jira/browse/SAMZA-2144

[jira] [Updated] (SAMZA-2143) NPE in CoordinatorStreamMessage#equals and some clean-up to CoordinatorStreamSystemConsumer

2019-03-23 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2143: Description: 1) NPE exposed in CoordinatorStreamMessage#equals now that the metadata store

[jira] [Updated] (SAMZA-2143) NPE in CoordinatorStreamMessage#equals and some clean-up to CoordinatorStreamSystemConsumer

2019-03-23 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2143: Description: NPE exposed in CoordinatorStreamMessage#equals now that the metadata store

[jira] [Created] (SAMZA-2143) NPE in CoordinatorStreamMessage#equals and some clean-up to CoordinatorStreamSystemConsumer

2019-03-23 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2143: --- Summary: NPE in CoordinatorStreamMessage#equals and some clean-up to CoordinatorStreamSystemConsumer Key: SAMZA-2143 URL: https://issues.apache.org/jira/browse/SAMZA-2143

[jira] [Updated] (SAMZA-2143) NPE in CoordinatorStreamMessage#equals and some clean-up to CoordinatorStreamSystemConsumer

2019-03-23 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2143: Issue Type: Bug (was: Improvement) > NPE in CoordinatorStreamMessage#equals and some

[jira] [Created] (SAMZA-2138) Incorrect logging when task to container mapping is written.

2019-03-21 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2138: --- Summary: Incorrect logging when task to container mapping is written. Key: SAMZA-2138 URL: https://issues.apache.org/jira/browse/SAMZA-2138 Project: Samza

[jira] [Commented] (SAMZA-2052) Update sonar-scanner in .travis.yml file to work problem with Travis-CI again.

2019-03-19 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796298#comment-16796298 ] Daniel Nishimura commented on SAMZA-2052: - [~pmaheshwari] - nope it was merged in. Resolved

[jira] [Created] (SAMZA-2132) Startpoint - flatten serialized key

2019-03-18 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2132: --- Summary: Startpoint - flatten serialized key Key: SAMZA-2132 URL: https://issues.apache.org/jira/browse/SAMZA-2132 Project: Samza Issue Type:

[jira] [Created] (SAMZA-2115) EventHubsSystemDescriptor - expose interceptors configuration

2019-02-26 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2115: --- Summary: EventHubsSystemDescriptor - expose interceptors configuration Key: SAMZA-2115 URL: https://issues.apache.org/jira/browse/SAMZA-2115 Project: Samza

[jira] [Assigned] (SAMZA-1990) Samza framework should let using the same system stream as both input and output.

2019-02-21 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura reassigned SAMZA-1990: --- Assignee: Daniel Nishimura > Samza framework should let using the same system

[jira] [Updated] (SAMZA-2022) Startpoints - SystemConsumers (not to be confused with SystemConsumer) modifications including integration with MessageChooser.

2018-12-21 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2022: Description: SystemConsumers multiplexes the register with offset calls to each

[jira] [Created] (SAMZA-2052) Update sonar-scanner in .travis.yml file to work problem with Travis-CI again.

2018-12-21 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2052: --- Summary: Update sonar-scanner in .travis.yml file to work problem with Travis-CI again. Key: SAMZA-2052 URL: https://issues.apache.org/jira/browse/SAMZA-2052

[jira] [Created] (SAMZA-2049) Startpoints user documentation

2018-12-20 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2049: --- Summary: Startpoints user documentation Key: SAMZA-2049 URL: https://issues.apache.org/jira/browse/SAMZA-2049 Project: Samza Issue Type: Task

[jira] [Updated] (SAMZA-2022) Startpoints - SystemConsumers (not to be confused with SystemConsumer) modifications including integration with MessageChooser.

2018-12-20 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2022: Issue Type: New Feature (was: Bug) > Startpoints - SystemConsumers (not to be confused

[jira] [Updated] (SAMZA-2024) Startpoints - Implement EventHubSystemConsumer#register(SystemStreamPartition, Startpoint) interface.

2018-12-20 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2024: Issue Type: New Feature (was: Bug) > Startpoints - Implement >

[jira] [Updated] (SAMZA-2038) Add and implement new interface TaskContext#setStartingOffset(SystemStreamPartition, Startpoint)

2018-12-20 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2038: Issue Type: New Feature (was: Bug) > Add and implement new interface >

[jira] [Updated] (SAMZA-2023) Startpoints - Implement KafkaSystemConsumer#register(SystemStreamPartition, Startpoint) interface.

2018-12-20 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2023: Issue Type: New Feature (was: Bug) > Startpoints - Implement

[jira] [Updated] (SAMZA-2022) Startpoints - SystemConsumers (not to be confused with SystemConsumer) modifications including integration with MessageChooser.

2018-12-19 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2022: Description: SystemConsumers multiplexes the register with offset calls to each

[jira] [Updated] (SAMZA-2022) Startpoints - SystemConsumers (not to be confused with SystemConsumer) modifications including integration with MessageChooser.

2018-12-19 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2022: Description: SystemConsumers multiplexes the register with offset calls to each

[jira] [Updated] (SAMZA-2046) Startpoints - Fanout of SSP-only keyed Startpoints to SSP+TaskName

2018-12-19 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2046: Summary: Startpoints - Fanout of SSP-only keyed Startpoints to SSP+TaskName (was:

[jira] [Updated] (SAMZA-2046) Startpoints - Fanout of SSP-only keyed Startpoints to SSP+TaskName

2018-12-19 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2046: Description: The job coordinators need to call the

[jira] [Updated] (SAMZA-2022) Startpoints - SystemConsumers (not to be confused with SystemConsumer) modifications including integration with MessageChooser.

2018-12-19 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-2022: Summary: Startpoints - SystemConsumers (not to be confused with SystemConsumer)

[jira] [Created] (SAMZA-2046) Startpoints - job coordinators need to re-map startpoints from SSP key to SSP+TaskName key

2018-12-17 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2046: --- Summary: Startpoints - job coordinators need to re-map startpoints from SSP key to SSP+TaskName key Key: SAMZA-2046 URL: https://issues.apache.org/jira/browse/SAMZA-2046

[jira] [Created] (SAMZA-2045) Startpoints integration tests

2018-12-15 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2045: --- Summary: Startpoints integration tests Key: SAMZA-2045 URL: https://issues.apache.org/jira/browse/SAMZA-2045 Project: Samza Issue Type: New Feature

[jira] [Created] (SAMZA-2038) Add and implement new interface TaskContext#setStartingOffset(SystemStreamPartition, Startpoint)

2018-12-11 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2038: --- Summary: Add and implement new interface TaskContext#setStartingOffset(SystemStreamPartition, Startpoint) Key: SAMZA-2038 URL:

[jira] [Updated] (SAMZA-1983) SEP-18 : Startpoints implementation in the core framework

2018-12-11 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-1983: Description: Umbrella Jira ticket for the SEP-18 implementation.

[jira] [Updated] (SAMZA-1983) SEP-18 : Startpoints implementation in the core framework

2018-12-11 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-1983: Description: Umbrella Jira ticket for the SEP-18 implementation. > SEP-18 : Startpoints

[jira] [Updated] (SAMZA-1983) SEP-18 : Startpoints implementation in the core framework

2018-12-11 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-1983: Summary: SEP-18 : Startpoints implementation in the core framework (was: Startpoints

[jira] [Created] (SAMZA-2024) Startpoints - Implement EventHubSystemConsumer#register(SystemStreamPartition, Startpoint) interface.

2018-12-04 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2024: --- Summary: Startpoints - Implement EventHubSystemConsumer#register(SystemStreamPartition, Startpoint) interface. Key: SAMZA-2024 URL:

[jira] [Created] (SAMZA-2023) Startpoints - Implement KafkaSystemConsumer#register(SystemStreamPartition, Startpoint) interface.

2018-12-04 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2023: --- Summary: Startpoints - Implement KafkaSystemConsumer#register(SystemStreamPartition, Startpoint) interface. Key: SAMZA-2023 URL:

[jira] [Created] (SAMZA-2022) Startpoints - SystemConsumer interface modifications required for Startpoints

2018-12-04 Thread Daniel Nishimura (JIRA)
Daniel Nishimura created SAMZA-2022: --- Summary: Startpoints - SystemConsumer interface modifications required for Startpoints Key: SAMZA-2022 URL: https://issues.apache.org/jira/browse/SAMZA-2022

[jira] [Updated] (SAMZA-1985) Implement Startpoints model and StartpointManager

2018-12-04 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-1985: Summary: Implement Startpoints model and StartpointManager (was: Implement Startpoints

[jira] [Updated] (SAMZA-1985) Implement Startpoints model and StartpointManager

2018-12-04 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-1985: Description: SEP-18 related work. > Implement Startpoints model and StartpointManager >

[jira] [Updated] (SAMZA-1988) Properly suffix modules with direct Scala dependencies with the Scala version

2018-11-09 Thread Daniel Nishimura (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Nishimura updated SAMZA-1988: Description: The following modules have direct Scala dependencies and info where the

  1   2   >