[GitHub] samza pull request #888: SAMZA-2078: Add zookeeper session metrics to ZkJobC...

2019-01-17 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/888 SAMZA-2078: Add zookeeper session metrics to ZkJobCoordinator. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza SAMZA-2078

[GitHub] samza pull request #886: SAMZA-2074: Read configuration from coordinator str...

2019-01-16 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/886 SAMZA-2074: Read configuration from coordinator stream in checkpoint tool. Currently, each run of a `CheckpointTool` requires the `TaskModel` from the `JobModel` for updating the checkpoints

[GitHub] samza pull request #884: SAMZA-2073: Do not commit the task offsets when shu...

2019-01-15 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/884 SAMZA-2073: Do not commit the task offsets when shutting down the SamzaContainer. SAMZA-1489 added support for committing the offsets of all the running tasks in a SamzaContainer. Other

[GitHub] samza pull request #879: SAMZA-2059: Persist configuration in coordinator st...

2019-01-14 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/879 SAMZA-2059: Persist configuration in coordinator stream for standalone. Prior to Samza 1.0, users plugged in the properties of an I/O system through a configuration file. Samza employed rewriters

[GitHub] samza pull request #874: SAMZA-2058: Integrate the input partition expansion...

2019-01-10 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/874 SAMZA-2058: Integrate the input partition expansion aware SystemStreamGrouper to JobModel generation flow. SAMZA-1989 added a partition expansion aware SystemStreamPartitionGrouper in samza

[GitHub] samza pull request #844: SAMZA-1835: Consolidate all processorId generation ...

2018-12-05 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/844 SAMZA-1835: Consolidate all processorId generation code. Currently, the processorId creation function createProcessorId() is repeated in three different implementation of `JobCoordinator` viz

[GitHub] samza pull request #803: SAMZA-1989: SystemStreamGrouper interface change fo...

2018-11-11 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/803 SAMZA-1989: SystemStreamGrouper interface change for SEP-5 Samza users may need to increase the partition count of the input streams of their stateful samza jobs. For example, Kafka needs to

[GitHub] samza pull request #795: SAMZA-1977: Shutdown the container threadPool when ...

2018-11-05 Thread shanthoosh
Github user shanthoosh closed the pull request at: https://github.com/apache/samza/pull/795 ---

[GitHub] samza pull request #795: SAMZA-1977: Shutdown the container threadPooln stop...

2018-11-05 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/795 SAMZA-1977: Shutdown the container threadPooln stopping AsyncRunLoop. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza

[GitHub] samza pull request #792: SAMZA-1638: Recreate SystemProducer on KafkaCheckpo...

2018-11-02 Thread shanthoosh
GitHub user shanthoosh reopened a pull request: https://github.com/apache/samza/pull/792 SAMZA-1638: Recreate SystemProducer on KafkaCheckpointManager.writeCheckpoint failures. Retry loop in the existing `KafkaCheckpointManager` implementation retries using the same

[GitHub] samza pull request #792: SAMZA-1638: Recreate SystemProducer on KafkaCheckpo...

2018-11-02 Thread shanthoosh
Github user shanthoosh closed the pull request at: https://github.com/apache/samza/pull/792 ---

[GitHub] samza pull request #792: SAMZA-1638: Recreate SystemProducer on KafkaCheckpo...

2018-11-02 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/792 SAMZA-1638: Recreate SystemProducer on KafkaCheckpointManager.writeCheckpoint failures. Retry loop in the existing `KafkaCheckpointManager` implementation retries using the same `SystemProducer

[GitHub] samza pull request #791: [WIP] SAMZA-1976: MetadataStore API cleanup.

2018-11-02 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/791 [WIP] SAMZA-1976: MetadataStore API cleanup. This PR consists of the following changes: * Switching all the API methods from using byte[] array as key type to string. * Fixed

[GitHub] samza pull request #790: [WIP] SAMZA-1973: Unify the TaskNameGrouper interfa...

2018-11-01 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/790 [WIP] SAMZA-1973: Unify the TaskNameGrouper interface for yarn and standalone. This patch consists of the following changes: * Unify the different methods present in the TaskNameGrouper

[GitHub] samza pull request #757: Fix samza-test checkstyle errors.

2018-10-22 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/757 Fix samza-test checkstyle errors. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza master Alternatively you can review and

[GitHub] samza pull request #726: SAMZA-1952: StreamPartitionCountMonitor for standal...

2018-10-15 Thread shanthoosh
GitHub user shanthoosh reopened a pull request: https://github.com/apache/samza/pull/726 SAMZA-1952: StreamPartitionCountMonitor for standalone. This patch adds the capability to detect the partition change of the input streams of a stateless standalone jobs and trigger a re

[GitHub] samza pull request #726: SAMZA-1952: StreamPartitionCountMonitor for standal...

2018-10-15 Thread shanthoosh
Github user shanthoosh closed the pull request at: https://github.com/apache/samza/pull/726 ---

[GitHub] samza pull request #726: SAMZA-1952: StreamPartitionCountMonitor for standal...

2018-10-15 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/726 SAMZA-1952: StreamPartitionCountMonitor for standalone. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza

[GitHub] samza pull request #703: SAMZA-1947: Remove specific js/css files from rat e...

2018-10-10 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/703 SAMZA-1947: Remove specific js/css files from rat excludes Internally at Linkedin we've observed that excluding specific `js` and `css` through rat gradle-plugin causes the ligradle build t

[GitHub] samza pull request #684: SAMZA-1933: Fix NPE in LocalityManager.

2018-10-02 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/684 SAMZA-1933: Fix NPE in LocalityManager. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza fix_NPE_in_task_assignment_manager

[GitHub] samza pull request #675: SAMZA-1926: Fix standalone configurations in config...

2018-09-28 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/675 SAMZA-1926: Fix standalone configurations in configuration table. Changes: * Fix the default value of debounce time configuration. * Remove the `coordination.utils.factory` configuration

[GitHub] samza pull request #670: SAMZA-1920: Standalone user guide.

2018-09-27 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/670 SAMZA-1920: Standalone user guide. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza getting_started_with_standalone

[GitHub] samza pull request #640: [WIP][Not ready for review]SAMZA-1885: Improve samz...

2018-09-15 Thread shanthoosh
Github user shanthoosh closed the pull request at: https://github.com/apache/samza/pull/640 ---

[GitHub] samza pull request #640: [WIP][Not ready for review]SAMZA-1885: Improve samz...

2018-09-15 Thread shanthoosh
GitHub user shanthoosh reopened a pull request: https://github.com/apache/samza/pull/640 [WIP][Not ready for review]SAMZA-1885: Improve samza build time. Samza codebase currently uses gradle 2.8 (which was released in 2014) and builds the codebase serially executing each of the

[GitHub] samza pull request #640: [WIP][Not ready for review]SAMZA-1885: Improve samz...

2018-09-15 Thread shanthoosh
Github user shanthoosh closed the pull request at: https://github.com/apache/samza/pull/640 ---

[GitHub] samza pull request #640: [WIP][Not ready for review]SAMZA-1885: Improve samz...

2018-09-14 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/640 [WIP][Not ready for review]SAMZA-1885: Improve samza build time. Samza codebase currently uses gradle 2.8 (which was released in 2014) and builds the codebase serially executing each of the

[GitHub] samza pull request #632: SAMZA-1865: Increase coordination timeouts in zooke...

2018-09-10 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/632 SAMZA-1865: Increase coordination timeouts in zookeeper integration tests. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza

[GitHub] samza pull request #629: SAMZA-1859: Zookeeper MetadataStore implementation.

2018-09-07 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/629 SAMZA-1859: Zookeeper MetadataStore implementation. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza metadata_store_zk_impl

[GitHub] samza pull request #621: SAMZA-1837: Fix TestLocalTableWithSideInputs failur...

2018-08-31 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/621 SAMZA-1837: Fix TestLocalTableWithSideInputs failures. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza

[GitHub] samza pull request #585: SAMZA-1788: Add LocationIdProvider abstraction.

2018-07-26 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/585 SAMZA-1788: Add LocationIdProvider abstraction. Currently in standalone, by default hostName of the standalone processor is used as LocationId. However, for containerized environments like azure

[GitHub] samza pull request #583: SAMZA-1786: Introduce metadata store abstraction.

2018-07-26 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/583 SAMZA-1786: Introduce metadata store abstraction. As a part of SEP-11, this patch adds MetadataStore interface to store task and container locality in both yarn and standalone deployment models

[GitHub] samza pull request #565: SAMZA-1761: Reduce runTime of TestZkUtils test from...

2018-06-26 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/565 SAMZA-1761: Reduce runTime of TestZkUtils test from 40s to 800ms. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza SAMZA-1761

[GitHub] samza pull request #554: SAMZA-1748: Standalone failure tests.

2018-06-14 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/554 SAMZA-1748: Standalone failure tests. In the standalone model, a processor can leave and join the group at any point in time. This processor reshuffle is referred to as rebalancing which

[GitHub] samza pull request #537: SAMZA-1732: Reduce the coordination timeouts in Tes...

2018-05-26 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/537 SAMZA-1732: Reduce the coordination timeouts in TestZkLocalApplicationRunner tests. Currently all the tests in TestZkLocalApplicationRunner takes around 5 minutes to finish. Reducing the

[GitHub] samza pull request #536: SAMZA-1731: Daemonize threads spawned from SamzaEve...

2018-05-25 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/536 SAMZA-1731: Daemonize threads spawned from SamzaEventHubClientManager. **Problem:** Existing SamzaEventHubClientManager implementation spawns non-daemon threads when instantiating

[GitHub] samza pull request #535: Adding state based valiations in StreamProcessor be...

2018-05-25 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/535 Adding state based valiations in StreamProcessor before doing any lifecycle operation and group coordination. Existing StreamProcessor implementation doesn't have state variable to repr

[GitHub] samza pull request #530: SAMZA-1725: Set travis build idle time out to 20 mi...

2018-05-22 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/530 SAMZA-1725: Set travis build idle time out to 20 minutes. Currently, average build time of samza codebase is 15 to 20 minutes. However, travis has a build idle timeout of 10 minutes and fails the

[GitHub] samza pull request #527: SAMZA-1720: Remove javafx.util dependency from samz...

2018-05-17 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/527 SAMZA-1720: Remove javafx.util dependency from samza-sql tests. In samza-sql module, currently few test classes(`TestSamzaSqlRelMessageSerde` and `TestSamzaSqlRelRecordSerde`) are dependent upon

[GitHub] samza pull request #526: Schedule ZkBarrierChangeHandler into debounce threa...

2018-05-17 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/526 Schedule ZkBarrierChangeHandler into debounce thread for execution. In existing implementation, `ZkBarrierChangeHandler` is executed from the `ZkEventThread` and has following drawbacks

[GitHub] samza pull request #519: SAMZA-1712: Tear down ZookeeperServer connections i...

2018-05-10 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/519 SAMZA-1712: Tear down ZookeeperServer connections in ZkClient on interrupts. **Problem:** If a thread executing zkClient.close is interrupted, currently we swallow the

[GitHub] samza pull request #515: SAMZA-1711: Re-enable existing standalone integrati...

2018-05-10 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/515 SAMZA-1711: Re-enable existing standalone integration tests. **Changes:** * Enable all existing standalone integration tests except `TestZkStreamProcessorSession

[GitHub] samza pull request #502: SAMZA-1698: Update appStatus on failures in localAp...

2018-05-03 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/502 SAMZA-1698: Update appStatus on failures in localApplication.run(streamApp). You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza

[GitHub] samza pull request #499: SAMZA-1695: Clear events in ScheduleAfterDebounceTi...

2018-05-01 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/499 SAMZA-1695: Clear events in ScheduleAfterDebounceTime on session expiration Scenario: Let's assume there're three processors in the group [P1, P2, P3] and P1 is the leader.

[GitHub] samza pull request #496: SAMZA-1692: Standalone stability fixes.

2018-04-30 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/496 SAMZA-1692: Standalone stability fixes. - Currently, on session expiration processorListener with incorrect generationId is registered with zookeeper(ZkUtils generationId is incremented on

[GitHub] samza pull request #494: SAMZA-1692: Standalone stability fixes.

2018-04-30 Thread shanthoosh
Github user shanthoosh closed the pull request at: https://github.com/apache/samza/pull/494 ---

[GitHub] samza pull request #494: SAMZA-1692: Standalone stability fixes.

2018-04-29 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/494 SAMZA-1692: Standalone stability fixes. * Currently on session expiration, processorListener with incorrect generationId is registered with zookeeper(ZkUtils generationId is incremented on

[GitHub] samza pull request #493: SAMZA-1647: Fix NPE in onJobModelExpired handler in...

2018-04-29 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/493 SAMZA-1647: Fix NPE in onJobModelExpired handler in StreamProcessor. Changes * Switch from using volatile to AtomicReference in StreamProcessor. * Add sufficient guards where container

[GitHub] samza pull request #490: SAMZA-1689: Add validations before state transition...

2018-04-27 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/490 SAMZA-1689: Add validations before state transitions in ZkBarrierForVersionUpgrade. Prevent invalid state updations on barrier. * Introduced a additional barrier state NEW. * Add state

[GitHub] samza pull request #487: SAMZA-1686: Set finite operation timeout when creat...

2018-04-23 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/487 SAMZA-1686: Set finite operation timeout when creating zkClient. Currently zkClient is created with operationRetryTimeOut of -1. This causes zkClient to retry indefinitely in case of

[GitHub] samza pull request #479: SAMZA-1667: Skip storing configuration as a part of...

2018-04-17 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/479 SAMZA-1667: Skip storing configuration as a part of JobModel in zookeeper data nodes. In general, jobModel configuration contains service access tokens and certs. It's a common practice t

[GitHub] samza pull request #476: Importing standalone fixes from the hot-fix branch.

2018-04-16 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/476 Importing standalone fixes from the hot-fix branch. Changes: * Handle job coordinator shutdown gracefully in case of unclean container shutdowns. * Fix the zookeeper session handling

[GitHub] samza pull request #474: SAMZA-1656: EventHubSystemAdmin does not fetch meta...

2018-04-13 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/474 SAMZA-1656: EventHubSystemAdmin does not fetch metadata for valid streams. Currently successive invocation of EventHubSystemAdmin.getSystemStreamMetadata with the same stream collection returns

[GitHub] samza pull request #466: SAMZA-1640: JobModel Json deserialization error in ...

2018-04-06 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/466 SAMZA-1640: JobModel Json deserialization error in ZkJobCoordinator. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza SAMZA

[GitHub] samza pull request #448: SAMZA-1554: Host affinity in standalone.

2018-04-04 Thread shanthoosh
Github user shanthoosh closed the pull request at: https://github.com/apache/samza/pull/448 ---

[GitHub] samza pull request #463: SAMZA-1183: Fix TestAsyncRunLoop flaky tests

2018-04-04 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/463 SAMZA-1183: Fix TestAsyncRunLoop flaky tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza

[GitHub] samza pull request #451: SAMZA-1621: Delete the ephemeral processor node in ...

2018-03-20 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/451 SAMZA-1621: Delete the ephemeral processor node in StreamProcessor shutdown phase. You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] samza pull request #448: SAMZA-1564: Host affinity in standalone.

2018-03-14 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/448 SAMZA-1564: Host affinity in standalone. SEP-11 Patch 1: Introducing MetadataStore interface and the associated classes. Followup patches will contain the TaskNameGrouper changes and

[GitHub] samza pull request #441: SAMZA-1584: LocalApplicationRunner.waitForFinish bl...

2018-03-08 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/441 SAMZA-1584: LocalApplicationRunner.waitForFinish blocks indefinitely. Changes. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh

[GitHub] samza pull request #438: SAMZA-1589: Reduce failure retry duration in KafkaC...

2018-03-07 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/438 SAMZA-1589: Reduce failure retry duration in KafkaCheckpointManager.writeCheckpoint You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] samza pull request #437: SAMZA-1607: Handle ZkNodeNotExistsException in zkUt...

2018-03-07 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/437 SAMZA-1607: Handle ZkNodeNotExistsException in zkUtils.readProcessorData You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza

[GitHub] samza pull request #430: SAMZA-1595: Fix scalacCompileOptions format to buil...

2018-02-22 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/430 SAMZA-1595: Fix scalacCompileOptions format to build with zinc scala compiler. Zinc scala compiler(part of gradle version >= 3.0) expects the scala compilation arguments as a list(where e

[GitHub] samza pull request #427: SAMZA-1594: Fix ScalaCompileOptions errors with hig...

2018-02-22 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/427 SAMZA-1594: Fix ScalaCompileOptions errors with higher gradle version. When samza repository is built with the gradle version greater than 3.0, we notice the following build failure. No

[GitHub] samza pull request #426: SAMZA-1593: Upgrade gradle nexus plugin.

2018-02-22 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/426 SAMZA-1593: Upgrade gradle nexus plugin. Current nexus plugin which samza repository is using is not compatible with the gradle versions greater than 3.0. For doing the ligradle

[GitHub] samza pull request #422: SAMZA-1588: Add random jitter to monitor’s schedu...

2018-02-15 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/422 SAMZA-1588: Add random jitter to monitor’s scheduling interval. We’ve observed in LinkedIn execution environments that, all the monitors running on the YARN node-manager machines hitting an

[GitHub] samza pull request #420: SAMZA-1572: Add fixed retries on failure in KafkaCh...

2018-02-07 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/420 SAMZA-1572: Add fixed retries on failure in KafkaCheckpointManager. KafkaCheckpointManager.writeCheckpoint currently goes into a infinite loop when an irrecoverable failure happens, this

[GitHub] samza pull request #416: SAMZA-1568: Handle ZkInterruptedException in zkclie...

2018-01-26 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/416 SAMZA-1568: Handle ZkInterruptedException in zkclient.close. When zookeeper session failures occur in a stream processor, leaves the group(zkClient is closed) and joins the group again

[GitHub] samza pull request #409: SAMZA-1561: Fix inconsistency problem in JobModel p...

2018-01-18 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/409 SAMZA-1561: Fix inconsistency problem in JobModel publish. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza master

[GitHub] samza pull request #283: SAMZA-1406: Fix potential orphaned containers probl...

2017-11-27 Thread shanthoosh
Github user shanthoosh closed the pull request at: https://github.com/apache/samza/pull/283 ---

[GitHub] samza pull request #362: Create changelog streams in Leader(ZkJobCoordinator...

2017-11-15 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/362 Create changelog streams in Leader(ZkJobCoordinator) for stateful operators. Verified with a test standalone job. Will add integration test for this as a part of fixing and reenabling standalone

[GitHub] samza pull request #357: SAMZA-1492: Add exception counter to LocalStoreMoni...

2017-11-13 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/357 SAMZA-1492: Add exception counter to LocalStoreMonitor. Add storeGCExceptionCounter to LocalStoreMonitor(as a part of LocalStoreMonitorMetrics) to enable alerts setup in an production environment

[GitHub] samza pull request #355: SAMZA-1487: Disable Flaky Zk Integration tests.

2017-11-09 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/355 SAMZA-1487: Disable Flaky Zk Integration tests. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza master Alternatively you

[GitHub] samza pull request #353: SAMZA-1487: Disable Flaky Zk Integration tests.

2017-11-08 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/353 SAMZA-1487: Disable Flaky Zk Integration tests. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza master Alternatively you

[GitHub] samza pull request #319: Enable integration tests conditionally in build.

2017-10-09 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/319 Enable integration tests conditionally in build. Remove runIntegrationTests property and introduce skipIntegrationTests property. If skipIntegrationTests gradle project property is enabled

[GitHub] samza pull request #283: SAMZA-1406: Fix potential orphaned containers probl...

2017-08-25 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/283 SAMZA-1406: Fix potential orphaned containers problem in stand alone. Changes: * Switch from `executorService.shutdown()` to `executorService.shutdownNow()` in `stopScheduler

[GitHub] samza pull request #270: SAMZA-1390: Update SamzaMonitorService to spawn dea...

2017-08-14 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/270 SAMZA-1390: Update SamzaMonitorService to spawn deamon threads Observed in LinkedIn production setup that samza-rest jvm process doesn’t stop after main thread death(due to jetty server

[GitHub] samza pull request #268: Fix ZkLatch await(timeout, TimeUnit) api.

2017-08-10 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/268 Fix ZkLatch await(timeout, TimeUnit) api. Use passed in timeUnit value for zkClient.waitUnitExists method rather than hardcoding with `TimeUnit.MILLISECONDS`. You can merge this pull request

[GitHub] samza pull request #260: Fix flaky, slow integration tests in TestZkStreamPr...

2017-08-03 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/260 Fix flaky, slow integration tests in TestZkStreamProcessor and TestZkStreamProcessorSession Fix flaky and slow integration tests in TestZkStreamProcessor and TestZkStreamProcessorSession

[GitHub] samza pull request #253: SAMZA-1365: Calling zkClient.close from zkWatch imp...

2017-07-27 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/253 SAMZA-1365: Calling zkClient.close from zkWatch impl blocks indefinitely. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza

[GitHub] samza pull request #252: Fix npe after master merge

2017-07-25 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/252 Fix npe after master merge You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza fix_NPE_after_master_merge Alternatively you can

[GitHub] samza pull request #250: Reenable LocalZkApplicationRunner tests.

2017-07-25 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/250 Reenable LocalZkApplicationRunner tests. Add back commented out ZkLocalApplicationRunner tests(Was dependent upon error propagation from SamzaContainer to LocalApplicationRunner). You can merge

[GitHub] samza pull request #249: Fix log messages from StreamProcessor(onJobModelExp...

2017-07-25 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/249 Fix log messages from StreamProcessor(onJobModelExpired event). Log messages published in onJobModelExpired event have `processorId` as null. `processorId` is cached as final var in

[GitHub] samza pull request #246: Samza-1364: Handle ZKExceptions in zkCoordinationUt...

2017-07-20 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/246 Samza-1364: Handle ZKExceptions in zkCoordinationUtils.reset. In some cases LocalAppRunner.waitForFinish indefinitely blocks after LocalApplicationRunner.kill. Last step in LocalAppRunner.kill

[GitHub] samza pull request #244: SAMZA-1282: Spinning up more containers than number...

2017-07-14 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/244 SAMZA-1282: Spinning up more containers than number of tasks. Changes * Stop streamProcessor in onNewJobModelAvailable eventHandler(instead of onNewJobModelConfirmed eventHandler

[GitHub] samza pull request #177: SAMZA-1185: Async commit documentation.

2017-07-10 Thread shanthoosh
Github user shanthoosh closed the pull request at: https://github.com/apache/samza/pull/177 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] samza pull request #240: SAMZA-1304: Handling duplicate stream processor reg...

2017-06-29 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/240 SAMZA-1304: Handling duplicate stream processor registration. When a stream processor registers with same processorId as already existing processor in processor group, it's registration s

[GitHub] samza pull request #237: SAMZA-1355 : Enable standalone integration tests co...

2017-06-28 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/237 SAMZA-1355 : Enable standalone integration tests conditionally in build. It's run only when includeSamzaTest gradle project property is set. You can merge this pull request into a Git repos

[GitHub] samza pull request #235: Fix NullPointerException in ZkUtils read/write api.

2017-06-28 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/235 Fix NullPointerException in ZkUtils read/write api. Problem: Read/Write api methods in ZkUtils updates counter/times in `metrics` field. In a ZkUtils constructor this is not set properly

[GitHub] samza pull request #219: Switch SamzaTaskProxy to use LocalityManager.

2017-06-07 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/219 Switch SamzaTaskProxy to use LocalityManager. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza fix-2 Alternatively you can

[GitHub] samza pull request #196: SAMZA-1296 : Stand alone integration tests.

2017-05-18 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/196 SAMZA-1296 : Stand alone integration tests. Changes Brings up a test bed that contains embedded kafka broker and zookeeper to test the following scenarios. A) Rolling upgrade of

[GitHub] samza pull request #177: SAMZA-1185: Async commit documentation.

2017-05-09 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/177 SAMZA-1185: Async commit documentation. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza add_async_commit Alternatively you

[GitHub] samza pull request #164: SAMZA-1206: Fix TestJMXServer.

2017-05-04 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/164 SAMZA-1206: Fix TestJMXServer. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza fix-test-jmx-server-1 Alternatively you can

[GitHub] samza pull request #158: Disable flaky tests.

2017-05-03 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/158 Disable flaky tests. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza master Alternatively you can review and apply these

[GitHub] samza pull request #140: SAMZA-1196: Fix TestJmxReporter

2017-04-25 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/140 SAMZA-1196: Fix TestJmxReporter You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza fix-test-jmx-reporter Alternatively you can

[GitHub] samza pull request #138: SAMZA-1233: Create SystemAdmin only for JobCoordina...

2017-04-24 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/138 SAMZA-1233: Create SystemAdmin only for JobCoordinator System in SamzaTaskProxy You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh

[GitHub] samza pull request #137: SAMZA-1232: Log configuration value in RunLoopFacto...

2017-04-24 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/137 SAMZA-1232: Log configuration value in RunLoopFactory You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza

[GitHub] samza pull request #130: SAMZA-1217: Fix broken build due to TestCheckstyle ...

2017-04-18 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/130 SAMZA-1217: Fix broken build due to TestCheckstyle problem in trunk You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza master

[GitHub] samza pull request #126: SAMZA-1182 : Disable flaky tests.

2017-04-18 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/126 SAMZA-1182 : Disable flaky tests. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shanthoosh/samza disable_all_async_run_loop_tests

[GitHub] samza pull request #124: SAMZA-1209: Improve error handling in LocalStoreMon...

2017-04-14 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/124 SAMZA-1209: Improve error handling in LocalStoreMonitor Changes: 1. Add opt-in configuration to continue garbage collection of local stores when there’s a failure in garbage

[GitHub] samza pull request #120: SAMZA-1205 : Disable flaky tests in TestJmxServer.

2017-04-10 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/120 SAMZA-1205 : Disable flaky tests in TestJmxServer. @navina Please take a look when you get a chance. Here is the failure build : https://builds.apache.org/job/samza-pr-checks

[GitHub] samza pull request #118: SAMZA-1194 - Commenting out testJmxReporter flaky t...

2017-04-07 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/118 SAMZA-1194 - Commenting out testJmxReporter flaky test TestJmxReporter brings up an JmxServer and uses it to test the reporter behavior. However, due to failures in bringing up/connecting to JMX

  1   2   >