[samza] branch master updated: SAMZA-398: Remove force NONE compression for changelog topic producer

2021-05-19 Thread nickpan47
This is an automated email from the ASF dual-hosted git repository. nickpan47 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/samza.git The following commit(s) were added to refs/heads/master by this push: new 9d9ebc7 SAMZA-398: Remove force NONE

[samza] branch master updated: SAMZA-2558: Refactor app.runner.class

2020-09-10 Thread nickpan47
This is an automated email from the ASF dual-hosted git repository. nickpan47 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/samza.git The following commit(s) were added to refs/heads/master by this push: new 3fcced3 SAMZA-2558: Refactor

svn commit: r34862 - in /release/samza: 0.10.0/ 0.10.1/ 0.11.0/ 0.12.0/ 0.13.0/ 0.13.1/ 0.14.0/ 0.14.1/ 0.9.0/ 0.9.1/ 1.0.0/ 1.1.0/ 1.2.0/

2019-07-12 Thread nickpan47
Author: nickpan47 Date: Fri Jul 12 10:00:51 2019 New Revision: 34862 Log: Removing old .md5 and replace with new .sha256 files Added: release/samza/0.10.0/apache-samza-0.10.0-src.tgz.sha256 release/samza/0.10.1/apache-samza-0.10.1-src.tgz.sha256 release/samza/0.11.0/apache-samza

samza git commit: SAMZA-1832: Fix race condition between StreamProcessor and SamzaContainerListener

2018-10-04 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 603bd8eac -> 6e5e1621a SAMZA-1832: Fix race condition between StreamProcessor and SamzaContainerListener The PR addresses the following issues - We have few scenarios where there is a race condition between `SamzaContainerListener` and `

[4/4] samza git commit: SAMZA-1814: consolidate JobNode and JobGraph configuration generation for high and low-level API applications

2018-09-26 Thread nickpan47
Reviewers: Prateek Maheshwari , Cameron Lee Closes #642 from nickpan47/SAMZA-1814 and squashes the following commits: 214373966 [Yi Pan (Data Infrastructure)] Merge branch 'master' into SAMZA-1814. With minor fixes to allow merge correctly. f8c8108ac [Yi Pan (Data Infrastructure)] SAMZA

[2/4] samza git commit: SAMZA-1814: consolidate JobNode and JobGraph configuration generation for high and low-level API applications

2018-09-26 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/cfbb9c6e/samza-core/src/test/java/org/apache/samza/execution/TestExecutionPlanner.java -- diff --git a/samza-core/src/test/java/org/apache/samza/execution/TestExecutionPlanner.java

[1/4] samza git commit: SAMZA-1814: consolidate JobNode and JobGraph configuration generation for high and low-level API applications

2018-09-26 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master b842626fd -> cfbb9c6eb http://git-wip-us.apache.org/repos/asf/samza/blob/cfbb9c6e/samza-kafka/src/main/scala/org/apache/samza/checkpoint/kafka/KafkaCheckpointManagerFactory.scala --

[3/4] samza git commit: SAMZA-1814: consolidate JobNode and JobGraph configuration generation for high and low-level API applications

2018-09-26 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/cfbb9c6e/samza-core/src/main/java/org/apache/samza/execution/JobNode.java -- diff --git a/samza-core/src/main/java/org/apache/samza/execution/JobNode.java b/samza-core/src/main/jav

samza git commit: SAMZA-1837: Fix TestLocalTableWithSideInputs failures.

2018-09-11 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 2b5970d81 -> 0e0a939df SAMZA-1837: Fix TestLocalTableWithSideInputs failures. * Fix TestRunner API config overriding. * By default, RocksDBTableProvider enables host affinity which failed this particular test. To fix test failure, turn off

[8/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-06 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/abf49eaa/samza-core/src/main/java/org/apache/samza/application/ApplicationDescriptorUtil.java -- diff --git a/samza-core/src/main/java/org/apache/samza/application/ApplicationDescr

[3/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-06 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/abf49eaa/samza-sql/src/main/java/org/apache/samza/sql/translator/JoinTranslator.java -- diff --git a/samza-sql/src/main/java/org/apache/samza/sql/translator/JoinTranslator.java b/

[1/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-06 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master b0b292200 -> abf49eaaa http://git-wip-us.apache.org/repos/asf/samza/blob/abf49eaa/samza-test/src/test/java/org/apache/samza/test/table/TestLocalTable.java -- diff --git a/s

[9/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-06 Thread nickpan47
, Cameron Lee Closes #606 from nickpan47/app-runtime-with-processor-callbacks and squashes the following commits: 3e60d44a [Yi Pan (Data Infrastructure)] SAMZA-1789: final revision on ApplicationDescriptor and ApplicationRunner APIs bdb5b0fc [Yi Pan (Data Infrastructure)] SAMZA-1789

[4/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-06 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/abf49eaa/samza-core/src/test/java/org/apache/samza/operators/spec/TestPartitionByOperatorSpec.java -- diff --git a/samza-core/src/test/java/org/apache/samza/operators/spec/TestPart

[7/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-06 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/abf49eaa/samza-core/src/main/java/org/apache/samza/operators/spec/OperatorSpec.java -- diff --git a/samza-core/src/main/java/org/apache/samza/operators/spec/OperatorSpec.java b/sa

[6/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-06 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/abf49eaa/samza-core/src/test/java/org/apache/samza/application/TestStreamApplicationDescriptorImpl.java -- diff --git a/samza-core/src/test/java/org/apache/samza/application/TestSt

[2/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-06 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/abf49eaa/samza-test/src/main/java/org/apache/samza/test/integration/TestStandaloneIntegrationApplication.java -- diff --git a/samza-test/src/main/java/org/apache/samza/test/integra

[5/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-06 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/abf49eaa/samza-core/src/test/java/org/apache/samza/operators/TestJoinOperator.java -- diff --git a/samza-core/src/test/java/org/apache/samza/operators/TestJoinOperator.java b/samz

samza git commit: SAMZA-1836: StreamManager created before ExecutionPlanner should also apply configuration overrides

2018-08-31 Thread nickpan47
hor: Yi Pan (Data Infrastructure) Reviewers: Prateek Maheshwari , Boris S , Xinyu Liu , Shanthoosh Venkataraman Closes #620 from nickpan47/SAMZA-1836 and squashes the following commits: a376b888 [Yi Pan (Data Infrastructure)] SAMZA-1836: StreamManager created before ExecutionPlanner should a

samza git commit: SAMZA-1822: Samza 0.14.1 not correctly handling OffsetOutOfRangeException exception

2018-08-27 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 2a71baf7c -> 46685406f SAMZA-1822: Samza 0.14.1 not correctly handling OffsetOutOfRangeException exception Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/46685406 Tre

samza git commit: SAMZA-1826: Fix unit test failure in table tests

2018-08-26 Thread nickpan47
ble, TestLocalTableWithSideInputs) creates some conflicts in the static counter map and triggers test failure in certain sequence of ordering of tests. Fixing it by requiring explicit name of the join functions in tests and register / verify by unique op names. Author: Yi Pan (Data Infrastructure) Closes #617 from nickpa

samza git commit: SAMZA-1738: Merge in some minor additions from Linkedin branch

2018-06-28 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master f6c99a4c4 -> c5557140d SAMZA-1738: Merge in some minor additions from Linkedin branch Author: Cameron Lee Reviewers: Yi Pan Closes #549 from cameronlee314/sync_li_trunk Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit

[03/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-sql/src/test/java/org/apache/samza/sql/testutil/TestSamzaSqlQueryParser.java -- diff --git a/samza-sql/src/test/java/org/apache/samza/sql/testutil/TestSamzaSqlQueryP

[02/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-test/src/main/java/org/apache/samza/example/BroadcastExample.java -- diff --git a/samza-test/src/main/java/org/apache/samza/example/BroadcastExample.java b/samza-te

[10/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
Closes #475 from nickpan47/serializable-opspec-only-Jan-24-18 and squashes the following commits: db0dea73 [Yi Pan (Data Infrastructure)] SAMZA-1659: fix intermittent TestZkLocalApplicationRunner failure due to StreamProcessor#stop() 34716d42 [Yi Pan (Data Infrastructure)] SAMZA-1659: fix a

[06/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-core/src/test/java/org/apache/samza/operators/TestStreamGraphSpec.java -- diff --git a/samza-core/src/test/java/org/apache/samza/operators/TestStreamGraphSpec.java

[04/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-sql/src/main/java/org/apache/samza/sql/translator/ProjectTranslator.java -- diff --git a/samza-sql/src/main/java/org/apache/samza/sql/translator/ProjectTranslator.ja

[05/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-core/src/test/java/org/apache/samza/operators/spec/OperatorSpecTestUtils.java -- diff --git a/samza-core/src/test/java/org/apache/samza/operators/spec/OperatorSpecTe

[08/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-core/src/main/java/org/apache/samza/operators/triggers/TriggerImpl.java -- diff --git a/samza-core/src/main/java/org/apache/samza/operators/triggers/TriggerImpl.java

[09/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-core/src/main/java/org/apache/samza/operators/StreamGraphImpl.java -- diff --git a/samza-core/src/main/java/org/apache/samza/operators/StreamGraphImpl.java b/samza-

[01/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master bc4a0c2de -> 53d7f2625 http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-test/src/test/java/org/apache/samza/test/table/TestLocalTable.java -- diff --git a/s

[07/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-core/src/test/java/org/apache/samza/operators/TestJoinOperator.java -- diff --git a/samza-core/src/test/java/org/apache/samza/operators/TestJoinOperator.java b/samz

samza git commit: SD-1599: Improve the efficiency of the AsynRunLoop when some partitio…

2018-03-29 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 13ff09024 -> 57fea260a SD-1599: Improve the efficiency of the AsynRunLoop when some partitio… …ns are empty. Author: James Lent Reviewers: Yi Pan , Xinyu Liu Closes #436 from jwlent55/SD-1599-improve-async-run-loop-efficiency and

[1/2] samza git commit: SAMZA-1555: Move creation of checkpoint and changelog streams to the Job Coordinators

2018-02-16 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 718c66612 -> 6dc89e100 http://git-wip-us.apache.org/repos/asf/samza/blob/6dc89e10/samza-core/src/main/scala/org/apache/samza/coordinator/JobModelManager.scala -- diff --git

[2/2] samza git commit: SAMZA-1555: Move creation of checkpoint and changelog streams to the Job Coordinators

2018-02-16 Thread nickpan47
. **Motivations** There are three driving forces for this refactoring. The first motivation is to assign the creation of the changelog and checkpoint streams to the JobCoordinators where it is most appropriate. This was discussed in more detail with nickpan47 . The second motivation is to have any potential

svn commit: r23996 - in /release/samza/0.14.0: samza-tools-0.14.0.tgz samza-tools-0.14.0.tgz.MD5 samza-tools-0.14.0.tgz.asc

2018-01-03 Thread nickpan47
Author: nickpan47 Date: Wed Jan 3 19:33:13 2018 New Revision: 23996 Log: upload samza-tools bin and MD5 and asc altogether Added: release/samza/0.14.0/samza-tools-0.14.0.tgz.MD5 release/samza/0.14.0/samza-tools-0.14.0.tgz.asc Modified: release/samza/0.14.0/samza-tools-0.14.0.tgz

svn commit: r23983 - in /release/samza/0.14.0: ./ apache-samza-0.14.0-src.tgz apache-samza-0.14.0-src.tgz.MD5 apache-samza-0.14.0-src.tgz.asc samza-tools-0.14.0.tgz

2018-01-02 Thread nickpan47
Author: nickpan47 Date: Tue Jan 2 17:34:53 2018 New Revision: 23983 Log: uploading tarballs for 0.14.0 release Added: release/samza/0.14.0/ release/samza/0.14.0/apache-samza-0.14.0-src.tgz (with props) release/samza/0.14.0/apache-samza-0.14.0-src.tgz.MD5 release/samza/0.14.0

samza git commit: SAMZA-1412 replace mockito-all with mockito-core

2017-11-28 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 9961023f7 -> d262f6663 SAMZA-1412 replace mockito-all with mockito-core ran "./gradlew clean check" and all tests passed Author: Fred Ji Reviewers: Prateek Maheshwari Closes #365 from fredji97/mockito-core Project: http://git-wip-us.

samza git commit: SAMZA-1482: add config documentation for auto-restart/fail behavior o…

2017-11-20 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master edce6b76d -> 9fb9a7673 SAMZA-1482: add config documentation for auto-restart/fail behavior o… …n partition count changes Author: Yi Pan (Data Infrastructure) Reviewers: Jagadish Closes #363 from nickpan47/partition-change-docs

samza git commit: SAMZA-1482: Restart or fail Samza jobs in YARN when detecting changes…

2017-11-14 Thread nickpan47
ers: Jacob Maes , Jagadish Closes #351 from nickpan47/restart-on-partition-change and squashes the following commits: 8d04cd6 [Yi Pan (Data Infrastructure)] SAMZA-1482: restart or fail the job when input topic partition count changes ee3fa65 [Yi Pan (Data Infrastructure)] SAMZA-1482: Restart

[samza] Git Push Summary

2017-10-11 Thread nickpan47
Repository: samza Updated Branches: refs/heads/0.13.2 [deleted] 90fa985ec

samza git commit: SAMZA-1408 update master doc to use 0.14.0-SNAPSHOT after 0.13.1 release

2017-08-25 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 2a4ccfdd7 -> 3a134386f SAMZA-1408 update master doc to use 0.14.0-SNAPSHOT after 0.13.1 release Author: Fred Ji Reviewers: Yi Pan Closes #285 from fredji97/master_doc and squashes the following commits: 58cc775 [Fred Ji] SAMZA-1408 kee

samza git commit: SAMZA-1408 update the branch doc for 0.13.1 release

2017-08-25 Thread nickpan47
Repository: samza Updated Branches: refs/heads/0.13.1 4039ca9a9 -> 33e1e8177 SAMZA-1408 update the branch doc for 0.13.1 release Author: Fred Ji Reviewers: Yi Pan Closes #286 from fredji97/0.13.1_doc and squashes the following commits: 0717974 [Fred Ji] SAMZA-1408 keep the doc unchanged f

svn commit: r21301 - in /release/samza/0.13.1: apache-samza-0.13.1-src.tgz.MD5 apache-samza-0.13.1-src.tgz.md5

2017-08-25 Thread nickpan47
Author: nickpan47 Date: Fri Aug 25 17:30:33 2017 New Revision: 21301 Log: rename .MD5 to .md5 per guidance from Apache board Added: release/samza/0.13.1/apache-samza-0.13.1-src.tgz.md5 Removed: release/samza/0.13.1/apache-samza-0.13.1-src.tgz.MD5 Added: release/samza/0.13.1/apache-samza

[17/23] samza git commit: Fix flaky, slow integration tests in TestZkStreamProcessor and TestZkStreamProcessorSession

2017-08-09 Thread nickpan47
Fix flaky, slow integration tests in TestZkStreamProcessor and TestZkStreamProcessorSession Fix flaky and slow integration tests in TestZkStreamProcessor and TestZkStreamProcessorSession Reason for failures: There’re three configurable wait times in rebalancing phase in samza standalone befo

[12/23] samza git commit: Samza-1364: Handle ZKExceptions in zkCoordinationUtils.reset.

2017-08-09 Thread nickpan47
Samza-1364: Handle ZKExceptions in zkCoordinationUtils.reset. In some cases LocalAppRunner.waitForFinish indefinitely blocks after LocalApplicationRunner.kill. Last step in LocalAppRunner.kill(streamApp) is zkClient.close()[zkClient belongs to ZkCoordinationService]. ApplicationRunner.kill trig

[11/23] samza git commit: Fix build failures after master merge

2017-08-09 Thread nickpan47
Fix build failures after master merge Changes * Fix checkstyle errors from #243 * Fix failure after bad merge in #244 Author: Shanthoosh Venkataraman Reviewers: Navina Ramesh Closes #252 from shanthoosh/fix_NPE_after_master_merge Project: http://git-wip-us.apache.org/repos/asf/samza/repo Co

[14/23] samza git commit: SAMZA-1361; OperatorImplGraph is using wrong keys to store/retrieve OperatorImpl in the map

2017-08-09 Thread nickpan47
SAMZA-1361; OperatorImplGraph is using wrong keys to store/retrieve OperatorImpl in the map Author: Prateek Maheshwari Reviewers: Jagadish Closes #248 from prateekm/operatorimpl-key and squashes the following commits: e733e9d3 [Prateek Maheshwari] Dummy commit to trigger jenkins build. 5a16f

[04/23] samza git commit: SAMZA-1336. Session disconnect propagation.

2017-08-09 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/ce777164/samza-test/src/test/java/org/apache/samza/test/processor/TestZkStreamProcessorFailures.java -- diff --git a/samza-test/src/test/java/org/apache/samza/test/processor/TestZk

[06/23] samza git commit: SAMZA-1165; cleanup old zk versions.

2017-08-09 Thread nickpan47
SAMZA-1165; cleanup old zk versions. Author: Boris Shkolnik Author: Boris Shkolnik Reviewers: Navina , Shanthoosh V Closes #239 from sborya/zkCleanUpBarrier1 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/4eb51531 Tree:

[15/23] samza git commit: SAMZA-1366: ScriptRunner should allow callers to control the child pr…

2017-08-09 Thread nickpan47
SAMZA-1366: ScriptRunner should allow callers to control the child pr… …ocess environment. Author: Jacob Maes Reviewers: Jagadish , Shanthoosh Venkataraman Closes #245 from jmakes/script-runner-improvements Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-w

[21/23] samza git commit: SAMZA-1380: Create Utility Class for interacting with Azure Blob Storage

2017-08-09 Thread nickpan47
SAMZA-1380: Create Utility Class for interacting with Azure Blob Storage PR 1: AzureClient + AzureConfig PR 2: LeaseBlobManager **PR 3: BlobUtils + JobModelBundle** (current PR) Author: PawasChhokra Author: PawasChhokra Reviewers: Navina Ramesh Closes #257 from PawasChhokra/BlobUtils Proje

[22/23] samza git commit: SAMZA-1381: Create Utility Class for interacting with Azure Table Storage

2017-08-09 Thread nickpan47
SAMZA-1381: Create Utility Class for interacting with Azure Table Storage PR 1: AzureClient + AzureConfig PR 2: LeaseBlobManager PR 3: BlobUtils + JobModelBundle **PR 4: TableUtils + ProcessorEntity** (Current PR) Author: PawasChhokra Author: PawasChhokra Reviewers: Navina Ramesh Closes #258

[18/23] samza git commit: Samza-1379: Create Azure Client

2017-08-09 Thread nickpan47
Samza-1379: Create Azure Client navina **PR 1: AzureClient + AzureConfig** (current PR) Author: PawasChhokra Reviewers: Navina Ramesh Closes #254 from PawasChhokra/AzureStorageClient Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/sa

[23/23] samza git commit: Merge branch 'master' into 0.14.0

2017-08-09 Thread nickpan47
Merge branch 'master' into 0.14.0 Conflicts: samza-core/src/main/java/org/apache/samza/processor/StreamProcessor.java Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/23bfaa8d Tree: http://git-wip-us.apache.org/repos/a

[19/23] samza git commit: Reenable LocalZkApplicationRunner tests.

2017-08-09 Thread nickpan47
Reenable LocalZkApplicationRunner tests. Add back commented out ZkLocalApplicationRunner tests(Was dependent upon error propagation from SamzaContainer to LocalApplicationRunner). Author: Shanthoosh Venkataraman Reviewers: Navina Ramesh Closes #250 from shanthoosh/fix_broken_tests Project:

[13/23] samza git commit: SAMZA-1370; Memory leak in CachedStore when using ByteBufferSerde as key Serde

2017-08-09 Thread nickpan47
SAMZA-1370; Memory leak in CachedStore when using ByteBufferSerde as key Serde ByteBufferSerde uses relative bulk get to serialize the provided ByteBuffer which changes its internal position. ByteBuffer's `equals` and `hashCode` depend upon its remaining elements, i.e. on its position. This mean

[20/23] samza git commit: SAMZA-1376: Create a leasing utility class for blobs in Azure

2017-08-09 Thread nickpan47
SAMZA-1376: Create a leasing utility class for blobs in Azure navina PR 1: AzureClient + AzureConfig **PR 2: LeaseBlobManager** (current PR) Author: PawasChhokra Author: PawasChhokra Reviewers: Navina Ramesh , Shanthoosh Venkataraman Closes #256 from PawasChhokra/LeaseUtils Project: http:

[16/23] samza git commit: SAMZA-1365: Calling zkClient.close from zkWatch impl blocks indefinitely.

2017-08-09 Thread nickpan47
SAMZA-1365: Calling zkClient.close from zkWatch impl blocks indefinitely. Author: Shanthoosh Venkataraman Reviewers: Navina Ramesh Closes #253 from shanthoosh/SAMZA-1365 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/0a4

[02/23] samza git commit: SAMZA-1324: Fix NullPointerException in ZkUtils api's.

2017-08-09 Thread nickpan47
SAMZA-1324: Fix NullPointerException in ZkUtils api's. Problem: Read/Write api methods in ZkUtils updates counters/timers in `metrics` field. In a ZkUtils constructor this fields is not initialized properly. Java default for uninitialized field is null resulting in NPE. Fix: Initialize private

[08/23] samza git commit: Fix log messages from StreamProcessor(onJobModelExpired event).

2017-08-09 Thread nickpan47
Fix log messages from StreamProcessor(onJobModelExpired event). Log messages published in onJobModelExpired event have `processorId` as null. `processorId` is cached as final var in jobCoordinatorListener method. JLS for final fields/variables states that they're initialized before the construct

[07/23] samza git commit: SAMZA-1368; make sure new job model will be generated in case of barrier timeout.

2017-08-09 Thread nickpan47
SAMZA-1368; make sure new job model will be generated in case of barrier timeout. Author: Boris Shkolnik Reviewers: Shanthoosh V Closes #247 from sborya/onBarrierTimeout1 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/1

[03/23] samza git commit: SAMZA-1304: Handling duplicate stream processor registration.

2017-08-09 Thread nickpan47
SAMZA-1304: Handling duplicate stream processor registration. When a stream processor registers with same processorId as already existing processor in processor group, it's registration should fail. Author: Shanthoosh Venkataraman Reviewers: Navina Ramesh , Jagadish V Closes #240 from shantho

[05/23] samza git commit: SAMZA-1336. Session disconnect propagation.

2017-08-09 Thread nickpan47
SAMZA-1336. Session disconnect propagation. If ZK doesn't receive any communication from a zkClient (including heartbeats), it closes the session with the client. It removes all the ephemeral nodes associated with the client. That's why we need to restore all these nodes - need to re-register.

[09/23] samza git commit: SAMZA-1359; Handle phantom container notifications cleanly during an RM fail-over

2017-08-09 Thread nickpan47
SAMZA-1359; Handle phantom container notifications cleanly during an RM fail-over 1. Improved our container handling logic to be resilient to phantom notifications. 2. Added a new metric to Samza's ContainerProcessManager module that tracks the number of such invalid notifications. 3. Add a cou

[10/23] samza git commit: SAMZA-1282: Spinning up more containers than number of tasks.

2017-08-09 Thread nickpan47
SAMZA-1282: Spinning up more containers than number of tasks. Changes * Stop streamProcessor in onNewJobModelAvailable eventHandler(instead of onNewJobModelConfirmed eventHandler) when it's not part of the group and prevent it from joining the barrier. * When numContainerIds > numTaskModels,

[01/23] samza git commit: SAMZA-1358: fix the bug in validating task.class empty string when app.class is configured

2017-08-09 Thread nickpan47
ers: Jacob Maes Closes #242 from nickpan47/SAMZA-1358 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/be989935 Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/be989935 Diff: http://git-wip-us.apache.org/repos/asf/samza/d

samza git commit: SAMZA-1358: fix the bug in validating task.class empty string when app.class is configured

2017-07-11 Thread nickpan47
ers: Jacob Maes Closes #242 from nickpan47/SAMZA-1358 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/be989935 Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/be989935 Diff: http://git-wip-us.apache.org/repos/asf/samza/d

samza git commit: SAMZA-1334: fix pre-condition for ContainerAllocator to work properly

2017-06-20 Thread nickpan47
ure) Reviewers: Jagadish Closes #228 from nickpan47/SAMZA-1334 and squashes the following commits: ad3320f [Yi Pan (Data Infrastructure)] SAMZA-1334: fix the pre-conditions for ContainerAllocator to work properly. Make sure JobModel is generated w/o LocalityManager if host-affinity is disabled f76f

[samza] Git Push Summary

2017-06-14 Thread nickpan47
Repository: samza Updated Tags: refs/tags/release-0.13.0 [created] 6a29b39f9

samza git commit: SAMZA-1226: relax type parameters in MessageStream functions

2017-04-21 Thread nickpan47
esh , Jacob Maes Closes #133 from nickpan47/SAMZA-1226 and squashes the following commits: b8d3461 [Yi Pan (Data Infrastructure)] SAMZA-1226: cleanup code example in StreamApplication javadoc 93fa471 [Yi Pan (Data Infrastructure)] SAMZA-1226: added more unit tests for type-cast functions 18e1e9f

samza git commit: SAMZA-868: support elasticsearch version 2.x

2017-04-20 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master de8cffdfa -> e753c8de3 SAMZA-868: support elasticsearch version 2.x Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/e753c8de Tree: http://git-wip-us.apache.org/repos/as

samza git commit: SAMZA-1217: Fix broken build due to TestCheckstyle problem.

2017-04-18 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master abe39676e -> d50b1791b SAMZA-1217: Fix broken build due to TestCheckstyle problem. Author: Shanthoosh Venkataraman Reviewers: Yi Pan Closes #130 from shanthoosh/master Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit:

samza git commit: SAMZA-1157: Serialization/deserialization throwables should not be suppressed

2017-04-18 Thread nickpan47
ses #128 from nickpan47/fix-serde-error-suppressed Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/abe39676 Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/abe39676 Diff: http://git-wip-us.apache.org/repos/asf/samza/diff/

samza git commit: SAMZA-1215, SAMZA-1216: remove ProcessKiller and change the ZooKeeper connection string in test

2017-04-18 Thread nickpan47
ses #129 from nickpan47/fix-some-tests Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/0b0b2958 Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/0b0b2958 Diff: http://git-wip-us.apache.org/repos/asf/samza/diff/0b0b2

samza git commit: SAMZA-1145: Provide Ability To Confgure The Default Number Of Changel…

2017-04-14 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 34178a63f -> 925866d9b SAMZA-1145: Provide Ability To Confgure The Default Number Of Changel… …og Replicas Author: James Lent Reviewers: Yi Pan , Jagadish Closes #86 from jwlent55/SAMZA-1145 Project: http://git-wip-us.apache.org/

samza git commit: SAMZA-1195 fix bug in Samza application master on Kerberos

2017-04-14 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 66cbac5c7 -> 34178a63f SAMZA-1195 fix bug in Samza application master on Kerberos Author: Chen Song Reviewers: Yi Pan Closes #119 from garlicbulb-puzhuo/SAMZA-1195 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: htt

samza git commit: SAMZA-1093: instantiating StreamOperatorTask in SamzaContainer

2017-03-18 Thread nickpan47
add instantiation of StreamOperatorTask in SamzaContainer Author: Yi Pan (Data Infrastructure) Reviewers: Xinyu Liu , Navina Ramesh , vjagadish1989 , Prateek Maheshwari , Chris Pettitt Closes #65 from nickpan47/SAMZA-1093 and squashes the following commits: 9daf451 [Yi Pan (Data Infrastructure)] SA

[2/3] samza git commit: Merge branch 'SAMZA-1093' into samza-fluent-api-v1

2017-02-27 Thread nickpan47
Merge branch 'SAMZA-1093' into samza-fluent-api-v1 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/cf267f8a Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/cf267f8a Diff: http://git-wip-us.apache.org/repos/asf/samza/di

[3/3] samza git commit: Merge branch 'samza-fluent-api-v1' of http://git-wip-us.apache.org/repos/asf/samza into samza-fluent-api-v1

2017-02-27 Thread nickpan47
Merge branch 'samza-fluent-api-v1' of http://git-wip-us.apache.org/repos/asf/samza into samza-fluent-api-v1 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/a9b213c1 Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/a9b2

[1/3] samza git commit: SAMZA-1093: instantiating StreamOperatorTask in SamzaContainer (WIP)

2017-02-27 Thread nickpan47
Repository: samza Updated Branches: refs/heads/samza-fluent-api-v1 dde754246 -> a9b213c13 SAMZA-1093: instantiating StreamOperatorTask in SamzaContainer (WIP) SAMZA-1093: Instantiating StreamOperatorTask in SamzaContainer SAMZA-1093: fix import SAMZA-1093: code ready, more unit tests pending

samza git commit: SAMZA-1092: replace stream spec in fluent API

2017-02-23 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master b5ea8776e -> e6147fdac SAMZA-1092: replace stream spec in fluent API Replaced the StreamSpec class w/ the new one from SAMZA-1075. Author: Yi Pan (Data Infrastructure) Reviewers: Jacob Maes Closes #58 from nickpan47/replace-str

samza git commit: SAMZA-1097: update master branch to use 0.13.0-SNAPSHOT version

2017-02-21 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 062ac56d1 -> eab180010 SAMZA-1097: update master branch to use 0.13.0-SNAPSHOT version Author: Yi Pan (Data Infrastructure) Reviewers: jagadish Closes #59 from nickpan47/SAMZA-1097 Project: http://git-wip-us.apache.org/repos/

svn commit: r18428 - in /release/samza/0.12.0: ./ apache-samza-0.12.0-src.tgz apache-samza-0.12.0-src.tgz.MD5 apache-samza-0.12.0-src.tgz.asc

2017-02-21 Thread nickpan47
Author: nickpan47 Date: Wed Feb 22 00:16:27 2017 New Revision: 18428 Log: Publishing Apache Samza 0.12.0 release Added: release/samza/0.12.0/ release/samza/0.12.0/apache-samza-0.12.0-src.tgz (with props) release/samza/0.12.0/apache-samza-0.12.0-src.tgz.MD5 release/samza/0.12.0

[2/5] samza git commit: SAMZA-1073: moving all operator classes into samza-core

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/8515448a/samza-operator/src/main/java/org/apache/samza/operators/spec/PartialJoinOperatorSpec.java -- diff --git a/samza-operator/src/main/java/org/apache/samza/operators/spec/Part

[1/5] samza git commit: SAMZA-1073: moving all operator classes into samza-core

2017-02-16 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master daaad7b84 -> 8515448a2 http://git-wip-us.apache.org/repos/asf/samza/blob/8515448a/samza-operator/src/test/java/org/apache/samza/operators/TestMessageStreamImplUtil.java -- d

[5/5] samza git commit: SAMZA-1073: moving all operator classes into samza-core

2017-02-16 Thread nickpan47
SAMZA-1073: moving all operator classes into samza-core Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/8515448a Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/8515448a Diff: http://git-wip-us.apache.org/repos/asf/sam

[3/5] samza git commit: SAMZA-1073: moving all operator classes into samza-core

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/8515448a/samza-core/src/test/java/org/apache/samza/operators/impl/TestOperatorImpls.java -- diff --git a/samza-core/src/test/java/org/apache/samza/operators/impl/TestOperatorImpls.

[4/5] samza git commit: SAMZA-1073: moving all operator classes into samza-core

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/8515448a/samza-core/src/main/java/org/apache/samza/system/StandaloneExecutionEnvironment.java -- diff --git a/samza-core/src/main/java/org/apache/samza/system/StandaloneExecutionEn

[3/5] samza git commit: SAMZA-1073: Remove operator module. Move all classes into samza-core

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/2c7309cf/samza-core/src/test/java/org/apache/samza/operators/impl/TestOperatorImpls.java -- diff --git a/samza-core/src/test/java/org/apache/samza/operators/impl/TestOperatorImpls.

[4/5] samza git commit: SAMZA-1073: Remove operator module. Move all classes into samza-core

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/2c7309cf/samza-core/src/main/java/org/apache/samza/system/StandaloneExecutionEnvironment.java -- diff --git a/samza-core/src/main/java/org/apache/samza/system/StandaloneExecutionEn

[5/5] samza git commit: SAMZA-1073: Remove operator module. Move all classes into samza-core

2017-02-16 Thread nickpan47
SAMZA-1073: Remove operator module. Move all classes into samza-core Author: Yi Pan (Data Infrastructure) Reviewers: Xinyu Liu , Jacob Maes , Prateek Maheshwari , Jagadish Closes #55 from nickpan47/remove-operator-module and squashes the following commits: 74d806e [Yi Pan (Data

[1/5] samza git commit: SAMZA-1073: Remove operator module. Move all classes into samza-core

2017-02-16 Thread nickpan47
Repository: samza Updated Branches: refs/heads/samza-fluent-api-v1 5d416cfc4 -> 2c7309cf6 http://git-wip-us.apache.org/repos/asf/samza/blob/2c7309cf/samza-operator/src/test/java/org/apache/samza/operators/TestMessageStreamImplUtil.java ---

[2/5] samza git commit: SAMZA-1073: Remove operator module. Move all classes into samza-core

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/2c7309cf/samza-operator/src/main/java/org/apache/samza/operators/spec/PartialJoinOperatorSpec.java -- diff --git a/samza-operator/src/main/java/org/apache/samza/operators/spec/Part

[13/14] samza git commit: Merge branch 'master' into samza-fluent-api-v1

2017-02-16 Thread nickpan47
Merge branch 'master' into samza-fluent-api-v1 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/55d7988b Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/55d7988b Diff: http://git-wip-us.apache.org/repos/asf/samza/diff/5

[07/14] samza git commit: SAMZA-1073: top-level fluent API `

2017-02-16 Thread nickpan47
SAMZA-1073: top-level fluent API ` Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/b3dd886d Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/b3dd886d Diff: http://git-wip-us.apache.org/repos/asf/samza/diff/b3dd886d Bra

[05/14] samza git commit: SAMZA-1073: top-level fluent API `

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/b3dd886d/samza-operator/src/main/java/org/apache/samza/operators/impl/SinkOperatorImpl.java -- diff --git a/samza-operator/src/main/java/org/apache/samza/operators/impl/SinkOperato

[06/14] samza git commit: SAMZA-1073: top-level fluent API `

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/b3dd886d/samza-api/src/main/java/org/apache/samza/operators/windows/Windows.java -- diff --git a/samza-api/src/main/java/org/apache/samza/operators/windows/Windows.java b/samza-ap

[08/14] samza git commit: SAMZA-1087: Schedule after debounce time

2017-02-16 Thread nickpan47
SAMZA-1087: Schedule after debounce time SAMZA-1087: Allows scheduling an action (a Runnable) after some de-bounce delay. Author: Boris Shkolnik Author: Boris Shkolnik Reviewers: Navina Ramesh , Fred Ji Closes #49 from sborya/ScheduleAfterDebounceTime1 Project: http://git-wip-us.apache.org

[12/14] samza git commit: SAMZA-1073: top-level fluent API

2017-02-16 Thread nickpan47
SAMZA-1073: top-level fluent API `Initial draft of top-level fluent API for operator DAGs Author: Yi Pan (Data Infrastructure) Reviewers: Xinyu Liu , Jacob Maes , Prateek Maheshwari Closes #51 from nickpan47/samza-fluent-api-v1 and squashes the following commits: 001be63 [Yi Pan (Data

  1   2   3   4   5   6   >