[ 
https://issues.apache.org/jira/browse/USERGRID-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15654664#comment-15654664
 ] 

ASF GitHub Bot commented on USERGRID-1318:
------------------------------------------

GitHub user snoopdave opened a pull request:

    https://github.com/apache/usergrid/pull/562

    Embedded Queueing System based on Akka

    Queue implementation as described here:
    https://issues.apache.org/jira/browse/USERGRID-1318


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/apache/usergrid usergrid-1318-queue

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/usergrid/pull/562.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #562
    
----
commit 461076c389ba8413cbbb1b596dba9439af35a8b9
Author: Dave Johnson <[email protected]>
Date:   2016-09-02T21:23:15Z

    Fixing links to point to mirrors.

commit a8cd381d5dd1c3b66639fe2f8f883927d2e897fc
Author: Dave Johnson <[email protected]>
Date:   2016-09-07T19:46:05Z

    Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/usergrid
    
    * 'master' of https://git-wip-us.apache.org/repos/asf/usergrid: (50 commits)
      Fix reactivateTest and handle re-activation differently from 
auto-activation with confirmation requirements.
      Fix issue with admin user confirmation flag not working when trying to 
disable emails.
      Moving older SDKs to a difference location and updating main README to 
link to new SDK locations.
      Removing the old Java SDK.
      Moving the Android SDK to https://github.com/apache/usergrid-android
      Moving the .NET SDK to https://github.com/apache/usergrid-dotnet
      Moving the Java SDK to https://github.com/apache/usergrid-java
      Moving the Javascript SDK to 
https://github.com/apache/usergrid-javascript.
      Moving the Node.js SDK to https://github.com/apache/usergrid-nodejs.
      Moving Python SDK to https://github.com/apache/usergrid-python
      Fix UniqueValueManager tool to work with datastax driver in the unique 
value serialization strategy.
      Moving Swift SDK to https://github.com/apache/usergrid-swift.
      Update test for collection level authoritative region setting.
      Rename the cluster authoritative region parameters/methods to be more 
specific.
      Set non-clustered unique value verification loading back to the 
non-consistent read consistency level.
      Use StringUtils.isEmpty() to determine if region is not set.
      Move shard logging statement to TRACE level.
      Don't shut down full actor system when the JVM exists ( this affects 
actors running on other hosts ).
      fix duplicate user test to use random usernames in case DB cleanup not 
done correctly
      Allow GET /management/me with local UG tokens when External SSO is 
enabled.
      ...

commit 1574b3af4765777f8693c79b6c1bea836812e6bc
Author: Dave Johnson <[email protected]>
Date:   2016-09-09T20:35:38Z

    Make TableDefinition into an interface, move to cassandra-all 2.1.14

commit 9016fd290e80b88ba3199c0020fca7722b82d780
Author: Dave Johnson <[email protected]>
Date:   2016-09-09T21:31:44Z

    Move under org.apache.usergrid.persistence package in preparation for 
integration into Usergrid.

commit 3075dce1631cc7f225ddb34aa08fb16a4a8f486a
Author: Dave Johnson <[email protected]>
Date:   2016-09-13T17:44:42Z

    Initial integration of Qakka into Usergrid Queue module, and implementation 
of Qakka-based LegacyQueueManager implementation.

commit f47a5f65add96bbd066c88e085bc1d6aac0cc3c2
Author: Dave Johnson <[email protected]>
Date:   2016-09-14T16:23:55Z

    Changes to make Queue / Hakka tests run with fewer intermittent failures.

commit 7fdba4a2cfa6d18047b5b893382806a342a78eff
Author: Dave Johnson <[email protected]>
Date:   2016-09-14T17:25:21Z

    Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/usergrid
    
    * 'master' of https://git-wip-us.apache.org/repos/asf/usergrid:
      Add unique value index update option to UniqueValueManager tool.
      Add support for application and organization client credentials to be 
passed in Authorization header.
      Fix NPE when user doesn't exist after lookup from the unique value index.
      Use URLs (like admin reset password URL) from properties if they are 
provided.

commit ffeadb20878d03002dd7a77fa9dacd6be614ec4b
Author: Dave Johnson <[email protected]>
Date:   2016-09-14T17:36:14Z

    Merge branch 'master' into usergrid-1318-queue

commit ee0dda4cca0ff5cd56b9574f998222f439fa948c
Author: Dave Johnson <[email protected]>
Date:   2016-09-14T20:08:30Z

    Still some intermittent failures in the queue module, but now able to get 
through ALL Usergrid tests w/Qakka

commit 483ca0f5485891f2acc5d3b1a921d68c87d1d647
Author: Dave Johnson <[email protected]>
Date:   2016-09-16T11:48:09Z

    switch Qakka to using two keyspaces, the original replicated Applications 
one and a new un-replicated Applications Local one

commit 447b60d4364c9f705a1350f11288dbad6ed3673c
Author: Dave Johnson <[email protected]>
Date:   2016-09-16T11:49:02Z

    Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/usergrid 
into usergrid-1318-queue
    
    * 'master' of https://git-wip-us.apache.org/repos/asf/usergrid:
      allow no password when creating admin users when SSO-enabled
      Load properties into Guice by using the getProperty method instead of 
generic putAll from Map superclass as it getProperty could be overridden
      add count to paged organizations get, and fix limit=1000
      Refactor superuser authentication/login such that permissions are handled 
more appropriately, allowing access to all parts of the system.
      Enhance superuser basic auth filter to login to shiro with a token just 
like the sysadmin tokens.
      Adding paging to get all orgs endpoint.  Enhance Akka cluster so it 
properly downs nodes that are restarted but still ok on the network. Don't load 
all orgs when validating sysadmin creds.

commit 99dbfc2d17e330583560d386b6ecb5cce93fa3e5
Author: Dave Johnson <[email protected]>
Date:   2016-09-16T13:39:51Z

    Fixes to get all tests passing again.

commit 79c5499799007e24ea1784f6fd8b21f2225c668b
Author: Dave Johnson <[email protected]>
Date:   2016-09-16T18:52:32Z

    Move router producer registration to CpEntityManagerFactory

commit 6f983a4c0fcf65dfabb048568c341b3698afbf25
Author: Dave Johnson <[email protected]>
Date:   2016-09-16T18:53:12Z

    Don't include test classes in prod release

commit 832b505c75724ed61a2d5869727208cbabf5ce13
Author: Dave Johnson <[email protected]>
Date:   2016-09-16T18:54:35Z

    Don't init queue in constructor

commit 18e4305b995be88947b72172dd22056702659a8e
Author: Dave Johnson <[email protected]>
Date:   2016-09-16T22:33:10Z

    Changes to get Qakka using same injector as rest of Usergrid

commit e09e74932642c7783888639d67218cfb0a117ddd
Author: Dave Johnson <[email protected]>
Date:   2016-09-17T15:01:01Z

    Exclude logback-classic as it was borking our logging setup.

commit 03eb31246839bca237c7f761cc4cdece74596bb3
Author: Dave Johnson <[email protected]>
Date:   2016-09-17T17:01:02Z

    Adding distributedQueueManager.init() to CpEntityManagerFactry startup, 
needed to start queue refreshers, time-outers and shard allocators.

commit a0b0f717bb1a23e4879282726045eba12514850d
Author: Michael Russo <[email protected]>
Date:   2016-09-17T18:50:34Z

    Update bootstrap/init logic so avoid race conditions in writing a new queue 
to the database.

commit c08e8f0e72321a238209265161c5c6fb1181923c
Author: Dave Johnson <[email protected]>
Date:   2016-09-19T16:15:41Z

    Make ReplicatedIndexAlias serializable

commit 434e53e7eed46fbdc3cdeafde9464c90101fa7e3
Author: Dave Johnson <[email protected]>
Date:   2016-09-20T16:18:33Z

    Implement configurable long polling for Qakka queue gets

commit 6c204b9f046fa9ea234d7e608b940ead60fb6720
Author: Dave Johnson <[email protected]>
Date:   2016-09-20T17:27:17Z

    Ensure local keyspace has unique name per datacenter / region.

commit 8b79fb875a3aea88458e08429286d2119d6a3c88
Author: Dave Johnson <[email protected]>
Date:   2016-09-20T18:30:20Z

    Introduce maxTtl for queue message and message payload data, default is two 
weeks.

commit 9306f12eea8cd8f0ad0b2ec4751cd8a9b9ba5382
Author: Dave Johnson <[email protected]>
Date:   2016-09-21T12:34:28Z

    Complete message counter and add support for getQueueDepth() in 
QakkaQueueManager

commit 727ff1d642fdaf3768ab2b1f0c07364854ec2e60
Author: Dave Johnson <[email protected]>
Date:   2016-09-21T17:48:47Z

    When writing to queue, if in-memory queue is empty then refresh will be 
done.

commit c08e02a914d98bd048f997cddd47b343ba9908c1
Author: Dave Johnson <[email protected]>
Date:   2016-09-22T11:47:07Z

    Use same timeout value as old queue implementation did

commit 00eb13965e2b31bc1c57e437ceac0a42f6610861
Author: Dave Johnson <[email protected]>
Date:   2016-09-22T11:47:44Z

    Make DatabaseQueueMessage serializable because it is sent in Akka messages

commit 2cd8ecb30fc5f97927ec000573daba2ba16e914f
Author: Dave Johnson <[email protected]>
Date:   2016-09-23T16:47:29Z

    Now supports elasticsearch.queue_impl=MULTIREGION setting instead of SNS, 
also more/better DEBUG logging

commit 5a19ba9a748c5d96f5356d77df1e7845aa92fc0f
Author: Dave Johnson <[email protected]>
Date:   2016-09-30T21:18:24Z

    Change to use proper Guice injection instead of static injector kludge.

commit 781b894a65851e4e8a4ff2fac84b644e5b72c12d
Author: Dave Johnson <[email protected]>
Date:   2016-10-03T14:45:22Z

    Fixes to get tests running consistently.

----


> Embeddable Queue implementation
> -------------------------------
>
>                 Key: USERGRID-1318
>                 URL: https://issues.apache.org/jira/browse/USERGRID-1318
>             Project: Usergrid
>          Issue Type: Story
>            Reporter: David Johnson
>            Assignee: David Johnson
>
> Provide a queue implementation that can be embedded in Usergrid and used as a 
> replacement for the existing AWS and in-memory options.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to