GitHub user snoopdave opened a pull request: https://github.com/apache/incubator-usergrid/pull/277
Improve Export Admins performance. DO NOT MERGE - still testing Use multiple threads to read data from Cassandra and one thread to write that data to the two output files. How it works: - In main thread we query for IDs of all admin users, add each ID to read queue. - Read-queue workers read admin user data, add data to write queue. - One write-queue worker reads data writes to file. You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/incubator-usergrid export-admins-parallel Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-usergrid/pull/277.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #277 ---- commit 0631bc6b9d0de0e9022284469ac32a0a2dce5d38 Author: Dave Johnson <dmjohn...@apigee.com> Date: 2015-06-11T21:08:52Z Use multiple threads to read data from Cassandra and one thread to write that data to the two output files. ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---