[09/20] tinkerpop git commit: Added TinkerWorkerMemory which will aggregate local to the current thread before propagated Memory to TinkerMemory. This reduces synchronization issues due all threads co

2017-01-05 Thread okram
Added TinkerWorkerMemory which will aggregate local to the current thread before propagated Memory to TinkerMemory. This reduces synchronization issues due all threads contending to mutate the master memory. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-u

[11/20] tinkerpop git commit: Added Serializer.cloneObject() which clones via serialization (helper method). TinkerGraphComputer now how a sound distributed Memory system where each worker/thread aggr

2017-01-05 Thread okram
Added Serializer.cloneObject() which clones via serialization (helper method). TinkerGraphComputer now how a sound distributed Memory system where each worker/thread aggregates without concurrency locally and then, at the end of the iteration, the thread-distributed memories are aggregated into

[14/20] tinkerpop git commit: CHAGELOG updated. Lunch time.

2017-01-05 Thread okram
CHAGELOG updated. Lunch time. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/27a4b271 Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/tree/27a4b271 Diff: http://git-wip-us.apache.org/repos/asf/tinkerpop/diff/27

[15/20] tinkerpop git commit: removed the toy file and updated CHANGELOG.

2017-01-05 Thread okram
removed the toy file and updated CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/dc38b435 Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/tree/dc38b435 Diff: http://git-wip-us.apache.org/repos/asf/tin

[10/20] tinkerpop git commit: Made is so MemoryComputeKey implements Cloneable. This is actually really important we have NOT been cloning the BiOperators of OrderGlobalStep and GroupStep. We have jus

2017-01-05 Thread okram
Made is so MemoryComputeKey implements Cloneable. This is actually really important we have NOT been cloning the BiOperators of OrderGlobalStep and GroupStep. We have just been 'getting lucky' in that Spark and Giraph use Serialization and thus we get a clone for free. However, for parallelizati

[12/20] tinkerpop git commit: updated CHANGELOG. Going to move on. Need example Gryo dataset from @dkuppitz to verify performance improvement of DedupGlobalStep on SparkGraphComputer.

2017-01-05 Thread okram
updated CHANGELOG. Going to move on. Need example Gryo dataset from @dkuppitz to verify performance improvement of DedupGlobalStep on SparkGraphComputer. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/cef19796 Tree:

[04/20] tinkerpop git commit: Removed use of deprecated ScriptEngines class. CTR

2017-01-05 Thread okram
Removed use of deprecated ScriptEngines class. CTR Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/65be461a Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/tree/65be461a Diff: http://git-wip-us.apache.org/repos/

[08/20] tinkerpop git commit: realized that DedupGlobalStep was doing a 'double dedup'. the barrier which is already dedup'd is added to the master traveral's dedup-step and then dedup'd again. I simp

2017-01-05 Thread okram
realized that DedupGlobalStep was doing a 'double dedup'. the barrier which is already dedup'd is added to the master traveral's dedup-step and then dedup'd again. I simple boolean flag added to determine if the master traversal's dedup is getting data from workers or not and thus, if so, don't

[20/20] tinkerpop git commit: have DedupGlobalStep as optimized as I can get it. I think BloomFilters are the next thing. Also, detachment factory stuff will help reduce barrier sizes. Found a bug in

2017-01-05 Thread okram
have DedupGlobalStep as optimized as I can get it. I think BloomFilters are the next thing. Also, detachment factory stuff will help reduce barrier sizes. Found a bug in SparkInterceptorStrategyTest. Fixed. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us

[07/20] tinkerpop git commit: minor nothing.

2017-01-05 Thread okram
minor nothing. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/f352b018 Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/tree/f352b018 Diff: http://git-wip-us.apache.org/repos/asf/tinkerpop/diff/f352b018 Branch:

[02/20] tinkerpop git commit: Fixed a minor problem in closing a sessioned client that was not initialized CTR

2017-01-05 Thread okram
Fixed a minor problem in closing a sessioned client that was not initialized CTR Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/3064b93a Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/tree/3064b93a Diff: http:

[18/20] tinkerpop git commit: no more SynchronizedIterator for TinkerGraphComputer. Each worker/thread has their own Iterator partition. In TinkerPop 3.3.0 (with Partitioner) this will be repl

2017-01-05 Thread okram
no more SynchronizedIterator for TinkerGraphComputer. Each worker/thread has their own Iterator partition. In TinkerPop 3.3.0 (with Partitioner) this will be replaced (easily). Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpo

[13/20] tinkerpop git commit: discovering various synchronization bottlenecks in TinkerGraphComputer. Also, realized some dumb things I was doing in TraversalVertexProgram. Its crazy, for this benchma

2017-01-05 Thread okram
discovering various synchronization bottlenecks in TinkerGraphComputer. Also, realized some dumb things I was doing in TraversalVertexProgram. Its crazy, for this benchmark that @dkuppitz and i have, if I don't touch vertex.properties that are compute keys: millisecond return times. If I do, sec

[19/20] tinkerpop git commit: now that MemoryComputeKeys are cloneable, they are cloned accordignly in TraversalVertexProgram.clone().

2017-01-05 Thread okram
now that MemoryComputeKeys are cloneable, they are cloned accordignly in TraversalVertexProgram.clone(). Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/253248e5 Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/

[17/20] tinkerpop git commit: added the concept of a master barrier to DedupGlobalStep to speed up the addition of worker barriers into the master traversal. A slight performance increase.

2017-01-05 Thread okram
added the concept of a master barrier to DedupGlobalStep to speed up the addition of worker barriers into the master traversal. A slight performance increase. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/64c80657

[16/20] tinkerpop git commit: more minor optimizations to DedupGlobalStep.

2017-01-05 Thread okram
more minor optimizations to DedupGlobalStep. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/ba390748 Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/tree/ba390748 Diff: http://git-wip-us.apache.org/repos/asf/ti

[06/20] tinkerpop git commit: forgot to add TinkerWorkerMemory file.

2017-01-05 Thread okram
forgot to add TinkerWorkerMemory file. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/056d7aed Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/tree/056d7aed Diff: http://git-wip-us.apache.org/repos/asf/tinkerpo

[01/20] tinkerpop git commit: Mark one of the Peer Pressure tests as non-deterministic. [Forced Update!]

2017-01-05 Thread okram
Repository: tinkerpop Updated Branches: refs/heads/TINKERPOP-1585 eb1b16083 -> dc38b4353 (forced update) Mark one of the Peer Pressure tests as non-deterministic. This test tends to fail on certain systems like Travis. By marking it as non-deterministic it will only run when a special system

[05/20] tinkerpop git commit: Merge branch 'tp32' of https://git-wip-us.apache.org/repos/asf/tinkerpop into tp32

2017-01-05 Thread okram
Merge branch 'tp32' of https://git-wip-us.apache.org/repos/asf/tinkerpop into tp32 Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/9c44f0d4 Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/tree/9c44f0d4 Diff: ht

[03/20] tinkerpop git commit: added Terminal Steps section to the-traversal.asciidoc docs.

2017-01-05 Thread okram
added Terminal Steps section to the-traversal.asciidoc docs. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/31ec68a0 Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/tree/31ec68a0 Diff: http://git-wip-us.apache.

tinkerpop git commit: removed the toy file and updated CHANGELOG.

2017-01-05 Thread okram
Repository: tinkerpop Updated Branches: refs/heads/TINKERPOP-1585 97e1b509a -> eb1b16083 removed the toy file and updated CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/eb1b1608 Tree: http://git-wip-us.

tinkerpop git commit: have DedupGlobalStep as optimized as I can get it. I think BloomFilters are the next thing. Also, detachment factory stuff will help reduce barrier sizes. Found a bug in SparkInt

2017-01-05 Thread okram
Repository: tinkerpop Updated Branches: refs/heads/TINKERPOP-1585 cd1d96964 -> 97e1b509a have DedupGlobalStep as optimized as I can get it. I think BloomFilters are the next thing. Also, detachment factory stuff will help reduce barrier sizes. Found a bug in SparkInterceptorStrategyTest. Fixe

tinkerpop git commit: more minor optimizations to DedupGlobalStep.

2017-01-05 Thread okram
Repository: tinkerpop Updated Branches: refs/heads/TINKERPOP-1585 f445bcc7f -> cd1d96964 more minor optimizations to DedupGlobalStep. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/cd1d9696 Tree: http://git-wip-us

[1/3] tinkerpop git commit: added Terminal Steps section to the-traversal.asciidoc docs.

2017-01-05 Thread okram
Repository: tinkerpop Updated Branches: refs/heads/master 1f42f9dda -> 1858872aa added Terminal Steps section to the-traversal.asciidoc docs. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/31ec68a0 Tree: http://gi

[3/3] tinkerpop git commit: Merge branch 'tp32'

2017-01-05 Thread okram
Merge branch 'tp32' Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/1858872a Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/tree/1858872a Diff: http://git-wip-us.apache.org/repos/asf/tinkerpop/diff/1858872a Br

[2/3] tinkerpop git commit: Merge branch 'tp32' of https://git-wip-us.apache.org/repos/asf/tinkerpop into tp32

2017-01-05 Thread okram
Merge branch 'tp32' of https://git-wip-us.apache.org/repos/asf/tinkerpop into tp32 Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/9c44f0d4 Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/tree/9c44f0d4 Diff: ht

[2/2] tinkerpop git commit: Merge branch 'tp32' of https://git-wip-us.apache.org/repos/asf/tinkerpop into tp32

2017-01-05 Thread okram
Merge branch 'tp32' of https://git-wip-us.apache.org/repos/asf/tinkerpop into tp32 Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/9c44f0d4 Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/tree/9c44f0d4 Diff: ht

[1/2] tinkerpop git commit: added Terminal Steps section to the-traversal.asciidoc docs.

2017-01-05 Thread okram
Repository: tinkerpop Updated Branches: refs/heads/tp32 65be461ad -> 9c44f0d45 added Terminal Steps section to the-traversal.asciidoc docs. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/31ec68a0 Tree: http://git-

tinkerpop git commit: Removed use of deprecated ScriptEngines class. CTR

2017-01-05 Thread spmallette
Repository: tinkerpop Updated Branches: refs/heads/tp32 3064b93a5 -> 65be461ad Removed use of deprecated ScriptEngines class. CTR Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/65be461a Tree: http://git-wip-us.apa

[1/2] tinkerpop git commit: Removed use of deprecated ScriptEngines class. CTR

2017-01-05 Thread spmallette
Repository: tinkerpop Updated Branches: refs/heads/master 70e1f1b69 -> 1f42f9dda Removed use of deprecated ScriptEngines class. CTR Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/65be461a Tree: http://git-wip-us.a

[2/2] tinkerpop git commit: Merge branch 'tp32'

2017-01-05 Thread spmallette
Merge branch 'tp32' Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/1f42f9dd Tree: http://git-wip-us.apache.org/repos/asf/tinkerpop/tree/1f42f9dd Diff: http://git-wip-us.apache.org/repos/asf/tinkerpop/diff/1f42f9dd Br

tinkerpop git commit: added Terminal Steps section to the-traversal.asciidoc docs.

2017-01-05 Thread okram
Repository: tinkerpop Updated Branches: refs/heads/TINKERPOP-1588 [created] 31ec68a09 added Terminal Steps section to the-traversal.asciidoc docs. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/tinkerpop/commit/31ec68a0 Tree: http

tinkerpop git commit: TINKERPOP-1589 Made some adjustments to Traversal.close()

2017-01-05 Thread spmallette
Repository: tinkerpop Updated Branches: refs/heads/TINKERPOP-1589 3597dc5f0 -> 67e0b373b TINKERPOP-1589 Made some adjustments to Traversal.close() Implemented AutoCloseable on TraversalParent. Project: http://git-wip-us.apache.org/repos/asf/tinkerpop/repo Commit: http://git-wip-us.apache.org

tinkerpop git commit: TINKERPOP-1589 Re-introduced CloseableIterator

2017-01-05 Thread spmallette
Repository: tinkerpop Updated Branches: refs/heads/TINKERPOP-1589 [created] 3597dc5f0 TINKERPOP-1589 Re-introduced CloseableIterator Made it so that the CloseableIterator is closed by GraphStep if it is provided by the iterator supplier. Furthermore, any steps in a Traversal implement AutoCl