This is an automated email from the ASF dual-hosted git repository.
spmallette pushed a change to branch tinkergraph-storage
in repository https://gitbox.apache.org/repos/asf/tinkerpop.git
discard 3fa7b54720 Tell agents the CHANGELOG breaking marker is applied only
at release
discard b8165aa5f7 Refuse explicit compaction of a closed or recovered
TinkerStorageGraph
discard 610e540235 Document what TinkerStorageGraph persistence does not
preserve or detect
discard 8e8834dde4 Fix stale and misplaced Javadoc in the TinkerStorageGraph
storage package
discard 6d5ebce814 Stop TinkerStorageGraph writing index definitions after
close and serialize those writes
discard 5451b94155 Tighten TinkerStorageGraph configuration checks and leave
directories as found after failed or recovery opens
discard 8e8ba015c2 Detect TinkerStorageGraph snapshot and log files copied in
from another store
discard da13330a99 Keep TinkerStorageGraph indexes unchanged when a commit
fails in storage
discard dd7e21d419 Stop TinkerStorageGraph commits when its storage directory
or log is removed while open
discard fc249f8202 Record the settings a TinkerStorageGraph store was created
with and keep data-shaping settings fixed
discard 69931797ff Share TinkerStorageGraph file helpers and drop the
deprecated Class.newInstance() in storage selection
discard 75d08a34d9 Update the threat model for TinkerStorageGraph persistence
discard be5e677f2c Reject a blank storage directory and a negative compaction
threshold for TinkerStorageGraph
discard 5e75c150ba Document how a persisted TinkerStorageGraph behaves under
concurrent writes
discard cedb4cb664 Document the value types TinkerStorageGraph can persist and
name the property and type it cannot
discard 8054473a35 Detect a missing TinkerStorageGraph snapshot, log or
VERSION marker instead of opening without it
discard 10df7e67e5 Back off a failed TinkerStorageGraph auto-compaction and
remove its partial snapshot
discard 5a70b64245 Close TinkerStorageGraph storage and release its directory
lock even when compaction fails on close
discard 42b571dba8 Checksum the length of each TinkerStorageGraph log frame so
corruption is not cut back as a torn tail
discard d717461435 Undo dictionary entries from a commit that fails to encode
in TinkerStorageGraph
discard 57dc4df26f Add a read-only recovery open for a damaged
TinkerStorageGraph store
discard 372897b75c Trim the header comment in
tinkerstoragegraph-persistent.properties
discard 04c21ab172 Reject commits on a TinkerStorageGraph after its storage is
closed
discard 04d38701d4 Roll back and stop accepting commits when the storage log
fails
discard ec5c5cc955 Fix NullPointerException on rollback with a vertex index
but no edge index
discard 0417daf780 Cut the storage log back to its last complete frame on
replay
discard a924a90f89 Rebuild the write-side dictionary on replay to stop
unbounded reopen growth
discard f21c894d69 Snapshot compaction from committed state so close() cannot
persist uncommitted data
discard bf7fbe8fa5 Document that persisted multi-properties require setting
default cardinality
discard 23d10933cf Restore TinkerStorageGraph index definitions on reopen
discard 58edf81a30 Rename ByteBufferBuffer to TinkerByteBuffer and add its
unit tests
discard 6f5cc75629 Publish TinkerStorageGraph commits under the storage lock
discard fd08343a26 Bound decoder allocations and dictionary refs in
TinkerStorageGraph storage
discard c0889d799b Document that TinkerStorageGraph is in-memory without a
storage engine
discard 615f58d8c8 Revised Upgrade docs around TinkerGraph storage
capabilities.
discard be9b36080a Rename graphLocation to storage.directory for
TinkerStorageGraph
discard 318c5267a2 Document TinkerStorageGraph persistence and fix stale class
doc
discard 639de84610 Document TinkerStorageGraph single-writer stance; enforce
meta-property conflict
discard a2a341f223 Reject corrupt TinkerStorage frames with a clear error
discard 20ef3330fd Test TinkerStorage durability, lifecycle, and dictionary
crash window
discard d57fd3334b Broaden TinkerStorage TCK: value types, ids, varints,
unicode round-trips
discard e64fb9330b Document TinkerStorageGraph compact encoding and
vertex-property id option
discard 7bb665d693 Add opt-in vertex-property id persistence to
TinkerStorageGraph storage
discard 342ec9a025 Encode TinkerStorageGraph elements as dictionary-referenced
components
discard 5364c9df42 Extract AbstractLogStorage base from GraphBinaryStorage
discard 99b0c0233d Document TinkerStorageGraph durability, compaction, and
locking
discard 2e09853530 Record TinkerStorageGraph format version once per store
discard c088c935d7 Add crash-consistency and streaming-scale tests for
TinkerStorageGraph storage
discard 92bd89de59 Add integrity checks to TinkerStorageGraph storage format
discard e0cc6cfab0 Stream TinkerStorageGraph snapshots one element at a time
discard c6d2e9ee0a Auto-compact TinkerStorageGraph log to bound its growth
discard 02e161b71e Lock TinkerStorageGraph storage directory to a single writer
discard 78c95a12b1 Serialize concurrent commit writes to TinkerStorageGraph
storage
discard 78dbf08126 Make TinkerStorageGraph commits fsync-durable with a
configurable sync mode
discard 33a6021b0e Move TinkerStorageGraph storage changelog entries to 4.0.0
section
discard f29b38a22d Add pluggable storage layer to TinkerStorageGraph
add 538c08bada Added "environment" to available beads label.
add a2150077d7 Merge branch '3.7-dev' into 3.8-dev
add ae6a5fef23 Merge branch '3.8-dev'
add fd352cac0b Use relates-to instead of related for beads links
add 62d6a4bf40 Merge branch '3.7-dev' into 3.8-dev
add f7d92d1be3 Merge branch '3.8-dev'
add 8e5fcba5f8 Share record beads across roots and resolve the session
root from its artifact
add c7538d1569 Merge branch '3.7-dev' into 3.8-dev
add ab3ef76c03 Merge branch '3.8-dev'
add 3f8612fc26 Add pluggable storage layer to TinkerStorageGraph
add 9258a7d206 Move TinkerStorageGraph storage changelog entries to 4.0.0
section
add 9119429329 Make TinkerStorageGraph commits fsync-durable with a
configurable sync mode
add 432820ea8c Serialize concurrent commit writes to TinkerStorageGraph
storage
add 2d2fb96bcf Lock TinkerStorageGraph storage directory to a single writer
add c306c611cd Auto-compact TinkerStorageGraph log to bound its growth
add e12352e10c Stream TinkerStorageGraph snapshots one element at a time
add 1047d18e3f Add integrity checks to TinkerStorageGraph storage format
add 57217ffe54 Add crash-consistency and streaming-scale tests for
TinkerStorageGraph storage
add d5b30cc52e Record TinkerStorageGraph format version once per store
add 64b73a7f6a Document TinkerStorageGraph durability, compaction, and
locking
add bfef424a8c Extract AbstractLogStorage base from GraphBinaryStorage
add 1b1826257d Encode TinkerStorageGraph elements as dictionary-referenced
components
add 94b8b3fcdb Add opt-in vertex-property id persistence to
TinkerStorageGraph storage
add bc851ef7fe Document TinkerStorageGraph compact encoding and
vertex-property id option
add a8cd43d050 Broaden TinkerStorage TCK: value types, ids, varints,
unicode round-trips
add bc27081183 Test TinkerStorage durability, lifecycle, and dictionary
crash window
add c22b22d5b8 Reject corrupt TinkerStorage frames with a clear error
add 96683422f0 Document TinkerStorageGraph single-writer stance; enforce
meta-property conflict
add 8adf403bc4 Document TinkerStorageGraph persistence and fix stale class
doc
add 918638d9ed Rename graphLocation to storage.directory for
TinkerStorageGraph
add c944a6bd21 Revised Upgrade docs around TinkerGraph storage
capabilities.
add 0f1538b576 Document that TinkerStorageGraph is in-memory without a
storage engine
add 1c210ec97a Bound decoder allocations and dictionary refs in
TinkerStorageGraph storage
add b12c5fc093 Publish TinkerStorageGraph commits under the storage lock
add 9a08e009ce Rename ByteBufferBuffer to TinkerByteBuffer and add its
unit tests
add db8f1d9ffb Restore TinkerStorageGraph index definitions on reopen
add 200e855b19 Document that persisted multi-properties require setting
default cardinality
add 8c487feb07 Snapshot compaction from committed state so close() cannot
persist uncommitted data
add 2b4c370b96 Rebuild the write-side dictionary on replay to stop
unbounded reopen growth
add 92e43a0d40 Cut the storage log back to its last complete frame on
replay
add 5694ab0dde Fix NullPointerException on rollback with a vertex index
but no edge index
add 8bae1d5e93 Roll back and stop accepting commits when the storage log
fails
add a7775358ae Reject commits on a TinkerStorageGraph after its storage is
closed
add 98aa2ad45f Trim the header comment in
tinkerstoragegraph-persistent.properties
add 4852291b14 Add a read-only recovery open for a damaged
TinkerStorageGraph store
add a7b5982ca2 Undo dictionary entries from a commit that fails to encode
in TinkerStorageGraph
add 491f582289 Checksum the length of each TinkerStorageGraph log frame so
corruption is not cut back as a torn tail
add 89e9918eef Close TinkerStorageGraph storage and release its directory
lock even when compaction fails on close
add 72d42e61af Back off a failed TinkerStorageGraph auto-compaction and
remove its partial snapshot
add 9934211f1c Detect a missing TinkerStorageGraph snapshot, log or
VERSION marker instead of opening without it
add 54fe0443bf Document the value types TinkerStorageGraph can persist and
name the property and type it cannot
add 414ae477aa Document how a persisted TinkerStorageGraph behaves under
concurrent writes
add 7461f62fd7 Reject a blank storage directory and a negative compaction
threshold for TinkerStorageGraph
add da49a0a46e Update the threat model for TinkerStorageGraph persistence
add eda0698d20 Share TinkerStorageGraph file helpers and drop the
deprecated Class.newInstance() in storage selection
add 711bc5ba9a Record the settings a TinkerStorageGraph store was created
with and keep data-shaping settings fixed
add 9cdc46cb1f Stop TinkerStorageGraph commits when its storage directory
or log is removed while open
add b50bb8295c Keep TinkerStorageGraph indexes unchanged when a commit
fails in storage
add 303a055c49 Detect TinkerStorageGraph snapshot and log files copied in
from another store
add bdd8d8a7aa Tighten TinkerStorageGraph configuration checks and leave
directories as found after failed or recovery opens
add 600e9ecf57 Stop TinkerStorageGraph writing index definitions after
close and serialize those writes
add 5d1159a3ea Fix stale and misplaced Javadoc in the TinkerStorageGraph
storage package
add ebb938fefc Document what TinkerStorageGraph persistence does not
preserve or detect
add 1240ab9fd6 Refuse explicit compaction of a closed or recovered
TinkerStorageGraph
add 64ffac0e74 Tell agents the CHANGELOG breaking marker is applied only
at release
add e9a2dc51c3 Skip TinkerStorageGraph storage writes for transactions
that changed nothing
add 625780548b Make TinkerStorageGraph clear() durable and refuse what a
closed or failed store cannot do
add 87100da4e4 Harden TinkerStorageGraph storage against torn writes,
corrupt records and replaced logs
add b573a401bf Refuse TinkerStorageGraph opens that would hide lost data
or damaged settings
add 127fde2998 Tighten TinkerStorageGraph storage test assertions
add fff15eac28 Update TinkerStorageGraph persistence and upgrade docs
add 8f7cf01b0d Move TinkerStorageGraph storage internals into a
tinkergraph-gremlin DESIGN.md
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (3fa7b54720)
\
N -- N -- N refs/heads/tinkergraph-storage (8f7cf01b0d)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.beads/PRIME.md | 75 +++--
.skills/tinker-review/references/enrichment-cli.md | 2 +-
.skills/tinker-review/references/schema.md | 17 +-
.skills/tinker-review/scripts/discovery/beads.js | 83 +++---
.skills/tinker-review/scripts/enrichment/api.js | 11 +-
.../tinker-review/scripts/graph/populate-beads.js | 10 +-
.skills/tinker-review/scripts/renderer/render.js | 19 +-
.skills/tinker-review/test/beads.test.js | 55 +++-
CHANGELOG.asciidoc | 2 +-
THREAT_MODEL.md | 2 +-
bin/beads-commits.py | 55 ++--
.../reference/implementations-tinkergraph.asciidoc | 217 +++++++++------
docs/src/upgrade/release-4.x.x.asciidoc | 24 +-
tinkergraph-gremlin/DESIGN.md | 241 +++++++++++++++++
.../structure/TinkerElementContainer.java | 10 +-
.../gremlin/tinkergraph/structure/TinkerGraph.java | 2 +-
.../tinkergraph/structure/TinkerStorageGraph.java | 121 ++++++++-
.../tinkergraph/structure/TinkerTransaction.java | 14 +-
.../structure/storage/AbstractLogStorage.java | 187 +++++++++++--
.../structure/storage/DirectoryLock.java | 46 ++++
.../structure/storage/GraphBinaryStorage.java | 84 +++++-
.../structure/storage/StorageFiles.java | 19 +-
.../structure/storage/StorageSettings.java | 55 +++-
.../structure/storage/TinkerByteBuffer.java | 41 ++-
.../structure/storage/TinkerStorage.java | 23 ++
.../structure/storage/ConcurrencyProbeStorage.java | 5 +-
.../structure/storage/FaultInjectingStorage.java | 21 +-
.../structure/storage/GraphBinaryStorageTest.java | 301 ++++++++++++++++++++-
.../structure/storage/StorageFailureTest.java | 242 ++++++++++++++++-
.../structure/storage/StorageRecoveryTest.java | 98 ++++++-
.../structure/storage/StorageSettingsTest.java | 86 +++++-
.../structure/storage/TinkerByteBufferTest.java | 22 ++
32 files changed, 1932 insertions(+), 258 deletions(-)
create mode 100644 tinkergraph-gremlin/DESIGN.md
