Stamatis Zampetakis created HIVE-29401:
------------------------------------------

             Summary: Speed-up Derby operations by setting durability mode to 
test
                 Key: HIVE-29401
                 URL: https://issues.apache.org/jira/browse/HIVE-29401
             Project: Hive
          Issue Type: Task
          Components: Tests
            Reporter: Stamatis Zampetakis
            Assignee: Stamatis Zampetakis


Set derby.system.durability property when running tests to speed-up Derby 
operations by avoiding expensive I/O system calls. This change can have 
noticeable impact in CI environments and anywhere where file-system operations 
are slow.

Local testing shows a performance gain of an order of magnitude when creating a 
new Derby database (times dropped from ~200ms to 20ms). In CI, these times are 
much bigger and reach the order of seconds.

The property should not be used in production but it is OK for testing where we 
don't care about recovering from JVM crashes and errors.

See: https://db.apache.org/derby/docs/10.8/ref/rrefproperdurability.html



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to