> On May 22, 2014, 8:28 p.m., Josh Elser wrote: > > Have you done any benchmarks with these changes? I would think that you > > should see higher CPU usage with less disk I/O, and, overall, quicker > > ingest. It would be good to see some before and after numbers that show > > this.
Oops, sorry. I didn't see the attachment you put on the ticket :) - Josh ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21826/#review43764 ----------------------------------------------------------- On May 22, 2014, 7:57 p.m., John McNamee wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/21826/ > ----------------------------------------------------------- > > (Updated May 22, 2014, 7:57 p.m.) > > > Review request for accumulo. > > > Repository: accumulo > > > Description > ------- > > The goal was to find a way to increase the write speed in the DfsLogger using > compression. > This patch uses the Snappy compression library and was the most optimum way > that I could find to increase write performance. > The option to use compression has been made configurable. > Recovery has been modified to uncompress the WAL if needed. > > > Diffs > ----- > > core/src/main/java/org/apache/accumulo/core/conf/Property.java 62b0a33 > > server/tserver/src/main/java/org/apache/accumulo/tserver/log/DecompressingInputStream.java > PRE-CREATION > server/tserver/src/main/java/org/apache/accumulo/tserver/log/DfsLogger.java > bfa51d3 > > server/tserver/src/test/java/org/apache/accumulo/tserver/log/DecompressingInputStreamTest.java > PRE-CREATION > > Diff: https://reviews.apache.org/r/21826/diff/ > > > Testing > ------- > > There is a unit test for the DecryptingInputStream.java, and I ran continuous > Ingest/ continuous verify with the agitator on. > > > Thanks, > > John McNamee > >
