> On Nov. 21, 2014, 7:34 p.m., David McLaughlin wrote: > > Does this code have test coverage? I can't see any tests that validate > > chunking is performing in the intended way. > > Kevin Sweeney wrote: > Existing test coverage in LogManagerTest validates the on-disk chunked > format is the same. This is only a refactor to stream the results as an > `Iterable<byte[]>` rather than buffer them as a `byte[][]`.
It seems like the only test that had to be updated was a test that accesses the first element. It's possible the other integration tests don't exceed the frame size or other conditions, right? - David ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28306/#review62606 ----------------------------------------------------------- On Nov. 21, 2014, 1:53 a.m., Kevin Sweeney wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/28306/ > ----------------------------------------------------------- > > (Updated Nov. 21, 2014, 1:53 a.m.) > > > Review request for Aurora, David McLaughlin and Bill Farner. > > > Bugs: AURORA-930 > https://issues.apache.org/jira/browse/AURORA-930 > > > Repository: aurora > > > Description > ------- > > Stream frame chunks instead of preallocating them. > > This avoids allocating an entire additional snapshot worth of heap during > entry serialization, reducing overall heap impact of the serializer from > 2*sizeof(serialized-entry) to sizeof(serialized-entry)+chunkSize. > > Further optimizations out-of-scope for this change: > > * Make the returned iterator mutate a fixed-size buffer (for GC pressure > avoidance). > * Change the log format so that FrameHeader doesn't need to know the size and > checksum of the serialized data ahead-of-time (maybe write it as a trailer). > > > Diffs > ----- > > src/main/java/org/apache/aurora/scheduler/storage/log/EntrySerializer.java > f4fa1cb740633ced529c1b5fd9f18abba8944571 > > src/main/java/org/apache/aurora/scheduler/storage/log/StreamManagerImpl.java > cb95d8996a934751745f423b79279266d73b7722 > src/test/java/org/apache/aurora/scheduler/app/SchedulerIT.java > c90389433d81dd72756c659736e38fd9f66fcb35 > > Diff: https://reviews.apache.org/r/28306/diff/ > > > Testing > ------- > > ./gradlew -Pq build > > > Thanks, > > Kevin Sweeney > >
