[Flac-dev] Proof-of-concept multithreaded FLAC encoder (take 2)

2008-05-13 Thread Frederick Akalin
Hey again FLAC devs, I managed to hack out another proof-of-concept multithreaded FLAC encoder that is more amenable to streaming and also uses a fixed buffer size. The performance is pretty much the same as my earlier version; that is, I can encode a 636 MB wave file in ~7s with 8 threads on an

Re: [Flac-dev] Proof-of-concept multithreaded FLAC encoder

2008-05-06 Thread Frederick Akalin
On Tue, May 6, 2008 at 3:51 PM, Harry Sack <[EMAIL PROTECTED]> wrote: > to Brian: i remember you were laughing at me when i told multiple > threads could speed it up a lot. you even called it 'nearly no > speedup' > > here is the proof now ;) > > i think this proves how much you know about audi

Re: [Flac-dev] Proof-of-concept multithreaded FLAC encoder

2008-05-06 Thread Frederick Akalin
On Tue, May 6, 2008 at 2:39 PM, Brian Willoughby <[EMAIL PROTECTED]> wrote: > > I may be biased because I work with hour-long recordings, but it seems like > the block size would be small compared to the overall file size. In other > words, if you break the encoded file into equal-sized regions,

Re: [Flac-dev] Proof-of-concept multithreaded FLAC encoder

2008-05-06 Thread Brian Willoughby
On May 6, 2008, at 14:20, Frederick Akalin wrote: > On Tue, May 6, 2008 at 2:03 PM, Brian Willoughby > <[EMAIL PROTECTED]> wrote: >> 3) Do you accelerate decode as well as encode? I'm thinking that >> the >> variable block size would require each thread to scan its block >> for the >> star

Re: [Flac-dev] Proof-of-concept multithreaded FLAC encoder

2008-05-06 Thread Frederick Akalin
On Tue, May 6, 2008 at 2:03 PM, Brian Willoughby <[EMAIL PROTECTED]> wrote: > Frederick, > > This is great news! Thanks for your effort. > > Your proof-of-concept raises a few questions for me: > > 1) I know that the ratio of uncompressed to compressed data is > unpredictable, but I never reall

Re: [Flac-dev] Proof-of-concept multithreaded FLAC encoder

2008-05-06 Thread Brian Willoughby
Frederick, This is great news! Thanks for your effort. Your proof-of-concept raises a few questions for me: 1) I know that the ratio of uncompressed to compressed data is unpredictable, but I never really considered whether the input block size or the output block size is constant. I'm ass

[Flac-dev] Proof-of-concept multithreaded FLAC encoder

2008-05-06 Thread Frederick Akalin
Hey FLAC devs, I managed to hack out a proof-of-concept multithreaded FLAC encoder based on the example libFLAC one. It turned out to be fairly straightforward to get near-linear speedup; I can encode a 636 MB wave file in 6.8s with 8 threads on an 8-core 3.0 GHz Xeon vs. 31.4s with a single thre