Re: [Haskell-cafe] Conduits and large ConduitResult chunks

2012-03-01 Thread Michael Snoyman
On Thu, Mar 1, 2012 at 11:50 PM, Nathan Howell
 wrote:
> I'm porting lzma-enumerator over to conduits and I've run into a snag.
> The output chunks from lzma can be quite large, so I'd like to stream
> the results out in smaller chunks instead of tens (or hundreds) of
> megabytes at a time. It seems as though this should be possible, as it
> is with enumeratees, but I can't see how. Is there a way to get this
> working without unsafeInterleaveIO?
>
> https://github.com/alphaHeavy/lzma-conduit/blob/2b1451f5596b2db5a23df9a0fb128c7444e112b2/src/Data/Conduit/Lzma.hs#L165
>
> thanks,
> -n
>
> ___
> Haskell-Cafe mailing list
> Haskell-Cafe@haskell.org
> http://www.haskell.org/mailman/listinfo/haskell-cafe

I just wrote a blog post on this topic:
http://www.yesodweb.com/blog/2012/03/more-powerful-conduit

Feedback requested!

Michael

___
Haskell-Cafe mailing list
Haskell-Cafe@haskell.org
http://www.haskell.org/mailman/listinfo/haskell-cafe


[Haskell-cafe] Conduits and large ConduitResult chunks

2012-03-01 Thread Nathan Howell
I'm porting lzma-enumerator over to conduits and I've run into a snag.
The output chunks from lzma can be quite large, so I'd like to stream
the results out in smaller chunks instead of tens (or hundreds) of
megabytes at a time. It seems as though this should be possible, as it
is with enumeratees, but I can't see how. Is there a way to get this
working without unsafeInterleaveIO?

https://github.com/alphaHeavy/lzma-conduit/blob/2b1451f5596b2db5a23df9a0fb128c7444e112b2/src/Data/Conduit/Lzma.hs#L165

thanks,
-n

___
Haskell-Cafe mailing list
Haskell-Cafe@haskell.org
http://www.haskell.org/mailman/listinfo/haskell-cafe