On Thu, Jul 11, 2019 at 7:29 PM Michael Jones <michael.jo...@gmail.com> wrote:
> I use Klaus' library to decompress ~GiB files that have been compressed by > zstd command line (c/c++ code) at level 19. Works great. > Thanks for sharing this information! > On Thu, Jul 11, 2019 at 9:10 AM Klaus Post <klausp...@gmail.com> wrote: > >> On Thursday, 11 July 2019 17:37:09 UTC+2, Aliaksandr Valialkin wrote: >>> >>> >>> >>> This is really great idea! Will try implementing it. >>> >>> Does github.com/klauspost/compress support all the levels for data >>> decompression? VictoriaMetrics varies compression level depending on the >>> data type. It would be great if github.com/klauspost/compress could >>> decompress data compressed by the upstream zstd on higher compression >>> levels. >>> >> >> Decompression will work for all input. It is implementing the full spec. >> > Great! I filed feature request for implementing pure Go builds for VictoriaMetrics - https://github.com/VictoriaMetrics/VictoriaMetrics/issues/94 . > >> Compression has "Fastest" and "Default" implemented, roughly matching >> level 1 and 3 in zstd in speed and performance. I plan on adding something >> around level 7-9 (as Better) and level 19 (as Best). But for it to be >> useful I have mainly focused on the fastest modes. I also am planning more >> concurrency in compression and decompression for streams - blocks will >> probably remain as single goroutines. For now I am taking a small break and >> having a bit of fun revisiting deflate and experimenting with Snappy. >> >> If there is anything I can do to help feel free to ping me. >> >> >> /Klaus >> >> >>> >>> -- >>> Best Regards, >>> >>> Aliaksandr >>> >> -- >> You received this message because you are subscribed to the Google Groups >> "golang-nuts" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to golang-nuts+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/golang-nuts/b12c7562-b3a6-426b-bb1c-a62fcfc41714%40googlegroups.com >> <https://groups.google.com/d/msgid/golang-nuts/b12c7562-b3a6-426b-bb1c-a62fcfc41714%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> For more options, visit https://groups.google.com/d/optout. >> > > > -- > > *Michael T. jonesmichael.jo...@gmail.com <michael.jo...@gmail.com>* > > -- > You received this message because you are subscribed to a topic in the > Google Groups "golang-nuts" group. > To unsubscribe from this topic, visit > https://groups.google.com/d/topic/golang-nuts/onlD1GIG00g/unsubscribe. > To unsubscribe from this group and all its topics, send an email to > golang-nuts+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/golang-nuts/CALoEmQwocTkYXf7bn39mxpkhuF%2Bynogb8BC6YwzXa9%3Dj89%3DvQw%40mail.gmail.com > <https://groups.google.com/d/msgid/golang-nuts/CALoEmQwocTkYXf7bn39mxpkhuF%2Bynogb8BC6YwzXa9%3Dj89%3DvQw%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- Best Regards, Aliaksandr -- You received this message because you are subscribed to the Google Groups "golang-nuts" group. To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/golang-nuts/CAPbKnmA7sJRkG4FG6kV%3D%3D%2Bb9sGvM1HwkG%3Dejwwnpt%2BYpVG86SQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
