Adding couple of capstan contributors to the thread. Sent from my iPhone
> On Nov 2, 2017, at 16:16, Waldek Kozaczuk <jwkozac...@gmail.com> wrote: > > I think this might be a well known and undestood issue by capstan team but I > wanted to uderstand why it happens for my own sake. > > In my scenario I am usually able to upload 300 of files totaling 60MB in > 10-12 seconds (Java app) using capstan which I believe employs same mechanism > as OSv build script (over a socket to cpiod). On other hand when I upload > 13,000 small JS files (node app) totalling around 100MB it takes at least 3 > minutes (when I use VirtualBox to run OSv instance I am uploading to it takes > over 10 minutes). Both capstan and ODv I am uploading to run on the same > machine. > > Why is the upload of small files at least 10 times slower than with bigger > files? Is it because ZFS is not most efficient handling small files? Is it > possibly of how the upload is implemented on capstan side? > > Any ideas how to speed it up? Would somehow compressing all files in one > archive and uploading to cpiod as one tarball and then decompressing help? > > Regards, > Waldek > > -- > You received this message because you are subscribed to a topic in the Google > Groups "OSv Development" group. > To unsubscribe from this topic, visit > https://groups.google.com/d/topic/osv-dev/ZsD57qBaWM4/unsubscribe. > To unsubscribe from this group and all its topics, send an email to > osv-dev+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "OSv Development" group. To unsubscribe from this group and stop receiving emails from it, send an email to osv-dev+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
