Hi, Brian, thank you for your detailed reply.
I'd suggest a test framework which uses multiple simultaneous "tahoe > put" commands, each in a separate process (ideally on a different > machine than the Tahoe node, to factor out contention for CPU and local > disk between your test harness and the Tahoe node). > You found in attachement a script that sends multiple files simultaneously. I done those tests on my laptop (test1 -> test3) and on the tahoe test platform (test4). The results are better than uploading sequentially small files but when files are larger this adds an overhead to each upload at least ~2s (1MB files). Parallelism is easy to add in my application :) but adding my code into the tahoe node is not obvious (I need to convert my code java -> python) > The quickest way to measure the HTTP roundtrip latency is to do "time > echo -n '' |tahoe put". That uploads a zero-byte file, which Tahoe does > by creating a "URI:LIT" filecap, which is not distributed and doesn't > even talk to the storage servers. Then compare the time it takes to do > that against uploading a 100-byte file, which *is* distributed and does > the usual tahoe upload work. On my laptop, the zero-byte file takes > 971ms to upload, > This is strange! Regards, Wassim
_testTahoeThreads.sh
Description: Bourne shell script
put_tahoe.sh
Description: Bourne shell script
-------------- Test1 with 4 threads -------------- 1 tahoe IP@ 1.261259110 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 1 tahoe IP@ 1.288291458 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 1 tahoe IP@ 1.337161497 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 1 tahoe IP@ 1.380702718 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 10 tahoe IP@ 1.200775798 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 10 tahoe IP@ 1.225693072 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 10 tahoe IP@ 1.287531657 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 10 tahoe IP@ 2.105804021 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 100 tahoe IP@ 1.329680802 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 100 tahoe IP@ 1.389611463 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 100 tahoe IP@ 1.417188221 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 100 tahoe IP@ 1.487378703 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 -------------- Test2 with 6 threads -------------- 1 tahoe IP@ 1.267536943 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 1 tahoe IP@ 1.261197938 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 1 tahoe IP@ 1.322769030 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 1 tahoe IP@ 1.334492796 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 1 tahoe IP@ 1.343449449 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 1 tahoe IP@ 2.098987304 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 10 tahoe IP@ 1.747522800 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 10 tahoe IP@ 1.809432274 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 10 tahoe IP@ 1.879797990 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 10 tahoe IP@ 1.912038887 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 10 tahoe IP@ 1.914080418 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 10 tahoe IP@ 2.114717376 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 100 tahoe IP@ 1.182178532 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 100 tahoe IP@ 1.264484102 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 100 tahoe IP@ 1.402855807 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 100 tahoe IP@ 1.423070597 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 100 tahoe IP@ 2.143349716 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 100 tahoe IP@ 2.225755507 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 -------------- Test3 with 6 threads -------------- 1 tahoe IP@ 1.237529138 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 1 tahoe IP@ 1.270131605 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 1 tahoe IP@ 1.312821880 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 1 tahoe IP@ 1.347683715 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 1 tahoe IP@ 1.371697941 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 1 tahoe IP@ 1.398471456 URI:CHK:iakaizokt5dgpyjyanmkure3ru:ondl3baqcr73dvacfgbhwyhezkvqnutdv4aqkjem4yd577s6evba:1:2:1024 10 tahoe IP@ 1.317009495 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 10 tahoe IP@ 1.320284423 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 10 tahoe IP@ 1.339858909 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 10 tahoe IP@ 1.403450651 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 10 tahoe IP@ 1.435402476 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 10 tahoe IP@ 1.463783596 URI:CHK:eqhsk743tyxln4by6hvsyuinma:he2jokzfrhpswngtcyab3gsq44yb4fywxyhode5x6z4qelb5yj4a:1:2:10240 100 tahoe IP@ 1.244101068 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 100 tahoe IP@ 1.373981541 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 100 tahoe IP@ 1.491952398 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 100 tahoe IP@ 1.537360892 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 100 tahoe IP@ 1.658407423 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 100 tahoe IP@ 1.715767298 URI:CHK:cjtub3gykhvptx3rkahosbvtqm:xybkx6ibmf7xfmxam5vqo2aj2ufmr2slfh2ijvgkdb6ewvwyjpsa:1:2:102400 512 tahoe IP@ 2.841242812 URI:CHK:7sh22aouvmt7urslbfcfkgcevy:swhojkzmahknwmbrefoldzcvnngew3m4qc32yut4poueaqr7s7jq:1:2:524288 512 tahoe IP@ 2.892670927 URI:CHK:7sh22aouvmt7urslbfcfkgcevy:swhojkzmahknwmbrefoldzcvnngew3m4qc32yut4poueaqr7s7jq:1:2:524288 512 tahoe IP@ 3.453847346 URI:CHK:7sh22aouvmt7urslbfcfkgcevy:swhojkzmahknwmbrefoldzcvnngew3m4qc32yut4poueaqr7s7jq:1:2:524288 512 tahoe IP@ 3.646595731 URI:CHK:7sh22aouvmt7urslbfcfkgcevy:swhojkzmahknwmbrefoldzcvnngew3m4qc32yut4poueaqr7s7jq:1:2:524288 512 tahoe IP@ 3.797702644 URI:CHK:7sh22aouvmt7urslbfcfkgcevy:swhojkzmahknwmbrefoldzcvnngew3m4qc32yut4poueaqr7s7jq:1:2:524288 512 tahoe IP@ 3.921000574 URI:CHK:7sh22aouvmt7urslbfcfkgcevy:swhojkzmahknwmbrefoldzcvnngew3m4qc32yut4poueaqr7s7jq:1:2:524288 1024 tahoe IP@ 4.129958490 URI:CHK:tsawtpn3xt2p2fdyh6shb2ipe4:rgxgrrgyltfenmysg7pcbthvngdhwnyo7m2zh6spkj4kdbsqwira:1:2:1048576 1024 tahoe IP@ 6.589627179 URI:CHK:tsawtpn3xt2p2fdyh6shb2ipe4:rgxgrrgyltfenmysg7pcbthvngdhwnyo7m2zh6spkj4kdbsqwira:1:2:1048576 1024 tahoe IP@ 7.006455082 URI:CHK:tsawtpn3xt2p2fdyh6shb2ipe4:rgxgrrgyltfenmysg7pcbthvngdhwnyo7m2zh6spkj4kdbsqwira:1:2:1048576 1024 tahoe IP@ 7.003886948 URI:CHK:tsawtpn3xt2p2fdyh6shb2ipe4:rgxgrrgyltfenmysg7pcbthvngdhwnyo7m2zh6spkj4kdbsqwira:1:2:1048576 1024 tahoe IP@ 7.042414191 URI:CHK:tsawtpn3xt2p2fdyh6shb2ipe4:rgxgrrgyltfenmysg7pcbthvngdhwnyo7m2zh6spkj4kdbsqwira:1:2:1048576 1024 tahoe IP@ 9.340874187 URI:CHK:tsawtpn3xt2p2fdyh6shb2ipe4:rgxgrrgyltfenmysg7pcbthvngdhwnyo7m2zh6spkj4kdbsqwira:1:2:1048576 2048 tahoe IP@ 11.986113386 URI:CHK:wzbxmwesrde62mg4mmipoajteq:hfiwgxkrlef3bi7htjphnc465tio7gamssn4shhk55fjtl4j4awa:1:2:2097152 2048 tahoe IP@ 13.059265421 URI:CHK:wzbxmwesrde62mg4mmipoajteq:hfiwgxkrlef3bi7htjphnc465tio7gamssn4shhk55fjtl4j4awa:1:2:2097152 2048 tahoe IP@ 14.362986496 URI:CHK:wzbxmwesrde62mg4mmipoajteq:hfiwgxkrlef3bi7htjphnc465tio7gamssn4shhk55fjtl4j4awa:1:2:2097152 2048 tahoe IP@ 14.670466075 URI:CHK:wzbxmwesrde62mg4mmipoajteq:hfiwgxkrlef3bi7htjphnc465tio7gamssn4shhk55fjtl4j4awa:1:2:2097152 2048 tahoe IP@ 14.742842595 URI:CHK:wzbxmwesrde62mg4mmipoajteq:hfiwgxkrlef3bi7htjphnc465tio7gamssn4shhk55fjtl4j4awa:1:2:2097152 2048 tahoe IP@ 14.928983432 URI:CHK:wzbxmwesrde62mg4mmipoajteq:hfiwgxkrlef3bi7htjphnc465tio7gamssn4shhk55fjtl4j4awa:1:2:2097152 -------------- Test4 with 4 threads on tahoe platform -------------- 1 tahoe IP@ 2.001100977 URI:CHK:2cert2wxwj7qpkw6cjpptt3pni:dfqzn7o2bo5slsvr5qfkyspuah4ncowfmuga2wshlydo2d7ihejq:3:10:1024 1 tahoe IP@ 2.173270552 URI:CHK:2cert2wxwj7qpkw6cjpptt3pni:dfqzn7o2bo5slsvr5qfkyspuah4ncowfmuga2wshlydo2d7ihejq:3:10:1024 1 tahoe IP@ 2.350056852 URI:CHK:2cert2wxwj7qpkw6cjpptt3pni:dfqzn7o2bo5slsvr5qfkyspuah4ncowfmuga2wshlydo2d7ihejq:3:10:1024 1 tahoe IP@ 3.485849458 URI:CHK:2cert2wxwj7qpkw6cjpptt3pni:dfqzn7o2bo5slsvr5qfkyspuah4ncowfmuga2wshlydo2d7ihejq:3:10:1024 10 tahoe IP@ 2.188173424 URI:CHK:equ4yary6giz2dfb5wgtycuowm:kvc2jmjfcyvuygzjci45xhhm7i2m34xhm7sug5svtwkx3wxjfg5a:3:10:10240 10 tahoe IP@ 2.375142934 URI:CHK:equ4yary6giz2dfb5wgtycuowm:kvc2jmjfcyvuygzjci45xhhm7i2m34xhm7sug5svtwkx3wxjfg5a:3:10:10240 10 tahoe IP@ 2.537365084 URI:CHK:equ4yary6giz2dfb5wgtycuowm:kvc2jmjfcyvuygzjci45xhhm7i2m34xhm7sug5svtwkx3wxjfg5a:3:10:10240 10 tahoe IP@ 2.683351794 URI:CHK:equ4yary6giz2dfb5wgtycuowm:kvc2jmjfcyvuygzjci45xhhm7i2m34xhm7sug5svtwkx3wxjfg5a:3:10:10240 100 tahoe IP@ 3.869707816 URI:CHK:tthql26qbbvu7hfr647v6rhsnq:zygqwcemqeui3ywd4ezb3ashtiil2ero7dzudjehfhs22s3fiehq:3:10:102400 100 tahoe IP@ 5.344227833 URI:CHK:tthql26qbbvu7hfr647v6rhsnq:zygqwcemqeui3ywd4ezb3ashtiil2ero7dzudjehfhs22s3fiehq:3:10:102400 100 tahoe IP@ 5.761520254 URI:CHK:tthql26qbbvu7hfr647v6rhsnq:zygqwcemqeui3ywd4ezb3ashtiil2ero7dzudjehfhs22s3fiehq:3:10:102400 100 tahoe IP@ 5.937094380 URI:CHK:tthql26qbbvu7hfr647v6rhsnq:zygqwcemqeui3ywd4ezb3ashtiil2ero7dzudjehfhs22s3fiehq:3:10:102400 1 tahoe IP@ 2.030462811 URI:CHK:2cert2wxwj7qpkw6cjpptt3pni:dfqzn7o2bo5slsvr5qfkyspuah4ncowfmuga2wshlydo2d7ihejq:3:10:1024 1 tahoe IP@ 2.194661678 URI:CHK:2cert2wxwj7qpkw6cjpptt3pni:dfqzn7o2bo5slsvr5qfkyspuah4ncowfmuga2wshlydo2d7ihejq:3:10:1024 1 tahoe IP@ 2.349011114 URI:CHK:2cert2wxwj7qpkw6cjpptt3pni:dfqzn7o2bo5slsvr5qfkyspuah4ncowfmuga2wshlydo2d7ihejq:3:10:1024 1 tahoe IP@ 2.500690661 URI:CHK:2cert2wxwj7qpkw6cjpptt3pni:dfqzn7o2bo5slsvr5qfkyspuah4ncowfmuga2wshlydo2d7ihejq:3:10:1024 10 tahoe IP@ 3.122335937 URI:CHK:equ4yary6giz2dfb5wgtycuowm:kvc2jmjfcyvuygzjci45xhhm7i2m34xhm7sug5svtwkx3wxjfg5a:3:10:10240 10 tahoe IP@ 3.304527530 URI:CHK:equ4yary6giz2dfb5wgtycuowm:kvc2jmjfcyvuygzjci45xhhm7i2m34xhm7sug5svtwkx3wxjfg5a:3:10:10240 10 tahoe IP@ 4.406646448 URI:CHK:equ4yary6giz2dfb5wgtycuowm:kvc2jmjfcyvuygzjci45xhhm7i2m34xhm7sug5svtwkx3wxjfg5a:3:10:10240 10 tahoe IP@ 4.892871443 URI:CHK:equ4yary6giz2dfb5wgtycuowm:kvc2jmjfcyvuygzjci45xhhm7i2m34xhm7sug5svtwkx3wxjfg5a:3:10:10240 100 tahoe IP@ 2.944603854 URI:CHK:tthql26qbbvu7hfr647v6rhsnq:zygqwcemqeui3ywd4ezb3ashtiil2ero7dzudjehfhs22s3fiehq:3:10:102400 100 tahoe IP@ 3.115370945 URI:CHK:tthql26qbbvu7hfr647v6rhsnq:zygqwcemqeui3ywd4ezb3ashtiil2ero7dzudjehfhs22s3fiehq:3:10:102400 100 tahoe IP@ 3.455118808 URI:CHK:tthql26qbbvu7hfr647v6rhsnq:zygqwcemqeui3ywd4ezb3ashtiil2ero7dzudjehfhs22s3fiehq:3:10:102400 100 tahoe IP@ 6.034042944 URI:CHK:tthql26qbbvu7hfr647v6rhsnq:zygqwcemqeui3ywd4ezb3ashtiil2ero7dzudjehfhs22s3fiehq:3:10:102400 512 tahoe IP@ 9.712638127 URI:CHK:mvwu7gvgtwkvmz7vsvdlfdp3ym:wlovonhz37qxwqogscrnkxs2wu7vvxvd2jsk3lq5nivwom3pdmpa:3:10:524288 512 tahoe IP@ 9.851092880 URI:CHK:mvwu7gvgtwkvmz7vsvdlfdp3ym:wlovonhz37qxwqogscrnkxs2wu7vvxvd2jsk3lq5nivwom3pdmpa:3:10:524288 512 tahoe IP@ 10.471724899 URI:CHK:mvwu7gvgtwkvmz7vsvdlfdp3ym:wlovonhz37qxwqogscrnkxs2wu7vvxvd2jsk3lq5nivwom3pdmpa:3:10:524288 512 tahoe IP@ 14.603881569 URI:CHK:mvwu7gvgtwkvmz7vsvdlfdp3ym:wlovonhz37qxwqogscrnkxs2wu7vvxvd2jsk3lq5nivwom3pdmpa:3:10:524288 1024 tahoe IP@ 16.498173721 URI:CHK:gjd43lucp3amzgbwwndlimpgui:gfgjcx2vyqzz5p76ukqlf263ixjvshv76knfvbob5yux6ko6knya:3:10:1048576 1024 tahoe IP@ 19.265861238 URI:CHK:gjd43lucp3amzgbwwndlimpgui:gfgjcx2vyqzz5p76ukqlf263ixjvshv76knfvbob5yux6ko6knya:3:10:1048576 1024 tahoe IP@ 19.444687316 URI:CHK:gjd43lucp3amzgbwwndlimpgui:gfgjcx2vyqzz5p76ukqlf263ixjvshv76knfvbob5yux6ko6knya:3:10:1048576 1024 tahoe IP@ 20.862147007 URI:CHK:gjd43lucp3amzgbwwndlimpgui:gfgjcx2vyqzz5p76ukqlf263ixjvshv76knfvbob5yux6ko6knya:3:10:1048576
_______________________________________________ tahoe-dev mailing list tahoe-dev@allmydata.org http://allmydata.org/cgi-bin/mailman/listinfo/tahoe-dev
