On Mon, Aug 09, 2010 at 10:22:39PM -0400, Nathan Gray wrote:
> On Sun, Aug 08, 2010 at 03:49:11PM +0100, Eric Kow wrote:
> > Second: it'd be nice to have some numbers comparing old-fashioned
> > repositories on Darcs 1.0.9 with hashed repositories in Darcs 2.5.
> > Nathan, would you be interested in repeating your experiments?
> 
> I would be interested.  I've been a bit swamped recently, but
> will try to find some time in the next week.

I ran a benchmark of darcs-2.4.93.3 against a darcs-2 format copy
of my cap repo, which is the one I used to do the darcs-1
benchmarks earlier this year.  The results are included at the
end of this message.  I am also including the results of my
original darcs-1 benchmark.

I tried to run this newer version of darcs-benchmark using
darcs-1.0.9 against the original old-fashioned format cap repo.
Unfortunately, my quick edit was not sufficient to fool
darcs-benchmark this time.  I now get the error:

  $ darcs-benchmark run darcs-1.0.9 / cap-1
  darcs-benchmark: Prelude.read: no parse

My edit this time looks like this:

------------------------------------------------------------
diff -rN -u old-darcs-benchmark/source/Benchmark.hs 
new-darcs-benchmark/source/Benchmark.hs
--- old-darcs-benchmark/source/Benchmark.hs     2010-08-20 09:51:35.000000000 
-0400
+++ new-darcs-benchmark/source/Benchmark.hs     2010-08-20 09:51:35.000000000 
-0400
@@ -190,6 +190,7 @@
                             , binContext = BS.pack context }
        case binVersion bin of
          2:_ -> return bin
+        1:_ -> return bin
          _ -> fail $ cmd ++ ": Not darcs 2.x binary."
 
 verbose :: String -> Command ()
------------------------------------------------------------

My original edit from earlier this year (that I had to remove
when I upgraded darcs-benchmark recently):

------------------------------------------------------------
Fri Feb 19 15:50:22 EST 2010  [email protected]
  * disable check for darcs-2.x executable
diff -rN -u old-darcs-benchmark/Benchmark.hs new-darcs-benchmark/Benchmark.hs
--- old-darcs-benchmark/Benchmark.hs    2010-08-13 15:53:33.000000000 -0400
+++ new-darcs-benchmark/Benchmark.hs    2010-08-13 15:53:33.000000000 -0400
@@ -204,6 +204,7 @@
        waitForProcess procH
        case out of
          '2':'.':_ -> return ()
+         '1':'.':_ -> return ()
          _ -> fail $ cmd ++ ": Not darcs 2.x binary."
 
 verbose :: String -> Command ()
------------------------------------------------------------

Below are the benchmark results for darcs-2.4.98.3 and
darcs-1.0.9.

-kolibrie


Benchmark Results
=====================================================

Machine description
    vs2
Year
    2005
CPU
    Pentium 4
Memory
    1 GB
Hard disk
    IDE
Notes
    Linux [Debian Sid]

How to read these tables
=====================================================

NB: times are reported as mean + 1 std deviation

* ?x = less than  5 runs used
* ~x = less than 20 runs used
* sdev = std deviation
* op = optimize --pristine variant

darcs-2.4.98.3: 2.4.98.3 (beta 3),
            2010-08-16 09:56:53, GHC 6.12.1


Timing Graphs
====================================================

cap - darcs-2 optimized pristine format
---------------------------------------

.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=wh+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,165.01807&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=wh+mod+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,167.79945&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=wh+-l+(s)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,2.4127302&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=record+(s)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,5.0079513&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=revert+(s)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,2.6361344&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=(un)revert+(s)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,5.63499&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=get+(full)+(s)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,362.63113&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=get+(lazy)+(s)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,34.799004&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=pull+100+(s)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,210.45493&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=pull+1000+(s)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,264.3154&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=check+(s)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,666.034&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=repair+(s)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,675.83563&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:_&chtt=annotate+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,0.0&chbh=23,5,20

Timings
====================================================

cap - darcs-2 optimized pristine format
---------------------------------------

==========  ===========  =======
            op 2.4.98.3     sdev
==========  ===========  =======
        wh      165.0ms  (5.5ms)
    wh mod      167.8ms  (2.0ms)
     wh -l        ~2.4s   (0.0s)
    record        ?5.0s   (0.0s)
    revert        ?2.6s   (0.0s)
(un)revert        ?5.6s   (0.0s)
get (full)      ?6m2.6s   (5.8s)
get (lazy)       ?34.8s   (1.0s)
  pull 100     ?3m30.5s   (0.8s)
 pull 1000     ?4m24.3s   (7.2s)
     check     ?11m6.0s  (22.0s)
    repair    ?11m15.8s  (13.7s)
  annotate            -        -
==========  ===========  =======


Memory Graphs
====================================================

cap - darcs-2 optimized pristine format
---------------------------------------

.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:_&chtt=wh+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,0.0&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=wh+mod+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,8.0&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:_&chtt=wh+-l+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,0.0&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=record+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,122.0&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=revert+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,126.0&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=(un)revert+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,128.0&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=get+(full)+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,189.66667&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=get+(lazy)+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,17.666666&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=pull+100+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,212.66667&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=pull+1000+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,529.6667&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=check+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,721.0&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=repair+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,721.0&chbh=23,5,20
.. image:: 
http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:_&chtt=annotate+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,0.0&chbh=23,5,20

Memory
====================================================

cap - darcs-2 optimized pristine format
---------------------------------------

==========  ===========
            op 2.4.98.3
==========  ===========
        wh         0.0M
    wh mod         8.0M
     wh -l         0.0M
    record       122.0M
    revert       126.0M
(un)revert       128.0M
get (full)       189.7M
get (lazy)        17.7M
  pull 100       212.7M
 pull 1000       529.7M
     check       721.0M
    repair       721.0M
  annotate            -
==========  ===========


cap - darcs-1 format
--------------------

==============  ==============
                   darcs-1.0.9
==============  ==============
    get (full)     55.1s d=5.7
    get (lazy)               -
      pull 100    113.8s d=0.9
            wh  1249.3ms d=0.1
        wh mod  1230.2ms d=0.0
         wh -l  7943.7ms d=0.2
    record mod  5712.0ms d=0.2
    revert mod  2417.3ms d=0.1
(un)revert mod  7482.9ms d=0.2
         check   206.9s d=76.0
        repair    181.3s d=8.0
      annotate               -
     pull 1000    615.7s d=3.8
==============  ==============

==============  ===========
                darcs-1.0.9
==============  ===========
    get (full)        47.0M
    get (lazy)            -
      pull 100        49.7M
            wh         0.0M
        wh mod         6.0M
         wh -l         0.0M
    record mod        17.0M
    revert mod         6.8M
(un)revert mod         7.0M
         check        44.7M
        repair        44.3M
      annotate            -
     pull 1000        99.0M
==============  ===========

Attachment: signature.asc
Description: Digital signature

_______________________________________________
darcs-users mailing list
[email protected]
http://lists.osuosl.org/mailman/listinfo/darcs-users

Reply via email to