Re: [MirageOS-devel] mirage-tcpip and jumbo frames

2017-01-22 Thread David Scott
On Thu, Jan 19, 2017 at 2:40 PM, Mindy wrote: > On 01/19/2017 04:14 AM, Anil Madhavapeddy wrote: > > On 19 Jan 2017, at 10:00, David Scott wrote: >> >>> Hi, >>> >>> I'm trying to increase the performance a program which uses the >>> mirag

[MirageOS-devel] mirage-tcpip and jumbo frames

2017-01-19 Thread David Scott
Hi, I'm trying to increase the performance a program which uses the mirage-tcpip stack (specifically vpnkit[1] running on Windows). I noticed the total CPU overhead in `top` was higher than I expected so I attempted to reduce the overhead per byte by enabling jumbo frames. I bumped the MTU of the

Re: [MirageOS-devel] Porting qcow-format to topkg

2016-11-26 Thread David Scott
On Sat, Nov 26, 2016 at 6:18 PM, Hannes Mehnert wrote: > On 26/11/2016 18:00, Federico Gimenez wrote: > > File "lib/qcow.ml", line 46, characters 12-16: > > Error: Unbound type constructor B.id > > > > this happens also while trying to build with oasis, will try to find > what's > > going on. > >

Re: [MirageOS-devel] Canopy and Liveblogging

2016-10-19 Thread David Scott
On Wed, Oct 19, 2016 at 9:30 AM, Gemma Gordon wrote: > Hi all, > > I have spent a lot of time recently using Canopy for liveblogging various > Mirage-related events specifically ICFP and the Docker Distributed Systems > Summit. > > I'd like to thank Enguerrand Decorne for his help with Canopy, An

Re: [MirageOS-devel] Using Result instead of Option in libraries

2016-10-14 Thread David Scott
On Fri, Oct 14, 2016 at 3:23 PM, Anil Madhavapeddy wrote: > On 14 Oct 2016, at 15:11, Hannes Mehnert wrote: > > > > On 14/10/2016 15:08, Anil Madhavapeddy wrote: > >> Yeah, once we agree on the conventions :-) Once we have everything > using Result.t, we also need to find the right set of combi

Re: [MirageOS-devel] Using Result instead of Option in libraries

2016-10-14 Thread David Scott
On Fri, Oct 14, 2016 at 2:51 PM, Anil Madhavapeddy wrote: > We have quite a few base libraries that use the pattern of > > val foo_exn : ... -> 'a > @raises > > val foo: ... -> 'a option > Gobbles the exception and returns Some/None > > Should we take the Mirage3 opportunity to port libraries lik

Re: [MirageOS-devel] load/startup time error handling

2016-10-04 Thread David Scott
On Tue, Oct 4, 2016 at 12:04 PM, Anil Madhavapeddy wrote: > On 1 Oct 2016, at 21:49, Hannes Mehnert wrote: > > > > On 30/09/2016 17:13, Hannes Mehnert wrote: > >> If nobody disagrees (and comes up with non-contrived examples), I'm > >> happy to massage code into this direction within the next fe

Re: [MirageOS-devel] Mirage/Solo5: What to do about C stubs?

2016-07-19 Thread David Scott
On Tue, Jul 19, 2016 at 5:19 PM, Thomas Leonard wrote: > On 19 July 2016 at 16:47, Martin Lucina wrote: > > Hi all, > > > > the mirage-solo5 package (i.e. the Solo5 "platform bindings") currently > > bundle C stubs for unrelated packages which get linked into a > > libsolo5camlbindings.a. > > >

Re: [MirageOS-devel] mirageos 3.0 : let's break some APIs

2016-06-05 Thread David Scott
Hi, On Mon, May 30, 2016 at 1:49 PM, Thomas Leonard wrote: > On 18 May 2016 at 17:28, Mindy wrote: > > Hi folks! > > > > With some exciting new developments (OCaml 4.03 with flambda, `result`, > > `logs`) and users, it's probably time to think about the broad world of > > possibilities unlocked

Re: [MirageOS-devel] mirageos 3.0 : let's break some APIs

2016-06-05 Thread David Scott
(sorry I hit send too soon!) On Sun, Jun 5, 2016 at 2:45 PM, David Scott wrote: > Hi, > > On Wed, May 18, 2016 at 5:28 PM, Mindy wrote: > > ... >> >> I'm surely missing many things folks would want to incorporate in a big >> API-breaking release

Re: [MirageOS-devel] mirageos 3.0 : let's break some APIs

2016-06-05 Thread David Scott
Hi, On Wed, May 18, 2016 at 5:28 PM, Mindy wrote: ... > > I'm surely missing many things folks would want to incorporate in a big > API-breaking release -- please do let us know what they are. :) > I'd like to address some problems with `FLOW`, in particular: - the `read` function val read: f

Re: [MirageOS-devel] Error reporting and logging in generated main.ml

2016-03-15 Thread David Scott
On Tue, Mar 15, 2016 at 12:06 PM, Thomas Leonard wrote: > I've been experimenting with some improvements to the error reporting > and logging in the generated main.ml code: > Some initial results are here (including a mirage-dev fork you can use > to try it): > > https://github.com/talex5/can

Re: [MirageOS-devel] AppveyorCI scripts (Windows CI)

2016-03-07 Thread David Scott
On Wed, Mar 2, 2016 at 11:21 PM, David Scott wrote: > > > On Wed, Mar 2, 2016 at 4:59 PM, Thomas Gazagnaire > wrote: > >> Hi all, >> >> following what I said in the MirageOS call, I’ve written some >> instructions to easily test packages on Windows, usin

Re: [MirageOS-devel] Mirage-Block-Unix Error

2016-03-05 Thread David Scott
Hi, On Sat, Mar 5, 2016 at 2:53 PM, Rupert Horlick wrote: > Okay, so I ran it with strace and the offending line is: > > write(4, > "\377\377\377\377\377\377\377\377\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., > 1048576) = -1 EINVAL (Invalid argument) > > I then looked up EINVAL errors

Re: [MirageOS-devel] AppveyorCI scripts (Windows CI)

2016-03-02 Thread David Scott
On Wed, Mar 2, 2016 at 4:59 PM, Thomas Gazagnaire wrote: > Hi all, > > following what I said in the MirageOS call, I’ve written some instructions > to easily test packages on Windows, using Appveyor CI: > > https://github.com/ocaml/ocaml-ci-scripts/blob/master/README-appveyor.md > > It is using t

Re: [MirageOS-devel] List moderation

2016-02-18 Thread David Scott
Hi Lars, I'm happy to moderate -- I assume the absolute volume isn't too high. Cheers, Dave On Wed, Feb 17, 2016 at 1:06 PM, Lars Kurth wrote: > Hi folks, > going through my inbox I noticed that the list has recently not been well > moderated, in particular related to posts by people who are n

Re: [MirageOS-devel] BTrees, File System, Information Retrieval, and ORAM

2016-02-17 Thread David Scott
Great-- I look forward to trying it! :-) Cheers, Dave On Thu, 18 Feb 2016, 06:29 Rupert Horlick wrote: > Hi all, > > I just wanted to let you know that I made the code for my Part II project > publicly available at: https://github.com/ruhatch/mirage-oram > > It is an implementation of the crypt

Re: [MirageOS-devel] atomically writing persistent data in mirage

2016-01-26 Thread David Scott
On Tue, Jan 26, 2016 at 10:01 AM, Thomas Leonard wrote: > On 26 January 2016 at 03:43, Tim Cuthbertson wrote: > > Hi all, > > > > I've got a small HTTP service which runs both as a normal unix server > > which I've slowly been porting to work on mirage as well. One factor I > > haven't found a s

Re: [MirageOS-devel] Irmin on BLOCK

2016-01-18 Thread David Scott
On Mon, Jan 18, 2016 at 8:13 PM, Thomas Gazagnaire wrote: > Seems that Dave has been busy: > > https://github.com/djs55/ocaml-btree > > (sorry Dave if I spoiled your future announcement) > That's ok -- I'm still experimenting with interfaces and disk layouts. It'll be a while before I have anyth

Re: [MirageOS-devel] A Unikernel Firewall for QubesOS

2016-01-02 Thread David Scott
On Sat, Jan 2, 2016 at 12:07 PM, Thomas Leonard wrote: > I have a Mirage firewall running now under Qubes: > > > http://roscidus.com/blog/blog/2016/01/01/a-unikernel-firewall-for-qubesos/ > > Excellent stuff! > There are some things that need fixing though: > > - I'm using an old version of mir

Re: [MirageOS-devel] Out of memory

2015-12-18 Thread David Scott
Hi Thomas, On Thu, Dec 17, 2015 at 4:59 PM, Thomas Leonard wrote: > I've been trying to track down some occasional out-of-memory errors > with my Mirage/Xen unikernel. My simplified code does this: > > let start ... = > ... > let rec loop () = > let open Bigarray in > let x =

Re: [MirageOS-devel] MirageOS AppVMs on Qubes

2015-11-23 Thread David Scott
On Mon, Nov 23, 2015 at 11:15 AM, Thomas Leonard wrote: > QubesOS is a security-focused desktop OS that runs multiple isolated > VMs under Xen. Typically, these run Linux. For example, I use a Fedora > VM for email and a Debian VM for development. > > There is discussion on the qubes mailing list

Re: [MirageOS-devel] Irmin on BLOCK

2015-11-11 Thread David Scott
Since it's for a project, take all of this with a pinch of salt: (random thoughts follow) A simple b-tree on disk would probably be much like an in-heap b-tree, except the nodes would be naturally wider and you would also need to track and reclaim free blocks (which the GC would normally do for yo

Re: [MirageOS-devel] Irmin on BLOCK

2015-11-10 Thread David Scott
On Mon, Nov 9, 2015 at 3:46 PM, Thomas Leonard wrote: > Hi Rupert, > > The main thing is to implement Irmin's AO signature: > > > https://github.com/mirage/irmin/blob/4b5d3117e4cc1ecff4a83cc508da59006423/lib/irmin.mli#L360 > > i.e. given a block of data, write it to disk and return its hash.

Re: [MirageOS-devel] BLOCK APIs

2015-10-29 Thread David Scott
Hi, FYI I just found myself writing a generic `copy` function over `BLOCK` devices for about the 100th time so I've created a repo called `mirage-block` to contain generic functions over block devices. The kinds of things I have in mind are: 1. copy 2. erase 3. mirror 4. Linux device-mapper like

Re: [MirageOS-devel] Vchan read/write

2015-10-22 Thread David Scott
Hi, Have a look at the cli in the ocaml-vchan repo first: https://github.com/mirage/ocaml-vchan/blob/master/cli/xencat.ml This uses the low-level vchan interfaces and is useful for debugging problems with the setup (exchanging domain ids, event channels etc). In a real app it might be better to

Re: [MirageOS-devel] BLOCK APIs

2015-10-17 Thread David Scott
Hi, On Sat, Oct 17, 2015 at 11:58 AM, Rupert Horlick wrote: > Hi all, > > I am currently working on building a functor which takes a V1.BLOCK > implementation and creates a new BLOCK implementation, with ORAM > capabilities. > > I’ve been looking through the APIs and I had a couple of questions

Re: [MirageOS-devel] Writing to Multiple Serial Ports

2015-10-06 Thread David Scott
Hi Paul, Aaron, On Tue, Oct 6, 2015 at 8:27 PM, Paul Skentzos wrote: > We are trying to access a serial port passed to a domu. We're very new to > Mirage > and ocaml, but plan on converting our existing system to use MirageOS for > various domU's. > > So, at the moment, the question we have is w

Re: [MirageOS-devel] Fwd: Amazon EC2 support now in Rumprun

2015-09-04 Thread David Scott
On Thu, Sep 3, 2015 at 11:02 PM, Andrew Stuart < andrew.stu...@supercoders.com.au> wrote: > > > >> From the Rump lists -- it looks increasingly complex to boot a > unikernel in EC2 when using non-S3 storage. > > I’m going to see if I can do anything to make booting on EC2 easier. > > One important

Re: [MirageOS-devel] Timestamp representation and CLOCK

2015-07-09 Thread David Scott
On Thu, Jul 9, 2015 at 3:26 PM, Anil Madhavapeddy wrote: > > > On 9 Jul 2015, at 14:47, Daniel Bünzli > wrote: > > > > > > module type CLOCK = sig > > > > val now_s : unit -> int64 * int > > (** [now_s ()] is [(s, ns)] the operating system's POSIX timestamp > > for the current time unders

Re: [MirageOS-devel] Restart the mirage.io unikernel

2015-06-29 Thread David Scott
Maybe someone beat me to it, but it seems to be responding now. On Mon, Jun 29, 2015 at 7:24 PM, Amir Chaudhry wrote: > Hi folks, > > Could someone who has access, please restart the mirage.io unikernel? > > Best wishes, > Amir > > -- > Sent via mobile > > ___

Re: [MirageOS-devel] pretty charts from OCaml and js_of_ocaml

2015-06-15 Thread David Scott
On Mon, Jun 15, 2015 at 11:41 AM, Thomas Gazagnaire wrote: > That's great! > > For Mirage, I think it would be fun to extend the mirage-www's built-in > stats reporting (GC live words etc) with a nice automatically-updating > chart. > > > Indeed! Do you think it would be easy to re-use the RRD co

[MirageOS-devel] pretty charts from OCaml and js_of_ocaml

2015-06-14 Thread David Scott
Hi, I've released an experimental OCaml binding for the Javascript charting library c3[1], which is built upon the well-known library d3[2]. If you're building a web application in javascript via js_of_ocaml, then this could be useful to you. Example output: http://djs55.github.io/ocaml-c3/index

Re: [MirageOS-devel] cubie2 arm image loses mac

2015-06-04 Thread David Scott
On Thu, Jun 4, 2015 at 9:31 AM, Thomas Leonard wrote: > On 4 June 2015 at 09:22, Nick Betteridge > wrote: > > Each time I fire up a '2 and leave it on overnight and then try and ssh > into > > the board the following morning, I get a no route to host. Doing an arp > on > > my machine will list t

[MirageOS-devel] API documentation best practices

2015-06-03 Thread David Scott
Hi, I would like to improve the API documentation of the Mirage (and xapi-project) libraries, to make them quicker and easier to understand. Currently I see the following problems: - some libraries don't have good ocamldoc in .mli files (I'm guilty of this) - we don't often generate the ocamldoc

Re: [MirageOS-devel] Mirage OS 2.4 errors on install and mirage-skeleton build

2015-04-29 Thread David Scott
Hi, On Wed, Apr 29, 2015 at 9:38 AM, Robert Ream wrote: > First, I want to say that I'm a huge fan of the emerging unikernel and > "Cloud OS" (i.e. OSv) approaches to operating systems. I also am a huge fan > of static type systems and have used OCaml in a production environment at a > previous

Re: [MirageOS-devel] mirage-www on xen and networking (on ARM)

2015-04-02 Thread David Scott
On Thu, Apr 2, 2015 at 9:18 PM, Magnus Therning wrote: > On Tue, Mar 31, 2015 at 09:49:28PM +0100, Anil Madhavapeddy wrote: > > On 31 Mar 2015, at 21:09, David Scott wrote: > > > > > > > > > > > > On Tue, Mar 31, 2015 at 6:43 PM, Anil Madhavapeddy

Re: [MirageOS-devel] mirage-www on xen and networking (on ARM)

2015-03-31 Thread David Scott
On Tue, Mar 31, 2015 at 6:43 PM, Anil Madhavapeddy wrote: > On 31 Mar 2015, at 07:37, Magnus Therning wrote: > > > > After a clean rebuild on my cubieboard, I'm getting the assertion > failures too, which is good. I notice the assert that's failing was added > relatively recently[1] in tcpip v2.

Re: [MirageOS-devel] mirage-www on xen and networking (on ARM)

2015-03-30 Thread David Scott
On Mon, Mar 30, 2015 at 10:11 PM, Magnus Therning wrote: > On Sun, Mar 29, 2015 at 09:00:27PM +0100, David Scott wrote: > > On Sun, Mar 29, 2015 at 7:52 PM, Magnus Therning > > wrote: > [...] > >> This time around I don't get anything in reply to my reque

Re: [MirageOS-devel] mirage-www on xen and networking (on ARM)

2015-03-29 Thread David Scott
On Sun, Mar 29, 2015 at 7:52 PM, Magnus Therning wrote: > On Sun, Mar 29, 2015 at 05:36:33PM +0100, David Scott wrote: > > On Sun, Mar 29, 2015 at 5:02 PM, Magnus Therning > > wrote: > [..] > > So it looks like you're receiving truncated IP frames. It would be &

Re: [MirageOS-devel] mirage-www on xen and networking (on ARM)

2015-03-29 Thread David Scott
On Sun, Mar 29, 2015 at 5:02 PM, Magnus Therning wrote: > I've finally managed to set up an ARM system that can compile > successfully (based on the pre-built image with swap added and an NTP > client installed). Compiling for unix now works perfectly fine, > albeit a bit slow. > > The next step

[MirageOS-devel] code coverage testing with Bisect

2015-03-12 Thread David Scott
Hi, I've been having a lot of fun with bisect[1] recently-- I've been using it to see which parts of the mirage-block-volume[2] and shared-block-ring[3] libraries are completely untouched by their unit tests. I found the following game to be quite addictive: 1. "make coverage", and load result in

Re: [MirageOS-devel] performance regression tests

2015-02-15 Thread David Scott
On Sun, Feb 15, 2015 at 11:52 AM, Richard Mortier < richard.mort...@cl.cam.ac.uk> wrote: > On 15 February 2015 at 11:28, Anil Madhavapeddy wrote: > > On 15 Feb 2015, at 11:19, Richard Mortier > wrote: > >> > >> On 15 February 2015 at 11:15, Anil Madhavapeddy > wrote: > >>> This is great to see

Re: [MirageOS-devel] performance regression tests

2015-02-15 Thread David Scott
On Sun, Feb 15, 2015 at 11:28 AM, Anil Madhavapeddy wrote: > On 15 Feb 2015, at 11:19, Richard Mortier > wrote: > > > > On 15 February 2015 at 11:15, Anil Madhavapeddy wrote: > >> This is great to see -- thanks for working on this Masoud! > >> > >> In particular, having even a simple iperf test

Re: [MirageOS-devel] Errors trying the "block" example with Mirage 2.0+ and Xen 4.4

2015-01-25 Thread David Scott
On Thu, Jan 22, 2015 at 4:45 PM, Thomas Leonard wrote: > On 22 January 2015 at 09:48, David Scott wrote: > > Hi, > > > > On Tue, Jan 20, 2015 at 2:29 PM, Raphael 'kena' Poss > wrote: > >> > >> > >> For information, if I manuall

Re: [MirageOS-devel] Errors trying the "block" example with Mirage 2.0+ and Xen 4.4

2015-01-22 Thread David Scott
Hi, On Tue, Jan 20, 2015 at 2:29 PM, Raphael 'kena' Poss wrote: > > For information, if I manually edit the Mirage-generated "main.ml" to say: > > let block1 () = > Block.connect "xvda1" > > (instead of Block.connect "/path/to/disk.img") > > Then it works fine! However this is not what I want,

Re: [MirageOS-devel] TLS on Xen write-up

2015-01-21 Thread David Scott
On Wed, Jan 21, 2015 at 11:07 AM, Thomas Leonard wrote: > I've now got my file queue REST service working with TLS on > Mirage/Xen, and I've put up my notes on the process here: > > http://roscidus.com/blog/blog/2015/01/21/securing-the-unikernel/ > > Let me know if you spot any flaws in the sch

Re: [MirageOS-devel] TLS on Xen

2015-01-16 Thread David Scott
On Fri, Jan 16, 2015 at 10:04 AM, Thomas Leonard wrote: > On 16 January 2015 at 08:51, Anil Madhavapeddy wrote: > > On 16 Jan 2015, at 00:00, Thomas Gazagnaire > wrote: > >> > On 15 January 2015 at 17:58, Thomas Gazagnaire > wrote: > >> - It would be good if you could configure an htt

Re: [MirageOS-devel] vchan client and server unikernels crash

2015-01-16 Thread David Scott
On Fri, Jan 16, 2015 at 12:00 PM, Michael Moon wrote: > when starting vchan client-server unikernels in > ocaml-vchan/lib_test/mirage, they crash with the error: > > unable to get domain type for domid=x > unable to attach console > > using pause-unpause (xl create -cp), I can see the following o

Re: [MirageOS-devel] supported platforms

2015-01-15 Thread David Scott
On Thu, Jan 15, 2015 at 3:14 PM, Richard Mortier < richard.mort...@cl.cam.ac.uk> wrote: > having just noticed the question of what compilers etc are supported > come up on another issue, i wondered: do we have the set of supported > ocaml and opam versions supported canonically stated anywhere? >

Re: [MirageOS-devel] An HTTP server with TLS

2015-01-12 Thread David Scott
On Mon, Jan 12, 2015 at 7:13 PM, Anil Madhavapeddy wrote: > On 12 Jan 2015, at 17:19, Thomas Leonard wrote: > > > > On 8 January 2015 at 11:35, Thomas Leonard wrote: > >> On 7 January 2015 at 17:35, Dave Scott wrote: > >>> > On 7 Jan 2015, at 17:12, Thomas Leonard wrote: > > On