Re: Regarding Netmap internal memory allocation.

2015-01-05 Thread Carlos Ferreira
First of all, Happy New Year :)

Now, to more serious developments..
I was unable to reduce the netmap memory usage by manipulating the buf_num
value. The lowest I could get was around the 20MB which is still high. I'm
going to change the strategy and try to directly mmap the RX and TX buffers
from the interface sockets. The results are going to be worse and I know
that I'm not going to have Zero-Copy capability between interfaces but...
oh well, I guess at least I'm going to be able to do something better than
basic layer 2 sockets.


Thank you for the info regarding netmap.



On 30 December 2014 at 18:55, Carlos Ferreira  wrote:

> Well... due to budget constraints I'm using USB 100Mb ports :)
> This is for experimental purposes only for now.
>
> Btw, can netmap work with wireless interfaces? I believe you once answered
> this question, but I could not find it in the mail list.
>
> On 30 December 2014 at 18:40, Luigi Rizzo  wrote:
>
>> On Tue, Dec 30, 2014 at 6:38 PM, Carlos Ferreira 
>> wrote:
>> > Ok, I'm having some trouble in tuning the amount of memory for netmap.
>> >
>> > I have been following the man page from FreeBSD in other to understand
>> the
>> > values at /sys/modules/netmap/parameters for linux but I'm having some
>> > trouble in understanding what each value actually means.
>> > For the following values:
>> >
>> > dev.netmap.ring_num: 200  -> Is this the number of rings in the Ring
>> Buffer
>> > Pool?
>>
>> yes. For interfaces with a single queue you need 4 rings (rx+tx for the
>> nic and
>> another rx+tx for the host port)
>>
>> > dev.netmap.ring_size: 36864 -> Is this value, the number of slots per
>> ring?
>>
>> this is the size in bytes of each ring. The number of slots is set by the
>> hardware (low end devices as in the openwrt devices will probably use
>> 256 or 512 slots, so 10-12k should suffice. But this is not worth
>> changing.
>>
>> Instead, you should reduce the number of buffers, though 8MB is only 4000
>> buffers and it is a bit on the low side for 5 ports.
>>
>> However, as far as I know most openwrt devices only have one physical NIC,
>> and a switch implementing various vlans.
>>
>> cheers
>> luigi
>>
>>  >
>> > I'm trying to keep the amount of memory used by netmap as low as 4MB -
>> 8MB
>> > since I'm going to use only up to 4 NICs and one TAP.
>> >
>> > Thanks for the help!
>> >
>> >
>> > On 30 December 2014 at 16:16, Luigi Rizzo  wrote:
>> >>
>> >> you can #undefine WITH_VALE.
>> >> But it is only 20K of code (and 150K of data structures, which you
>> >> can further reduce by lowering NM_BRIDGS).
>> >> The saving is probably not worth the effort.
>> >>
>> >> cheers
>> >> luigi
>> >>
>> >> On Tue, Dec 30, 2014 at 5:08 PM, Carlos Ferreira <
>> carlosmf...@gmail.com>
>> >> wrote:
>> >> > By the way, another question.
>> >> > Is there a way to not compile the code regarding the VALE switch? I'm
>> >> > only
>> >> > interested in using netmap with Tap Devices and NICs, so I was
>> hoping to
>> >> > save some memory.
>> >> >
>> >> > On 30 December 2014 at 15:47, Carlos Ferreira > >
>> >> > wrote:
>> >> >>
>> >> >> You mean netmap_mem2.c ? It was there where I found the
>> >> >> NETMAP_BUF_MAX_NUM
>> >> >> define.
>> >> >>
>> >> >>
>> >> >>
>> >> >> On 30 December 2014 at 15:43, Carlos Ferreira <
>> carlosmf...@gmail.com>
>> >> >> wrote:
>> >> >>>
>> >> >>> Ok thanks. I was hoping not having to recompile the module, but
>> it's
>> >> >>> ok.
>> >> >>> Thank you for the info!
>> >> >>>
>> >> >>>
>> >> >>> On 30 December 2014 at 15:38, Luigi Rizzo 
>> wrote:
>> >> >>>>
>> >> >>>> you can reduce the amount of ram (buffers, mostly) by
>> >> >>>> tweaking the values in netmap_mem2.c ::
>> >> >>>> struct netmap_obj_params netmap_params[NETMAP_POOLS_NR] = {
>> >> >>>> ...
>> >> >>>> }
>> >> >>>>
>> >> >>

Re: Regarding Netmap internal memory allocation.

2014-12-30 Thread Carlos Ferreira
Well... due to budget constraints I'm using USB 100Mb ports :)
This is for experimental purposes only for now.

Btw, can netmap work with wireless interfaces? I believe you once answered
this question, but I could not find it in the mail list.

On 30 December 2014 at 18:40, Luigi Rizzo  wrote:

> On Tue, Dec 30, 2014 at 6:38 PM, Carlos Ferreira 
> wrote:
> > Ok, I'm having some trouble in tuning the amount of memory for netmap.
> >
> > I have been following the man page from FreeBSD in other to understand
> the
> > values at /sys/modules/netmap/parameters for linux but I'm having some
> > trouble in understanding what each value actually means.
> > For the following values:
> >
> > dev.netmap.ring_num: 200  -> Is this the number of rings in the Ring
> Buffer
> > Pool?
>
> yes. For interfaces with a single queue you need 4 rings (rx+tx for the
> nic and
> another rx+tx for the host port)
>
> > dev.netmap.ring_size: 36864 -> Is this value, the number of slots per
> ring?
>
> this is the size in bytes of each ring. The number of slots is set by the
> hardware (low end devices as in the openwrt devices will probably use
> 256 or 512 slots, so 10-12k should suffice. But this is not worth changing.
>
> Instead, you should reduce the number of buffers, though 8MB is only 4000
> buffers and it is a bit on the low side for 5 ports.
>
> However, as far as I know most openwrt devices only have one physical NIC,
> and a switch implementing various vlans.
>
> cheers
> luigi
>
>  >
> > I'm trying to keep the amount of memory used by netmap as low as 4MB -
> 8MB
> > since I'm going to use only up to 4 NICs and one TAP.
> >
> > Thanks for the help!
> >
> >
> > On 30 December 2014 at 16:16, Luigi Rizzo  wrote:
> >>
> >> you can #undefine WITH_VALE.
> >> But it is only 20K of code (and 150K of data structures, which you
> >> can further reduce by lowering NM_BRIDGS).
> >> The saving is probably not worth the effort.
> >>
> >> cheers
> >> luigi
> >>
> >> On Tue, Dec 30, 2014 at 5:08 PM, Carlos Ferreira  >
> >> wrote:
> >> > By the way, another question.
> >> > Is there a way to not compile the code regarding the VALE switch? I'm
> >> > only
> >> > interested in using netmap with Tap Devices and NICs, so I was hoping
> to
> >> > save some memory.
> >> >
> >> > On 30 December 2014 at 15:47, Carlos Ferreira 
> >> > wrote:
> >> >>
> >> >> You mean netmap_mem2.c ? It was there where I found the
> >> >> NETMAP_BUF_MAX_NUM
> >> >> define.
> >> >>
> >> >>
> >> >>
> >> >> On 30 December 2014 at 15:43, Carlos Ferreira  >
> >> >> wrote:
> >> >>>
> >> >>> Ok thanks. I was hoping not having to recompile the module, but it's
> >> >>> ok.
> >> >>> Thank you for the info!
> >> >>>
> >> >>>
> >> >>> On 30 December 2014 at 15:38, Luigi Rizzo 
> wrote:
> >> >>>>
> >> >>>> you can reduce the amount of ram (buffers, mostly) by
> >> >>>> tweaking the values in netmap_mem2.c ::
> >> >>>> struct netmap_obj_params netmap_params[NETMAP_POOLS_NR] = {
> >> >>>> ...
> >> >>>> }
> >> >>>>
> >> >>>> or you can simply modify the constant
> >> >>>>
> >> >>>> netmap_mem2.h:#define NETMAP_BUF_MAX_NUM 20*4096*2
> >> >>>>
> >> >>>> to something smaller that suits an openwrt box
> >> >>>> (in which i am very interested, as I'd like to deploy one of these
> >> >>>> soon)
> >> >>>>
> >> >>>> cheers
> >> >>>> luigi
> >> >>>>
> >> >>>>
> >> >>>> On Tue, Dec 30, 2014 at 4:12 PM, Carlos Ferreira
> >> >>>> 
> >> >>>> wrote:
> >> >>>> > Update:
> >> >>>> >
> >> >>>> > I noticed that the netmap module was still crashing, after
> >> >>>> > changing
> >> >>>> > the
> >> >>>> > OpenWRT VM ram to 256MB. I now raised to 1GB and it no longer
> >> >>>> > crashed.
> >&g

Re: Regarding Netmap internal memory allocation.

2014-12-30 Thread Carlos Ferreira
Ok, I'm having some trouble in tuning the amount of memory for netmap.

I have been following the man page from FreeBSD
<https://www.freebsd.org/cgi/man.cgi?query=netmap&sektion=4#end> in other
to understand the values at /sys/modules/netmap/parameters for linux but
I'm having some trouble in understanding what each value actually means.
For the following values:

dev.netmap.ring_num: 200  -> Is this the number of rings in the Ring Buffer
Pool?
dev.netmap.ring_size: 36864 -> Is this value, the number of slots per ring?

I'm trying to keep the amount of memory used by netmap as low as 4MB - 8MB
since I'm going to use only up to 4 NICs and one TAP.

Thanks for the help!


On 30 December 2014 at 16:16, Luigi Rizzo  wrote:

> you can #undefine WITH_VALE.
> But it is only 20K of code (and 150K of data structures, which you
> can further reduce by lowering NM_BRIDGS).
> The saving is probably not worth the effort.
>
> cheers
> luigi
>
> On Tue, Dec 30, 2014 at 5:08 PM, Carlos Ferreira 
> wrote:
> > By the way, another question.
> > Is there a way to not compile the code regarding the VALE switch? I'm
> only
> > interested in using netmap with Tap Devices and NICs, so I was hoping to
> > save some memory.
> >
> > On 30 December 2014 at 15:47, Carlos Ferreira 
> wrote:
> >>
> >> You mean netmap_mem2.c ? It was there where I found the
> NETMAP_BUF_MAX_NUM
> >> define.
> >>
> >>
> >>
> >> On 30 December 2014 at 15:43, Carlos Ferreira 
> >> wrote:
> >>>
> >>> Ok thanks. I was hoping not having to recompile the module, but it's
> ok.
> >>> Thank you for the info!
> >>>
> >>>
> >>> On 30 December 2014 at 15:38, Luigi Rizzo  wrote:
> >>>>
> >>>> you can reduce the amount of ram (buffers, mostly) by
> >>>> tweaking the values in netmap_mem2.c ::
> >>>> struct netmap_obj_params netmap_params[NETMAP_POOLS_NR] = {
> >>>> ...
> >>>> }
> >>>>
> >>>> or you can simply modify the constant
> >>>>
> >>>> netmap_mem2.h:#define NETMAP_BUF_MAX_NUM 20*4096*2
> >>>>
> >>>> to something smaller that suits an openwrt box
> >>>> (in which i am very interested, as I'd like to deploy one of these
> soon)
> >>>>
> >>>> cheers
> >>>> luigi
> >>>>
> >>>>
> >>>> On Tue, Dec 30, 2014 at 4:12 PM, Carlos Ferreira <
> carlosmf...@gmail.com>
> >>>> wrote:
> >>>> > Update:
> >>>> >
> >>>> > I noticed that the netmap module was still crashing, after  changing
> >>>> > the
> >>>> > OpenWRT VM ram to 256MB. I now raised to 1GB and it no longer
> crashed.
> >>>> > The
> >>>> > netmap module is now consuming about 350MB of Ram, which for my
> >>>> > objectives
> >>>> > is just too much...
> >>>> >
> >>>> > On 30 December 2014 at 14:06, Carlos Ferreira <
> carlosmf...@gmail.com>
> >>>> > wrote:
> >>>> >
> >>>> >> To Luigi and to whom may be able to help
> >>>> >>
> >>>> >> Hello all.
> >>>> >>
> >>>> >> Is it possible to reduce the size of the memory buffer allocated by
> >>>> >> the
> >>>> >> netmap module?
> >>>> >> I'm asking this because I was implementing some testing code, using
> >>>> >> NICs
> >>>> >> and a Tap device in an OpenWRT VM with 64MB of RAM.
> >>>> >> Because of the small RAM amount, the nm_open crashed when the
> program
> >>>> >> tried to netmap the tap device, after I previously netmapped one
> NIC
> >>>> >> successfully.
> >>>> >> After the crash, I bumped the VM RAM to 256MB and the test program
> >>>> >> ran
> >>>> >> well, but not without me noticing that the VM RAM consumption was
> >>>> >>  increased about 90 MB by netmap.
> >>>> >>
> >>>> >> Resuming, I want to know if there is a way to reduce the memory
> >>>> >> buffer
> >>>> >> allocation, without recompiling the netmap kernel module.
> >>>> >>
> 

Re: Regarding Netmap internal memory allocation.

2014-12-30 Thread Carlos Ferreira
By the way, another question.
Is there a way to not compile the code regarding the VALE switch? I'm only
interested in using netmap with Tap Devices and NICs, so I was hoping to
save some memory.

On 30 December 2014 at 15:47, Carlos Ferreira  wrote:

> You mean netmap_mem2.c ? It was there where I found the NETMAP_BUF_MAX_NUM
> define.
>
>
>
> On 30 December 2014 at 15:43, Carlos Ferreira 
> wrote:
>
>> Ok thanks. I was hoping not having to recompile the module, but it's ok.
>> Thank you for the info!
>>
>>
>> On 30 December 2014 at 15:38, Luigi Rizzo  wrote:
>>
>>> you can reduce the amount of ram (buffers, mostly) by
>>> tweaking the values in netmap_mem2.c ::
>>> struct netmap_obj_params netmap_params[NETMAP_POOLS_NR] = {
>>> ...
>>> }
>>>
>>> or you can simply modify the constant
>>>
>>> netmap_mem2.h:#define NETMAP_BUF_MAX_NUM 20*4096*2
>>>
>>> to something smaller that suits an openwrt box
>>> (in which i am very interested, as I'd like to deploy one of these soon)
>>>
>>> cheers
>>> luigi
>>>
>>>
>>> On Tue, Dec 30, 2014 at 4:12 PM, Carlos Ferreira 
>>> wrote:
>>> > Update:
>>> >
>>> > I noticed that the netmap module was still crashing, after  changing
>>> the
>>> > OpenWRT VM ram to 256MB. I now raised to 1GB and it no longer crashed.
>>> The
>>> > netmap module is now consuming about 350MB of Ram, which for my
>>> objectives
>>> > is just too much...
>>> >
>>> > On 30 December 2014 at 14:06, Carlos Ferreira 
>>> wrote:
>>> >
>>> >> To Luigi and to whom may be able to help
>>> >>
>>> >> Hello all.
>>> >>
>>> >> Is it possible to reduce the size of the memory buffer allocated by
>>> the
>>> >> netmap module?
>>> >> I'm asking this because I was implementing some testing code, using
>>> NICs
>>> >> and a Tap device in an OpenWRT VM with 64MB of RAM.
>>> >> Because of the small RAM amount, the nm_open crashed when the program
>>> >> tried to netmap the tap device, after I previously netmapped one NIC
>>> >> successfully.
>>> >> After the crash, I bumped the VM RAM to 256MB and the test program ran
>>> >> well, but not without me noticing that the VM RAM consumption was
>>> >>  increased about 90 MB by netmap.
>>> >>
>>> >> Resuming, I want to know if there is a way to reduce the memory buffer
>>> >> allocation, without recompiling the netmap kernel module.
>>> >>
>>> >> Thank you for the attention.
>>> >>
>>> >> --
>>> >>
>>> >> Carlos Miguel Ferreira
>>> >> Researcher at Telecommunications Institute
>>> >> Aveiro - Portugal
>>> >> Work E-mail - c...@av.it.pt
>>> >> Skype & GTalk -> carlosmf...@gmail.com
>>> >> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>>> >>
>>> >
>>> >
>>> >
>>> > --
>>> >
>>> > Carlos Miguel Ferreira
>>> > Researcher at Telecommunications Institute
>>> > Aveiro - Portugal
>>> > Work E-mail - c...@av.it.pt
>>> > Skype & GTalk -> carlosmf...@gmail.com
>>> > LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>>> > ___
>>> > freebsd-net@freebsd.org mailing list
>>> > http://lists.freebsd.org/mailman/listinfo/freebsd-net
>>> > To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
>>>
>>>
>>>
>>> --
>>> -+---
>>>  Prof. Luigi RIZZO, ri...@iet.unipi.it  . Dip. di Ing. dell'Informazione
>>>  http://www.iet.unipi.it/~luigi/. Universita` di Pisa
>>>  TEL  +39-050-2211611   . via Diotisalvi 2
>>>  Mobile   +39-338-6809875   . 56122 PISA (Italy)
>>> -+---
>>>
>>
>>
>>
>> --
>>
>> Carlos Miguel Ferreira
>> Researcher at Telecommunications Institute
>> Aveiro - Portugal
>> Work E-mail - c...@av.it.pt
>> Skype & GTalk -> carlosmf...@gmail.com
>> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>>
>
>
>
> --
>
> Carlos Miguel Ferreira
> Researcher at Telecommunications Institute
> Aveiro - Portugal
> Work E-mail - c...@av.it.pt
> Skype & GTalk -> carlosmf...@gmail.com
> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"


Re: Regarding Netmap internal memory allocation.

2014-12-30 Thread Carlos Ferreira
You mean netmap_mem2.c ? It was there where I found the NETMAP_BUF_MAX_NUM
define.


On 30 December 2014 at 15:43, Carlos Ferreira  wrote:

> Ok thanks. I was hoping not having to recompile the module, but it's ok.
> Thank you for the info!
>
>
> On 30 December 2014 at 15:38, Luigi Rizzo  wrote:
>
>> you can reduce the amount of ram (buffers, mostly) by
>> tweaking the values in netmap_mem2.c ::
>> struct netmap_obj_params netmap_params[NETMAP_POOLS_NR] = {
>> ...
>> }
>>
>> or you can simply modify the constant
>>
>> netmap_mem2.h:#define NETMAP_BUF_MAX_NUM 20*4096*2
>>
>> to something smaller that suits an openwrt box
>> (in which i am very interested, as I'd like to deploy one of these soon)
>>
>> cheers
>> luigi
>>
>>
>> On Tue, Dec 30, 2014 at 4:12 PM, Carlos Ferreira 
>> wrote:
>> > Update:
>> >
>> > I noticed that the netmap module was still crashing, after  changing the
>> > OpenWRT VM ram to 256MB. I now raised to 1GB and it no longer crashed.
>> The
>> > netmap module is now consuming about 350MB of Ram, which for my
>> objectives
>> > is just too much...
>> >
>> > On 30 December 2014 at 14:06, Carlos Ferreira 
>> wrote:
>> >
>> >> To Luigi and to whom may be able to help
>> >>
>> >> Hello all.
>> >>
>> >> Is it possible to reduce the size of the memory buffer allocated by the
>> >> netmap module?
>> >> I'm asking this because I was implementing some testing code, using
>> NICs
>> >> and a Tap device in an OpenWRT VM with 64MB of RAM.
>> >> Because of the small RAM amount, the nm_open crashed when the program
>> >> tried to netmap the tap device, after I previously netmapped one NIC
>> >> successfully.
>> >> After the crash, I bumped the VM RAM to 256MB and the test program ran
>> >> well, but not without me noticing that the VM RAM consumption was
>> >>  increased about 90 MB by netmap.
>> >>
>> >> Resuming, I want to know if there is a way to reduce the memory buffer
>> >> allocation, without recompiling the netmap kernel module.
>> >>
>> >> Thank you for the attention.
>> >>
>> >> --
>> >>
>> >> Carlos Miguel Ferreira
>> >> Researcher at Telecommunications Institute
>> >> Aveiro - Portugal
>> >> Work E-mail - c...@av.it.pt
>> >> Skype & GTalk -> carlosmf...@gmail.com
>> >> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>> >>
>> >
>> >
>> >
>> > --
>> >
>> > Carlos Miguel Ferreira
>> > Researcher at Telecommunications Institute
>> > Aveiro - Portugal
>> > Work E-mail - c...@av.it.pt
>> > Skype & GTalk -> carlosmf...@gmail.com
>> > LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>> > ___
>> > freebsd-net@freebsd.org mailing list
>> > http://lists.freebsd.org/mailman/listinfo/freebsd-net
>> > To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
>>
>>
>>
>> --
>> -+---
>>  Prof. Luigi RIZZO, ri...@iet.unipi.it  . Dip. di Ing. dell'Informazione
>>  http://www.iet.unipi.it/~luigi/. Universita` di Pisa
>>  TEL  +39-050-2211611   . via Diotisalvi 2
>>  Mobile   +39-338-6809875   . 56122 PISA (Italy)
>> -+---
>>
>
>
>
> --
>
> Carlos Miguel Ferreira
> Researcher at Telecommunications Institute
> Aveiro - Portugal
> Work E-mail - c...@av.it.pt
> Skype & GTalk -> carlosmf...@gmail.com
> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"


Re: Regarding Netmap internal memory allocation.

2014-12-30 Thread Carlos Ferreira
Ok thanks. I was hoping not having to recompile the module, but it's ok.
Thank you for the info!


On 30 December 2014 at 15:38, Luigi Rizzo  wrote:

> you can reduce the amount of ram (buffers, mostly) by
> tweaking the values in netmap_mem2.c ::
> struct netmap_obj_params netmap_params[NETMAP_POOLS_NR] = {
> ...
> }
>
> or you can simply modify the constant
>
> netmap_mem2.h:#define NETMAP_BUF_MAX_NUM 20*4096*2
>
> to something smaller that suits an openwrt box
> (in which i am very interested, as I'd like to deploy one of these soon)
>
> cheers
> luigi
>
>
> On Tue, Dec 30, 2014 at 4:12 PM, Carlos Ferreira 
> wrote:
> > Update:
> >
> > I noticed that the netmap module was still crashing, after  changing the
> > OpenWRT VM ram to 256MB. I now raised to 1GB and it no longer crashed.
> The
> > netmap module is now consuming about 350MB of Ram, which for my
> objectives
> > is just too much...
> >
> > On 30 December 2014 at 14:06, Carlos Ferreira 
> wrote:
> >
> >> To Luigi and to whom may be able to help
> >>
> >> Hello all.
> >>
> >> Is it possible to reduce the size of the memory buffer allocated by the
> >> netmap module?
> >> I'm asking this because I was implementing some testing code, using NICs
> >> and a Tap device in an OpenWRT VM with 64MB of RAM.
> >> Because of the small RAM amount, the nm_open crashed when the program
> >> tried to netmap the tap device, after I previously netmapped one NIC
> >> successfully.
> >> After the crash, I bumped the VM RAM to 256MB and the test program ran
> >> well, but not without me noticing that the VM RAM consumption was
> >>  increased about 90 MB by netmap.
> >>
> >> Resuming, I want to know if there is a way to reduce the memory buffer
> >> allocation, without recompiling the netmap kernel module.
> >>
> >> Thank you for the attention.
> >>
> >> --
> >>
> >> Carlos Miguel Ferreira
> >> Researcher at Telecommunications Institute
> >> Aveiro - Portugal
> >> Work E-mail - c...@av.it.pt
> >> Skype & GTalk -> carlosmf...@gmail.com
> >> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
> >>
> >
> >
> >
> > --
> >
> > Carlos Miguel Ferreira
> > Researcher at Telecommunications Institute
> > Aveiro - Portugal
> > Work E-mail - c...@av.it.pt
> > Skype & GTalk -> carlosmf...@gmail.com
> > LinkedIn -> http://www.linkedin.com/in/carlosmferreira
> > ___
> > freebsd-net@freebsd.org mailing list
> > http://lists.freebsd.org/mailman/listinfo/freebsd-net
> > To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
>
>
>
> --
> -+---
>  Prof. Luigi RIZZO, ri...@iet.unipi.it  . Dip. di Ing. dell'Informazione
>  http://www.iet.unipi.it/~luigi/. Universita` di Pisa
>  TEL  +39-050-2211611   . via Diotisalvi 2
>  Mobile   +39-338-6809875   . 56122 PISA (Italy)
> -+---
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"


Re: Regarding Netmap internal memory allocation.

2014-12-30 Thread Carlos Ferreira
Update:

I noticed that the netmap module was still crashing, after  changing the
OpenWRT VM ram to 256MB. I now raised to 1GB and it no longer crashed. The
netmap module is now consuming about 350MB of Ram, which for my objectives
is just too much...

On 30 December 2014 at 14:06, Carlos Ferreira  wrote:

> To Luigi and to whom may be able to help
>
> Hello all.
>
> Is it possible to reduce the size of the memory buffer allocated by the
> netmap module?
> I'm asking this because I was implementing some testing code, using NICs
> and a Tap device in an OpenWRT VM with 64MB of RAM.
> Because of the small RAM amount, the nm_open crashed when the program
> tried to netmap the tap device, after I previously netmapped one NIC
> successfully.
> After the crash, I bumped the VM RAM to 256MB and the test program ran
> well, but not without me noticing that the VM RAM consumption was
>  increased about 90 MB by netmap.
>
> Resuming, I want to know if there is a way to reduce the memory buffer
> allocation, without recompiling the netmap kernel module.
>
> Thank you for the attention.
>
> --
>
> Carlos Miguel Ferreira
> Researcher at Telecommunications Institute
> Aveiro - Portugal
> Work E-mail - c...@av.it.pt
> Skype & GTalk -> carlosmf...@gmail.com
> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"


Regarding Netmap internal memory allocation.

2014-12-30 Thread Carlos Ferreira
To Luigi and to whom may be able to help

Hello all.

Is it possible to reduce the size of the memory buffer allocated by the
netmap module?
I'm asking this because I was implementing some testing code, using NICs
and a Tap device in an OpenWRT VM with 64MB of RAM.
Because of the small RAM amount, the nm_open crashed when the program tried
to netmap the tap device, after I previously netmapped one NIC successfully.
After the crash, I bumped the VM RAM to 256MB and the test program ran
well, but not without me noticing that the VM RAM consumption was
 increased about 90 MB by netmap.

Resuming, I want to know if there is a way to reduce the memory buffer
allocation, without recompiling the netmap kernel module.

Thank you for the attention.

-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"


Re: tutorial on Netmap in Mountain View - Aug.28

2014-08-18 Thread Carlos Ferreira
Hi Luigi.
Do you have presentations or tutorial code from that tutorial, that you can
share here?


On 4 August 2014 10:55, Luigi Rizzo  wrote:

> In case someone (especially those in the bay area) is interested:
> I will give a half day tutorial on netmap at Hot Interconnects,
> in Mountain View on August 28, 2014
>
> http://www.hoti.org/hoti22/tutorials/#tut4
>
> This tutorial targets hardware vendors, network engineers, and
> researchers looking for solutions to: OS support for high speed NICs;
> efficient software packet processing techniques for SDN products;
> high speed networking in VMs. We will show how to achieve these
> results using netmap.
>
> cheers
> luigi
>
> (P.S. I have no financial interest in the event. I am posting the info
> because I think it might be useful to people on this list, and of course
> having a larger audience at the tutorial will generate more interesting
> feedback from participants)
>
> -+---
>   Prof. Luigi RIZZO, ri...@iet.unipi.it  . Dip. di Ing. dell'Informazione
>   http://www.iet.unipi.it/~luigi/. Universita` di Pisa
>   TEL  +39-050-2211611   . via Diotisalvi 2
>   Mobile   +39-338-6809875   . 56122 PISA (Italy)
> -+---
> ___
> freebsd-net@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"


Re: fastforward/routing: a 3 million packet-per-second system?

2014-07-24 Thread Carlos Ferreira
Juliet, a network equipment with eight SFP 10Gb Ethernet port is a small
solution. Network operators usually have solutions with 24, 48 or even more
ports mounted in racks. Check out the OLT solutions that Cisco has to offer.
Thinking that more cores always solves the problem is incorrect because you
will end up strangling the bus at the motherboard. Also, there's always a
limit to how many generic cpu cores you can add to a single system and the
power they need to operate.
There's a good reason why the optical network equipments cards use FPGA's.
It's not just deterministic execution, power consumption, reliability and
maintenance cost but also that dedicated digital circuit implementation
will always be faster than a generic cpu implementation.

I simply cannot imagine someone installing a network solution with eight
10GbE ports with a generic processor with 16 cores. But then again, I'm
humble enough to accept and study a solution of that kind, and the reasons
why someone would want to implement such solution in an operator network.
If you have seen such solution, please tell me where I can find it.


On 24 July 2014 18:22, Juli Mallett  wrote:

> On Tue, Jul 22, 2014 at 12:23 PM, Carlos Ferreira 
> wrote:
>
>> I think the results presented at the paper are regarding one port sending
>> or receiving at 14.88Mpps. Using several ports at the same time will
>> surely
>> give much lower results. But then again, if one wants 8, 16, 24 or even
>> more ports at 10Gb/s, then it should look for FPGA implementations.
>
>
> This is incorrect and misleading speculation, assuming your hardware is
> not set up badly in some way.  With netmap it is quite easy to have
> additional threads handling other ports, so long as you have enough real
> cores to run those threads on (ideally pinned, and with nothing else
> running.)  If you've got the RAM and the CPU, 8 ports of 10GbE with netmap
> on FreeBSD is not at all infeasible.  The question is always how much work
> you need to be able to do per-packet and whether you're able to do that
> work in an efficient way that fits with the model.  So something with a
> slightly-specific or at least sneaky architecture is very important here,
> so that you can just swap buffers rather than having to do a gratuitous
> copy.  And a very careful design even just for parsing the packets, let
> alone the process of doing the routing.
>
> Using several ports at the same time on a single CPU absolutely gives
> lower results, but someone with 8 10GbE ports can hopefully pretty well
> handle providing 16 cores to get the job done and still have a meaningful
> control plane.  The idea that netmap or similar solutions would be
> bottlenecked otherwise is wrong, unless there's something wrong with your
> hardware (not so uncommon as one might like.)  (For cache performance,
> etc., you really don't want to use hyperthreads for something as
> timing-sensitive and data-hungry as this kind of packet processing; your
> results may vary.)
>
> Juli.
>
> On 22 July 2014 19:36, John Jasen  wrote:
>>
>> >
>> > On 07/22/2014 01:41 PM, John-Mark Gurney wrote:
>> > > John Jasen wrote this message on Tue, Jul 22, 2014 at 11:18 -0400:
>> > >> Feedback and/or tips and tricks more than welcome.
>> > > You should look at netmap if you really want high PPS routing...
>> >
>> > Originally, I assumed an interface supporting netmap was required, but
>> > the manpage disabuses me of this. Besides, I think the Chelsio cards got
>> > netmap recently.
>> >
>> > I presume either the use of bridge in tools/netmap, or vale-ctl in the
>> > same location would start providing me sufficient clue on this?
>> > Unfortunately, both seem to be pretty short on verbosity ... More clue
>> > is always welcome!
>> >
>> >
>> > ___
>> > freebsd-net@freebsd.org mailing list
>> > http://lists.freebsd.org/mailman/listinfo/freebsd-net
>> > To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
>> >
>>
>>
>>
>> --
>>
>> Carlos Miguel Ferreira
>> Researcher at Telecommunications Institute
>> Aveiro - Portugal
>> Work E-mail - c...@av.it.pt
>> Skype & GTalk -> carlosmf...@gmail.com
>> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>> ___
>> freebsd-net@freebsd.org mailing list
>> http://lists.freebsd.org/mailman/listinfo/freebsd-net
>> To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
>>
>
>


-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"


Re: fastforward/routing: a 3 million packet-per-second system?

2014-07-22 Thread Carlos Ferreira
I think the results presented at the paper are regarding one port sending
or receiving at 14.88Mpps. Using several ports at the same time will surely
give much lower results. But then again, if one wants 8, 16, 24 or even
more ports at 10Gb/s, then it should look for FPGA implementations.


On 22 July 2014 19:36, John Jasen  wrote:

>
> On 07/22/2014 01:41 PM, John-Mark Gurney wrote:
> > John Jasen wrote this message on Tue, Jul 22, 2014 at 11:18 -0400:
> >> Feedback and/or tips and tricks more than welcome.
> > You should look at netmap if you really want high PPS routing...
>
> Originally, I assumed an interface supporting netmap was required, but
> the manpage disabuses me of this. Besides, I think the Chelsio cards got
> netmap recently.
>
> I presume either the use of bridge in tools/netmap, or vale-ctl in the
> same location would start providing me sufficient clue on this?
> Unfortunately, both seem to be pretty short on verbosity ... More clue
> is always welcome!
>
>
> ___
> freebsd-net@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"


Re: netmap

2014-07-12 Thread Carlos Ferreira
I'm sorry, I made  a mistake. The real_num_rx_queues field, with the 3.10
kernel which is currently being used with the OpenWRT trunk branch, is only
defined when CONFIG_RPS flag is active. CONFIG_RPS is only active when
CONFIG_SMP is active.

This as changed (beyond 3.13 version) and the real_num_rx_queues field
depends now on CONFIG_SYSFS field.


On 12 July 2014 15:36, Carlos Ferreira  wrote:

> Ok it seems that Symmetric MultiProcessing is broken for the IXP4xx arch
> when compiling the OpenWRT linux kernel. Since netmap requires SMP to be
> active. Netmap uses the real_num_rx_queues field from the netdev_rx_queue
> which requires CONFIG_SYSFS, which is active when CONFIG_SMP is active.
>
> I just posted at the OpenWRT development mailing list, requesting info and
> also, contacted Ryan Erbstoesser at Gateworks to also request info.
>
>
> On 12 July 2014 11:52, Carlos Ferreira  wrote:
>
>> Ok,I solved that problem that I was having but now I have another one.
>> For what I was able to determine, SMP is not supported for IXP4xx
>> processors on OpenWRT.
>> I'm able to compile it for x86, but not for IXP4xx, the CPU's that the
>> SBC Cambria from Gateworks use.
>> I'm still investigating if this is really the problem and if it is, if it
>> is possible to overcome.
>>
>> I will try to keep regular updates on this situation.
>> Carlos
>>
>>
>> On 11 July 2014 22:54, Carlos Ferreira  wrote:
>>
>>> OK, ignore what I said in the last e-mail. My Makefile is nor working
>>> properly and I'm trying to figure out why. OpenWRT documentation for module
>>> Makefiles creation is scarce and confuse...
>>>
>>>
>>> On 11 July 2014 18:27, Carlos Ferreira  wrote:
>>>
>>>> I'm building for OpenWRT (trunk) for the IXP4xx target.
>>>>
>>>> Attached goes the output for the compile attempt. Maybe I'm missing
>>>> something very basic...
>>>>
>>>>
>>>> On 11 July 2014 17:13, Luigi Rizzo  wrote:
>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Fri, Jul 11, 2014 at 6:07 PM, Carlos Ferreira <
>>>>> carlosmf...@gmail.com> wrote:
>>>>>
>>>>>> Luigi one question. Does netmap requires a processor with 64 bits?
>>>>>> I'm having some trouble in compiling netmap, using the same Makefile I 
>>>>>> used
>>>>>> previously, but for an Intel IXP435 CPU (Gateworks Cambria).
>>>>>>
>>>>>
>>>>> ​it used to build and work on 32 bit archs but we have not tried that
>>>>> there i a while.
>>>>> Hopefully it is just a matter of casts in printfs.
>>>>>
>>>>> which OS and netmap versions are you using ?
>>>>> can you send me an error log ?
>>>>>
>>>>> cheers
>>>>> luigi
>>>>> ​
>>>>>
>>>>>>
>>>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> Carlos Miguel Ferreira
>>>> Researcher at Telecommunications Institute
>>>> Aveiro - Portugal
>>>> Work E-mail - c...@av.it.pt
>>>> Skype & GTalk -> carlosmf...@gmail.com
>>>> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>>>>
>>>
>>>
>>>
>>> --
>>>
>>> Carlos Miguel Ferreira
>>> Researcher at Telecommunications Institute
>>> Aveiro - Portugal
>>> Work E-mail - c...@av.it.pt
>>> Skype & GTalk -> carlosmf...@gmail.com
>>> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>>>
>>
>>
>>
>> --
>>
>> Carlos Miguel Ferreira
>> Researcher at Telecommunications Institute
>> Aveiro - Portugal
>> Work E-mail - c...@av.it.pt
>> Skype & GTalk -> carlosmf...@gmail.com
>> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>>
>
>
>
> --
>
> Carlos Miguel Ferreira
> Researcher at Telecommunications Institute
> Aveiro - Portugal
> Work E-mail - c...@av.it.pt
> Skype & GTalk -> carlosmf...@gmail.com
> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"

Re: netmap

2014-07-12 Thread Carlos Ferreira
Ok it seems that Symmetric MultiProcessing is broken for the IXP4xx arch
when compiling the OpenWRT linux kernel. Since netmap requires SMP to be
active. Netmap uses the real_num_rx_queues field from the netdev_rx_queue
which requires CONFIG_SYSFS, which is active when CONFIG_SMP is active.

I just posted at the OpenWRT development mailing list, requesting info and
also, contacted Ryan Erbstoesser at Gateworks to also request info.


On 12 July 2014 11:52, Carlos Ferreira  wrote:

> Ok,I solved that problem that I was having but now I have another one. For
> what I was able to determine, SMP is not supported for IXP4xx processors on
> OpenWRT.
> I'm able to compile it for x86, but not for IXP4xx, the CPU's that the SBC
> Cambria from Gateworks use.
> I'm still investigating if this is really the problem and if it is, if it
> is possible to overcome.
>
> I will try to keep regular updates on this situation.
> Carlos
>
>
> On 11 July 2014 22:54, Carlos Ferreira  wrote:
>
>> OK, ignore what I said in the last e-mail. My Makefile is nor working
>> properly and I'm trying to figure out why. OpenWRT documentation for module
>> Makefiles creation is scarce and confuse...
>>
>>
>> On 11 July 2014 18:27, Carlos Ferreira  wrote:
>>
>>> I'm building for OpenWRT (trunk) for the IXP4xx target.
>>>
>>> Attached goes the output for the compile attempt. Maybe I'm missing
>>> something very basic...
>>>
>>>
>>> On 11 July 2014 17:13, Luigi Rizzo  wrote:
>>>
>>>>
>>>>
>>>>
>>>> On Fri, Jul 11, 2014 at 6:07 PM, Carlos Ferreira >>> > wrote:
>>>>
>>>>> Luigi one question. Does netmap requires a processor with 64 bits? I'm
>>>>> having some trouble in compiling netmap, using the same Makefile I used
>>>>> previously, but for an Intel IXP435 CPU (Gateworks Cambria).
>>>>>
>>>>
>>>> ​it used to build and work on 32 bit archs but we have not tried that
>>>> there i a while.
>>>> Hopefully it is just a matter of casts in printfs.
>>>>
>>>> which OS and netmap versions are you using ?
>>>> can you send me an error log ?
>>>>
>>>> cheers
>>>> luigi
>>>> ​
>>>>
>>>>>
>>>>>
>>>
>>>
>>> --
>>>
>>> Carlos Miguel Ferreira
>>> Researcher at Telecommunications Institute
>>> Aveiro - Portugal
>>> Work E-mail - c...@av.it.pt
>>> Skype & GTalk -> carlosmf...@gmail.com
>>> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>>>
>>
>>
>>
>> --
>>
>> Carlos Miguel Ferreira
>> Researcher at Telecommunications Institute
>> Aveiro - Portugal
>> Work E-mail - c...@av.it.pt
>> Skype & GTalk -> carlosmf...@gmail.com
>> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>>
>
>
>
> --
>
> Carlos Miguel Ferreira
> Researcher at Telecommunications Institute
> Aveiro - Portugal
> Work E-mail - c...@av.it.pt
> Skype & GTalk -> carlosmf...@gmail.com
> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"

Re: netmap

2014-07-12 Thread Carlos Ferreira
Ok,I solved that problem that I was having but now I have another one. For
what I was able to determine, SMP is not supported for IXP4xx processors on
OpenWRT.
I'm able to compile it for x86, but not for IXP4xx, the CPU's that the SBC
Cambria from Gateworks use.
I'm still investigating if this is really the problem and if it is, if it
is possible to overcome.

I will try to keep regular updates on this situation.
Carlos


On 11 July 2014 22:54, Carlos Ferreira  wrote:

> OK, ignore what I said in the last e-mail. My Makefile is nor working
> properly and I'm trying to figure out why. OpenWRT documentation for module
> Makefiles creation is scarce and confuse...
>
>
> On 11 July 2014 18:27, Carlos Ferreira  wrote:
>
>> I'm building for OpenWRT (trunk) for the IXP4xx target.
>>
>> Attached goes the output for the compile attempt. Maybe I'm missing
>> something very basic...
>>
>>
>> On 11 July 2014 17:13, Luigi Rizzo  wrote:
>>
>>>
>>>
>>>
>>> On Fri, Jul 11, 2014 at 6:07 PM, Carlos Ferreira 
>>> wrote:
>>>
>>>> Luigi one question. Does netmap requires a processor with 64 bits? I'm
>>>> having some trouble in compiling netmap, using the same Makefile I used
>>>> previously, but for an Intel IXP435 CPU (Gateworks Cambria).
>>>>
>>>
>>> ​it used to build and work on 32 bit archs but we have not tried that
>>> there i a while.
>>> Hopefully it is just a matter of casts in printfs.
>>>
>>> which OS and netmap versions are you using ?
>>> can you send me an error log ?
>>>
>>> cheers
>>> luigi
>>> ​
>>>
>>>>
>>>>
>>
>>
>> --
>>
>> Carlos Miguel Ferreira
>> Researcher at Telecommunications Institute
>> Aveiro - Portugal
>> Work E-mail - c...@av.it.pt
>> Skype & GTalk -> carlosmf...@gmail.com
>> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>>
>
>
>
> --
>
> Carlos Miguel Ferreira
> Researcher at Telecommunications Institute
> Aveiro - Portugal
> Work E-mail - c...@av.it.pt
> Skype & GTalk -> carlosmf...@gmail.com
> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"

Re: netmap

2014-07-11 Thread Carlos Ferreira
OK, ignore what I said in the last e-mail. My Makefile is nor working
properly and I'm trying to figure out why. OpenWRT documentation for module
Makefiles creation is scarce and confuse...


On 11 July 2014 18:27, Carlos Ferreira  wrote:

> I'm building for OpenWRT (trunk) for the IXP4xx target.
>
> Attached goes the output for the compile attempt. Maybe I'm missing
> something very basic...
>
>
> On 11 July 2014 17:13, Luigi Rizzo  wrote:
>
>>
>>
>>
>> On Fri, Jul 11, 2014 at 6:07 PM, Carlos Ferreira 
>> wrote:
>>
>>> Luigi one question. Does netmap requires a processor with 64 bits? I'm
>>> having some trouble in compiling netmap, using the same Makefile I used
>>> previously, but for an Intel IXP435 CPU (Gateworks Cambria).
>>>
>>
>> ​it used to build and work on 32 bit archs but we have not tried that
>> there i a while.
>> Hopefully it is just a matter of casts in printfs.
>>
>> which OS and netmap versions are you using ?
>> can you send me an error log ?
>>
>> cheers
>> luigi
>> ​
>>
>>>
>>>
>
>
> --
>
> Carlos Miguel Ferreira
> Researcher at Telecommunications Institute
> Aveiro - Portugal
> Work E-mail - c...@av.it.pt
> Skype & GTalk -> carlosmf...@gmail.com
> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"

Re: netmap

2014-07-11 Thread Carlos Ferreira
I'm building for OpenWRT (trunk) for the IXP4xx target.

Attached goes the output for the compile attempt. Maybe I'm missing
something very basic...


On 11 July 2014 17:13, Luigi Rizzo  wrote:

>
>
>
> On Fri, Jul 11, 2014 at 6:07 PM, Carlos Ferreira 
> wrote:
>
>> Luigi one question. Does netmap requires a processor with 64 bits? I'm
>> having some trouble in compiling netmap, using the same Makefile I used
>> previously, but for an Intel IXP435 CPU (Gateworks Cambria).
>>
>
> ​it used to build and work on 32 bit archs but we have not tried that
> there i a while.
> Hopefully it is just a matter of casts in printfs.
>
> which OS and netmap versions are you using ?
> can you send me an error log ?
>
> cheers
> luigi
> ​
>
>>
>>


-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
make ./package/netmap/compile V=99
Collecting package info: done
make[1]: Entering directory '/home/openwrt/Desktop/OpenWRT-Cambria/openwrt'
make[2]: Entering directory 
'/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/package/netmap'


MAKE  = make
PKG_NAME   = netmap
PKG_VERSION= HEAD
PKG_BUILD_DIR  = 
/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/netmap
PKG_SOURCE_PROTO   = git
PKG_SOURCE_URL = https://code.google.com/p/netmap/
PKG_SOURCE = netmap.tar.gz
PKG_SOURCE_VERSION = HEAD
PKG_SOURCE_SUBDIR  = netmap
MAKE_OPTS  = -C 
/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/linux-ixp4xx_generic/linux-3.10.28
 
PATH=/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/staging_dir/toolchain-armeb_xscale_gcc-4.8-linaro_uClibc-0.9.33.2/bin:/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/staging_dir/host/bin:/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/staging_dir/toolchain-armeb_xscale_gcc-4.8-linaro_uClibc-0.9.33.2/bin:/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/staging_dir/host/bin:/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/bin/site_perl:/usr/bin/vendor_perl:/usr/bin/core_perl
 DOMULTI=1
EXTRA_CFLAGS   = 
-I/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/netmap/LINUX
 
-I/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/netmap/LINUX/../sys
 
-I/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/netmap/LINUX/../sys/dev
 -DCONFIG_NETMAP -Wno-unused-but-set-variable 
EXTRA_KCONFIG  = 
LINUX_KMOD_SUFFIX  = ko
LINUX_DIR  = 
/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/linux-ixp4xx_generic/linux-3.10.28
LINUX_KARCH= arm
TARGET_CROSS   = armeb-openwrt-linux-uclibcgnueabi-
PWD= /home/openwrt/Desktop/OpenWRT-Cambria/openwrt


mkdir -p 
/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/netmap
tar  
--directory="/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2"
 -zxf /home/openwrt/Desktop/OpenWRT-Cambria/openwrt/dl/netmap.tar.gz
#cp -fpR ./* 
/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/netmap/
touch 
/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/netmap/.prepared_82fc248445e7486533e645a5023cf3ad
(cd 
/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/netmap/./;
 if [ -x ./configure ]; then /usr/bin/find 
/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/netmap/
 -name config.guess | xargs -r chmod u+w; /usr/bin/find 
/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/netmap/
 -name config.guess | xargs -r -n1 cp 
/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/scripts/config.guess; 
/usr/bin/find 
/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/netmap/
 -name config.sub | xargs -r chmod u+w; /usr/bin/find 
/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/build_dir/target-armeb_xscale_uClibc-0.9.33.2/netmap/
 -name config.sub | xargs -r -n1 cp 
/home/openwrt/Desktop/OpenWRT-Cambria/openwrt/scripts/config.sub; 
AR=armeb-openwrt-linux-uclibcgnueabi-ar 
AS="armeb-openwrt-linux-uclibcgnueabi-gcc -c -Os -pipe -march=armv5te 
-mtune=xscale -fno-caller-saves -fhonour-copts 
-Wno-error=unused-but-set-variable -msoft-float" 
LD=armeb-openwrt-linux-uclibcgnueabi-ld NM=armeb-openwrt-linux-uclibcgnueabi-nm 
CC="armeb-openwrt-lin

Re: netmap

2014-07-11 Thread Carlos Ferreira
Luigi one question. Does netmap requires a processor with 64 bits? I'm
having some trouble in compiling netmap, using the same Makefile I used
previously, but for an Intel IXP435 CPU (Gateworks Cambria).


On 28 June 2014 14:07, Carlos Ferreira  wrote:

> Hello to all.
> Unfortunately, I have been unable to do the test that Luigi requested due
> to the lack of hardware. All the Gateworks Cambria SBC that I have are
> currently allocated to another project. Only in about one week, will I have
> the opportunity to test it.
> As soon as I have news, I will post them. :)
>
>
> On 28 June 2014 09:24, Luigi Rizzo  wrote:
>
>>
>>
>> On Saturday, June 28, 2014, Prashant Upadhyaya 
>> wrote:
>>
>>> Hi,
>>>
>>> Any further news ?
>>>
>>> Professor Luigi, one question regarding the tx with netmap.
>>> Whenever, I write a packet from user space into netmap rings, and if I
>>> want netmap to send this out immediately, do I necessarily have to do
>>> a ioctl(fd, NIOCTXSYNC, NULL) ?
>>>
>>
>> Yes it is up to the application to decide when to push packets out with a
>> txsync or select() or poll(), and unfortunately there is a tradeoff between
>> efficiency and latency
>>
>> Cheers
>> Luigi
>>
>>
>>>
>>> I have an application which receives packets, does some processing and
>>> then sends them out. If I keep doing ioctl's on every packet send, then
>>> there will be too may system calls hitting performance, the application
>>> can't afford to block it has to return back to polling for the receipt of
>>> next packet.
>>>
>>> On the receive side, I see that I don't have a problem because I can
>>> poll the ring without initiating an RXSYNC and whenever in user space I
>>> find that there is nothing on the ring (probably half way down the ring
>>> size), I do an RXSYNC to get more packets thus saving system calls.
>>>
>>> But on tx side, I have noticed that unless I do a TXSYNC, the packet
>>> does not go out, please let me know if I am missing something.
>>>
>>> Regards
>>> -Prashant
>>>
>>>
>>>
>>> On Tue, Jun 17, 2014 at 7:33 PM, Carlos Ferreira 
>>> wrote:
>>>
>>>> Great! :)
>>>> I will give you the results as soon as I can get them :)
>>>>
>>>>
>>>>
>>>> On 17 June 2014 12:55, Luigi Rizzo  wrote:
>>>>
>>>> > On Mon, Jun 16, 2014 at 5:30 PM, Carlos Ferreira <
>>>> carlosmf...@gmail.com>
>>>> > wrote:
>>>> >
>>>> >> Ok, thanks for the enlightenment regarding the loss of performance.
>>>> >>
>>>> >> One question, just to be sure. Does the kernel module contains the
>>>> VALA
>>>> >> switch code? Or do I need to compile extra code to have the switch
>>>> working?
>>>> >> Also, where can I find the documentation to use the Vala Switch?
>>>> >>
>>>> >
>>>> > ​VALE is part of the netmap kernel module, the only thing you need
>>>> > to know to use it is port names:
>>>> > you can have multiple switch instances with multiple ports each,
>>>> >
>>>> > valeX:Y means port Y on switch X, X and Y are arbitrary strings
>>>> > with the constraint that the whole name must fit 15 characters.
>>>> >
>>>> > Details in the netmap manpage
>>>> >
>>>> > cheers
>>>> > luigi
>>>> >
>>>> >
>>>>
>>>>
>>>> --
>>>>
>>>> Carlos Miguel Ferreira
>>>> Researcher at Telecommunications Institute
>>>> Aveiro - Portugal
>>>> Work E-mail - c...@av.it.pt
>>>> Skype & GTalk -> carlosmf...@gmail.com
>>>> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>>>> ___
>>>> freebsd-net@freebsd.org mailing list
>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-net
>>>> To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
>>>>
>>>
>>>
>>
>> --
>> -+---
>>  Prof. Luigi RIZZO, ri...@iet.unipi.it  . Dip. di Ing. dell'Informazione
>>  http://www.iet.unipi.it/~luigi/. Universita` di Pisa
>>  TEL  +39-050-2211611   . via Diotisalvi 2
>>  Mobile   +39-338-6809875   . 56122 PISA (Italy)
>> -+---
>>
>>
>
>
> --
>
> Carlos Miguel Ferreira
> Researcher at Telecommunications Institute
> Aveiro - Portugal
> Work E-mail - c...@av.it.pt
> Skype & GTalk -> carlosmf...@gmail.com
> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"

Re: Please help

2014-07-02 Thread Carlos Ferreira
Sanuri, in order to achieve your goal, you should look for service
distribution over several systems (computers), basically a Cloud
architecture.
Depending on the language that your system is implemented, you should look
for the appropriate framework.

My regards,
Carlos


On 2 July 2014 10:08, Luigi Rizzo  wrote:

> On Wed, Jul 02, 2014 at 12:48:42PM +0530, Sanuri Dananja wrote:
> > Hi sir,
> > I'm trying to setup netmap on my machine on Ubuntu 12.04 LTS and having
> > difficulties. I don't understand much as I am not a networking student.
> > Could you please help me with the installation?
> > My NICs are as follows:
> > Wired: Atheros AR8151 PCI-E Gigabit Ethernet Controller (NDIS 6.20)
> > Wireless: Atheros AR9002WB-1NG Wireless Network Adapter
> > Can netmap be used with wireless connection?
> > Can it be used with my NICs?
> > I saw this on your website: " we provide an emulated mode on top of
> > standard drivers.". Even though I didn't understand it exactly, I felt
> like
> > your system can support any NIC.
> > Our project is a tracking service provider optimized in performance,
> > security and reliability. My goal is to achieve at least 1 million client
> > connections per second.
> > Could you please help me? This is kind of urgent because we have to
> finish
> > our project within next 3 months.
> > Thank you!
>
> i don't think netmap is useful for your project,
> at least unless you plan to do something very special
> (which you probably won't given the above description).
>
> cheers
> luigi
>
> > Regards,
> > Sanuri
> > ___
> > freebsd-net@freebsd.org mailing list
> > http://lists.freebsd.org/mailman/listinfo/freebsd-net
> > To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
> ___
> freebsd-net@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"


Re: netmap

2014-06-28 Thread Carlos Ferreira
Hello to all.
Unfortunately, I have been unable to do the test that Luigi requested due
to the lack of hardware. All the Gateworks Cambria SBC that I have are
currently allocated to another project. Only in about one week, will I have
the opportunity to test it.
As soon as I have news, I will post them. :)


On 28 June 2014 09:24, Luigi Rizzo  wrote:

>
>
> On Saturday, June 28, 2014, Prashant Upadhyaya 
> wrote:
>
>> Hi,
>>
>> Any further news ?
>>
>> Professor Luigi, one question regarding the tx with netmap.
>> Whenever, I write a packet from user space into netmap rings, and if I
>> want netmap to send this out immediately, do I necessarily have to do
>> a ioctl(fd, NIOCTXSYNC, NULL) ?
>>
>
> Yes it is up to the application to decide when to push packets out with a
> txsync or select() or poll(), and unfortunately there is a tradeoff between
> efficiency and latency
>
> Cheers
> Luigi
>
>
>>
>> I have an application which receives packets, does some processing and
>> then sends them out. If I keep doing ioctl's on every packet send, then
>> there will be too may system calls hitting performance, the application
>> can't afford to block it has to return back to polling for the receipt of
>> next packet.
>>
>> On the receive side, I see that I don't have a problem because I can poll
>> the ring without initiating an RXSYNC and whenever in user space I find
>> that there is nothing on the ring (probably half way down the ring size), I
>> do an RXSYNC to get more packets thus saving system calls.
>>
>> But on tx side, I have noticed that unless I do a TXSYNC, the packet does
>> not go out, please let me know if I am missing something.
>>
>> Regards
>> -Prashant
>>
>>
>>
>> On Tue, Jun 17, 2014 at 7:33 PM, Carlos Ferreira 
>> wrote:
>>
>>> Great! :)
>>> I will give you the results as soon as I can get them :)
>>>
>>>
>>>
>>> On 17 June 2014 12:55, Luigi Rizzo  wrote:
>>>
>>> > On Mon, Jun 16, 2014 at 5:30 PM, Carlos Ferreira <
>>> carlosmf...@gmail.com>
>>> > wrote:
>>> >
>>> >> Ok, thanks for the enlightenment regarding the loss of performance.
>>> >>
>>> >> One question, just to be sure. Does the kernel module contains the
>>> VALA
>>> >> switch code? Or do I need to compile extra code to have the switch
>>> working?
>>> >> Also, where can I find the documentation to use the Vala Switch?
>>> >>
>>> >
>>> > ​VALE is part of the netmap kernel module, the only thing you need
>>> > to know to use it is port names:
>>> > you can have multiple switch instances with multiple ports each,
>>> >
>>> > valeX:Y means port Y on switch X, X and Y are arbitrary strings
>>> > with the constraint that the whole name must fit 15 characters.
>>> >
>>> > Details in the netmap manpage
>>> >
>>> > cheers
>>> > luigi
>>> >
>>> >
>>>
>>>
>>> --
>>>
>>> Carlos Miguel Ferreira
>>> Researcher at Telecommunications Institute
>>> Aveiro - Portugal
>>> Work E-mail - c...@av.it.pt
>>> Skype & GTalk -> carlosmf...@gmail.com
>>> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>>> ___
>>> freebsd-net@freebsd.org mailing list
>>> http://lists.freebsd.org/mailman/listinfo/freebsd-net
>>> To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
>>>
>>
>>
>
> --
> -+---
>  Prof. Luigi RIZZO, ri...@iet.unipi.it  . Dip. di Ing. dell'Informazione
>  http://www.iet.unipi.it/~luigi/. Universita` di Pisa
>  TEL  +39-050-2211611   . via Diotisalvi 2
>  Mobile   +39-338-6809875   . 56122 PISA (Italy)
> -+---
>
>


-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"

Re: MTU not regrowing?

2014-06-24 Thread Carlos Ferreira
don't forget the header of the ping. the -s flag specifies the amount of
data that the ping carries. By specifying a size of 500, you are creating a
ping packet larger than the MTU.


On 24 June 2014 19:43, Andrea Venturoli  wrote:

> Hello.
>
> Today I experienced something weird (at least for me) on a 8.4 system:
>
> _ the system had vlan3 interface, with default MTU (1500 bytes);
> _ "ping -D -s 1400 somehost" would work, but "ping -D -s 1500 somehost"
> would yield "frag needed and DF set" (forgive me if the message is not
> exact, I don't have it anymore);
>
> _ to make some tests I reduced MTU size with "ifconfig vlan3 mtu 500";
> _ now, of course, "ping -D -s 400 somehost" would work, but "ping -D -s
> 500 somehost" would yield "frag needed and DF set";
>
> _ then I raised MTU again with "ifconfig vlan3 mtu 1500" (notice ifconfig
> would actually report this as "mtu 1500" was shown);
> _ however the results were as before, i.e. "ping -D -s 400 somehost" would
> work, but "ping -D -s 500 somehost" would yield "frag needed and DF set";
>
> _ no way I could ping with a packet bigger than 500 bytes until I rebooted.
>
> Is this expected behaviour? Any way to get around this?
>
>  bye & Thanks
> av.
> ___
> freebsd-net@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"


Re: netmap

2014-06-17 Thread Carlos Ferreira
Great! :)
I will give you the results as soon as I can get them :)



On 17 June 2014 12:55, Luigi Rizzo  wrote:

> On Mon, Jun 16, 2014 at 5:30 PM, Carlos Ferreira 
> wrote:
>
>> Ok, thanks for the enlightenment regarding the loss of performance.
>>
>> One question, just to be sure. Does the kernel module contains the VALA
>> switch code? Or do I need to compile extra code to have the switch working?
>> Also, where can I find the documentation to use the Vala Switch?
>>
>
> ​VALE is part of the netmap kernel module, the only thing you need
> to know to use it is port names:
> you can have multiple switch instances with multiple ports each,
>
> valeX:Y means port Y on switch X, X and Y are arbitrary strings
> with the constraint that the whole name must fit 15 characters.
>
> Details in the netmap manpage
>
> cheers
> luigi
>
>


-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"

Re: netmap

2014-06-17 Thread Carlos Ferreira
Just a remainder, so that the question doesn't get lost in time.


On 16 June 2014 16:30, Carlos Ferreira  wrote:

> Ok, thanks for the enlightenment regarding the loss of performance.
>
> One question, just to be sure. Does the kernel module contains the VALA
> switch code? Or do I need to compile extra code to have the switch working?
> Also, where can I find the documentation to use the Vala Switch?
>
> Once again, thank you for the support.
>
>
> On 14 June 2014 11:15, Luigi Rizzo  wrote:
>
>> On Fri, Jun 13, 2014 at 10:55:54AM +0100, Carlos Ferreira wrote:
>> > Hello Luigi (and to all)
>> >
>> > I was able to successfully compile the netmap module for OpenWRT but
>> > without drivers. According to the information in the README file which
>> > comes with the source, the drivers are not necessary but with some
>> "reduced
>> > performance".
>> >
>> > I would like to ask how much degradation should be expected. I would
>> like
>> > to run some tests to see if everything is ok and if the port was
>> successful.
>>
>> At 10Gbit we are easily talking about a 5x loss of efficiency.
>>
>> At 1Gbit probably the gap is a bit smaller, also because a
>> lot of low-end device have severe bus bandwidth limitations.
>>
>> I would be interested in seeing what kind of performance you
>> get on your openwrt box with the following commands
>>
>> 1.  just a sender on a software switch
>> pkt-gen -i vale0:a -f tx
>>
>> 2. sender and receiver on a software switch
>> pkt-gen -i vale0:a -f tx &
>> pkt-gen -i vale0:b -f rx &
>>
>> 3. sender and receiver on a netmap pipe
>> pkt-gen -i vale0:x{0 -f tx &
>> pkt-gen -i vale0:x}0 -f rx &
>>
>> 4. sending on a physical device (make sure something is attached
>>to the output port. Also this is tricky because many openwrt boxes
>>have a switch on the output so you need to use a unicast destination
>>MAC address)
>>
>> pkt-gen -i eth0 -f tx -D 00:11:22:33:44:55
>>
>> cheers
>> luigi
>>
>> >
>> > Thank you for the help!
>> >
>> >
>> >
>> > On 12 June 2014 11:48, Carlos Ferreira  wrote:
>> >
>> > > First of all, thank you for the quick answer!
>> > >
>> > > I will try it myself to compile just the netmap module without the
>> drivers
>> > > and report the results back to you.
>> > >
>> > > Once again, thank you!
>> > >
>> > >
>> > > On 12 June 2014 11:41, Luigi Rizzo  wrote:
>> > >
>> > >>
>> > >>
>> > >>
>> > >> On Thu, Jun 12, 2014 at 12:35 PM, Carlos Ferreira <
>> carlosmf...@gmail.com>
>> > >> wrote:
>> > >>
>> > >>> Hello!
>> > >>>
>> > >>> First of all, to Luigi and the dev team, great piece of work that
>> netmap
>> > >>> is! This is a piece of software that I was looking for quite some
>> time.
>> > >>> Your team effort is appreciated!
>> > >>>
>> > >>> Now the question.
>> > >>> I know that this is a FreeBSD mailing list but I was wondering,
>> since you
>> > >>> have a PKGBUILD file for ArchLinux, could someone in your team do
>> the
>> > >>> same
>> > >>> for OpenWRT? Netmap seems to be a piece of software which would
>> come in
>> > >>> handy, to develop applications and protocols for the OpenWRT distro.
>> > >>> Since OpenWRT uses uClib, I don't really know if it is possible to
>> > >>> compile
>> > >>> it.
>> > >>> Help is appreciated!
>> > >>>
>> > >>>
>> > >> ???i expect it will be trivial to compile netmap for openwrt,
>> > >> because it is just a piece of kernel code and the userspace
>> > >> has little or no dependencies.
>> > >> Another story is to write specific netmap extensions for the
>> > >> driver in use -- that might require a little bit of work
>> > >> though not much, knowing the driver.
>> > >>
>> > >> I am afraid we currently we do not have the time and manpower
>> > >> to set up a build environment and give it a try.
>> > >>
>> > >> cheers
>>

Re: netmap

2014-06-16 Thread Carlos Ferreira
Ok, thanks for the enlightenment regarding the loss of performance.

One question, just to be sure. Does the kernel module contains the VALA
switch code? Or do I need to compile extra code to have the switch working?
Also, where can I find the documentation to use the Vala Switch?

Once again, thank you for the support.


On 14 June 2014 11:15, Luigi Rizzo  wrote:

> On Fri, Jun 13, 2014 at 10:55:54AM +0100, Carlos Ferreira wrote:
> > Hello Luigi (and to all)
> >
> > I was able to successfully compile the netmap module for OpenWRT but
> > without drivers. According to the information in the README file which
> > comes with the source, the drivers are not necessary but with some
> "reduced
> > performance".
> >
> > I would like to ask how much degradation should be expected. I would like
> > to run some tests to see if everything is ok and if the port was
> successful.
>
> At 10Gbit we are easily talking about a 5x loss of efficiency.
>
> At 1Gbit probably the gap is a bit smaller, also because a
> lot of low-end device have severe bus bandwidth limitations.
>
> I would be interested in seeing what kind of performance you
> get on your openwrt box with the following commands
>
> 1.  just a sender on a software switch
> pkt-gen -i vale0:a -f tx
>
> 2. sender and receiver on a software switch
> pkt-gen -i vale0:a -f tx &
> pkt-gen -i vale0:b -f rx &
>
> 3. sender and receiver on a netmap pipe
> pkt-gen -i vale0:x{0 -f tx &
> pkt-gen -i vale0:x}0 -f rx &
>
> 4. sending on a physical device (make sure something is attached
>to the output port. Also this is tricky because many openwrt boxes
>have a switch on the output so you need to use a unicast destination
>    MAC address)
>
> pkt-gen -i eth0 -f tx -D 00:11:22:33:44:55
>
> cheers
> luigi
>
> >
> > Thank you for the help!
> >
> >
> >
> > On 12 June 2014 11:48, Carlos Ferreira  wrote:
> >
> > > First of all, thank you for the quick answer!
> > >
> > > I will try it myself to compile just the netmap module without the
> drivers
> > > and report the results back to you.
> > >
> > > Once again, thank you!
> > >
> > >
> > > On 12 June 2014 11:41, Luigi Rizzo  wrote:
> > >
> > >>
> > >>
> > >>
> > >> On Thu, Jun 12, 2014 at 12:35 PM, Carlos Ferreira <
> carlosmf...@gmail.com>
> > >> wrote:
> > >>
> > >>> Hello!
> > >>>
> > >>> First of all, to Luigi and the dev team, great piece of work that
> netmap
> > >>> is! This is a piece of software that I was looking for quite some
> time.
> > >>> Your team effort is appreciated!
> > >>>
> > >>> Now the question.
> > >>> I know that this is a FreeBSD mailing list but I was wondering,
> since you
> > >>> have a PKGBUILD file for ArchLinux, could someone in your team do the
> > >>> same
> > >>> for OpenWRT? Netmap seems to be a piece of software which would come
> in
> > >>> handy, to develop applications and protocols for the OpenWRT distro.
> > >>> Since OpenWRT uses uClib, I don't really know if it is possible to
> > >>> compile
> > >>> it.
> > >>> Help is appreciated!
> > >>>
> > >>>
> > >> ???i expect it will be trivial to compile netmap for openwrt,
> > >> because it is just a piece of kernel code and the userspace
> > >> has little or no dependencies.
> > >> Another story is to write specific netmap extensions for the
> > >> driver in use -- that might require a little bit of work
> > >> though not much, knowing the driver.
> > >>
> > >> I am afraid we currently we do not have the time and manpower
> > >> to set up a build environment and give it a try.
> > >>
> > >> cheers
> > >> luigi
> > >>
> > >>
> > >
> > >
> > > --
> > >
> > > Carlos Miguel Ferreira
> > > Researcher at Telecommunications Institute
> > > Aveiro - Portugal
> > > Work E-mail - c...@av.it.pt
> > > Skype & GTalk -> carlosmf...@gmail.com
> > > LinkedIn -> http://www.linkedin.com/in/carlosmferreira
> > >
> >
> >
> >
> > --
> >
> > Carlos Miguel Ferreira
> > Researcher at Telecommunications Institute
> > Aveiro - Portugal
> > Work E-mail - c...@av.it.pt
> > Skype & GTalk -> carlosmf...@gmail.com
> > LinkedIn -> http://www.linkedin.com/in/carlosmferreira
> > ___
> > freebsd-net@freebsd.org mailing list
> > http://lists.freebsd.org/mailman/listinfo/freebsd-net
> > To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"


Re: netmap

2014-06-13 Thread Carlos Ferreira
Hello Luigi (and to all)

I was able to successfully compile the netmap module for OpenWRT but
without drivers. According to the information in the README file which
comes with the source, the drivers are not necessary but with some "reduced
performance".

I would like to ask how much degradation should be expected. I would like
to run some tests to see if everything is ok and if the port was successful.


Thank you for the help!



On 12 June 2014 11:48, Carlos Ferreira  wrote:

> First of all, thank you for the quick answer!
>
> I will try it myself to compile just the netmap module without the drivers
> and report the results back to you.
>
> Once again, thank you!
>
>
> On 12 June 2014 11:41, Luigi Rizzo  wrote:
>
>>
>>
>>
>> On Thu, Jun 12, 2014 at 12:35 PM, Carlos Ferreira 
>> wrote:
>>
>>> Hello!
>>>
>>> First of all, to Luigi and the dev team, great piece of work that netmap
>>> is! This is a piece of software that I was looking for quite some time.
>>> Your team effort is appreciated!
>>>
>>> Now the question.
>>> I know that this is a FreeBSD mailing list but I was wondering, since you
>>> have a PKGBUILD file for ArchLinux, could someone in your team do the
>>> same
>>> for OpenWRT? Netmap seems to be a piece of software which would come in
>>> handy, to develop applications and protocols for the OpenWRT distro.
>>> Since OpenWRT uses uClib, I don't really know if it is possible to
>>> compile
>>> it.
>>> Help is appreciated!
>>>
>>>
>> ​i expect it will be trivial to compile netmap for openwrt,
>> because it is just a piece of kernel code and the userspace
>> has little or no dependencies.
>> Another story is to write specific netmap extensions for the
>> driver in use -- that might require a little bit of work
>> though not much, knowing the driver.
>>
>> I am afraid we currently we do not have the time and manpower
>> to set up a build environment and give it a try.
>>
>> cheers
>> luigi
>>
>>
>
>
> --
>
> Carlos Miguel Ferreira
> Researcher at Telecommunications Institute
> Aveiro - Portugal
> Work E-mail - c...@av.it.pt
> Skype & GTalk -> carlosmf...@gmail.com
> LinkedIn -> http://www.linkedin.com/in/carlosmferreira
>



-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"

Re: netmap

2014-06-12 Thread Carlos Ferreira
First of all, thank you for the quick answer!

I will try it myself to compile just the netmap module without the drivers
and report the results back to you.

Once again, thank you!


On 12 June 2014 11:41, Luigi Rizzo  wrote:

>
>
>
> On Thu, Jun 12, 2014 at 12:35 PM, Carlos Ferreira 
> wrote:
>
>> Hello!
>>
>> First of all, to Luigi and the dev team, great piece of work that netmap
>> is! This is a piece of software that I was looking for quite some time.
>> Your team effort is appreciated!
>>
>> Now the question.
>> I know that this is a FreeBSD mailing list but I was wondering, since you
>> have a PKGBUILD file for ArchLinux, could someone in your team do the same
>> for OpenWRT? Netmap seems to be a piece of software which would come in
>> handy, to develop applications and protocols for the OpenWRT distro.
>> Since OpenWRT uses uClib, I don't really know if it is possible to compile
>> it.
>> Help is appreciated!
>>
>>
> ​i expect it will be trivial to compile netmap for openwrt,
> because it is just a piece of kernel code and the userspace
> has little or no dependencies.
> Another story is to write specific netmap extensions for the
> driver in use -- that might require a little bit of work
> though not much, knowing the driver.
>
> I am afraid we currently we do not have the time and manpower
> to set up a build environment and give it a try.
>
> cheers
> luigi
>
>


-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"

netmap

2014-06-12 Thread Carlos Ferreira
Hello!

First of all, to Luigi and the dev team, great piece of work that netmap
is! This is a piece of software that I was looking for quite some time.
Your team effort is appreciated!

Now the question.
I know that this is a FreeBSD mailing list but I was wondering, since you
have a PKGBUILD file for ArchLinux, could someone in your team do the same
for OpenWRT? Netmap seems to be a piece of software which would come in
handy, to develop applications and protocols for the OpenWRT distro.
Since OpenWRT uses uClib, I don't really know if it is possible to compile
it.
Help is appreciated!

Once again, thank you!
-- 

Carlos Miguel Ferreira
Researcher at Telecommunications Institute
Aveiro - Portugal
Work E-mail - c...@av.it.pt
Skype & GTalk -> carlosmf...@gmail.com
LinkedIn -> http://www.linkedin.com/in/carlosmferreira
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"