Re: [pfSense Support] snort issue w/ memory

2009-11-08 Thread Glenn Kelley

No such luck

Scott - if it helps - you guys had us (via paid support) upgrade to  
the rc version due to BGP implementation



On Nov 7, 2009, at 1:05 PM, Scott Ullrich wrote:

On Fri, Nov 6, 2009 at 10:57 PM, Glenn Kelley   
wrote:

Grace and Peace Friends:
In Snort we are seeing the following:
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried  
to

allocate 74957108 bytes) in /usr/local/pkg/snort.inc on line 1488
When we attempt to see if there are any ip addresses being blocked.
This is a bit annoying - any suggestions?


This should be resolved.   Reinstall your package 15 minutes after
this message (1:05PM EDT Saturday).

Scott

-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org




-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org



Re: [pfSense Support] snort issue w/ memory

2009-11-08 Thread Scott Ullrich
On Sat, Nov 7, 2009 at 9:53 PM, Glenn Kelley  wrote:
> No such luck
>
> Scott - if it helps - you guys had us (via paid support) upgrade to the rc
> version due to BGP implementation

Thanks, I will forward this to the snort maintainer.  Maybe he can help.

Scott

-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org



Re: [pfSense Support] snort issue w/ memory

2009-11-08 Thread Tim Dressel
How is that for open source support!

You guys rock.


On Sat, Nov 7, 2009 at 10:05 AM, Scott Ullrich  wrote:
> On Fri, Nov 6, 2009 at 10:57 PM, Glenn Kelley  wrote:
>> Grace and Peace Friends:
>> In Snort we are seeing the following:
>> Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to
>> allocate 74957108 bytes) in /usr/local/pkg/snort.inc on line 1488
>> When we attempt to see if there are any ip addresses being blocked.
>> This is a bit annoying - any suggestions?
>
> This should be resolved.   Reinstall your package 15 minutes after
> this message (1:05PM EDT Saturday).
>
> Scott
>
> -
> To unsubscribe, e-mail: support-unsubscr...@pfsense.com
> For additional commands, e-mail: support-h...@pfsense.com
>
> Commercial support available - https://portal.pfsense.org
>
>

-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org



Re: [pfSense Support] snort issue w/ memory

2009-11-08 Thread Scott Ullrich
On Sat, Nov 7, 2009 at 9:53 PM, Glenn Kelley  wrote:
> No such luck
>
> Scott - if it helps - you guys had us (via paid support) upgrade to the rc
> version due to BGP implementation

BTW: did the error message change after reinstalling the package with
my changes?

Scott

-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org



Re: [pfSense Support] snort issue w/ memory

2009-11-08 Thread Glenn Kelley

Any clue how to remove an ip that is blocked w/o having the gui ?
We uninstalled but still have some IP's blocked -
Reinstalled - same thing


On Nov 8, 2009, at 2:05 PM, Scott Ullrich wrote:

On Sat, Nov 7, 2009 at 9:53 PM, Glenn Kelley   
wrote:

No such luck

Scott - if it helps - you guys had us (via paid support) upgrade to  
the rc

version due to BGP implementation


Thanks, I will forward this to the snort maintainer.  Maybe he can  
help.


Scott

-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org




-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org



Re: [pfSense Support] snort issue w/ memory

2009-11-08 Thread Scott Ullrich
On Sun, Nov 8, 2009 at 5:39 PM, Glenn Kelley  wrote:
> Any clue how to remove an ip that is blocked w/o having the gui ?
> We uninstalled but still have some IP's blocked -
> Reinstalled - same thing

Try /usr/local/sbin/expiretable -v -t 1 virusprot

Scott

-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org



Re: [pfSense Support] throughput, haproxy

2009-11-08 Thread Lenny

Seth Mos wrote:


Lenny schreef:

But I would really like to ask again, as this is very important: will 
replacing the PCI-X NIC with PCI-e one give some boost in performance?


Unlikely, there is little reason to switch. The theoretical bandwidth 
cases are not too helpful.


The intel dual port pci-e cards are x4 ~ (4 * 250MB/s)
The intel dual port pci-x card is 64bit 133 mhz is ~ 1000MB/s

So, no you are not likely to see any improvement. If any, I suspect 
it's more of a chipset thing.


Regards,

Seth

-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org



You're kind of taking this last hope from me:)

Then what are the options for someone who has traffic more than pfSense 
can take?
For a example, a streamer with packet length of 1840 and 50kpps, that's 
700Mb.

Is there a possibility of some sort of pfSense cluster?
Because as far as I understand, I have one of the fastest CPUs on the 
market, not counting the i7 and I still can't pass more than 50kpps with 
a packet length of 600, and that's just image files.


Thanks,

Lenny.

-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org



Re: [pfSense Support] throughput, haproxy

2009-11-08 Thread Evgeny Yurchenko


From: "Lenny" 
Sent: Sunday, November 08, 2009 1:38 AM


Seth Mos wrote:


Lenny schreef:

But I would really like to ask again, as this is very important: will 
replacing the PCI-X NIC with PCI-e one give some boost in performance?


Unlikely, there is little reason to switch. The theoretical bandwidth 
cases are not too helpful.


The intel dual port pci-e cards are x4 ~ (4 * 250MB/s)
The intel dual port pci-x card is 64bit 133 mhz is ~ 1000MB/s

So, no you are not likely to see any improvement. If any, I suspect it's 
more of a chipset thing.


Regards,

Seth

-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org



You're kind of taking this last hope from me:)

Then what are the options for someone who has traffic more than pfSense 
can take?
For a example, a streamer with packet length of 1840 and 50kpps, that's 
700Mb.

Is there a possibility of some sort of pfSense cluster?
Because as far as I understand, I have one of the fastest CPUs on the 
market, not counting the i7 and I still can't pass more than 50kpps with a 
packet length of 600, and that's just image files.


Thanks,

Lenny.


Lenny,

now I am experimenting a lot trying to find out why sometimes when there is 
heavy load CARP-master switches to stand-by and never comes back. I know 
this problem is different from yours but look at the performance I get on 
pretty old hardware.


UDP-stream generator > pfSense CARP cluster on HP DL360 G3 -> 
receiver


This from receiver:
[ ID] Interval   Transfer Bandwidth   Jitter   Lost/Total 
Datagrams
[  4] 350.0-360.0 sec  1.05 GBytes903 Mbits/sec  0.013 ms   12/767479 
(0.0016%)
[ ID] Interval   Transfer Bandwidth   Jitter   Lost/Total 
Datagrams
[  4] 360.0-370.0 sec  1.05 GBytes902 Mbits/sec  0.013 ms  334/767174 
(0.044%)
[ ID] Interval   Transfer Bandwidth   Jitter   Lost/Total 
Datagrams
[  4] 370.0-380.0 sec  1.05 GBytes901 Mbits/sec  0.013 ms8/766545 
(0.001%)
[ ID] Interval   Transfer Bandwidth   Jitter   Lost/Total 
Datagrams
[  4] 380.0-390.0 sec  1.05 GBytes903 Mbits/sec  0.015 ms   19/767586 
(0.0025%)


This is on pfSense:
last pid: 44303;  load averages:  0.08,  0.02,  0.00 
up 3+07:30:11  23:14:56

89 processes:  6 running, 66 sleeping, 17 waiting
CPU:  0.1% user,  0.0% nice,  0.2% system, 15.7% interrupt, 83.9% idle
Mem: 44M Active, 10M Inact, 39M Wired, 76K Cache, 17M Buf, 1906M Free
Swap: 4096M Total, 4096M Free

 PID USERNAME  THR PRI NICE   SIZERES STATE  C   TIME   WCPU COMMAND
  13 root1 171 ki31 0K 8K CPU1   1  79.3H 100.00% idle: 
cpu1
  11 root1 171 ki31 0K 8K CPU3   3  79.3H 100.00% idle: 
cpu3
  12 root1 171 ki31 0K 8K RUN2  79.1H 100.00% idle: 
cpu2
  40 root1 -68- 0K 8K CPU0   0  30:17 54.20% irq30: 
bge1

  14 root1 171 ki31 0K 8K RUN0  78.6H 41.06% idle: cpu0
  39 root1 -68- 0K 8K WAIT   0  18:12  4.05% irq28: 
bge0


... and it results in approximately 76kpps.
And this is pretty old HP DL360 G3 with Broadcom NICs.
There must be some mystery in your set up. Your system MUST perform better.

Evgeny. 



-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org



Re: [pfSense Support] throughput, haproxy

2009-11-08 Thread Lenny

Evgeny Yurchenko wrote:



Then what are the options for someone who has traffic more than 
pfSense can take?
For a example, a streamer with packet length of 1840 and 50kpps, 
that's 700Mb.

Is there a possibility of some sort of pfSense cluster?
Because as far as I understand, I have one of the fastest CPUs on the 
market, not counting the i7 and I still can't pass more than 50kpps 
with a packet length of 600, and that's just image files.


Thanks,

Lenny.


Lenny,

now I am experimenting a lot trying to find out why sometimes when 
there is heavy load CARP-master switches to stand-by and never comes 
back. I know this problem is different from yours but look at the 
performance I get on pretty old hardware.


UDP-stream generator > pfSense CARP cluster on HP DL360 G3 -> 
receiver


This from receiver:
[ ID] Interval   Transfer Bandwidth   Jitter   Lost/Total 
Datagrams
[  4] 350.0-360.0 sec  1.05 GBytes903 Mbits/sec  0.013 ms   
12/767479 (0.0016%)
[ ID] Interval   Transfer Bandwidth   Jitter   Lost/Total 
Datagrams
[  4] 360.0-370.0 sec  1.05 GBytes902 Mbits/sec  0.013 ms  
334/767174 (0.044%)
[ ID] Interval   Transfer Bandwidth   Jitter   Lost/Total 
Datagrams
[  4] 370.0-380.0 sec  1.05 GBytes901 Mbits/sec  0.013 ms
8/766545 (0.001%)
[ ID] Interval   Transfer Bandwidth   Jitter   Lost/Total 
Datagrams
[  4] 380.0-390.0 sec  1.05 GBytes903 Mbits/sec  0.015 ms   
19/767586 (0.0025%)


This is on pfSense:
last pid: 44303;  load averages:  0.08,  0.02,  0.00 up 3+07:30:11  
23:14:56

89 processes:  6 running, 66 sleeping, 17 waiting
CPU:  0.1% user,  0.0% nice,  0.2% system, 15.7% interrupt, 83.9% idle
Mem: 44M Active, 10M Inact, 39M Wired, 76K Cache, 17M Buf, 1906M Free
Swap: 4096M Total, 4096M Free

 PID USERNAME  THR PRI NICE   SIZERES STATE  C   TIME   WCPU COMMAND
  13 root1 171 ki31 0K 8K CPU1   1  79.3H 100.00% 
idle: cpu1
  11 root1 171 ki31 0K 8K CPU3   3  79.3H 100.00% 
idle: cpu3
  12 root1 171 ki31 0K 8K RUN2  79.1H 100.00% 
idle: cpu2
  40 root1 -68- 0K 8K CPU0   0  30:17 54.20% 
irq30: bge1
  14 root1 171 ki31 0K 8K RUN0  78.6H 41.06% idle: 
cpu0
  39 root1 -68- 0K 8K WAIT   0  18:12  4.05% 
irq28: bge0


... and it results in approximately 76kpps.
And this is pretty old HP DL360 G3 with Broadcom NICs.
There must be some mystery in your set up. Your system MUST perform 
better.


Evgeny.

-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org



Evgeny,

Now I'm totally lost:(

I had this long thread this year on this issue here and eventually the 
only thing the guys could advise me is to buy a newer server. I did.  
And while I do see an improvement in performance (it's about twice it 
was before) I'm still nowhere near what you have.


I realize that your traffic is lab UDP and mine is production TCP, so 
let's say you'd get half of that in production, but then still - you're 
only on 54% CPU. By the way, how come your second NIC is only loading 
the CPU 4%? Shouldn't it be pretty much like the first one? It's what I 
have.


I'm ready to show you my config/diagrams/whatever, but I need this issue 
resolved.


Please?


Lenny.

-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org



[pfSense Support] Sticky Connections

2009-11-08 Thread Dave Warren
I'm running 1.2.3-rc3, load balancing two connections (MultiWAN, NAT
mode) shortly after enabling Sticky Connections I notice problems making
connections.

Looking through the lists this appears to be a known issue.  Is there a
workaround or is there any case where this does work or do I have
something misconfigured?


-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org



Re: [pfSense Support] Sticky Connections

2009-11-08 Thread Chris Buechler
On Mon, Nov 9, 2009 at 1:48 AM, Dave Warren
 wrote:
> I'm running 1.2.3-rc3, load balancing two connections (MultiWAN, NAT
> mode) shortly after enabling Sticky Connections I notice problems making
> connections.
>
> Looking through the lists this appears to be a known issue.  Is there a
> workaround or is there any case where this does work or do I have
> something misconfigured?
>

Don't use it with multi-WAN, it only works for server load balancing.

-
To unsubscribe, e-mail: support-unsubscr...@pfsense.com
For additional commands, e-mail: support-h...@pfsense.com

Commercial support available - https://portal.pfsense.org