Send netdisco-users mailing list submissions to
        netdisco-users@lists.sourceforge.net

To subscribe or unsubscribe via the World Wide Web, visit
        https://lists.sourceforge.net/lists/listinfo/netdisco-users
or, via email, send a message with subject or body 'help' to
        netdisco-users-requ...@lists.sourceforge.net

You can reach the person managing the list at
        netdisco-users-ow...@lists.sourceforge.net

When replying, please edit your Subject line so it is more specific
than "Re: Contents of netdisco-users digest..."
Today's Topics:

   1. Re: Install/Upgrade version 2 (Oliver Gorwits)
   2. Explanations of the four key actions (Nicolas FERNANDES)
   3. Re: Explanations of the four key actions (Oliver Gorwits)
   4. ND2 Worker configuration and Server Performance problems
      (Tobias Gerlach)
   5. Re: ND2 Worker configuration and Server Performance       problems
      (Charles Goldsmith)
--- Begin Message ---
That's great news, thanks for letting us know. :)

Regards
Oliver. 

> On 27 Mar 2015, at 19:24, Jim Glassford <jmgl...@iup.edu> wrote:
> 
> Greetings,
> 
> Finally got back on this and have had success. Wanted to say thank-you for 
> all the work put in on the product and the feed back on the email list. 
> Very much appreciated!  :-)
> 
> best!
> jim
> Built using Open Source
> 
> Software      Version
> App::Netdisco 2.032001
> DB Schema     v40
> Dancer        1.3134
> Bootstrap     2.3.1
> PostgreSQL    PostgreSQL 9.2.7 on x86_64-redhat-linux-gnu, compiled by gcc 
> (GCC) 4.8.2 20140120 (Red Hat 4.8.2-13), 64-bit.
>  DBI 1.633, DBD::Pg 2.19.3
> SNMP::Info    3.26
> Perl  5.016003
> Statistics for this installation
> 
> 
> 646 devices with 31,315 interfaces using 1,675 IPs
> 12 layer 2 links between devices
> 26,108 nodes in 37,358 entries
> 22,277 IPs in 30,500 entries
> Statistics took 1 seconds to process.
> 
> 
> 
>  
> 
>> On 10/5/2014 8:42 AM, Oliver Gorwits wrote:
>> Hi,
>> 
>> Sorry for the confusion about where to start in the docs, this will be 
>> more clear in the next release.
>> 
>> For now I suggest you delete everything in your Netdisco user's home 
>> area and then start from the instructions at the very top (including 
>> installing needed RPMs):
>> 
>> https://metacpan.org/pod/App::Netdisco
>> 
>> regards,
>> oliver,
>> 
>> On 2014-10-03 16:03, Jim Glassford wrote:
>>> Greetings,
>>> 
>>>  Trying to get Netdisco 2.007000_001 setup on RedHat SELinux
>>> 2.6.18-398.el5 running in a VM.
>>>  Had a Linux admin that setup version 1.1, just about the time 
>>> version
>>> 2 started. Since then, the admin had left for greener pastures and I
>>> just waited a while, planned to go to version 2. So I have limited
>>> knowledge on the Linux so please forgive my ignorance.
>>> 
>>>  # netdisco -v
>>>  n e t d i s c o
>>>  --------------------------------------------------
>>>  Netdisco Version : 1.1
>>>  SNMP::Info Version : 2.09
>>>  Net-SNMP Version : 5.03022
>>>  Perl Version : 5.8.8
>>> 
>>>  Following instructions at:
>>> 
>>> 
>>> <http://search.cpan.org/~oliver/App-Netdisco-2.007000_001/lib/App/Netdisco.pm#Installation>
>>> [1]
>>> 
>>>  ~~ I tried to start at the Upgrading section but had perl issue
>>> reported
>>> 
>>> 
>>> ------------------------------------------------------------------------------
>>> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
>>> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
>>> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
>>> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
>>> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
>>> _______________________________________________
>>> Netdisco mailing list
>>> netdisco-users@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/netdisco-users
> 
> ------------------------------------------------------------------------------
> Dive into the World of Parallel Programming The Go Parallel Website, sponsored
> by Intel and developed in partnership with Slashdot Media, is your hub for all
> things parallel software development, from weekly thought leadership blogs to
> news, videos, case studies, tutorials and more. Take a look and join the 
> conversation now. http://goparallel.sourceforge.net/
> _______________________________________________
> Netdisco mailing list
> netdisco-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/netdisco-users

--- End Message ---
--- Begin Message ---
Hello everyone,

I would like to know in a few words what are the following: discoverall,
macwalk, arpwalk and nbtwalk.

Thank you for your help !

Nicolas FERNANDES

--- End Message ---
--- Begin Message ---
Hi Nicolas,

On 2015-03-31 15:09, Nicolas FERNANDES wrote:
I would like to know in a few words what are the following:
discoverall, macwalk, arpwalk and nbtwalk.

Good question - I think this is missing from our docs.

You can start with this to understand Nodes and Devices:
https://metacpan.org/pod/distribution/App-Netdisco/lib/App/Netdisco/Manual/Troubleshooting.pod#Understanding-Nodes-and-Devices

Then:
discover - gather information about the switch/router itself; learn new switches/routers via neighbor protocols.
macsuck - gather MAC to port mappings
arpnip - gather MAC to IP mappings
nbtstat - gather NetBIOS names

The *walk or *all versions of these simply run the job across all known devices.

I hope this helps.

regards,
oliver.



--- End Message ---
--- Begin Message ---
Hello All,

I'm using

App::Netdisco 2.032001
DB Schema v40
Dancer 1.3132
Bootstrap 2.3.1
PostgreSQL PostgreSQL 9.1.12 on x86_64-suse-linux-gnu, compiled by gcc
(SUSE Linux) 4.3.2
 [gcc-4_3-branch revision 141291], 64-bit.
DBI 1.632, DBD::Pg 2.19.3
SNMP::Info 3.26
Perl 5.010000

in our network environment

Statistics for this installation
5,524 devices with 236,925 interfaces using 19,316 IPs 19,915 layer 2
links between devices
96,146 nodes in 161,029 entries 159,622 IPs in 528,795 entries

on a SLES 11.3 Server

8x Intel(R) Xeon(R) CPU E7- 4820  @ 2.00GHz
16 GB RAM

The problem is that after a few hours the RAM begins to swap

netdisco@server:~> free
             total       used       free     shared    buffers     cached
Mem:      16336160    1331484   15004676      34996       5732     367940
-/+ buffers/cache:     957812   15378348
Swap:     16777212     334176   16443036

as a result the server uptime is increasing and the jobs didn't finish
in proper time

netdisco@server:~> uptime
 11:59am  up 1 day 21:47,  1 user,  load average: 1.67, 2.19, 1.68

I try to play around with the worker configuration, but it looks like
that the settings are not working

~environments/deployment.yml
...
workers:
  tasks: 'AUTO * 2'
  sleep_time: 1
  queue: PostgreSQL
...

Based on 8 installed CPUs I expect 16 netdisco workers, but
independent if I increase or decrease the worker count,
all the time I see 8 workers in the process table

netdisco@server:~> ps aux | grep "netdisco-daemon: worker"
netdisco  3058  0.0  0.2 173052 43276 ?        S    11:53   0:00
netdisco-daemon: worker #1 scheduler: idle
netdisco  3059 25.8  0.4 208940 65420 ?        S    11:53   0:00
netdisco-daemon: worker #2 manager: idle
netdisco  3060 46.7  0.4 210788 68416 ?        S    11:53   0:00
netdisco-daemon: worker #3 poller: working on #16169554 ...
netdisco  3061 57.8  0.4 215476 72960 ?        S    11:53   0:01
netdisco-daemon: worker #4 poller: working on #16168032 ...
netdisco  3062 57.3  0.4 215464 72944 ?        S    11:53   0:01
netdisco-daemon: worker #5 poller: working on #16167271 ...
netdisco  3063 54.3  0.4 210628 68200 ?        S    11:53   0:01
netdisco-daemon: worker #6 poller: working on #16168522 ...
netdisco  3064 62.9  0.4 215536 72972 ?        S    11:53   0:01
netdisco-daemon: worker #7 poller: working on #16170079 ...
netdisco  3065 60.9  0.4 215224 72800 ?        S    11:53   0:01
netdisco-daemon: worker #8 poller: working on #16170677 ...
netdisco  3066 48.4  0.4 210692 68208 ?        S    11:53   0:00
netdisco-daemon: worker #9 poller: working on #16170967 ...
netdisco  3067 67.3  0.4 216832 74552 ?        R    11:53   0:01
netdisco-daemon: worker #10 poller: working on #16167410 ...


How much RAM / CPU is recommended for such network environment (see
above) and what could be the reason that the worker configurations is
not working?
Thanks in advance for any tip!



--- End Message ---
--- Begin Message ---
Tobias, that's a pretty big network.  I have not worked with ND2 on
such a size, but I have with ND1, and we had to do quite a bit of
tuning on pgsql to optimize for ram.

Have you done any tuning yet?

>From your PS, looks like the cpu's are quite busy, what process(es)
are using the most ram and causing the swap?

On Wed, Apr 1, 2015 at 4:29 AM, Tobias Gerlach <tobi...@gmail.com> wrote:
> Hello All,
>
> I'm using
>
> App::Netdisco 2.032001
> DB Schema v40
> Dancer 1.3132
> Bootstrap 2.3.1
> PostgreSQL PostgreSQL 9.1.12 on x86_64-suse-linux-gnu, compiled by gcc
> (SUSE Linux) 4.3.2
>  [gcc-4_3-branch revision 141291], 64-bit.
> DBI 1.632, DBD::Pg 2.19.3
> SNMP::Info 3.26
> Perl 5.010000
>
> in our network environment
>
> Statistics for this installation
> 5,524 devices with 236,925 interfaces using 19,316 IPs 19,915 layer 2
> links between devices
> 96,146 nodes in 161,029 entries 159,622 IPs in 528,795 entries
>
> on a SLES 11.3 Server
>
> 8x Intel(R) Xeon(R) CPU E7- 4820  @ 2.00GHz
> 16 GB RAM
>
> The problem is that after a few hours the RAM begins to swap
>
> netdisco@server:~> free
>              total       used       free     shared    buffers     cached
> Mem:      16336160    1331484   15004676      34996       5732     367940
> -/+ buffers/cache:     957812   15378348
> Swap:     16777212     334176   16443036
>
> as a result the server uptime is increasing and the jobs didn't finish
> in proper time
>
> netdisco@server:~> uptime
>  11:59am  up 1 day 21:47,  1 user,  load average: 1.67, 2.19, 1.68
>
> I try to play around with the worker configuration, but it looks like
> that the settings are not working
>
> ~environments/deployment.yml
> ...
> workers:
>   tasks: 'AUTO * 2'
>   sleep_time: 1
>   queue: PostgreSQL
> ...
>
> Based on 8 installed CPUs I expect 16 netdisco workers, but
> independent if I increase or decrease the worker count,
> all the time I see 8 workers in the process table
>
> netdisco@server:~> ps aux | grep "netdisco-daemon: worker"
> netdisco  3058  0.0  0.2 173052 43276 ?        S    11:53   0:00
> netdisco-daemon: worker #1 scheduler: idle
> netdisco  3059 25.8  0.4 208940 65420 ?        S    11:53   0:00
> netdisco-daemon: worker #2 manager: idle
> netdisco  3060 46.7  0.4 210788 68416 ?        S    11:53   0:00
> netdisco-daemon: worker #3 poller: working on #16169554 ...
> netdisco  3061 57.8  0.4 215476 72960 ?        S    11:53   0:01
> netdisco-daemon: worker #4 poller: working on #16168032 ...
> netdisco  3062 57.3  0.4 215464 72944 ?        S    11:53   0:01
> netdisco-daemon: worker #5 poller: working on #16167271 ...
> netdisco  3063 54.3  0.4 210628 68200 ?        S    11:53   0:01
> netdisco-daemon: worker #6 poller: working on #16168522 ...
> netdisco  3064 62.9  0.4 215536 72972 ?        S    11:53   0:01
> netdisco-daemon: worker #7 poller: working on #16170079 ...
> netdisco  3065 60.9  0.4 215224 72800 ?        S    11:53   0:01
> netdisco-daemon: worker #8 poller: working on #16170677 ...
> netdisco  3066 48.4  0.4 210692 68208 ?        S    11:53   0:00
> netdisco-daemon: worker #9 poller: working on #16170967 ...
> netdisco  3067 67.3  0.4 216832 74552 ?        R    11:53   0:01
> netdisco-daemon: worker #10 poller: working on #16167410 ...
>
>
> How much RAM / CPU is recommended for such network environment (see
> above) and what could be the reason that the worker configurations is
> not working?
> Thanks in advance for any tip!
>
> ------------------------------------------------------------------------------
> Dive into the World of Parallel Programming The Go Parallel Website, sponsored
> by Intel and developed in partnership with Slashdot Media, is your hub for all
> things parallel software development, from weekly thought leadership blogs to
> news, videos, case studies, tutorials and more. Take a look and join the
> conversation now. http://goparallel.sourceforge.net/
> _______________________________________________
> Netdisco mailing list
> netdisco-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/netdisco-users



--- End Message ---
------------------------------------------------------------------------------
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
_______________________________________________
Netdisco mailing list - Digest Mode
netdisco-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/netdisco-users

Reply via email to