Re: AIDE Information Overload

2002-10-22 Thread andrew lattis
On 2002/10/22 04:27:26PM +0200, Tue, Kjetil Kjernsmo wrote:
 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1
 
 Hi folks!
 
 I'd like to ask what people do with their AIDE output at times when a 
 lot of things change on their system?
 
 I've gone through the AIDE configuration, and I feel like having 
 configured it well, to catch the things that might be trojaned while 
 leaving out things that I would certainly change often.
 
 But I'm working a lot on the system these days, so the output just keeps 
 growing out of hand really quick. I get a Too Much Information problem 
 within a week of having created the database. Last night's output was 
 close to 3000 lines, but I've had up to 6 lines of output there... 
 I find it hard to keep up at all when the output exceeds a hundred 
 lines. 
 
 So, I've got to do something, but I don't really understand what. 
 aide --update, ok, but what does that really mean? It just creates a new 
 database to compare with the old, but then, I should keep the old, 
 because there are too many changes for me to keep up and be certain 
 that nothing Bad[tm] as slipped in But if I do, the problem just 
 keeps growing... 
 
 So I hope the kind folks here can offer some advice... :-) 
 
 Best,
 
 Kjetil
 - -- 
 Kjetil Kjernsmo
 Astrophysicist/IT Consultant/Skeptic/Ski-orienteer/Orienteer/Mountaineer
 [EMAIL PROTECTED]  [EMAIL PROTECTED]  [EMAIL PROTECTED]
 Homepage: http://www.kjetil.kjernsmo.net/
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v1.0.7 (GNU/Linux)
 
 iD8DBQE9tWBllE/Gp2pqC7wRAh2mAJwLpsL5PmPehawrkmOC368xMsFENQCdHevV
 w81q6a0R1km8GbjxGTcZFng=
 =sOls
 -END PGP SIGNATURE-

i've only got 20 or so servers to deal with but i know what you mean.
i use a shell script to create system backups, i added an option to it
todo an aide backup which basically consists of

'tar -cvpWf aide.$date.tar /var/lib/aide/aide.db /etc/aide/aide.conf /usr/bin/aide 
/var/cache/apt/archives/aide_*.deb'

then scp that to a backup server where it goes through my normal
process, except these files never get deleted from disk/tape. so i can always 
go back and see what happened if needed. 

i also like to keep a separate mbox for each server where i can save all
the interesting logcheck, aide, etc output.

as far as keeping things small, i usually just do a aide --update the
day after i've made any changes, i go through the output to make sure
the only changes are what i expected.

hope this helps



msg07488/pgp0.pgp
Description: PGP signature


Re: AIDE Information Overload

2002-10-22 Thread Arthur de Jong
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Tue, 22 Oct 2002, Kjetil Kjernsmo wrote:

 I'd like to ask what people do with their AIDE output at times when a
 lot of things change on their system?

 I've gone through the AIDE configuration, and I feel like having
 configured it well, to catch the things that might be trojaned while
 leaving out things that I would certainly change often.
 ...

I use aide on several machines but it is not really usefull on for example
a Debian/unstable machine or a machine that has a lot of changing files
where aide is used to inspect development files.

The approach I take is that when aide reports some changes I check that
the changes are normal, optionally change aide.conf if the changes are
regular and appropriate. After that I regenerate the database and save it
as aide.db.mmdd and provide a symlink to aide.db.

Apart from that I also use tools like debsums to keep me informed of
integrity (although a lot of packages don't provide all or correct
md5sums) (maybe I should file some bugreports for wrong md5sums)

- -- arthur - [EMAIL PROTECTED] - 
http://tiefighter.et.tudelft.nl/~arthur --
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.0.6 (GNU/Linux)

iD8DBQE9tWUfVYan35+NCKcRAvTEAJ0SUrVSNwRgo2bgGmK5ea12Yb6OdQCfXfq5
JiY7Y3OOzlClgLBqwb8bAcg=
=zYNE
-END PGP SIGNATURE-


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]




Re: AIDE Information Overload

2002-10-22 Thread Tim Haynes
Arthur de Jong [EMAIL PROTECTED] writes:

 On Tue, 22 Oct 2002, Kjetil Kjernsmo wrote:

 I'd like to ask what people do with their AIDE output at times when a
 lot of things change on their system?

 I've gone through the AIDE configuration, and I feel like having
 configured it well, to catch the things that might be trojaned while
 leaving out things that I would certainly change often.

 I use aide on several machines but it is not really usefull on for
 example a Debian/unstable machine or a machine that has a lot of changing
 files where aide is used to inspect development files.

I use it here on a basically Testing box - I've just automated the daily
upgrade process so that it re-runs aide immediately after the dist-upgrade.
That way I get all changes to important bits of the filesystem since the
last package upgrade every day in the mail. (It's partly a matter of policy
to use this script rather than wedging things by hand.)



#!/bin/sh

PATH=/sbin:/usr/sbin:/bin:/usr/bin ; export PATH

apt-get update
chmod -R og=rX /var/lib/apt/lists /var/cache/apt/archives

nice apt-get -u dist-upgrade

echo 
echo All done. Now running AIDE
echo 

cd /var/lib/aide  nice nice aide -i  mv aide.db.new aide.db  echo Cool

echo 


~Tim
-- 
http://spodzone.org.uk/


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]




Re: AIDE Information Overload

2002-10-22 Thread andrew lattis
On Tue, 22 Oct 2002, Arthur de Jong wrote:

 Apart from that I also use tools like debsums to keep me informed of
 integrity (although a lot of packages don't provide all or correct
 md5sums) (maybe I should file some bugreports for wrong md5sums)

you also might want to checkout tiger, it will run debsums and it can
check your currently installed packages for security advisories as well
as a few other general security checks. although i've never seen an
email about security advisories, so i'm either missing something or
really quick to update

i like the idea of bugreports for missing md5sums, a few i'd really like
to see are sysvinit, bash, dpkg(?)



msg07491/pgp0.pgp
Description: PGP signature


Re: AIDE Information Overload

2002-10-22 Thread Dion Mendel
Hi all,

I'm not providing an answer, but rather asking another question on
this topic.

Which files do people exclude when using integrity checkers
(e.g. aide/tripwire etc)?

Under normal system use, certain files do change
(e.g. /etc/mtab, /dev/tty*).  Including these files in the integrity
checker's database will certainly produce spurious warning about file
modification each time the checker is run.

So what files are safe to exclude?  Is it really necessary to check
for modifications to /usr/share/doc/* ?

I've used tripwire but haven't used aide, so if aide automatically
handles changeable system files this is a moot question.

Dion.

-- 
Dion's Maxim:  If you are ever surprised at just how stupid people can be,
   then you haven't understood Dion's Maxim.


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]




Re: AIDE Information Overload

2002-10-22 Thread Tim Haynes
[EMAIL PROTECTED] (Dion Mendel) writes:

 I'm not providing an answer, but rather asking another question on this
 topic.

 Which files do people exclude when using integrity checkers (e.g.
 aide/tripwire etc)?

 Under normal system use, certain files do change (e.g. /etc/mtab,

That does? Maybe on your box if you're [u]mounting things a lot, I suppose,
but that's not always the case. If it causes you hassle, ignore it by all
means :8)

 /dev/tty*). Including these files in the integrity checker's database
 will certainly produce spurious warning about file modification each time
 the checker is run.

 So what files are safe to exclude? Is it really necessary to check for
 modifications to /usr/share/doc/* ?

I would say that it's possible a file could be created in any of those
directories (c.f. where various trojans and worms and kits put their files
by default - /dev/.lib/, /usr/lib/ and so on), therefore it should be
checked. 
Run aide frequently and keep the number of files changed down by refreshing
the database every thing you dist-upgrade; also, get used to what it tells
you - e.g. /dev/console and a few others changing is indicative of a reboot,
you soon get used to identifying that.

I've compromised on avoiding checking all of:

 | zsh/scr, potato  5:06PM # grep '^!' /etc/aide/aide.conf
 | !/var/log/snort
 | !/dev/pts
 | !/var/run
 | !/home  

but anything else is most definitely being checked, with various
combinations of options as per the default config file.

 I've used tripwire but haven't used aide, so if aide automatically
 handles changeable system files this is a moot question.

It handles them if you set it up properly ;8)

~Tim
-- 
http://spodzone.org.uk/


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]




Re: AIDE Information Overload

2002-10-22 Thread Noah L. Meyerhans
On Tue, Oct 22, 2002 at 11:36:06PM +0800, Dion Mendel wrote:
 Which files do people exclude when using integrity checkers
 (e.g. aide/tripwire etc)?

I don't typically exclude many files, but I often limit the changes that
tripwire notifies me about.  For example, if one of my users changes
their password, I don't need to know that the md5 checksum of
/etc/shadow has changed.  However, if the link count, ownership, or
permissions of /etc/shadow change, I want to know about it.  Configuring
tripwire is fairly easy for this type of thing.  I'll happily share bits
of my policy file if you want.

I have very little experience with AIDE, so I don't know if it's
possible to do this type of thing with it.  I installed it for a short
while and found it unpleasant to work with.  I found tripwire to be
superior, and contarary to popular belief, it is at least as free as
AIDE.  See www.tripwire.org.  And note that this is not the same
tripwire that shipped with potato.  That version was ancient and slow
and bad.

noah

-- 
 ___
| Web: http://web.morgul.net/~frodo/
| PGP Public Key: http://web.morgul.net/~frodo/mail.html 



msg07497/pgp0.pgp
Description: PGP signature


Re: AIDE Information Overload

2002-10-22 Thread andrew lattis
On 2002/10/22 04:27:26PM +0200, Tue, Kjetil Kjernsmo wrote:
 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1
 
 Hi folks!
 
 I'd like to ask what people do with their AIDE output at times when a 
 lot of things change on their system?
 
 I've gone through the AIDE configuration, and I feel like having 
 configured it well, to catch the things that might be trojaned while 
 leaving out things that I would certainly change often.
 
 But I'm working a lot on the system these days, so the output just keeps 
 growing out of hand really quick. I get a Too Much Information problem 
 within a week of having created the database. Last night's output was 
 close to 3000 lines, but I've had up to 6 lines of output there... 
 I find it hard to keep up at all when the output exceeds a hundred 
 lines. 
 
 So, I've got to do something, but I don't really understand what. 
 aide --update, ok, but what does that really mean? It just creates a new 
 database to compare with the old, but then, I should keep the old, 
 because there are too many changes for me to keep up and be certain 
 that nothing Bad[tm] as slipped in But if I do, the problem just 
 keeps growing... 
 
 So I hope the kind folks here can offer some advice... :-) 
 
 Best,
 
 Kjetil
 - -- 
 Kjetil Kjernsmo
 Astrophysicist/IT Consultant/Skeptic/Ski-orienteer/Orienteer/Mountaineer
 [EMAIL PROTECTED]  [EMAIL PROTECTED]  [EMAIL PROTECTED]
 Homepage: http://www.kjetil.kjernsmo.net/
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v1.0.7 (GNU/Linux)
 
 iD8DBQE9tWBllE/Gp2pqC7wRAh2mAJwLpsL5PmPehawrkmOC368xMsFENQCdHevV
 w81q6a0R1km8GbjxGTcZFng=
 =sOls
 -END PGP SIGNATURE-

i've only got 20 or so servers to deal with but i know what you mean.
i use a shell script to create system backups, i added an option to it
todo an aide backup which basically consists of

'tar -cvpWf aide.$date.tar /var/lib/aide/aide.db /etc/aide/aide.conf 
/usr/bin/aide /var/cache/apt/archives/aide_*.deb'

then scp that to a backup server where it goes through my normal
process, except these files never get deleted from disk/tape. so i can always 
go back and see what happened if needed. 

i also like to keep a separate mbox for each server where i can save all
the interesting logcheck, aide, etc output.

as far as keeping things small, i usually just do a aide --update the
day after i've made any changes, i go through the output to make sure
the only changes are what i expected.

hope this helps


pgpgJcT2inL09.pgp
Description: PGP signature


Re: AIDE Information Overload

2002-10-22 Thread Arthur de Jong
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Tue, 22 Oct 2002, Kjetil Kjernsmo wrote:

 I'd like to ask what people do with their AIDE output at times when a
 lot of things change on their system?

 I've gone through the AIDE configuration, and I feel like having
 configured it well, to catch the things that might be trojaned while
 leaving out things that I would certainly change often.
 ...

I use aide on several machines but it is not really usefull on for example
a Debian/unstable machine or a machine that has a lot of changing files
where aide is used to inspect development files.

The approach I take is that when aide reports some changes I check that
the changes are normal, optionally change aide.conf if the changes are
regular and appropriate. After that I regenerate the database and save it
as aide.db.mmdd and provide a symlink to aide.db.

Apart from that I also use tools like debsums to keep me informed of
integrity (although a lot of packages don't provide all or correct
md5sums) (maybe I should file some bugreports for wrong md5sums)

- -- arthur - [EMAIL PROTECTED] - http://tiefighter.et.tudelft.nl/~arthur --
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.0.6 (GNU/Linux)

iD8DBQE9tWUfVYan35+NCKcRAvTEAJ0SUrVSNwRgo2bgGmK5ea12Yb6OdQCfXfq5
JiY7Y3OOzlClgLBqwb8bAcg=
=zYNE
-END PGP SIGNATURE-



Re: AIDE Information Overload

2002-10-22 Thread Tim Haynes
Arthur de Jong [EMAIL PROTECTED] writes:

 On Tue, 22 Oct 2002, Kjetil Kjernsmo wrote:

 I'd like to ask what people do with their AIDE output at times when a
 lot of things change on their system?

 I've gone through the AIDE configuration, and I feel like having
 configured it well, to catch the things that might be trojaned while
 leaving out things that I would certainly change often.

 I use aide on several machines but it is not really usefull on for
 example a Debian/unstable machine or a machine that has a lot of changing
 files where aide is used to inspect development files.

I use it here on a basically Testing box - I've just automated the daily
upgrade process so that it re-runs aide immediately after the dist-upgrade.
That way I get all changes to important bits of the filesystem since the
last package upgrade every day in the mail. (It's partly a matter of policy
to use this script rather than wedging things by hand.)



#!/bin/sh

PATH=/sbin:/usr/sbin:/bin:/usr/bin ; export PATH

apt-get update
chmod -R og=rX /var/lib/apt/lists /var/cache/apt/archives

nice apt-get -u dist-upgrade

echo 
echo All done. Now running AIDE
echo 

cd /var/lib/aide  nice nice aide -i  mv aide.db.new aide.db  echo Cool

echo 


~Tim
-- 
http://spodzone.org.uk/



Re: AIDE Information Overload

2002-10-22 Thread andrew lattis
On Tue, 22 Oct 2002, Arthur de Jong wrote:

 Apart from that I also use tools like debsums to keep me informed of
 integrity (although a lot of packages don't provide all or correct
 md5sums) (maybe I should file some bugreports for wrong md5sums)

you also might want to checkout tiger, it will run debsums and it can
check your currently installed packages for security advisories as well
as a few other general security checks. although i've never seen an
email about security advisories, so i'm either missing something or
really quick to update

i like the idea of bugreports for missing md5sums, a few i'd really like
to see are sysvinit, bash, dpkg(?)


pgp5vm8ANgd27.pgp
Description: PGP signature


Re: AIDE Information Overload

2002-10-22 Thread Dion Mendel
Hi all,

I'm not providing an answer, but rather asking another question on
this topic.

Which files do people exclude when using integrity checkers
(e.g. aide/tripwire etc)?

Under normal system use, certain files do change
(e.g. /etc/mtab, /dev/tty*).  Including these files in the integrity
checker's database will certainly produce spurious warning about file
modification each time the checker is run.

So what files are safe to exclude?  Is it really necessary to check
for modifications to /usr/share/doc/* ?

I've used tripwire but haven't used aide, so if aide automatically
handles changeable system files this is a moot question.

Dion.

-- 
Dion's Maxim:  If you are ever surprised at just how stupid people can be,
   then you haven't understood Dion's Maxim.



Re: AIDE Information Overload

2002-10-22 Thread Tim Haynes
[EMAIL PROTECTED] (Dion Mendel) writes:

 I'm not providing an answer, but rather asking another question on this
 topic.

 Which files do people exclude when using integrity checkers (e.g.
 aide/tripwire etc)?

 Under normal system use, certain files do change (e.g. /etc/mtab,

That does? Maybe on your box if you're [u]mounting things a lot, I suppose,
but that's not always the case. If it causes you hassle, ignore it by all
means :8)

 /dev/tty*). Including these files in the integrity checker's database
 will certainly produce spurious warning about file modification each time
 the checker is run.

 So what files are safe to exclude? Is it really necessary to check for
 modifications to /usr/share/doc/* ?

I would say that it's possible a file could be created in any of those
directories (c.f. where various trojans and worms and kits put their files
by default - /dev/.lib/, /usr/lib/ and so on), therefore it should be
checked. 
Run aide frequently and keep the number of files changed down by refreshing
the database every thing you dist-upgrade; also, get used to what it tells
you - e.g. /dev/console and a few others changing is indicative of a reboot,
you soon get used to identifying that.

I've compromised on avoiding checking all of:

 | zsh/scr, potato  5:06PM # grep '^!' /etc/aide/aide.conf
 | !/var/log/snort
 | !/dev/pts
 | !/var/run
 | !/home  

but anything else is most definitely being checked, with various
combinations of options as per the default config file.

 I've used tripwire but haven't used aide, so if aide automatically
 handles changeable system files this is a moot question.

It handles them if you set it up properly ;8)

~Tim
-- 
http://spodzone.org.uk/



Re: AIDE Information Overload

2002-10-22 Thread Noah L. Meyerhans
On Tue, Oct 22, 2002 at 11:36:06PM +0800, Dion Mendel wrote:
 Which files do people exclude when using integrity checkers
 (e.g. aide/tripwire etc)?

I don't typically exclude many files, but I often limit the changes that
tripwire notifies me about.  For example, if one of my users changes
their password, I don't need to know that the md5 checksum of
/etc/shadow has changed.  However, if the link count, ownership, or
permissions of /etc/shadow change, I want to know about it.  Configuring
tripwire is fairly easy for this type of thing.  I'll happily share bits
of my policy file if you want.

I have very little experience with AIDE, so I don't know if it's
possible to do this type of thing with it.  I installed it for a short
while and found it unpleasant to work with.  I found tripwire to be
superior, and contarary to popular belief, it is at least as free as
AIDE.  See www.tripwire.org.  And note that this is not the same
tripwire that shipped with potato.  That version was ancient and slow
and bad.

noah

-- 
 ___
| Web: http://web.morgul.net/~frodo/
| PGP Public Key: http://web.morgul.net/~frodo/mail.html 


pgpdgNEHBaFA6.pgp
Description: PGP signature