Re: 9.0 release hang in quiescent X

2012-08-16 Thread Matthew Seaman
On 16/08/2012 05:45, Gary Aitken wrote:
 I've been struggling trying to ignore something and it refuses to go
 away :-(.
 
 Running 9.0 release on an amd 64 box, standard kernel, 16GB, SSD (/,
 /usr, /var, /tmp) + HDDs, visiontek 900331 graphics card (ati radeon
 hd5550).
 
 As long as I am using the system, things seem to be fine.  However,
 when I leave the system idle for an extended period of time (e.g.
 overnight, out for the day, etc.), it often refuses to return from
 whatever state it is in.  The screen is blank and in standby for
 power saving, and ctlalt Fn won't get me a console prompt.  The
 only way I know to recover is to power off and reboot.
 
 When this first happened, the file systems would come up trashed and
 I needed to manually fsck everything.  I've gotten in the habit of
 doing a sync prior to leaving the system, and they now seem to come
 up clean when I have to reboot, but that's obviously not a solution
 to the problem.
 
 Xorg.0.log shows the following errors: (EE) RADEON(0): Acceleration
 initialization failed However, the display works fine and I'm
 assuming I'm just getting slow rendering, which is ok in this case.
 
 Can someone suggest a good way to proceed to figure out what's going
 on?

Can you get network access to the machine when it gets into this state?

If you can't, that suggests the OS is hanging or crashing, possibly in
response to going into some sort of power-saving mode.

If you can get in, then there are many more possibilities.  Firstly, you
should be able to kill and restart the X server, which might get your
display back without rebooting.  Or else you could shutdown and reboot
cleanly.

As to working out what the underlying cause of the problem is: that's
harder.  I'd try experimenting with the power saving settings for your
graphics display.  If you can turn them off as a test, and the machine
then survives for an extended period of idleness, you'll have gone a
long way towards isolating the problem.

Cheers,

Matthew

-- 
Dr Matthew J Seaman MA, D.Phil.
PGP: http://www.infracaninophile.co.uk/pgpkey




signature.asc
Description: OpenPGP digital signature


Re: 9.0 release hang in quiescent X

2012-08-16 Thread Steve O'Hara-Smith
On Wed, 15 Aug 2012 22:45:47 -0600
Gary Aitken a...@dreamchaser.org wrote:

 I've been struggling trying to ignore something and it refuses to go
 away :-(.
 
 Running 9.0 release on an amd 64 box, standard kernel, 16GB, SSD
 (/, /usr, /var, /tmp) + HDDs, visiontek 900331 graphics card (ati radeon
 hd5550).  
 
 As long as I am using the system, things seem to be fine.  However, when
 I leave the system idle for an extended period of time (e.g. overnight,
 out for the day, etc.), it often refuses to return from whatever state it
 is in.  The screen is blank and in standby for power saving, and
 ctlalt Fn won't get me a console prompt.  The only way I know to
 recover is to power off and reboot.

Are you running any kind of screensaver ?

 Xorg.0.log shows the following errors:
   (EE) RADEON(0): Acceleration initialization failed
 However, the display works fine and I'm assuming I'm just getting slow
 rendering, which is ok in this case.

Sometimes the OpenGL screen saver modules crash without proper
hardware support. If you're running a screensaver try disabling it and just
using display blanking.

-- 
Steve O'Hara-Smith  |   Directable Mirror Arrays
C:WIN  | A better way to focus the sun
The computer obeys and wins.|licences available see
You lose and Bill collects. |http://www.sohara.org/
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Blender port

2012-08-16 Thread Peter Boosten
Hi All,

I've installed Blender from the ports, and it compiled fine, without any error.

However, when I start Blender (even just with a -v for version info), it core 
dumps.

So I did a ktrace, and it seems to stumble on a library it cannot find: 
libirml.so
This library however is nowhere to be found on my system, nor in the ports 
repository.

Does anyone know what this library is for, and where would I find that library?

-- 
Peter Boosten


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


RE: ZFS sharenfs problem - bug?

2012-08-16 Thread Radek Krejča
Hi again,

I take example line from manual:

zfs set sharenfs='rw=@123.123.0.0/16,root=neo' tank/home

modify it to:

zfs set sharenfs='rw=@pokus.starnet.cz,root=0' storage/pokus

and I got in messagess

Aug 16 12:04:45 storage mountd[1180]: can't get address info for host 
rw=@pokus.starnet.cz
Aug 16 12:04:45 storage mountd[1180]: bad host rw=@pokus.starnet.cz, skipping
Aug 16 12:04:45 storage mountd[1180]: can't get address info for host root=0
Aug 16 12:04:45 storage mountd[1180]: bad host root=0, skipping
Aug 16 12:04:45 storage mountd[1180]: bad exports list line 
/usr/local/storage/pokus  rw=@pokus.starnet.cz root=0

my /etc/zfs/exports
# !!! DO NOT EDIT THIS FILE MANUALLY !!!

/usr/local/storage/pokus   rw=@pokus.starnet.cz root=0

.
pokus.starnet.cz is in dns (reversible dns too), if I use IP address, the 
situation is the same.

zfs get shows:

storage/pokus  sharenfs  rw=@pokus.starnet.cz,root=0   local
storage/pokus  version   5 -

uname:

FreeBSD storage.starnet.cz 9.0-RELEASE-p4 FreeBSD 9.0-RELEASE-p4 #2: Sat Aug 11 
17:48:50 CEST 2012 r...@storage.starnet.cz:/usr/obj/usr/src/sys/GENERIC  
amd64

Where could be a problem? Is it bug or I am wrong but I dont see any mistake

Thank you
Radek
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Listing in http://www.ro.freebsd.org/gallery/pgallery.html

2012-08-16 Thread Michael Bedin
Hello,

I would like to ask you to remove link to 'niga.ru' web site from the
listing (in the subject). Now this domain does not belong me.

Thank you.

-- 
With best regards,
Mikhail U. Bedin
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Blender port

2012-08-16 Thread Polytropon
On Thu, 16 Aug 2012 11:33:22 +0200, Peter Boosten wrote:
 So I did a ktrace, and it seems to stumble on a library it cannot find: 
 libirml.so
 This library however is nowhere to be found on my system, nor in the ports 
 repository.
 
 Does anyone know what this library is for, and where would I find that 
 library?

IRML - it seems to be the Intel Resource Management Layer library.
It is a work dispatcher used by Threading Building Blocks (TBB).
The tbb port (devel/tbb) however does not contain it. No port
seems to mention it in its pkg-plist file. The google search
results are very disillusioning, even more than the typical
Linuxisms that sometimes hits a FreeBSD port... ;-)



-- 
Polytropon
Magdeburg, Germany
Happy FreeBSD user since 4.0
Andra moi ennepe, Mousa, ...
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


RE: ZFS sharenfs problem - solved, documentation bug

2012-08-16 Thread Radek Krejča
Hi again,

 I take example line from manual:
 
 zfs set sharenfs='rw=@123.123.0.0/16,root=neo' tank/home
 
 modify it to:
 
 zfs set sharenfs='rw=@pokus.starnet.cz,root=0' storage/pokus
 
 Where could be a problem? Is it bug or I am wrong but I dont see any
 mistake
 


I found solution finally on the web (and I lost week with finding solution 
:-(() 

zfs sharenfs=-maproot=0:0 pokus.starnet.cz storage/pokus

This command works but there is mistake in documentation...

Radek
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Listing in http://www.ro.freebsd.org/gallery/pgallery.html

2012-08-16 Thread Julian H. Stacey
Hi,
Reference:
 From: Michael Bedin michael.be...@gmail.com 
 Date: Thu, 16 Aug 2012 14:16:56 +0400 
 Message-id:   
 cagjtwazatmv3ssqhcg8ymewfkdhdes1_48dhvy0jqcrfo7u...@mail.gmail.com 

Michael Bedin wrote:
 Hello,
 
 I would like to ask you to remove link to 'niga.ru' web site from the
 listing (in the subject). Now this domain does not belong me.

This list is wrong address,
I  most others on this list cant do that for you.

To get it done, you need to us either:
command send-pr
or use bug report interface 
http://www.freebsd.org/support/bugreports.html
clickable from
 http://www.freebsd.org
so it gets noted permanently, so the right people see your request  act on it .
Specify category as www.

 Thank you.
 
 -- 
 With best regards,
 Mikhail U. Bedin

Cheers,
Julian
-- 
Julian Stacey, BSD Unix Linux C Sys Eng Consultants Munich http://berklix.com
 Reply below not above, cumulative like a play script,  indent with  .
 Format: Plain text. Not HTML, multipart/alternative, base64, quoted-printable.
 Mail from Yahoo  Hotmail to be dumped @Berklix.  http://berklix.org/yahoo/
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


HELP! core dumps: install, mtree, et cetera all of the sudden after portmaster security/cyrus-sasl2

2012-08-16 Thread Hartmann, O.

I ran into a very delicate and nasty situation.

On several boxes, FreeBSD 9.1-PRE and FreeBSD 10-CURRENT (build of
CURRENT sources from yesterday, r239295 Wed August 15 17:04:51 CEST 2012
amd64, I had to recompile all requirements of port Apache22, since after
the port update it core dumped.

On FreeBSD 9.1-PRE, with pkg(ng), things went well. Recompilation and
installation of all portmaster -f apache-2.2 requirements went perfect.

On both FreeBSD 10-CURRENT boxes it ended up in a mess, all of a
sudden(!), while reinstalling port security/cyrus-sasl2, things started
to fail in a dramatik way!

On both FBSD 10 boxes, the installation of the port security/cyrus-sasl2
got corrupted by install and/or mtree dumping core and signalling
SIGNAL 11. Booting into multiuser mode is impossible, login core dumps
SIGNAL 11, many other daemons, too. The only way is to boot into single
user mode.

An installation failed due to pkg(ng) was missing libarchive.so via
portmaster or via core dumping install(1). By installing on one box, my
home box, port security/cyrus-sasl2 manually, luckily install(1) and
mtree(1) didn't coredump and it worked - and this precedure rescued me.
But on my lab's development box, it doesn't work!

On this specific box, where this nasty problem also occured the same way
by simply recompiling everything for port www/apache22, including the
reinstallation of port security/cyrus-sasl2. Nearly every binary is
suddenly coredumping (as on the home box). login, vi, install, devfs,
syslogd, mtree, id, find ... a whole lot of binaries seem to be
compromised by something I do not see (libsasl2.so perhaps?).

I tried to help myself via copying /rescue/vi to /usr/bin/vi to have at
least a working vi. But in /rescue, I can not find install or mtree. I'm
not familiar with the sophisticated ways of /rescue. Where are
install(1) and mtree(1)?

Trying to reinstall security/cyrus-sasl2 from single-user fails due
install coredumps. pkg(ng) fails due to missing libpkg.so.5 and even
rejects being reinstalled. But /usr/local/lib/libpkg.so.0 is even there!
Disabling the use of pkg with commenting out WITH_PKGNG=yes in
/etc/make.conf leads to the above issues with mtree and install.
Disabling this pkgng tag leads to reinstallation of missing packages,
which are store in the pkgng sqlite format and not as ASCII anymore, but
then I get
/var/runld-elf.so.hints: No such file or directory
Error: shared library iconv.3 does not exist.

But most of the libs have never been touch! So what is the loader
complaining about?

Well, I'm floating like a dead man in the water and I'm glad that one
box survided although suffering from the same symptomes.

I tried to find rescue images and a rescue DVD of a snap shot server,
but there is no way to crawl through the informations on the web pages
towards a snapshot. All folders end up in 2011 and highly outdated
(www.freebsd.org, I didn't look at mirrors since I thought the main
server carries the most recent stuff). This isn't funny. No lead, no
hint, even in the download section.

If someone has some hints how to recompile the sources with an emergency
booted disk, I highly appreciate some desater advice. Maybe the release
of FreeBSD-10-CURRENT sources I compiled do have accidentally a nasty
bug, so it would be nice to update the sources and have a complete
recompilation done.

Thanks in advance,

oh
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: HELP! core dumps: install, mtree, et cetera all of the sudden after portmaster security/cyrus-sasl2

2012-08-16 Thread Glen Barber
On Thu, Aug 16, 2012 at 05:33:20PM +0200, Hartmann, O. wrote:
 
 I ran into a very delicate and nasty situation.
 
 On several boxes, FreeBSD 9.1-PRE and FreeBSD 10-CURRENT (build of
 CURRENT sources from yesterday, r239295 Wed August 15 17:04:51 CEST 2012
 amd64, I had to recompile all requirements of port Apache22, since after
 the port update it core dumped.
 
 On FreeBSD 9.1-PRE, with pkg(ng), things went well. Recompilation and
 installation of all portmaster -f apache-2.2 requirements went perfect.
 
 On both FreeBSD 10-CURRENT boxes it ended up in a mess, all of a
 sudden(!), while reinstalling port security/cyrus-sasl2, things started
 to fail in a dramatik way!
 
 On both FBSD 10 boxes, the installation of the port security/cyrus-sasl2
 got corrupted by install and/or mtree dumping core and signalling
 SIGNAL 11. Booting into multiuser mode is impossible, login core dumps
 SIGNAL 11, many other daemons, too. The only way is to boot into single
 user mode.
 
 An installation failed due to pkg(ng) was missing libarchive.so via

There is pkg-static for recovering in this type of situation.

 portmaster or via core dumping install(1). By installing on one box, my
 home box, port security/cyrus-sasl2 manually, luckily install(1) and
 mtree(1) didn't coredump and it worked - and this precedure rescued me.
 But on my lab's development box, it doesn't work!
 
 On this specific box, where this nasty problem also occured the same way
 by simply recompiling everything for port www/apache22, including the
 reinstallation of port security/cyrus-sasl2. Nearly every binary is
 suddenly coredumping (as on the home box). login, vi, install, devfs,
 syslogd, mtree, id, find ... a whole lot of binaries seem to be
 compromised by something I do not see (libsasl2.so perhaps?).
 
 I tried to help myself via copying /rescue/vi to /usr/bin/vi to have at
 least a working vi. But in /rescue, I can not find install or mtree. I'm
 not familiar with the sophisticated ways of /rescue. Where are
 install(1) and mtree(1)?
 
 Trying to reinstall security/cyrus-sasl2 from single-user fails due
 install coredumps. pkg(ng) fails due to missing libpkg.so.5 and even
 rejects being reinstalled. But /usr/local/lib/libpkg.so.0 is even there!
 Disabling the use of pkg with commenting out WITH_PKGNG=yes in
 /etc/make.conf leads to the above issues with mtree and install.
 Disabling this pkgng tag leads to reinstallation of missing packages,
 which are store in the pkgng sqlite format and not as ASCII anymore, but
 then I get
 /var/runld-elf.so.hints: No such file or directory

Is this a typo, or literal transcription?  (The missing / between
'run' and 'ld-elf.so.hints', that is.)

 Error: shared library iconv.3 does not exist.
 
 But most of the libs have never been touch! So what is the loader
 complaining about?
 
 Well, I'm floating like a dead man in the water and I'm glad that one
 box survided although suffering from the same symptomes.
 
 I tried to find rescue images and a rescue DVD of a snap shot server,
 but there is no way to crawl through the informations on the web pages
 towards a snapshot. All folders end up in 2011 and highly outdated
 (www.freebsd.org, I didn't look at mirrors since I thought the main
 server carries the most recent stuff). This isn't funny. No lead, no
 hint, even in the download section.
 

Yes, I have been complaining about this for a while now...

 If someone has some hints how to recompile the sources with an emergency
 booted disk, I highly appreciate some desater advice. Maybe the release
 of FreeBSD-10-CURRENT sources I compiled do have accidentally a nasty
 bug, so it would be nice to update the sources and have a complete
 recompilation done.
 

If you can get booted into a recovery medium, you can mount /usr/src and
/usr/obj from the hosed system, and should be able to
installworld/installkernel into the hosed system with DESTDIR set.

Glen

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Best file system for a busy webserver

2012-08-16 Thread Paul Schmehl
Does anyone have any opinions on which file system is best for a busy 
webserver (7 million hits/month)?  Is anyone one system noticeably better 
than any other?


Just curious.  I'm getting ready to setup a new box running FreeBSD 9, and 
since I'm starting from scratch, I'm questioning all my previous 
assumptions.


--
Paul Schmehl, Senior Infosec Analyst
As if it wasn't already obvious, my opinions
are my own and not those of my employer.
***
It is as useless to argue with those who have
renounced the use of reason as to administer
medication to the dead. Thomas Jefferson
There are some ideas so wrong that only a very
intelligent person could believe in them. George Orwell

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: HELP! core dumps: install, mtree, et cetera all of the sudden after portmaster security/cyrus-sasl2

2012-08-16 Thread Bryan Drewery
On 8/16/2012 10:33 AM, Hartmann, O. wrote:
 I tried to find rescue images and a rescue DVD of a snap shot server,
 but there is no way to crawl through the informations on the web pages
 towards a snapshot. All folders end up in 2011 and highly outdated
 (www.freebsd.org, I didn't look at mirrors since I thought the main
 server carries the most recent stuff). This isn't funny. No lead, no
 hint, even in the download section.

http://pub.allbsd.org/FreeBSD-snapshots/

Bryan
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Best file system for a busy webserver

2012-08-16 Thread Wojciech Puchar
Does anyone have any opinions on which file system is best for a busy 
webserver (7 million hits/month)?  Is anyone one system noticeably better 
than any other?


Use stock UFS, just configure it properly. most importantly noatime.

Amount of cached data is more important than hit count. Unless your 
webpage is incredibly bad design or constantly load different set of large 
amount of small file - filesystem shouldn't be a limit.


Repetitive file fetches would go from cache.

Just curious.  I'm getting ready to setup a new box running FreeBSD 9, and 
since I'm starting from scratch, I'm questioning all my previous assumptions.


Small files will be cached, if you push data from large set of big files 
that will not fit cache, make sure transfers will be fine.


use 32kB block size, 4kB fragment size for UFS

add

options MAXPHYS=2097152

(or even twice of that) to your kernel config so there will be large 
transfers from disk.


This tuning will not make any harm to small files.


My recommendation is for serving files by WWW (or actually - by any 
means).


If you ask for SQL database subsystem then answer is completely different:

make sure all database fits memory cache, or is on SSD or it WILL BE SLOW 
no matter what you use.


Do everything you can to limit amount of sync writes.

if you use SSD and your database software allow dedicating raw partition - 
do it. If not - it is not crucial but useful, avoid double buffering of 
unix cache and database cache.

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Best file system for a busy webserver

2012-08-16 Thread Steve O'Hara-Smith
On Thu, 16 Aug 2012 10:45:25 -0500
Paul Schmehl pschmehl_li...@tx.rr.com wrote:

 Does anyone have any opinions on which file system is best for a busy 
 webserver (7 million hits/month)?  Is anyone one system noticeably better 
 than any other?

That's an average of about 3 hits per second. If it's static pages
then pretty much anything will handle it easily (but please don't use FAT).
If it's dynamic then the whole problem is more complex than a simple page
rate. If that load is bursty it may make a difference too.

Other considerations may come into play - how big is this
filesystem (number of files, maximum number of entries in a directory,
volume of data) ? Are there many users needing to be protected from each
other ? What about archives ? snapshots ? growth ? churn ? uptime
requirements, disaster recovery time ?

-- 
Steve O'Hara-Smith  |   Directable Mirror Arrays
C:WIN  | A better way to focus the sun
The computer obeys and wins.|licences available see
You lose and Bill collects. |http://www.sohara.org/
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Best file system for a busy webserver

2012-08-16 Thread Robert Bonomi

 Date: Thu, 16 Aug 2012 10:45:25 -0500
 From: Paul Schmehl pschmehl_li...@tx.rr.com
 To: FreeBSD Questions List freebsd-questions@freebsd.org
 Subject: Best file system for a busy webserver

 Does anyone have any opinions on which file system is best for a busy 
 webserver (7 million hits/month)?  Is anyone one system noticeably better 
 than any other?

 Just curious.  I'm getting ready to setup a new box running FreeBSD 9, and 
 since I'm starting from scratch, I'm questioning all my previous 
 assumptions.

Insufficient data for a meaningful answer.

A _LOT_ depends on the natue of the pages being served, 

Is the underlying data fairly 'static', or is it being frequently updated?

If 'updated', you need to take into consideration things like 'how often',
'how large', and 'how localized' (in terms of the filesystem structure),
are the updates.

If file access is almost exclusively reads, the filesystem choice doesn't
make much difference O/S 'caching', which occurs above the filesystem level,
will handle the 'most frequently accessed' stuff.

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: ZFS stats in top -- ZFS performance started being crappy in spurts

2012-08-16 Thread Chad Leigh Shire.Net LLC

On Aug 11, 2012, at 5:33 PM, Chad Leigh - Pengar LLC wrote:

 Hi
 
 I have a FreeBSD 9 system with ZFS root.  It is actually a VM under Xen on a 
 beefy piece of HW (4 core Sandy Bridge 3ghz Xeon, total HW memory 32GB -- VM 
 has 4vcpus and 6GB RAM).  Mirrored gpart partitions.  I am looking for data 
 integrity more than performance as long as performance is reasonable (which 
 it has more than been the last 3 months).
 
 The other servers on the same HW, the other VMs on the same, don't have 
 this problem but are set up the same way.  There are 4 other FreeBSD VMs, one 
 running email for a one man company and a few of his friends, as well as some 
 static web pages and stuff for him, one runs a few low use web apps for 
 various customers, and one runs about 30 websites with apache and nginx, 
 mostly just static sites.  None are heavily used.  There is also one VM with 
 linux running a couple low use FrontBase databases.   Not high use database 
 -- low use ones.
 
 The troubleseome VM  has been running fine for over 3 months since I 
 installed it.Level of use has been pretty much constant.   The server 
 runs 4 jails on it, each dedicated to a different bit of email processing for 
 a small number of users.   One is a secondary DNS.  One runs clamav and 
 spamassassin.  One runs exim for incoming and outgoing mail.  One runs 
 dovecot for imap and pop.   There is no web server or database or anything 
 else running.
 
 Total number of mail users on the system is approximately 50, plus or minus.  
 Total mail traffic is very low compared to real mail servers.
 
 Earlier this week things started freezing up.  It might last a few minutes, 
 or it might last 1/2 hour.   Processes become unresponsive.  This can last a 
 few minutes or much longer.  It eventually resolves itself and things are 
 good for another 10 minutes or 3 hours until it happens again.  When it 
 happens,  lots of processes are listed in top as 
 
 zfs
 zio-i
 zfs
 tx-tx
 db-db
 
 state.   These processes only get listed in these states when there are 
 problems.   What are these states indicative of?
 

Ok, after much reading of ZFS blog posts, forum postings, email list postings, 
and trying stuff out, I seem to have gotten stuff back down to normal and 
reasonable performance.

In case anyone has similar issues in a similar circumstance, here is what I 
did.  Some of these may have had little or no effect but this is what was 
changed.

The biggest effect was when I did the following:

vfs.zfs.zfetch.block_cap  from default 256 down to 64

This was like night and day.  The idea to try this from a post by user 
madtrader in the forum 
http://forums.sagetv.com/forums/showthread.php?t=43830page=2  .  He was 
recording multiple streams of HD video and trying to play HD video off a stream 
from the same server/ZFS file system.  


Also, setting

vfs.zfs.write_limit_override   to something other than the default disabled 0 
seems to have had a relatively significant effect.   Before I worked with the  
block_cap above, I was focussing on this and had tried everything from 64M to 
768M.  It is currently set to 576M and is around the area where I was having 
best results on my system with my amount of RAM (6GB).  I tried 512M and had 
good results and then 768M, which was still good but not quite as good as far 
as I could tell from testing.  So I went with 576M on my last attempt and then 
added in the block_cap and things really are pretty much back to normal.


I turned on vdev caching

vfs.zfs.vdev.cache.size   form 0 to 10M.   Don't know if it helped.  

I also lowered 

vfs.zfs.txg.timeout   from 5 to 3.   This seems to have had a slightly 
noticeable effect.


I also adjusted


vfs.zfs.arc_max

The default of 0 (meaning system self set) seemed to result in an actual value 
of around 75-80% of RAM, which seemed high.   I ended up setting it at 3072M, 
which for me seems to work well.  Don't know what the overall effect on the 
problem was though.


Thanks
Chad




Re: Best file system for a busy webserver

2012-08-16 Thread Paul Schmehl
--On August 16, 2012 6:02:57 PM +0100 Steve O'Hara-Smith st...@sohara.org 
wrote:



On Thu, 16 Aug 2012 10:45:25 -0500
Paul Schmehl pschmehl_li...@tx.rr.com wrote:


Does anyone have any opinions on which file system is best for a busy
webserver (7 million hits/month)?  Is anyone one system noticeably
better  than any other?


That's an average of about 3 hits per second. If it's static pages
then pretty much anything will handle it easily (but please don't use
FAT). If it's dynamic then the whole problem is more complex than a
simple page rate. If that load is bursty it may make a difference too.



Thanks for the reply.  It's a combination.  There are many static pages, 
but there is also a php-mysql forum that generates pages on the fly.  It 
accounts for about half of the traffic.  I've always used ufs but am 
wondering if switching to zfs would make sense.


This stats page might answer some of your questions: 
http://www.stovebolt.com/stats/


Basically traffic is steady but it's busiest in the evenings (US time zones)


Other considerations may come into play - how big is this
filesystem (number of files, maximum number of entries in a directory,
volume of data) ? Are there many users needing to be protected from each
other ? What about archives ? snapshots ? growth ? churn ? uptime
requirements, disaster recovery time ?


I don't even know where to begin.  There's about 15G of data on the server.

Maybe this will help answer your questions:
# sysctl -a | grep file
kern.maxfiles: 12328
kern.bootfile: /boot/kernel/kernel
kern.maxfilesperproc: 11095
kern.openfiles: 492
kern.corefile: %N.core
kern.filedelay: 30
p1003_1b.mapped_files: 1

last pid: 40369;  load averages:  0.01,  0.03,  0.00 
up 104+09:33:44 13:14:49

137 processes: 1 running, 136 sleeping
CPU:  0.7% user,  0.0% nice,  0.1% system,  0.0% interrupt, 99.2% idle
Mem: 229M Active, 6108M Inact, 1056M Wired, 15M Cache, 828M Buf, 514M Free
Swap: 16G Total, 28K Used, 16G Free

The system is not being stressed.

If by users, you means shell accounts, there's two, so that's not really an 
issue.  The site has grown organically over the years from a few hundred 
hits a month to the now 6-8 million hits (depends on the time of year and 
the weather - mechanics are usually out in the garage if it's sunny and on 
the computer when it's not).


Uptime is not an issue.  The owners have repeatedly said if the site is 
down for two days they don't care.  (The forum users don't feel that way 
though!)  We've had one disaster (hard drive failure and raid failed 
while I was on vacation), and it took about 36 hours to get back online, 
but that was 10 years ago.  The site doesn't go down - it's running on 
FreeBSD. :-)


--
Paul Schmehl, Senior Infosec Analyst
As if it wasn't already obvious, my opinions
are my own and not those of my employer.
***
It is as useless to argue with those who have
renounced the use of reason as to administer
medication to the dead. Thomas Jefferson
There are some ideas so wrong that only a very
intelligent person could believe in them. George Orwell

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


HELP! core dumps: install, mtree, et cetera all of the sudden after portmaster security/cyrus-sasl2

2012-08-16 Thread O. Hartmann
I ran into a very delicate and nasty situation.

On several boxes, FreeBSD 9.1-PRE and FreeBSD 10-CURRENT (build of
CURRENT sources from yesterday, r239295 Wed August 15 17:04:51 CEST 2012
amd64, I had to recompile all requirements of port Apache22, since after
the port update it core dumped.

On FreeBSD 9.1-PRE, with pkg(ng), things went well. Recompilation and
installation of all portmaster -f apache-2.2 requirements went perfect.

On both FreeBSD 10-CURRENT boxes it ended up in a mess, all of a
sudden(!), while reinstalling port security/cyrus-sasl2, things started
to fail in a dramatik way!

On both FBSD 10 boxes, the installation of the port security/cyrus-sasl2
got corrupted by install and/or mtree dumping core and signalling
SIGNAL 11. Booting into multiuser mode is impossible, login core dumps
SIGNAL 11, many other daemons, too. The only way is to boot into single
user mode.

An installation failed due to pkg(ng) was missing libarchive.so via
portmaster or via core dumping install(1). By installing on one box, my
home box, port security/cyrus-sasl2 manually, luckily install(1) and
mtree(1) didn't coredump and it worked - and this precedure rescued me.
But on my lab's development box, it doesn't work!

On this specific box, where this nasty problem also occured the same way
by simply recompiling everything for port www/apache22, including the
reinstallation of port security/cyrus-sasl2. Nearly every binary is
suddenly coredumping (as on the home box). login, vi, install, devfs,
syslogd, mtree, id, find ... a whole lot of binaries seem to be
compromised by something I do not see (libsasl2.so perhaps?).

I tried to help myself via copying /rescue/vi to /usr/bin/vi to have at
least a working vi. But in /rescue, I can not find install or mtree. I'm
not familiar with the sophisticated ways of /rescue. Where are
install(1) and mtree(1)?

Trying to reinstall security/cyrus-sasl2 from single-user fails due
install coredumps. pkg(ng) fails due to missing libpkg.so.5 and even
rejects being reinstalled. But /usr/local/lib/libpkg.so.0 is even there!
Disabling the use of pkg with commenting out WITH_PKGNG=yes in
/etc/make.conf leads to the above issues with mtree and install.
Disabling this pkgng tag leads to reinstallation of missing packages,
which are store in the pkgng sqlite format and not as ASCII anymore, but
then I get
/var/runld-elf.so.hints: No such file or directory
Error: shared library iconv.3 does not exist.

But most of the libs have never been touch! So what is the loader
complaining about?

Well, I'm floating like a dead man in the water and I'm glad that one
box survided although suffering from the same symptomes.

I tried to find rescue images and a rescue DVD of a snap shot server,
but there is no way to crawl through the informations on the web pages
towards a snapshot. All folders end up in 2011 and highly outdated
(www.freebsd.org, I didn't look at mirrors since I thought the main
server carries the most recent stuff). This isn't funny. No lead, no
hint, even in the download section.

If someone has some hints how to recompile the sources with an emergency
booted disk, I highly appreciate some desater advice. Maybe the release
of FreeBSD-10-CURRENT sources I compiled do have accidentally a nasty
bug, so it would be nice to update the sources and have a complete
recompilation done.

Thanks in advance,

oh



signature.asc
Description: OpenPGP digital signature


Re: Best file system for a busy webserver

2012-08-16 Thread Robert Huff

Paul Schmehl writes:

  That's an average of about 3 hits per second. If it's static pages
   then pretty much anything will handle it easily (but please don't use
   FAT). If it's dynamic then the whole problem is more complex than a
   simple page rate. If that load is bursty it may make a difference too.
  
  
  Thanks for the reply.  It's a combination.  There are many static
  pages, but there is also a php-mysql forum that generates pages
  on the fly.  It accounts for about half of the traffic.  I've
  always used ufs but am wondering if switching to zfs would make
  sense.

ZFS is known to use much more RAM than UFS.  While (from the
'top' below) you have enough ... is that RAM best used for ZFS, or
for something else?


Robert Huff

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Blender port

2012-08-16 Thread Fernando Apesteguía
On Thu, Aug 16, 2012 at 12:29 PM, Polytropon free...@edvax.de wrote:
 On Thu, 16 Aug 2012 11:33:22 +0200, Peter Boosten wrote:
 So I did a ktrace, and it seems to stumble on a library it cannot find: 
 libirml.so
 This library however is nowhere to be found on my system, nor in the ports 
 repository.

 Does anyone know what this library is for, and where would I find that 
 library?

No port seems to install that library (at least according to pkg-plist files).
Maybe you could file a PR


 IRML - it seems to be the Intel Resource Management Layer library.
 It is a work dispatcher used by Threading Building Blocks (TBB).
 The tbb port (devel/tbb) however does not contain it. No port
 seems to mention it in its pkg-plist file. The google search
 results are very disillusioning, even more than the typical
 Linuxisms that sometimes hits a FreeBSD port... ;-)



 --
 Polytropon
 Magdeburg, Germany
 Happy FreeBSD user since 4.0
 Andra moi ennepe, Mousa, ...
 ___
 freebsd-questions@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-questions
 To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Blender port

2012-08-16 Thread Peter Boosten

On 16 aug. 2012, at 21:17, Fernando Apesteguía fernando.apesteg...@gmail.com 
wrote:

 On Thu, Aug 16, 2012 at 12:29 PM, Polytropon free...@edvax.de wrote:
 On Thu, 16 Aug 2012 11:33:22 +0200, Peter Boosten wrote:
 So I did a ktrace, and it seems to stumble on a library it cannot find: 
 libirml.so
 This library however is nowhere to be found on my system, nor in the ports 
 repository.
 
 Does anyone know what this library is for, and where would I find that 
 library?
 
 No port seems to install that library (at least according to pkg-plist files).
 Maybe you could file a PR


I sent an email to the maintainer... see what he/she's got to say.

-- 
Peter Boosten




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


can a jail have link to outside of the jail?

2012-08-16 Thread Len Conrad

I have an ssh user who needs only to search some log files not in his jail. The 
jail required because I don't want the user seeing the rest the machine.  If 
the dirs were linked to his jail, would that work? 

What I'd really like is something like ftpchroot for but ssh.

suggestions?

Len


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: HELP! core dumps: install, mtree, et cetera all of the sudden after portmaster security/cyrus-sasl2

2012-08-16 Thread Garrett Cooper
On Thu, Aug 16, 2012 at 11:33 AM, O. Hartmann
ohart...@zedat.fu-berlin.de wrote:
 I ran into a very delicate and nasty situation.

Please don't cross-post / double-post.
Thanks,
-Garrett
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: HELP! core dumps: install, mtree, et cetera all of the sudden after portmaster security/cyrus-sasl2

2012-08-16 Thread Garrett Cooper
On Thu, Aug 16, 2012 at 8:33 AM, Hartmann, O.
ohart...@zedat.fu-berlin.de wrote:

 I ran into a very delicate and nasty situation.

...

 On both FBSD 10 boxes, the installation of the port security/cyrus-sasl2
 got corrupted by install and/or mtree dumping core and signalling
 SIGNAL 11. Booting into multiuser mode is impossible, login core dumps
 SIGNAL 11, many other daemons, too. The only way is to boot into single
 user mode.

I'm not drawing a correlation between this and unrelated coredumping processes.

 An installation failed due to pkg(ng) was missing libarchive.so via
 portmaster or via core dumping install(1). By installing on one box, my
 home box, port security/cyrus-sasl2 manually, luckily install(1) and
 mtree(1) didn't coredump and it worked - and this precedure rescued me.
 But on my lab's development box, it doesn't work!

Don't make delete-old-lib unless you have it moved off to compat
directories, or have rebuilt everything using the new libarchive.

 On this specific box, where this nasty problem also occured the same way
 by simply recompiling everything for port www/apache22, including the
 reinstallation of port security/cyrus-sasl2. Nearly every binary is
 suddenly coredumping (as on the home box). login, vi, install, devfs,
 syslogd, mtree, id, find ... a whole lot of binaries seem to be
 compromised by something I do not see (libsasl2.so perhaps?).

truss the binaries to figure out exactly what's going wrong.

A lot of this lost effort could be avoided (like others have posted on
the list more than once), by having a centralized package distribution
server, and by having VMs or jails and keeping snapshots with
pre-upgrade state on the package building machine to avoid dead in
the water scenarios like you're in right now.

 I tried to help myself via copying /rescue/vi to /usr/bin/vi to have at
 least a working vi. But in /rescue, I can not find install or mtree. I'm
 not familiar with the sophisticated ways of /rescue. Where are
 install(1) and mtree(1)?

I ran into this issue too a little while ago. I basically gave up on
recovering a VM and nuked and repaved it using a LiveCD with a chroot,
some cp -p'ing, etc. But yes.. it would be nice if I could have
recovered the system at least with a static toolchain: cc, binutils
[equivalent], mtree, install, etc.

...

 Disabling this pkgng tag leads to reinstallation of missing packages,
 which are store in the pkgng sqlite format and not as ASCII anymore, but
 then I get
 /var/runld-elf.so.hints: No such file or directory
 Error: shared library iconv.3 does not exist.

service ldconfig start ?

 But most of the libs have never been touch! So what is the loader
 complaining about?

...

 I tried to find rescue images and a rescue DVD of a snap shot server,
 but there is no way to crawl through the informations on the web pages
 towards a snapshot. All folders end up in 2011 and highly outdated
 (www.freebsd.org, I didn't look at mirrors since I thought the main
 server carries the most recent stuff). This isn't funny. No lead, no
 hint, even in the download section.

 If someone has some hints how to recompile the sources with an emergency
 booted disk, I highly appreciate some desater advice. Maybe the release
 of FreeBSD-10-CURRENT sources I compiled do have accidentally a nasty
 bug, so it would be nice to update the sources and have a complete
 recompilation done.

 Thanks in advance,

Simply put: fix your infrastructure (as this isn't the first time
you have complained about infrastructure issues on the MLs). A lot of
these issues should not be issues if you set up your infrastructure
properly to deal with building things only once, backup packages
before installation, you had snapshots of your system, etc. This will
help you avoid administration pain, and hopefully will result in less
duplicated work.

Cheers,
-Garrett
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: can a jail have link to outside of the jail?

2012-08-16 Thread Jeff Tipton

On 08/16/2012 21:51, Len Conrad wrote:

I have an ssh user who needs only to search some log files not in his jail. The 
jail required because I don't want the user seeing the rest the machine.  If 
the dirs were linked to his jail, would that work?

What I'd really like is something like ftpchroot for but ssh.

suggestions?

Len


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
It's not clear from what you are writing whether you mean JAIL(8) (a 
secure, virtual FreeBSD OS on top of host OS) or chrooted directories. 
Anyway, ssh can be set up very easily to have some chrooted sftp users. 
Read this:


https://calomel.org/sftp_chroot.html

You will probably have to think about where to place the log directory 
it if it's important to have no other logs in it.


-Jeff
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: can a jail have link to outside of the jail?

2012-08-16 Thread Devin Teske

On Aug 16, 2012, at 11:51 AM, Len Conrad wrote:

 
 I have an ssh user who needs only to search some log files not in his jail. 
 The jail required because I don't want the user seeing the rest the machine.  
 If the dirs were linked to his jail, would that work? 
 

To show a directory from a base-host to a member-jail, I'd recommend using a 
nullfs-mount.

Furthermore, you can automate the process in 2 different ways (scoped 
differently depending on how you use jails).

You can add jail_{name}_mount_enable=YES to rc.conf(5) which enables the 
automatic handling of /etc/fstab.{name} every time you perform a service jail 
start|stop|restart {name} (the mount will automatically be mounted and 
unmounted on-demand of bringing the jail up-and-down irrespective of the base 
host but respective to each jail). You'd load you /etc/fstab.{name} with your 
nullfs mounts.

The second way is of course is to put all your nullfs mounts into /etc/fstab 
(proper) but mark them as noauto (if desired) and optionally (if going the 
noauto approach) add jail_{name}_exec_prestart=mount dirname and likewise 
[optional] jail_{name}_exec_poststop=umount dirname

All depending on how you use jails.

If you'd of course rather prefer all the mounts come up at boot and go from 
permanent directories to permanent directories (which you know will never go 
away), _and_ you like the idea of not having mounts going up and down with your 
jails (perhaps you're fine-tuning your jail's startup), I'd say throw them into 
/etc/fstab full-auto and not associate them with the jails. But it's all up to 
you.

Hope that helps.


 What I'd really like is something like ftpchroot for but ssh.
 

Hmmm, does the above approach work better? just exposing one directory to his 
jail via nullfs?


 suggestions?
 

-- 
Cheers,
Devin

_
The information contained in this message is proprietary and/or confidential. 
If you are not the intended recipient, please: (i) delete the message and all 
copies; (ii) do not disclose, distribute or use the message in any manner; and 
(iii) notify the sender immediately. In addition, please be aware that any 
message addressed to our domain is subject to archiving and review by persons 
other than the intended recipient. Thank you.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: can a jail have link to outside of the jail?

2012-08-16 Thread Christer Solskogen
On Thu, Aug 16, 2012 at 8:51 PM, Len Conrad lcon...@go2france.com wrote:

 I have an ssh user who needs only to search some log files not in his jail. 
 The jail required because I don't want the user seeing the rest the machine.  
 If the dirs were linked to his jail, would that work?


man mount_nullfs(8)

-- 
chs,
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Best file system for a busy webserver

2012-08-16 Thread Steve O'Hara-Smith
On Thu, 16 Aug 2012 13:16:26 -0500
Paul Schmehl pschmehl_li...@tx.rr.com wrote:

 --On August 16, 2012 6:02:57 PM +0100 Steve O'Hara-Smith
 st...@sohara.org wrote:
 
  On Thu, 16 Aug 2012 10:45:25 -0500
  Paul Schmehl pschmehl_li...@tx.rr.com wrote:
 
  Does anyone have any opinions on which file system is best for a busy
  webserver (7 million hits/month)?  Is anyone one system noticeably
  better  than any other?
 
  That's an average of about 3 hits per second. If it's static
  pages then pretty much anything will handle it easily (but please don't
  use FAT). If it's dynamic then the whole problem is more complex than a
  simple page rate. If that load is bursty it may make a difference too.
 
 
 Thanks for the reply.  It's a combination.  There are many static pages, 
 but there is also a php-mysql forum that generates pages on the fly.  It 
 accounts for about half of the traffic.  I've always used ufs but am 
 wondering if switching to zfs would make sense.
 
 This stats page might answer some of your questions: 
 http://www.stovebolt.com/stats/
 
 Basically traffic is steady but it's busiest in the evenings (US time
 zones)
 
  Other considerations may come into play - how big is this
  filesystem (number of files, maximum number of entries in a directory,
  volume of data) ? Are there many users needing to be protected from each
  other ? What about archives ? snapshots ? growth ? churn ? uptime
  requirements, disaster recovery time ?
 
 I don't even know where to begin.  There's about 15G of data on the
 server.

OK I would say there's no pressing reason to consider ZFS for this
purpose. You'd save a bit of time in crash recovery with no fsck going on,
and perhaps the checksum mechanism would give some peace of mind - but
really in 15GB silent corruption is a very slow process - now if it were
15TB ...

 last pid: 40369;  load averages:  0.01,  0.03,  0.00 
 up 104+09:33:44 13:14:49
 137 processes: 1 running, 136 sleeping
 CPU:  0.7% user,  0.0% nice,  0.1% system,  0.0% interrupt, 99.2% idle
 Mem: 229M Active, 6108M Inact, 1056M Wired, 15M Cache, 828M Buf, 514M Free
 Swap: 16G Total, 28K Used, 16G Free

OTOH you have plenty of memory lying around doing nothing much
(6108M inactive) so you can easily support ZFS if you want to play with
it's features (the smooth integration of volume management and filesystem
is rather cool).

 The system is not being stressed.
 
 If by users, you means shell accounts, there's two, so that's not really
 an issue.

OK so no need for fancy quota schemes then.

 Uptime is not an issue.  The owners have repeatedly said if the site is 
 down for two days they don't care.  (The forum users don't feel that way 
 though!)  We've had one disaster (hard drive failure and raid failed 
 while I was on vacation), and it took about 36 hours to get back online, 
 but that was 10 years ago.  The site doesn't go down - it's running on 
 FreeBSD. :-)

It sounds like you have backups or at least some means of restoring
the site in the event of disaster so that's all good. If there was a
pressing need to be able to get back up fairly quickly and easily I'd be
suggesting ZFS in RAID1 with a hot swap bay in which a third disc goes,
attached as a third mirror, periodically split it off the mirror take
it off site, and replace it with the one that's been off site.

There's really nothing here that's pushing you in any particular
direction for a filesystem, at 15GB if performance ever becomes a problem a
RAID1 of SSDs with UFS would make it fly probably into the hundreds of hits
per second range.

-- 
Steve O'Hara-Smith  |   Directable Mirror Arrays
C:WIN  | A better way to focus the sun
The computer obeys and wins.|licences available see
You lose and Bill collects. |http://www.sohara.org/
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Best file system for a busy webserver

2012-08-16 Thread Paul Schmehl
--On August 16, 2012 9:42:30 PM +0100 Steve O'Hara-Smith st...@sohara.org 
wrote:



I don't even know where to begin.  There's about 15G of data on the
server.


OK I would say there's no pressing reason to consider ZFS for this
purpose. You'd save a bit of time in crash recovery with no fsck going on,
and perhaps the checksum mechanism would give some peace of mind - but
really in 15GB silent corruption is a very slow process - now if it were
15TB ...



Thanks.


last pid: 40369;  load averages:  0.01,  0.03,  0.00
up 104+09:33:44 13:14:49
137 processes: 1 running, 136 sleeping
CPU:  0.7% user,  0.0% nice,  0.1% system,  0.0% interrupt, 99.2% idle
Mem: 229M Active, 6108M Inact, 1056M Wired, 15M Cache, 828M Buf, 514M
Free Swap: 16G Total, 28K Used, 16G Free


OTOH you have plenty of memory lying around doing nothing much
(6108M inactive) so you can easily support ZFS if you want to play with
it's features (the smooth integration of volume management and filesystem
is rather cool).



It's hard, nowadays, to buy a server that's too small for our needs.  Most 
of them are way overspec'd for what this server does.  Which is a nice 
luxury to have.



It sounds like you have backups or at least some means of restoring
the site in the event of disaster so that's all good.


Yes, daily, and the servers are always configured in RAID1.


If there was a
pressing need to be able to get back up fairly quickly and easily I'd be
suggesting ZFS in RAID1 with a hot swap bay in which a third disc goes,
attached as a third mirror, periodically split it off the mirror take
it off site, and replace it with the one that's been off site.

There's really nothing here that's pushing you in any particular
direction for a filesystem, at 15GB if performance ever becomes a problem
a RAID1 of SSDs with UFS would make it fly probably into the hundreds of
hits per second range.


Thanks for the input, Steve.  I appreciate it.

--
Paul Schmehl, Senior Infosec Analyst
As if it wasn't already obvious, my opinions
are my own and not those of my employer.
***
It is as useless to argue with those who have
renounced the use of reason as to administer
medication to the dead. Thomas Jefferson
There are some ideas so wrong that only a very
intelligent person could believe in them. George Orwell

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


freebsd-update and csup - I'm going around in circles.

2012-08-16 Thread Walter Hurry
Please forgive me if this is a daft question; I am quite new to FreeBSD.

I have read the handbook assiduously and am attempting to follow it. This 
is 9.0-RELEASE-p3, by the way.

Every time I run freebsd-update fetch it says it wants to update the 
following 5 source files as part of updating to 9.0-RELEASE-p4:

/usr/src/sys/amd64/amd64/trap.c
/usr/src/sys/conf/newvers.sh
/usr/src/sys/netinet/tcp_input.c
/usr/src/sys/netinet6/in6.c
/usr/src/sys/netinet6/ip6_input.c

So I run freebsd-update install and they are updated happily.

But when I run csup with my standard-supfile, it puts the same 5 files 
back to where they were.

What am I missing, or doing wrong?

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: can't build Samba 35 on FreeBSD 9.0

2012-08-16 Thread James D. Parra
On Wed, Aug 15, 2012 at 8:59 PM, James D. Parra  jam...@musicreports.com  
wrote: 

Hello, 

I am trying to install Samba35 on FreeBSD 9.0 but I keep getting a build error. 

The text you gave us gives me the thought you are flailing in the dark. First 
off, use a port management tool eg portmaster. Learn how to use it fully 
including regularly reading /usr/ports/UPDATING The handbook has great 
information on managing ports, I suggest reading it closely if you want FreeBSD 
to be your friend. 

In this scenario, you would use 

portsnap fetch update(assuming you've once a portsnap extract once before) 
portmaster /usr/ports/net/samba35 

The specific error in your message indicates some problem with ccache. What 
does your /etc/make.conf look like? 

-- 
Adam Vande More 
~

Thanks all for your replies. I had copied the details from what I had done 
from, http://forums.freebsd.org/archive/index.php/t-21461.html. I knew what the 
OP meant so I had issued, portsnap fetch, then portsnap extract, on my system.

I was able to get this to work on FreeBSD 8.2 and was hoping to also get this 
working on 9.0. Since I will be using Kerberos, I use, 'make 
KRB5_HOME=/usr/local install clean'. My /etc/make.conf file has the following;

 cat /etc/make.conf
# Uncomment this if you want to do port builds with no interaction
#BATCH=yes
# Keep KDE4 in /usr/local, fixes sharing of icons / mime and others
KDE4_PREFIX=/usr/local
# added by use.perl 2012-06-28 21:39:00
PERL_VERSION=5.12.4
#To build Samba
WITH_ADS=yes
snip

I do need ADS as I will be joining this server to our domain.

For reference, here is the build error;
libsmb/libsmb_setget.c: In function 'smbc_getOptionUseCCache':
libsmb/libsmb_setget.c:427: error: 'SMB_CTX_FLAG_USE_CCACHE' undeclared (first 
use in this function)
libsmb/libsmb_setget.c:427: error: (Each undeclared identifier is reported only 
once
libsmb/libsmb_setget.c:427: error: for each function it appears in.)
libsmb/libsmb_setget.c: In function 'smbc_setOptionUseCCache':
libsmb/libsmb_setget.c:435: error: 'SMB_CTX_FLAG_USE_CCACHE' undeclared (first 
use in this function)
The following command failed:
cc -I/usr/local/include -O2 -pipe -DLDAP_DEPRECATED -fno-strict-aliasing -I. 
-I/usr/ports/net/samba35/work/samba-3.5.15/source3 
-I/usr/ports/net/samba35/work/samba-3.5.15/source3/iniparser/src -Iinclude 
-I./include  -I. -I. -I./../lib/replace -I./../lib/tevent -I./libaddns 
-I./librpc -I./.. -DHAVE_CONFIG_H  -I/usr/local/include -I/usr/local/include 
-Iinclude -I./include -I. -I. -I./../lib/replace -I./../lib/tevent -I./libaddns 
-I./librpc -I./.. -I./../lib/popt -I/usr/local/include -DLDAP_DEPRECATED  
-I/usr/ports/net/samba35/work/samba-3.5.15/source3/lib -I.. -I../source4 
-D_SAMBA_BUILD_=3 -D_SAMBA_BUILD_=3  -fPIC -DPIC -c libsmb/libsmb_setget.c -o 
libsmb/libsmb_setget.o
gmake: *** [libsmb/libsmb_setget.o] Error 1
*** Error code 1

Stop in /usr/ports/net/samba35.
*** Error code 1

Stop in /usr/ports/net/samba35.
snip

Thanks for your help.

James 
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Best file system for a busy webserver

2012-08-16 Thread Tim Daneliuk

On 08/16/2012 01:16 PM, Paul Schmehl wrote:


Paul Schmehl pschmehl_li...@tx.rr.com wrote:


Does anyone have any opinions on which file system is best for a busy
webserver (7 million hits/month)?  Is anyone one system noticeably
better  than any other?




With only 15G of data, I'd recommend a pair of 60G SSD drives like
the OCZ Vertex IIIs (About $1/G these days) wired into a *hardware*
RAID controller setup to mirror them.  This gives you blazing speed
and reliability.  If you want to add another drive, you can make it
RAID 5 which - with the right cabinet and mounting hardware - would
give you hotswap capability.

I know people are fond of software RAID but I personally do not
consider this a very high reliability technology unless you're
running true datacenter class hardware with redundant everything
(disk, NIC, fiber ...) and that's probably overkill in this case.
Good RAID controllers are available from a number of manufacturers.
I dunno if FreeBSD supports them, but Rocket has a good reputation
(though I've never used them) as do both Adaptec and LSI.

In any case, a controller plus 3 drives would probably only set you
back in the $500-ish area which seems like a reasonable price point.

Furthermore, depending on the amount of stuff that you're serving
that is static vs. dynamic, you may get benefit from increasing
memory (thereby increasing the likelihood of a cache hit) and increasing
the minimum/threshold values for the number of httpd processing running
all the time.
--

Tim Daneliuk tun...@tundraware.com
PGP Key: http://www.tundraware.com/PGP/

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: freebsd-update and csup - I'm going around in circles.

2012-08-16 Thread Polytropon
On Thu, 16 Aug 2012 21:24:37 + (UTC), Walter Hurry wrote:
 Every time I run freebsd-update fetch it says it wants to update the 
 following 5 source files as part of updating to 9.0-RELEASE-p4:
 
 /usr/src/sys/amd64/amd64/trap.c
 /usr/src/sys/conf/newvers.sh
 /usr/src/sys/netinet/tcp_input.c
 /usr/src/sys/netinet6/in6.c
 /usr/src/sys/netinet6/ip6_input.c
 
 So I run freebsd-update install and they are updated happily.
 
 But when I run csup with my standard-supfile, it puts the same 5 files 
 back to where they were.

Not and. Why are you mixing tools here? You're shooting
your own foot. :-)

You use _either_ freebsd-update to update your system the binary
way, _or_ you use csup to update your sources and then compile
your system from that sources.

Solution: Don't use csup. :-)

Side note: Check your update configuration files so they reflect
the proper branch you want to follow. With freebsd-update you
follow the -RELEASE-pX branch, with csup you can

a) follow -RELEASE-pX
b) follow -STABLE
c) follow -CURRENT

Note that you should not mix those! You can always switch branches
when using the source code based method (csup), but you should not
do so using freebsd-update.

An example configuration to follow -RELEASE-pX using the csup
method with make update would look like this:

% cat /etc/sup/release.sup 
*default host=cvsup.freebsd.org
*default base=/var/db
*default prefix=/usr
*default release=cvs tag=RELENG_9_0
*default delete use-rel-suffix
*default compress
src-all

Together with the selection in /etc/make.conf:

SUP_UPDATE= YES
SUP=/usr/bin/csup
SUPFLAGS=   -L 2
SUPHOST=cvsup.freebsd.org
SUPFILE=/etc/sup/release.sup
PORTSSUPFILE=   /etc/sup/ports.sup
DOCSUPFILE= /etc/sup/doc.sup
DOC_LANG=   en_US.ISO8859-1 de_DE.ISO8859-1

you can easily control the process.

(Sidenote: I also have /etc/sup/stable.sup which looks like the
example provided, but has tag=RELENG_9 in it. You could also use
tag=RELENG_9_0_0_RELEASE to revert back to 9.0-RELEASE.)



You can find an example for what the CVS tags mean here:
http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/cvs-tags.html



-- 
Polytropon
Magdeburg, Germany
Happy FreeBSD user since 4.0
Andra moi ennepe, Mousa, ...
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: can a jail have link to outside of the jail?

2012-08-16 Thread Wojciech Puchar


I have an ssh user who needs only to search some log files not in his jail. The 
jail required because I don't want the user seeing the rest the machine.  If 
the dirs were linked to his jail, would that work?

man mount_nullfs
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Best file system for a busy webserver

2012-08-16 Thread Wojciech Puchar

OK I would say there's no pressing reason to consider ZFS for this


another ZFS fanatics. it is about performance.


direction for a filesystem, at 15GB if performance ever becomes a problem a
RAID1 of SSDs with UFS would make it fly probably into the hundreds of hits
per second range.
classic for ZFS and modern things fanatics. lots of talk about high end 
hardware nothing about a thread.


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Best file system for a busy webserver

2012-08-16 Thread Wojciech Puchar

the OCZ Vertex IIIs (About $1/G these days) wired into a *hardware*
RAID controller setup to mirror them.  This gives you blazing speed

just like i would read some popular street PC newspaper.


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Double boot

2012-08-16 Thread prab

  Hello,
 I have installed FreeBSD 8.3 to Toshiba Satellite besides Windows XP.
 Unix boots ok, but I can't reach  Windows anymore!
   It shows:
 F1 Win
 F2 FreeBSD

 F6 PXE
 Boot F1
 -

  If I press F1, it stays hanging forever.
  I'm relatively new to FreeBSD. Please, advise which way to go out
 of this  situation. When I  rerun sysinstall, there is a warning:
chunk 'ad0s2' [179380224..234441647] does not start on a track boundary
 (the chunk of FreeBSD) How to change the boundary of chunk? CDROM is  
not reachable, something happened to it. I can use only FreeBSD  
instruments.

  Which of them?
 Thanks in advance.


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Best file system for a busy webserver

2012-08-16 Thread Adam Vande More
On Thu, Aug 16, 2012 at 10:45 AM, Paul Schmehl pschmehl_li...@tx.rr.comwrote:

 Does anyone have any opinions on which file system is best for a busy
 webserver (7 million hits/month)?  Is anyone one system noticeably better
 than any other?

 Just curious.  I'm getting ready to setup a new box running FreeBSD 9, and
 since I'm starting from scratch, I'm questioning all my previous
 assumptions.


Sounds like you have ample hardware, so I would probably consider ZFS.  You
get a lot of other options with it which simply aren't available or harder
to manage on a UFS system.  Things like data integrity, ZIL/ARC, live
low-cost snapshots, diff'ing the snapshot, transparent compression, etc all
come with ZFS.  Great tools for certain scenarios.  Properly setup, ZFS
RAID functionality will own any hardware raid solution ever presented
because ZFS doesn't rely on a battery for consistency, nor do they provide
most other features stated including integrity oriented ones.  ZFS is
intended to work with raw disk/JBOD. Good controllers are still important,
they simply don't have the knowledge to use them at peak efficiency.

I don't see much benefit to SSD's for this use case.  All the common files
should be in the fs cache which is at least an order of magnitude faster
than flash based memory, and finding enterprise SSD's(preferably SLC) which
obey FLUSH commands appropriately and have a capicitor appropriate to
production use is something more of a crapshoot than traditional SATA/SAS
drives.

All that being said, UFS is fine too.  I use it most often for light VM
installs and where resources are scarce.  However the 2 single biggest ZFS
feature I like are the data integrity and transparent compression are
wonderful which aren't available in UFS.  ZFS snapshots are much more
functional as well and go well w/ zfs send/receive.

-- 
Adam Vande More
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org