Re: [nlug] df says partition is full but du numbers don't add up
Are you out of inodes? df -i Did you delete a big file of a running process? That won't be released until the process dies. Try lsof to see On Mon, Jun 20, 2011 at 4:34 PM, Bruce W. Martin marti...@gmail.com wrote: I have a 4.6TB partition on a RAID array that is reporting as 100% full but running du on the partition only shows 3.5TB worth of files. What gives? Is there some way to fix this short of rebooting? I am not sure of the right question to pose to do a proper google search for this. Bruce -- Bruce W. Martin, KQ4TV Trustee for NT4UX Nashville Linux User Group - Amateur Radio- Special Interest Group NLUG-AR-SIG -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en
Re: [nlug] df says partition is full but du numbers don't add up
If a reboot fixes it, make sure that any jobs that truncate logfiles do so by cat /dev/null file rather than rm file, to prevent zombies or open file handles from mucking with free space. Can you create a new file on the file system with touch? Do you get no more extents, or something different? -P On Mon, Jun 20, 2011 at 8:34 PM, Mark J. Bailey m...@jobsoft.com wrote: That is weird. I like Brian idea of rebooting and seeing what you have afterwards. -Original Message- From: nlug-talk@googlegroups.com [mailto:nlug-talk@googlegroups.com] On Behalf Of Bruce W. Martin Sent: Monday, June 20, 2011 7:28 PM To: nlug-talk@googlegroups.com Subject: Re: [nlug] df says partition is full but du numbers don't add up On Jun 20, 2011, at 6:33 PM, Mark J. Bailey wrote: Bruce, if you have the 'lsof' (list of open files) util on that system, you might be able to do some analysis from that perspective that might help narrow it down. Also, if it is lots of small files, what is the default block size (and/or minimum allocation) for a file. I think it is 4k. What filesystem? ext3 Could the overhead for the filesystem structure with LOTS of files be eating up space in the filesystem/inode datastructure? I don't think so. Wild guess, but overhead for such a largely allocated filesystem might account for some dark matter. There was about 500GB available on Friday with the only directory (3T) that is seeing any significant activity was using 1.5TB. Today the partition is 100% full but the 3T directory is now only using 1.1TB with all other directories unchanged since Friday. I don't know what the users have been doing over the weekend. Bruce -Original Message- From: nlug-talk@googlegroups.com [mailto:nlug-talk@googlegroups.com] On Behalf Of Bruce W. Martin Sent: Monday, June 20, 2011 6:25 PM To: nlug-talk@googlegroups.com Subject: Re: [nlug] df says partition is full but du numbers don't add up On Jun 20, 2011, at 4:00 PM, Mark J. Bailey wrote: IS there some sort of reserve/overhead with the array or the filesystem on it? No. Is it being replicated somewhere? NO. And, do you have a whole lot of small files or a lesser number of huge files? It is mostly small files. Paul, Thanks for that thought but there are plenty of inodes available on that partition. I deleted a large number of files last week but the space showed free right afterwards. I ran lsof but nothing on that partition showed up in the list. Brian, I have a sneaking suspicion that you may be correct about the running or zombie processes, I will have to look into that further. This partition is served up to about a dozen machines so I suspect that i will have to look at processes on each of the other machines to find if there is a culprit down this path. Thanks for the suggestions. Any other thoughts? Bruce From: nlug-talk@googlegroups.com [mailto:nlug-talk@googlegroups.com] On Behalf Of Brian H. Ward Sent: Monday, June 20, 2011 3:46 PM To: nlug-talk@googlegroups.com Subject: Re: [nlug] df says partition is full but du numbers don't add up unlinked (deleted) files which are still held open by running (or even zombie) processes will keep disk space from being returned to df, but won't show up in du. On Mon, Jun 20, 2011 at 4:34 PM, Bruce W. Martin marti...@gmail.com wrote: I have a 4.6TB partition on a RAID array that is reporting as 100% full but running du on the partition only shows 3.5TB worth of files. What gives? Is there some way to fix this short of rebooting? I am not sure of the right question to pose to do a proper google search for this. Bruce -- Bruce W. Martin, KQ4TV Trustee for NT4UX Nashville Linux User Group - Amateur Radio- Special Interest Group NLUG-AR-SIG -- Our visit to this planet is short, so we should use our time meaningfully, which we can do by helping others wherever possible. And if we cannot help others, at least we should try not to create pain and suffering for them. - Dalai Lama -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this
Re: [nlug] df says partition is full but du numbers don't add up
Finally, (sorry, stream of conciousness kicks in once I send an email, and I think of something else) what sort of workload is the server under? DB, File Server, App Server? Oracle behaves differently than Weblogic with regard to holding space, under certain circumstances. -P On Mon, Jun 20, 2011 at 9:04 PM, Paul W. Roach III p...@isaroach.comwrote: In my experience, if nothing shows up in lsof, there's no process (zombie or otherwise) holding it. Any chance you have something symlinked to that partition which might throw off your grep on lsof? -P On Mon, Jun 20, 2011 at 7:25 PM, Bruce W. Martin marti...@gmail.comwrote: On Jun 20, 2011, at 4:00 PM, Mark J. Bailey wrote: IS there some sort of reserve/overhead with the array or the filesystem on it? No. Is it being replicated somewhere? NO. And, do you have a whole lot of small files or a lesser number of huge files? It is mostly small files. Paul, Thanks for that thought but there are plenty of inodes available on that partition. I deleted a large number of files last week but the space showed free right afterwards. I ran lsof but nothing on that partition showed up in the list. Brian, I have a sneaking suspicion that you may be correct about the running or zombie processes, I will have to look into that further. This partition is served up to about a dozen machines so I suspect that i will have to look at processes on each of the other machines to find if there is a culprit down this path. Thanks for the suggestions. Any other thoughts? Bruce From: nlug-talk@googlegroups.com [mailto:nlug-talk@googlegroups.com] On Behalf Of Brian H. Ward Sent: Monday, June 20, 2011 3:46 PM To: nlug-talk@googlegroups.com Subject: Re: [nlug] df says partition is full but du numbers don't add up unlinked (deleted) files which are still held open by running (or even zombie) processes will keep disk space from being returned to df, but won't show up in du. On Mon, Jun 20, 2011 at 4:34 PM, Bruce W. Martin marti...@gmail.com wrote: I have a 4.6TB partition on a RAID array that is reporting as 100% full but running du on the partition only shows 3.5TB worth of files. What gives? Is there some way to fix this short of rebooting? I am not sure of the right question to pose to do a proper google search for this. Bruce -- Bruce W. Martin, KQ4TV Trustee for NT4UX Nashville Linux User Group - Amateur Radio- Special Interest Group NLUG-AR-SIG -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en -- Our visit to this planet is short, so we should use our time meaningfully, which we can do by helping others wherever possible. And if we cannot help others, at least we should try not to create pain and suffering for them. - Dalai Lama -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en
Re: [nlug] df says partition is full but du numbers don't add up
If it's nfsd holding the lock, lsof would still show it, though a quick restart of NFS would clear up any held locks by remote machines. Quick enough to disprove, anyway :) On Mon, Jun 20, 2011 at 9:20 PM, Mark J Bailey m...@jobsoft.com wrote: Is dmesg showing ext3 errors? Maybe time for fsck? Paul W. Roach III p...@isaroach.com wrote: Finally, (sorry, stream of conciousness kicks in once I send an email, and I think of something else) what sort of workload is the server under? DB, File Server, App Server? Oracle behaves differently than Weblogic with regard to holding space, under certain circumstances. -P On Mon, Jun 20, 2011 at 9:04 PM, Paul W. Roach III p...@isaroach.com wrote: In my experience, if nothing shows up in lsof, there's no process (zombie or otherwise) holding it. Any chance you have something symlinked to that partition which might throw off your grep on lsof? -P On Mon, Jun 20, 2011 at 7:25 PM, Bruce W. Martin marti...@gmail.com wrote: On Jun 20, 2011, at 4:00 PM, Mark J. Bailey wrote: IS there some sort of reserve/overhead with the array or the filesystem on it? No. Is it being replicated somewhere? NO. And, do you have a whole lot of small files or a lesser number of huge files? It is mostly small files. Paul, Thanks for that thought but there are plenty of inodes available on that partition. I deleted a large number of files last week but the space showed free right afterwards. I ran lsof but nothing on that partition showed up in the list. Brian, I have a sneaking suspicion that you may be correct about the running or zombie processes, I will have to look into that further. This partition is served up to about a dozen machines so I suspect that i will have to look at processes on each of the other machines to find if there is a culprit down this path. Thanks for the suggestions. Any other thoughts? Bruce From: nlug-talk@googlegroups.com [mailto:nlug-talk@googlegroups.com] On Behalf Of Brian H. Ward Sent: Monday, June 20, 2011 3:46 PM To: nlug-talk@googlegroups.com Subject: Re: [nlug] df says partition is full but du numbers don't add up unlinked (deleted) files which are still held open by running (or even zombie) processes will keep disk space from being returned to df, but won't show up in du. On Mon, Jun 20, 2011 at 4:34 PM, Bruce W. Martin marti...@gmail.com wrote: I have a 4.6TB partition on a RAID array that is reporting as 100% full but running du on the partition only shows 3.5TB worth of files. What gives? Is there some way to fix this short of rebooting? I am not sure of the right question to pose to do a proper google search for this. Bruce -- Bruce W. Martin, KQ4TV Trustee for NT4UX Nashville Linux User Group - Amateur Radio- Special Interest Group NLUG-AR-SIG -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en -- Our visit to this planet is short, so we should use our time meaningfully, which we can do by helping others wherever possible. And if we cannot help others, at least we should try not to create pain and suffering for them. - Dalai Lama -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en -- You received this message because you are subscribed to the Google Groups
Re: [nlug] Photo Editing ... Simplified
Paint.Net -- it's not photoshop, but it's great. Not sure if it's open source, but it's free. On Fri, Jan 21, 2011 at 4:05 PM, Jack Coats j...@coats.org wrote: This is to help my wife out, she is looking at using Picnik for online picture editing. The problem is we have between no and very low bandwidth available. We need a downloadable open source, and simple program that will run on XP. This will be used in a 2 hour class, only 1 really at the computer, and this is 11 to 18 yr olds. Suggestions? (offline responses are OK) ... Jack Whatever you do, work at it with all your heart... Colossians 3:23 -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.comnlug-talk%2bunsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en -- You received this message because you are subscribed to the Google Groups NLUG group. To post to this group, send email to nlug-talk@googlegroups.com To unsubscribe from this group, send email to nlug-talk+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en
Re: [nlug] Perl Question
Or even better, %{$ref} = undef;
[pro...@misterstorage ~]$ perl foo.pl
Hash before cleaning
foo: 1
foo2: 2
Hash after cleaning
:
#!/usr/bin/perl
my %hash = (foo = 1, foo2 = 2);
print Hash before cleaning\n;
foreach my $key (keys(%hash)) {
print $key: $hash{$key}\n;
}
cleanup(hash = \%hash);
print \nHash after cleaning\n;
foreach my $key (keys(%hash)) {
print $key: $hash{$key}\n;
}
exit;
sub cleanup {
my %args = @_;
%{$args{hash}} = undef;
}
On Sat, Sep 18, 2010 at 2:58 AM, Steven S. Critchfield
cri...@basesys.comwrote:
%{$ref} = ()
Assigns an empty hash to the hash at ref.
- Original Message -
Just curious. Wednesday I was coding a subroutine, and wanted to
delete all the keys in a hash, to which the subroutine has a
reference.
Of course you can do a delete with a hash slice like so.
delete @{$ref}{keys %{$ref}};
Is there something better?
$ref = {};
only works within the subroutine. Since this assigns a new reference
to the local variable, the original hash is not effected.
Paul
-- You received this message because you are subscribed to the Google
Groups NLUG group.
To post to this group, send email to nlug-talk@googlegroups.com
To unsubscribe from this group, send email to
nlug-talk+unsubscr...@googlegroups.comnlug-talk%2bunsubscr...@googlegroups.comFor
more options, visit this
group at http://groups.google.com/group/nlug-talk?hl=en
--
Steven Critchfield cri...@basesys.com
--
You received this message because you are subscribed to the Google Groups
NLUG group.
To post to this group, send email to nlug-talk@googlegroups.com
To unsubscribe from this group, send email to
nlug-talk+unsubscr...@googlegroups.comnlug-talk%2bunsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/nlug-talk?hl=en
--
You received this message because you are subscribed to the Google Groups
NLUG group.
To post to this group, send email to nlug-talk@googlegroups.com
To unsubscribe from this group, send email to
nlug-talk+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/nlug-talk?hl=en
