It is actually worst than that, the partition is 4.5TB. It takes about 4-6 
hours to do an fsck on a partition and that partition is actually one of the 
smaller ones of the 6 data partitions on this file server.

Bruce

On Jun 20, 2011, at 8:33 PM, Mark J Bailey wrote:

> Actually, if your weekend users literally ran it out of space, the freelist 
> may be out of whack.  So, fsck might be a sensible thing, but I would try 
> Brian and Paul less involved ideas first.  Fsck on 1.5TB ext3 is going to 
> take a while :)
> 
> Mark J Bailey <m...@jobsoft.com> wrote:
> 
> Is dmesg showing ext3 errors?  Maybe time for fsck? 
> 
> "Paul W. Roach III" <p...@isaroach.com> wrote:
> 
> Finally, (sorry, stream of conciousness kicks in once I send an email, and I
> think of something else) what sort of workload is the server under?  DB,
> File Server, App Server?  Oracle behaves differently than Weblogic with
> regard to holding space, under certain circumstances.
> 
> -P
> On Mon, Jun 20, 2011 at 9:04 PM, Paul W. Roach III <p...@isaroach.com>wrote:
> 
>> In my experience, if nothing shows up in lsof, there's no process (zombie
>> or otherwise) holding it.  Any chance you have something symlinked to that
>> partition which might throw off your grep on lsof?
>> 
>> -P
>> 
>>  On Mon, Jun 20, 2011 at 7:25 PM, Bruce W. Martin <marti...@gmail.com>wrote:
>> 
>>> 
>>> On Jun 20, 2011, at 4:00 PM, Mark J. Bailey wrote:
>>> 
>>>> IS there some sort of reserve/overhead with the array or the filesystem
>>> on it?
>>> 
>>> No.
>>> 
>>>> Is it being replicated somewhere?
>>> 
>>> NO.
>>> 
>>>> And, do you have a whole lot of small files or a lesser number of huge
>>> files?
>>> 
>>> It is mostly small files.
>>> 
>>> Paul, Thanks for that thought but there are plenty of inodes available on
>>> that partition. I deleted a large number of files last week but the space
>>> showed free right afterwards. I ran lsof but nothing on that partition
>>> showed up in the list.
>>> 
>>> Brian, I have a sneaking suspicion that you may be correct about the
>>> running or zombie processes, I will have to look into that further.
>>> This partition is served up to about a dozen machines so I suspect that i
>>> will have to look at processes on each of the other machines to find if
>>> there is a culprit down this path.
>>> 
>>> Thanks for the suggestions. Any other thoughts?
>>> 
>>> Bruce
>>> 
>>> 
>>>> 
>>>> From: nlug-talk@googlegroups.com [mailto:nlug-talk@googlegroups.com] On
>>> Behalf Of Brian H. Ward
>>>> Sent: Monday, June 20, 2011 3:46 PM
>>>> To: nlug-talk@googlegroups.com
>>>> Subject: Re: [nlug] df says partition is full but du numbers don't add
>>> up
>>>> 
>>>> unlinked (deleted) files which are still held open by running (or even
>>> zombie) processes will keep disk space from being returned to df, but won't
>>> show up in du.
>>>> 
>>>> On Mon, Jun 20, 2011 at 4:34 PM, Bruce W. Martin <marti...@gmail.com>
>>> wrote:
>>>> I have a 4.6TB partition on a RAID array that is reporting as 100% full
>>> but running du on the partition only shows 3.5TB worth of files. What gives?
>>> Is there some way to fix this short of rebooting? I am not sure of the right
>>> question to pose to do a proper google search for this.
>>>> 
>>>> 
>>>> Bruce
>>>> --
>>>> Bruce W. Martin, KQ4TV
>>>> Trustee for NT4UX
>>>> Nashville Linux User Group - Amateur Radio- Special Interest Group
>>>> NLUG-AR-SIG
>>>> 
>>>> --
>>>> You received this message because you are subscribed to the Google
>>> Groups "NLUG" group.
>>>> To post to this group, send email to nlug-talk@googlegroups.com
>>>> To unsubscribe from this group, send email to
>>> nlug-talk+unsubscr...@googlegroups.com
>>>> For more options, visit this group at
>>> http://groups.google.com/group/nlug-talk?hl=en
>>>> 
>>>> 
>>>> 
>>>> --
>>>> Our visit to this planet is short, so we should use our time
>>> meaningfully, which we can do by helping others wherever possible. And if we
>>> cannot help others, at least we should try not to create pain and suffering
>>> for them. - Dalai Lama
>>>> --
>>>> You received this message because you are subscribed to the Google
>>> Groups "NLUG" group.
>>>> To post to this group, send email to nlug-talk@googlegroups.com
>>>> To unsubscribe from this group, send email to
>>> nlug-talk+unsubscr...@googlegroups.com
>>>> For more options, visit this group at
>>> http://groups.google.com/group/nlug-talk?hl=en
>>>> 
>>>> --
>>>> You received this message because you are subscribed to the Google
>>> Groups "NLUG" group.
>>>> To post to this group, send email to nlug-talk@googlegroups.com
>>>> To unsubscribe from this group, send email to
>>> nlug-talk+unsubscr...@googlegroups.com
>>>> For more options, visit this group at
>>> http://groups.google.com/group/nlug-talk?hl=en
>>> 
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "NLUG" group.
>>> To post to this group, send email to nlug-talk@googlegroups.com
>>> To unsubscribe from this group, send email to
>>> nlug-talk+unsubscr...@googlegroups.com
>>> For more options, visit this group at
>>> http://groups.google.com/group/nlug-talk?hl=en
>>> 
>> 
>> 
> 
> -- 
> You received this message because you are subscribed to the Google Groups 
> "NLUG" group.
> To post to this group, send email to nlug-talk@googlegroups.com
> To unsubscribe from this group, send email to 
> nlug-talk+unsubscr...@googlegroups.com
> For more options, visit this group at 
> http://groups.google.com/group/nlug-talk?hl=en
> 
> -- 
> You received this message because you are subscribed to the Google Groups 
> "NLUG" group.
> To post to this group, send email to nlug-talk@googlegroups.com
> To unsubscribe from this group, send email to 
> nlug-talk+unsubscr...@googlegroups.com
> For more options, visit this group at 
> http://groups.google.com/group/nlug-talk?hl=en
> 
> -- 
> You received this message because you are subscribed to the Google Groups 
> "NLUG" group.
> To post to this group, send email to nlug-talk@googlegroups.com
> To unsubscribe from this group, send email to 
> nlug-talk+unsubscr...@googlegroups.com
> For more options, visit this group at 
> http://groups.google.com/group/nlug-talk?hl=en

-- 
You received this message because you are subscribed to the Google Groups 
"NLUG" group.
To post to this group, send email to nlug-talk@googlegroups.com
To unsubscribe from this group, send email to 
nlug-talk+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/nlug-talk?hl=en

Reply via email to