[
https://issues.apache.org/jira/browse/LUCENE-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Muir updated LUCENE-4209:
--------------------------------
Attachment: LUCENE-4209_more.patch
here's the patch: what a horrendous thing to track down.
It only happened on Uwe's computer because he has /tmp on a separate volume. So
the rename fails, and it does this copy() thing, but doesn't delete the old
file.
> BytesRefSorter leaves files in /tmp and never cleans them up
> ------------------------------------------------------------
>
> Key: LUCENE-4209
> URL: https://issues.apache.org/jira/browse/LUCENE-4209
> Project: Lucene - Java
> Issue Type: Bug
> Components: core/FSTs
> Affects Versions: 3.6, 4.0-ALPHA
> Reporter: Uwe Schindler
> Priority: Critical
> Fix For: 4.0, 3.6.1, 5.0
>
> Attachments: LUCENE-4209.patch, LUCENE-4209.patch,
> LUCENE-4209_more.patch
>
>
> When reviewing my Jenkins installation, I found out that /tmp is filled by
> Jenkins with the following files (in Linux and Windows).
> -rw-r--r-- 1 jenkins nogroup 12433 Jul 5 21:14
> RefSorter-1839005885812820606.sorted
> -rw-r--r-- 1 jenkins nogroup 13574 Jul 5 19:26
> RefSorter-2799526995307200478.sorted
> -rw-r--r-- 1 jenkins nogroup 12600 Jul 5 17:14
> RefSorter-2841491891429925756.sorted
> -rw-r--r-- 1 jenkins nogroup 11697 Jul 5 19:57
> RefSorter-3302954184439492426.sorted
> -rw-r--r-- 1 jenkins nogroup 13496 Jul 5 16:30
> RefSorter-3738422482066276549.sorted
> -rw-r--r-- 1 jenkins nogroup 13781 Jul 5 15:36
> RefSorter-4235756851148318773.sorted
> -rw-r--r-- 1 jenkins nogroup 12719 Jul 5 18:54
> RefSorter-4530019493984469514.sorted
> -rw-r--r-- 1 jenkins nogroup 12696 Jul 5 16:04
> RefSorter-5245195867837976219.sorted
> -rw-r--r-- 1 jenkins nogroup 13879 Jul 5 18:27
> RefSorter-5977302780601133089.sorted
> -rw-r--r-- 1 jenkins nogroup 12712 Jul 5 21:39
> RefSorter-6336186633027300753.sorted
> -rw-r--r-- 1 jenkins nogroup 12820 Jul 5 20:30
> RefSorter-6447286760971372233.sorted
> -rw-r--r-- 1 jenkins nogroup 12105 Jul 5 17:48
> RefSorter-6532780916605441895.sorted
> -rw-r--r-- 1 jenkins nogroup 13505 Jul 5 20:53
> RefSorter-7247901917320979657.sorted
> -rw-r--r-- 1 jenkins nogroup 12688 Jul 5 22:10
> RefSorter-7796370222379929612.sorted
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 18:54
> sort1277839437346448611partition
> -rw-r--r-- 1 jenkins nogroup 21299752 Jul 5 15:35
> sort1362726822297484023intermediate
> -rw-r--r-- 1 jenkins nogroup 21300496 Jul 5 17:48
> sort1435680293746542872intermediate
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 16:30
> sort1498884601796138622partition
> -rw-r--r-- 1 jenkins nogroup 21300869 Jul 5 20:30
> sort1634015425760928615intermediate
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 20:30
> sort1954741677243403383partition
> -rw-r--r-- 1 jenkins nogroup 21300802 Jul 5 20:53
> sort2203784121687916561intermediate
> -rw-r--r-- 1 jenkins nogroup 21300493 Jul 5 22:10
> sort24154414907891444intermediate
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 22:10
> sort2816986454022083882partition
> -rw-r--r-- 1 jenkins nogroup 21300111 Jul 5 18:27
> sort285022281545547041intermediate
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 18:28
> sort295507558144077223partition
> -rw-r--r-- 1 jenkins nogroup 21300569 Jul 5 16:30
> sort3013772538520090513intermediate
> -rw-r--r-- 1 jenkins nogroup 21300574 Jul 5 17:14
> sort3297463807520676013intermediate
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 21:14
> sort3364874175018276528partition
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 17:14
> sort3846182021346233750partition
> -rw-r--r-- 1 jenkins nogroup 21300204 Jul 5 19:26
> sort4397860673342757974intermediate
> -rw-r--r-- 1 jenkins nogroup 21300050 Jul 5 16:04
> sort4474792189525490476intermediate
> -rw-r--r-- 1 jenkins nogroup 21300825 Jul 5 18:54
> sort4518448528614283778intermediate
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 21:39
> sort4756172476965226743partition
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 20:53
> sort5416699953867843402partition
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 19:26
> sort5558474409634346477partition
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 17:48
> sort6281513108922200314partition
> -rw-r--r-- 1 jenkins nogroup 21300155 Jul 5 21:39
> sort6639309492804635005intermediate
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 19:57
> sort6777765458777941142partition
> -rw-r--r-- 1 jenkins nogroup 21301369 Jul 5 19:57
> sort6973021800616034113intermediate
> -rw-r--r-- 1 jenkins nogroup 21300341 Jul 5 21:14
> sort7260811068342958052intermediate
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 16:04
> sort852078170643422390partition
> -rw-r--r-- 1 jenkins nogroup 19 Jul 5 15:35
> sort8857722113319559286partition
> The pattern "RefSorter-" I found in Lucene's source code, so it must come
> from tests. Why are they not cleaned up and why do we need those files? Would
> a RamDirectory not be enough for this?
> This is serious, as the files are never cleaned up, they stay alive when the
> test passes, so its not caused by the always failing Solr Suggester tests.
> There are also other filenames with .sorted and similar at end.
> The slave was taken automatically offline after its RAM-based /tmp (2 GB) was
> filling in <24h). On the Windows Box c:\Users\JenkinsSlave\AppData\Temp
> contained already 60,000 files like this (still deleting them), taking 12 GB
> of disk space. I will review Apache Jenkins, too -> also cleaned up lots of
> files.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
