Tom,
I agree that things can be made to work well under the current setup. It's
just not intuitive nor well-documented.
By "hidden", I mean hidden in terms of any standard Unix monitoring tools.
It is hidden both from both the virtual and resident memory tallies, which
are where most Unix admins
I'm not exactly sure how this can be considered a "hidden memory
requirement". By default, train-table-perl creates a moses.ini
configuration that loads these resources into RAM. A user must edit the
configuration to enable mem-mapped language model or binarized tables,
and these on-disk features
Hi There,
Finally I got it. Basically, there is no bug :)
The problem was the older (svn) moses version didn't require absolute path for
train-model.perl for parameter "-corpus". When I put the absolute path to the
new moses version - the path was correctly hand out to extract-parallel and
the
Personally, I would could "The sees the process as a small-memory process
and won't be
tempted to kill it when it's running out of memory" as a disadvantage
rather than an advantage. If the OOM killer is trying to stabilize the
system, this will potentially prevent it from doing so.
The other disa
Hi guys,
Phil - thanks.
Hieu - you are correct (dir is created). The problem is in command ln in
extract_parallel (lines: 70 and 2 more below 70).
$cmd = "ln -s $target $TMPDIR/target.$numStr";
ln creates symbolic link (no error message is generated), however, the link is
invalid. It is due t
Hi Barry,
> I've updated the sparse features branch of Moses (miramerge), merging all the
> recent changes from trunk. It passes all the unit tests, and all the
> regression tests (apart from small number of rounding errors) but I have't
> run
> any other tests on this branch.
I'm just wonder
You'll also get thrashing with memory-mapped files if you don't have
enough memory.
Advantage of the file API:
1. can access 2+GB files even running a 32 bit OS
2. OS portable
3. The sees the process as a small-memory process and won't be
tempted to kill it when it's running out of m
hi tomas
1. thanks. Phil fixed it
https://github.com/moses-smt/mosesdecoder/commit/82580280bc0b30607b00a55ffe0f22d5665269a3
2. The temp directory is created in
extract-parallel.perl line 34
Do you get an error when running the extract or scoring?
On 26/05/2012 12:33, Tomas Hudik wro
Hi Hieu,
Thanks for your reply. Yep - I downloaded latest git version
(de8a2e7667fe2bde9df0ef5a32b3b85b6469eb0f) and found out following problems:
1. During compilation; gcc version 4.6.3. produces error in:
gcc.compile.c++
scripts/training/phrase-extract/pcfg-common/bin/gcc-4.6.3/r
