Re: [Moses-support] Filtering for tree-based models

2012-08-03 Thread Philip Williams
Hi Rasul, the filter-rule-table.py script can filter string-to-tree or hierarchical rule tables. The filter-model-given-input.pl script (with the --Hierarchical option) calls the former script to perform filtering in addition to performing some extra steps that are required in the standard Mos

Re: [Moses-support] help with filtering the noise enties in phrase-table.

2012-08-03 Thread Barry Haddow
Hi Jun It's normal for the phrase table to contain a lot of "noise", and generally the decoder can cope with this since it looks at various sources of information, ie different phrase scores, language model, reordering model. Moses also applies a cutoff when it loads translation options, so m

Re: [Moses-support] help with filtering the noise enties in phrase-table.

2012-08-03 Thread Jun.Tan
Hi Barry, Thank you very much! I’ll do a test with this tool. Btw, the download URL link on Moses website is unreachable. The project site should be: http://projectile.sv.cmu.edu/research/public/tools/salm/salm.htm#update From: Barry Haddow [mailto:bhad...@staffmail.ed.ac.uk] Sent: Friday, Augus

[Moses-support] Adding compact phrase table to trunk

2012-08-03 Thread Marcin Junczys-Dowmunt
Hi all, I have a created a new branch "minphr" in which I am going to prepare a version of my compact phrase table that can be easily merged into the trunk. I have several questions here, so I do not cause any trouble when merging. Also I want to include a usage instruction in my MTM2012 paper,

Re: [Moses-support] Adding compact phrase table to trunk

2012-08-03 Thread Hieu Hoang
Hi Marcin, glad to hear it, a compact phrase table could be really useful. All you points seems good. I think the code has changed a bit since you forked, it may take a while to merge. Before you git push, please run the regression test. ./bjam .. -a --with-regtest=[moses-reg-test-data]

[Moses-support] Experiment error: mkcls

2012-08-03 Thread Mauro Zanotti
Dear all, I launched an experiment in the new moses installation (latest version of irstlm and randlm, yesterday git version of moses) and I get an error in the training-prepare-data phase. In the TRAINING_prepare-data.4.STDERR file there are following lines Can't exec "/mkcls": File or direcory

[Moses-support] Please help me about how to generate word alignment information in Nbest results with moses

2012-08-03 Thread yang haitong
Dear, I am a student researching on SMT. Moses is an open powerful tool. Recently I want to generate word alignment in N-best output with Moses. For example, the below sentence is outputted by moses and it has word alignment information such as "0=0". A sentence generated by

Re: [Moses-support] moses installation problem

2012-08-03 Thread Kenneth Heafield
Hi Yvette, Think I found the bug, which was in the test. If you git pull, does it compile fine for you now? Sorry, Kenneth On 08/03/12 01:51, ygra...@computing.dcu.ie wrote: > Hi Kenneth, > > Both the following commands are in the list of processes for top: > > util/bin/gcc-4.3/releas

Re: [Moses-support] Filtering for tree-based models

2012-08-03 Thread rasul
Hi Philip, Thanks for the information. I tried filter-model-given-input.pl on tree-to-string and it worked. In fact, I had been previously using it for this model and it used to work. However, I needed to filter against a SAMT-relaxed input and was not sure. So, I did that, translated the

Re: [Moses-support] Filtering for tree-based models

2012-08-03 Thread Hieu Hoang
When I use tree-to-string models, I didn't bother filtering. I just binarized the whole phrase table and run. If your server doesn't have lots of memory, it will be slow, but it will still run Hieu Sent from my flying horse On 3 Aug 2012, at 01:19 PM, ra...@rszk.net wrote: > Hi Philip, > > T

Re: [Moses-support] Filtering for tree-based models

2012-08-03 Thread Philip Williams
Hi Rasul, for the tree-to-string model, if you stripped the XML out of the input file before running filter-model-given-input.pl then I think that should have worked OK. The filtered table would contain some rules that could potentially have been filtered out (if the tree annotation had been a

[Moses-support] Question about discontinuous orientation types

2012-08-03 Thread Daniel Schaut
Hi all, What are the differences between discontinuous, discontinuous right and discontinuous left orientation in lexicalized RMs? I'm a bit lost after hours of skimming through papers. Discontinuous orientation occurs if neither an alignment point to top left nor to the top right in an alignment

Re: [Moses-support] Placeholder drift

2012-08-03 Thread Achim Ruopp
Hi Henry, If you are willing to use XLIFF-style placeholders M4Loc/Okapi already provide support for placeholder preservation with XML input and plain text translation with placeholder reinsertion http://code.google.com/p/m4loc . The later method uses phrase-alignment info from the decoder. Not y

Re: [Moses-support] How to debug the function of GlobalLexicalModel(.h/.cpp) in the Moses

2012-08-03 Thread Philipp Koehn
Hi, there is also a training script for training these models: scripts/training/train-global-lexicon-model.perl but it is VERY slow (months of compute time). -phi On Thu, Aug 2, 2012 at 11:24 AM, Barry Haddow wrote: > Hi Chen > > You should look at this paper to find out what the GlobalLexicalM

[Moses-support] Building Moses with statically linked libraries?

2012-08-03 Thread Sumita Sami
Hello, I’m trying to build Moses with statically linked libraries, but it doesn’t seem to be working. Here’s what I’ve tried so far: ./bjam --clean-all Then ./bjam -j8 link=static I've also tried ./bjam -j8 --build-type=complete The output file continues to be only dynamically li

Re: [Moses-support] Building Moses with statically linked libraries?

2012-08-03 Thread Kenneth Heafield
Hi, Moses attempts to link statically by default but falls back to dynamic links. You must have static versions of all the dependencies installed as well. Run bjam --debug-configuration and, near the top, it will show you some command lines followed by their exit code. In order to

Re: [Moses-support] Best IDE for manipulate

2012-08-03 Thread Hieu Hoang
I would recommend Eclipse with the C++ plugin http://www.eclipse.org/downloads/moreinfo/c.php if you have any issues with it, please let me know and I can help you. if you have a mac, there are already xcode files for moses in the directory contrib/other-builds/ __

Re: [Moses-support] Please help me about how to generate word alignment information in Nbest results with moses

2012-08-03 Thread Hieu Hoang
i don't think it's available for syntax-model. in moses-cmd/src/IOWrapper.cpp line 454, there is variable includeAlignment however, in moses-chart-cmd/src/IOWrapper.cpp, this is commented out. you're welcome to change the code to enable it. Email me if you have any problems On 03/08/2012 1