Re: [Moses-support] Problem with qsub when running experiments
Dear Barry, thanks a lot for your help. In the end we have reinstalled everything in the machine (even the OS) and it seems to be working (at least now tuning is ongoing). I still have to run some other tests, but so far the baseline examples from the website are running as expected, even when I specify several clusters / threads. I have no clue of what happened and I hope I don't have to bother you again with these issues. Best, Carla El 07.05.2015 11:39, Barry Haddow escribió: > Hi Carla > > I don't think your second error is qsub-related, you need to look at > filterphrases.err to see what is going on. > > For the EMS errors, I can't really see why it is detecting that you > have a cluster. As a workaround, I would suggest that you comment out > the call to detect_if_cluster() (line 44 in current master) in > experiment.perl and see if that helps, > > cheers - Barry > > On 06/05/15 14:59, carla.pa...@hermestrans.com wrote: > >> Hi again, >> >> this is the command I use: >> "~/mosesdecoder/scripts/ems/experiment.perl -config config.toy >> -exec" >> >> I have also tried a modification of the configuration file >> "config.placeables". This is when the problem started. To make sure >> that it was not the config file, I tried with an older config.file >> from another experiment which finished without problems (just >> changed the path for the experiment). I tried to run an older >> experiment which worked and also failed this time with the same >> error. >> >> I attach both files, so that you can see them. >> >> I don't know if it might help, but I also tried to run the >> experiment step-by-step and at decoding I also got an error: >> >> /home/hermesta/mosesdecoder/scripts/training/mert-moses.pl >> > /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en >> > /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.es >> /home/hermesta/mosesdecoder/bin/moses >> > /home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini >> --mertdir /home/hermesta/mosesdecoder/bin/ >> >> Using SCRIPTS_ROOTDIR: /home/hermesta/mosesdecoder/scripts >> filtering the phrase tables... mié may 6 15:58:15 CEST 2015 >> exec: >> > /home/hermesta/mosesdecoder/scripts/training/filter-model-given-input.pl >> ./filtered >> > /home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini >> > /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en >> >> Executing: >> > /home/hermesta/mosesdecoder/scripts/training/filter-model-given-input.pl >> ./filtered >> > /home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini >> > /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en >>> filterphrases.out 2> filterphrases.err >> Exit code: 1 >> ERROR: Failed to run >> > '/home/hermesta/mosesdecoder/scripts/training/filter-model-given-input.pl >> ./filtered >> > /home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini >> > /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en'. >> at /home/hermesta/mosesdecoder/scripts/training/mert-moses.pl line >> 1719. >> >> When checking line 1719 of mert-moses.pl, I realized it is also >> related to qsub. >> >> Thank you so much! >> Carla >> >> El 06.05.2015 15:27, Barry Haddow escribió: >> Hi Carla >> >> Not sure what's going on, and no reason why things should change >> when >> you installed asiya. Something else must have changed. >> >> Could you post your EMS config file, and the exact command you use >> to run EMS? >> >> cheers - Barry >> >> On 06/05/15 13:32, carla.pa...@hermestrans.com wrote: >> Hi Barry, >> >> thanks for your prompt reply. If I am not wrong the name of the >> server is "hermesta-Z10PE-D8-WS" (I have taken it from the machine >> information, I attach a screenshot). If I should look somewhere else >> please let me know. >> >> Thanks, >> Carla >> >> El 06.05.2015 14:10, Barry Haddow escribió: >> Hi Carla >> >> What's your server called? >> >> There's a hard-coded list of Edinburgh machines in ems, so I'm >> wondering if it collides with one of them, >> >> cheers - Barry >> >> On 06/05/15 12:56, carla.pa...@hermestrans.com wrote: >> Hi everyone, >> >> First of all, thanks for reading and hopefully giving me some >> useful >> pointer. I am running several SMT experiments on an Ubuntu machine. >> It >> is a multicore machine, but I have commented out the options for >> running >> experiments on multicore machines in the config.file. >> >> Up to last week, I was able to run experiments without problems. >> However, since yesterday I get the error: >> >> "Can't exec "qsub": No existe el archivo o el directorio at >> /home/hermesta/mosesdecoder/scripts/ems/experiment.perl line 1291." >> >> >> Does anyone know what could be going on? The only thing I did was >> installing asiya to assess MT output. My guess is that somehow >> MOSES >> detects that
Re: [Moses-support] Problem with qsub when running experiments
Hi Carla I don't think your second error is qsub-related, you need to look at filterphrases.err to see what is going on. For the EMS errors, I can't really see why it is detecting that you have a cluster. As a workaround, I would suggest that you comment out the call to detect_if_cluster() (line 44 in current master) in experiment.perl and see if that helps, cheers - Barry On 06/05/15 14:59, carla.pa...@hermestrans.com wrote: Hi again, this is the command I use: "~/mosesdecoder/scripts/ems/experiment.perl -config config.toy -exec" I have also tried a modification of the configuration file "config.placeables". This is when the problem started. To make sure that it was not the config file, I tried with an older config.file from another experiment which finished without problems (just changed the path for the experiment). I tried to run an older experiment which worked and also failed this time with the same error. I attach both files, so that you can see them. I don't know if it might help, but I also tried to run the experiment step-by-step and at decoding I also got an error: /home/hermesta/mosesdecoder/scripts/training/mert-moses.pl /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.es /home/hermesta/mosesdecoder/bin/moses /home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini --mertdir /home/hermesta/mosesdecoder/bin/ Using SCRIPTS_ROOTDIR: /home/hermesta/mosesdecoder/scripts filtering the phrase tables... mié may 6 15:58:15 CEST 2015 exec: /home/hermesta/mosesdecoder/scripts/training/filter-model-given-input.pl ./filtered /home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en Executing: /home/hermesta/mosesdecoder/scripts/training/filter-model-given-input.pl ./filtered /home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en > filterphrases.out 2> filterphrases.err Exit code: 1 ERROR: Failed to run '/home/hermesta/mosesdecoder/scripts/training/filter-model-given-input.pl ./filtered /home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en'. at /home/hermesta/mosesdecoder/scripts/training/mert-moses.pl line 1719. When checking line 1719 of mert-moses.pl, I realized it is also related to qsub. Thank you so much! Carla El 06.05.2015 15:27, Barry Haddow escribió: Hi Carla Not sure what's going on, and no reason why things should change when you installed asiya. Something else must have changed. Could you post your EMS config file, and the exact command you use to run EMS? cheers - Barry On 06/05/15 13:32, carla.pa...@hermestrans.com wrote: Hi Barry, thanks for your prompt reply. If I am not wrong the name of the server is "hermesta-Z10PE-D8-WS" (I have taken it from the machine information, I attach a screenshot). If I should look somewhere else please let me know. Thanks, Carla El 06.05.2015 14:10, Barry Haddow escribió: Hi Carla What's your server called? There's a hard-coded list of Edinburgh machines in ems, so I'm wondering if it collides with one of them, cheers - Barry On 06/05/15 12:56, carla.pa...@hermestrans.com wrote: Hi everyone, First of all, thanks for reading and hopefully giving me some useful pointer. I am running several SMT experiments on an Ubuntu machine. It is a multicore machine, but I have commented out the options for running experiments on multicore machines in the config.file. Up to last week, I was able to run experiments without problems. However, since yesterday I get the error: "Can't exec "qsub": No existe el archivo o el directorio at /home/hermesta/mosesdecoder/scripts/ems/experiment.perl line 1291." Does anyone know what could be going on? The only thing I did was installing asiya to assess MT output. My guess is that somehow MOSES detects that it is a multicore machine and tries to parallelize jobs. However, I don't understand why this was not happening last week, for instance. I have also tried to update MOSES by running "git pull" and I also reinstalled MOSES hoping this would fix the problem. My background is linguistics, and thus I am a bit lost now. Thank you very much, Carla Parra Escartín Marie Curie ER - EXPERT ITN Hermes Traducciones ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. __
Re: [Moses-support] Problem with qsub when running experiments
Hi again, this is the command I use: "~/mosesdecoder/scripts/ems/experiment.perl -config config.toy -exec" I have also tried a modification of the configuration file "config.placeables". This is when the problem started. To make sure that it was not the config file, I tried with an older config.file from another experiment which finished without problems (just changed the path for the experiment). I tried to run an older experiment which worked and also failed this time with the same error. I attach both files, so that you can see them. I don't know if it might help, but I also tried to run the experiment step-by-step and at decoding I also got an error: /home/hermesta/mosesdecoder/scripts/training/mert-moses.pl /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.es /home/hermesta/mosesdecoder/bin/moses /home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini --mertdir /home/hermesta/mosesdecoder/bin/ Using SCRIPTS_ROOTDIR: /home/hermesta/mosesdecoder/scripts filtering the phrase tables... mié may 6 15:58:15 CEST 2015 exec: /home/hermesta/mosesdecoder/scripts/training/filter-model-given-input.pl ./filtered /home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en Executing: /home/hermesta/mosesdecoder/scripts/training/filter-model-given-input.pl ./filtered /home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en > filterphrases.out 2> filterphrases.err Exit code: 1 ERROR: Failed to run '/home/hermesta/mosesdecoder/scripts/training/filter-model-given-input.pl ./filtered /home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini /home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en'. at /home/hermesta/mosesdecoder/scripts/training/mert-moses.pl line 1719. When checking line 1719 of mert-moses.pl, I realized it is also related to qsub. Thank you so much! Carla El 06.05.2015 15:27, Barry Haddow escribió: Hi Carla Not sure what's going on, and no reason why things should change when you installed asiya. Something else must have changed. Could you post your EMS config file, and the exact command you use to run EMS? cheers - Barry On 06/05/15 13:32, carla.pa...@hermestrans.com wrote: Hi Barry, thanks for your prompt reply. If I am not wrong the name of the server is "hermesta-Z10PE-D8-WS" (I have taken it from the machine information, I attach a screenshot). If I should look somewhere else please let me know. Thanks, Carla El 06.05.2015 14:10, Barry Haddow escribió: Hi Carla What's your server called? There's a hard-coded list of Edinburgh machines in ems, so I'm wondering if it collides with one of them, cheers - Barry On 06/05/15 12:56, carla.pa...@hermestrans.com wrote: Hi everyone, First of all, thanks for reading and hopefully giving me some useful pointer. I am running several SMT experiments on an Ubuntu machine. It is a multicore machine, but I have commented out the options for running experiments on multicore machines in the config.file. Up to last week, I was able to run experiments without problems. However, since yesterday I get the error: "Can't exec "qsub": No existe el archivo o el directorio at /home/hermesta/mosesdecoder/scripts/ems/experiment.perl line 1291." Does anyone know what could be going on? The only thing I did was installing asiya to assess MT output. My guess is that somehow MOSES detects that it is a multicore machine and tries to parallelize jobs. However, I don't understand why this was not happening last week, for instance. I have also tried to update MOSES by running "git pull" and I also reinstalled MOSES hoping this would fix the problem. My background is linguistics, and thus I am a bit lost now. Thank you very much, Carla Parra Escartín Marie Curie ER - EXPERT ITN Hermes Traducciones ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support ### CONFIGURATION FILE FOR AN SMT EXPERIMENT ### [GENERAL] ### directory in which experiment is run # working-dir = /home/hermesta/Exps/KES_newDev_placeholders # specification of the language pair input-extension = en output-extension = es pair-extension = en-es ### directories that contain tools and data # # moses moses-src-dir = /home/hermesta/mosesdecoder # # moses binaries moses-bin-dir = $moses-src-dir/bin # # moses scripts moses-script-dir = $moses-src-dir/scripts # # directory where GIZA++/MGIZA programs resides external-bin-dir = /home/hermesta/my/installation/dir/fast_align # # srilm #srilm-d
Re: [Moses-support] Problem with qsub when running experiments
Hi Carla Not sure what's going on, and no reason why things should change when you installed asiya. Something else must have changed. Could you post your EMS config file, and the exact command you use to run EMS? cheers - Barry On 06/05/15 13:32, carla.pa...@hermestrans.com wrote: > Hi Barry, > > thanks for your prompt reply. If I am not wrong the name of the server > is "hermesta-Z10PE-D8-WS" (I have taken it from the machine > information, I attach a screenshot). If I should look somewhere else > please let me know. > > Thanks, > Carla > > El 06.05.2015 14:10, Barry Haddow escribió: >> Hi Carla >> >> What's your server called? >> >> There's a hard-coded list of Edinburgh machines in ems, so I'm >> wondering if it collides with one of them, >> >> cheers - Barry >> >> On 06/05/15 12:56, carla.pa...@hermestrans.com wrote: >>> Hi everyone, >>> >>> First of all, thanks for reading and hopefully giving me some useful >>> pointer. I am running several SMT experiments on an Ubuntu machine. It >>> is a multicore machine, but I have commented out the options for >>> running >>> experiments on multicore machines in the config.file. >>> >>> Up to last week, I was able to run experiments without problems. >>> However, since yesterday I get the error: >>> >>> "Can't exec "qsub": No existe el archivo o el directorio at >>> /home/hermesta/mosesdecoder/scripts/ems/experiment.perl line 1291." >>> >>> Does anyone know what could be going on? The only thing I did was >>> installing asiya to assess MT output. My guess is that somehow MOSES >>> detects that it is a multicore machine and tries to parallelize jobs. >>> However, I don't understand why this was not happening last week, for >>> instance. I have also tried to update MOSES by running "git pull" and I >>> also reinstalled MOSES hoping this would fix the problem. My background >>> is linguistics, and thus I am a bit lost now. >>> >>> Thank you very much, >>> >>> Carla Parra Escartín >>> Marie Curie ER - EXPERT ITN >>> Hermes Traducciones >>> >>> >>> ___ >>> Moses-support mailing list >>> Moses-support@mit.edu >>> http://mailman.mit.edu/mailman/listinfo/moses-support -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Problem with qsub when running experiments
Hi Carla What's your server called? There's a hard-coded list of Edinburgh machines in ems, so I'm wondering if it collides with one of them, cheers - Barry On 06/05/15 12:56, carla.pa...@hermestrans.com wrote: > Hi everyone, > > First of all, thanks for reading and hopefully giving me some useful > pointer. I am running several SMT experiments on an Ubuntu machine. It > is a multicore machine, but I have commented out the options for running > experiments on multicore machines in the config.file. > > Up to last week, I was able to run experiments without problems. > However, since yesterday I get the error: > > "Can't exec "qsub": No existe el archivo o el directorio at > /home/hermesta/mosesdecoder/scripts/ems/experiment.perl line 1291." > > Does anyone know what could be going on? The only thing I did was > installing asiya to assess MT output. My guess is that somehow MOSES > detects that it is a multicore machine and tries to parallelize jobs. > However, I don't understand why this was not happening last week, for > instance. I have also tried to update MOSES by running "git pull" and I > also reinstalled MOSES hoping this would fix the problem. My background > is linguistics, and thus I am a bit lost now. > > Thank you very much, > > Carla Parra Escartín > Marie Curie ER - EXPERT ITN > Hermes Traducciones > > > ___ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
[Moses-support] Problem with qsub when running experiments
Hi everyone, First of all, thanks for reading and hopefully giving me some useful pointer. I am running several SMT experiments on an Ubuntu machine. It is a multicore machine, but I have commented out the options for running experiments on multicore machines in the config.file. Up to last week, I was able to run experiments without problems. However, since yesterday I get the error: "Can't exec "qsub": No existe el archivo o el directorio at /home/hermesta/mosesdecoder/scripts/ems/experiment.perl line 1291." Does anyone know what could be going on? The only thing I did was installing asiya to assess MT output. My guess is that somehow MOSES detects that it is a multicore machine and tries to parallelize jobs. However, I don't understand why this was not happening last week, for instance. I have also tried to update MOSES by running "git pull" and I also reinstalled MOSES hoping this would fix the problem. My background is linguistics, and thus I am a bit lost now. Thank you very much, Carla Parra Escartín Marie Curie ER - EXPERT ITN Hermes Traducciones ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
