[Moses-support] Fwd: about the moses code

2014-07-14 Thread Arefeh Kazemi
Thank you Hieu
It was very useful.
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Fwd: about the moses code

2014-07-14 Thread amir haghighi
Thank you very much Mr Hieu for uploading this helpful video.
unfortunately some part of it, are corrupted( especially the first
minutes), and  what you are typing in the terminal can not be seen.
It would be great if you could upload a better one.
Thank you again.

Amir


On Mon, Jul 14, 2014 at 2:46 AM, Hieu Hoang  wrote:

> I've just uploaded a youtube video about this
>https://www.youtube.com/watch?v=P43h827uLac&feature=youtu.be
> Hope thats useful to you
>
>
>
> On 13 July 2014 22:53, amir haghighi  wrote:
>
>>
>> Hello all
>>
>> it is a week that I want to open moses code with Netbeans od eclipse IDE
>> and I cant.
>> regrading that moses code does not have any make or configure file, could
>> you please help me how can I open and run its code with those IDEs?
>> I should add my feature function to moses code but I can't even open the
>> code with an IDE.
>>
>> I would be very grateful if you could help me.
>>
>> Thank you
>> Amir
>>
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Detokenizer

2014-07-14 Thread Philipp Koehn
Hi,

the tokenizer / detokenizer are indeed not fully able to
reverse to the original string. It is possible to write such
a tokenizer (not easy), but the one that ships with
Moses does not do the job.

-phi

On Mon, Jul 14, 2014 at 11:53 AM, Judah  Schvimer
 wrote:
> Hi,
>
> When I'm using the decoder I have to tokenize my target sentences before I
> translate them. However, when I detokenize them it leaves awkward spaces
> around what was tokenized. is there any way to fix this? It seems to be
> mainly around slashes and colons
>
> Source: :doc:`/tutorial/aggregation-zip-code-data-set`
> Target: : Doc: '/ tutorial / aggregation-zip-code-data-set'
>
> Thanks,
> Judah
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


[Moses-support] Detokenizer

2014-07-14 Thread Judah Schvimer
Hi,

When I'm using the decoder I have to tokenize my target sentences before I
translate them. However, when I detokenize them it leaves awkward spaces
around what was tokenized. is there any way to fix this? It seems to be
mainly around slashes and colons

Source: :doc:`/tutorial/aggregation-zip-code-data-set`
Target: : Doc: '/ tutorial / aggregation-zip-code-data-set'

Thanks,
Judah
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] How to implement "Syntax Based Statistical Machine Translation"

2014-07-14 Thread Philipp Koehn
Hi,

there is a nice tutorial on syntax-based MT on the Moses web site:
http://www.statmt.org/moses/?n=Moses.SyntaxTutorial

-phi

On Sun, Jul 13, 2014 at 5:22 AM, Hieu Hoang  wrote:
> you should try the hierarchical model after the phrase-based model. This
> uses the same algorithms as the syntax model but doesn't need linguistic
> resources.
>
> there are EMS example to create hierarchical models
>
>
> On 10 July 2014 11:26, Asad A.Malik  wrote:
>>
>> Hi All,
>>
>> I've successfully developed "Phrase Based Statistical Machine Translation"
>> for Urdu to English. Now I wanted to move forward to the "Syntax Based". I
>> wanted to know that how can I develop Syntax Based SMT? Do I need linguistic
>> rules in order to develop it?
>>
>> Thanks,
>> Mr. Asad
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Fwd: about the moses code

2014-07-14 Thread Hieu Hoang
I've just uploaded a youtube video about this
   https://www.youtube.com/watch?v=P43h827uLac&feature=youtu.be
Hope thats useful to you



On 13 July 2014 22:53, amir haghighi  wrote:

>
> Hello all
>
> it is a week that I want to open moses code with Netbeans od eclipse IDE
> and I cant.
> regrading that moses code does not have any make or configure file, could
> you please help me how can I open and run its code with those IDEs?
> I should add my feature function to moses code but I can't even open the
> code with an IDE.
>
> I would be very grateful if you could help me.
>
> Thank you
> Amir
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


-- 
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Problem of Concurrent access of MT SYSTEM

2014-07-14 Thread Hieu Hoang
thats strange. I think the server is specifically designed for concurrent
access.

I tested your website by opening several tabs on my browser and requesting
translations. It seemed to work ok.

What errors are you getting? Also, did you change the source code of the
client or server in anyway?





On 13 July 2014 16:45, Ajit Kumar  wrote:

> Sir
>
> Thank you very much for your feedback. We are using binarized the
> phrase table, lexical reordering table and language model files for
> the online as well as offline systems. So loading time is not a
> problem. But the issue is of concurrency. The moses server  in not
> able to serve more than one request at a time.
>
> Kindly suggest some solution. Thanks.
>
>
> On 7/13/14, Hieu Hoang  wrote:
> > Have you binarized the phrase table, lexical reordering table and
> language
> > model files? If not, Moses will take a long time to load. During loading
> it
> > won't be able to translate anything
> >
> > If you have binarized the model files, you should all force them into the
> > filesystem cache if you computer has enough memory. This will make moses
> > run faster.
> >https://www.mail-archive.com/moses-support%40mit.edu/msg05533.html
> >
> > Also, there is an issue with threading with moses server that makes it
> > slower than it should be. We will fix it soon.
> >
> > On 11 July 2014 16:35, Vishal Goyal(विशाल गोयल) 
> > wrote:
> >
> >> Hello friends,
> >> I have developed Hindi to Punjabi MachineTranslation System using MOSES
> >> Toolkit and installed on dedicated Server and the web address for the
> >> same
> >> is http://116.193.161.115/cgi-bin/hi2pu/index.cgi
> >> This is working fine. Now, I am facing the problem is that When I tried
> >> load testing, I mean I opened 4-5 tabs in the web browser and given
> input
> >> text for translation, It started giving Internal Server Error. Then
> after
> >> 5
> >> minutes it started working but it always fails to handle multiple
> >> requests.
> >> Kindly help in resoving this issue
> >>
> >> --
> >> *Regards,*
> >> Vishal Goyal,
> >> Ph.D., M.Tech., MCA, M.C.S.D.
> >> Assistant Professor(Stage III),
> >> Department of Computer Science,
> >> Punjabi University Patiala-147002
> >> *[ICON 2014- http://ltrc.iiit.ac.in/icon/2014/
> >> ]*
> >> [*Online Hindi to Punjabi Machine Translation Tool -*
> >> http://h2p.learnpunjabi.org ]
> >> *[Research Cell: An International Journal of Engineering Sciences,
> >> http://ijoes.vidyapublications.com  >]*
> >>
> >>
> >> ___
> >> Moses-support mailing list
> >> Moses-support@mit.edu
> >> http://mailman.mit.edu/mailman/listinfo/moses-support
> >>
> >>
> >
> >
> > --
> > Hieu Hoang
> > Research Associate
> > University of Edinburgh
> > http://www.hoang.co.uk/hieu
> >
>
>
> --
> Ajit Kumar
> Multani Mal Modi College
> Patiala
>
> Mobile 9855544225
>
>


-- 
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support