Re: Language packs version 3

​Hello, I am a happy user of Apache Joshua Language packs! Thank you for your work! I would like to ask you for language packs, in particular polish - english version. *Where could I find version 3 of language packs of any language pair?* I would like to run a language pack with "Improved

[RESULT] WAS Re: [VOTE] Graduate the Apache Joshua (Incubating) Project

Hi Folks, 72 hours has come and gone. I am closing off this thread. Thank you to everyone that VOTE'd. RESULT is below [7] +1 Graduate the Apache Joshua (Incubating) Project Rajesh Dharmadhikari Lewis John McGibbney* Tommaso Teofili* Thamme Gowda* Tom Barber* Chris A. Mattmann* kellen sunderland*

Re: [VOTE] Graduate the Apache Joshua (Incubating) Project

+1 (binding) On Thu, Apr 26, 2018 at 7:06 PM, Mattmann, Chris A (1761) < chris.a.mattm...@jpl.nasa.gov> wrote: > +1! > > Sent from my iPhone > > On Apr 26, 2018, at 5:04 PM, Tom Barber spicule.co.uk>> wrote: > > +1 > > On Fri, 27 Apr 2018, 00:58 Thamme Gowda,

Re: [VOTE] Graduate the Apache Joshua (Incubating) Project

+1! Sent from my iPhone On Apr 26, 2018, at 5:04 PM, Tom Barber > wrote: +1 On Fri, 27 Apr 2018, 00:58 Thamme Gowda, > wrote: +1 (binding) Cheers, TG -- *Thamme Gowda * @thammegowda

Re: [VOTE] Graduate the Apache Joshua (Incubating) Project

+1 (binding) Cheers, TG -- *Thamme Gowda * @thammegowda | https://isi.edu/~tg ~Sent via somebody's Webmail server 2018-04-24 22:02 GMT-07:00 lewis john mcgibbney : > Hi Folks, > I would like to open a VOTE for graduating the Apache Joshua

[VOTE] Graduate the Apache Joshua (Incubating) Project

Hi Folks, I would like to open a VOTE for graduating the Apache Joshua (Incubating) project. For those that are interested, the Incubator guidelines on graduation can be found at [0]. Joshua has been reporting to the IPMC since 16th March 2016 and made one Incubating release. Joshua Basics -

Fwd: FW: March 2018 Newsletter - LDC

-- Forwarded message - From: Mcgibbney, Lewis J (398M) Date: Thu, Mar 15, 2018 at 08:29 Subject: FW: March 2018 Newsletter - LDC To: lewis john mcgibbney Dr. Lewis John McGibbney Ph.D., B.Sc. Data Scientist II Computer

Re: Hadoop tmp Directory Issue

Hi Mozhdeh, As you can see from the pipeline.pl source [0], you are required to override the '-tmp' flag [1] on the pipeline.pl execution. I would highly encourage you to also scope out the entire parameter and flag options to geta better feel for the pipeline execution. HTH Lewis [0]

Hadoop tmp Directory Issue

Hi, I'm working with joshua on a grid computing system. The problem I face is that although I modify hadoop.tmp.dir and set it to the temporary directory assigned to me, Hadoop still ends up in /tmp. This causes serious problems because the next user that wants to run joshua and is assigned

Re: pipeline.pl failed

Hi Marco, I've retained the lines of logging which indicate that your source and target corpus' are not available or are not found by the pipeline. Please make sure that the file are available at /home/joshua/joshua/LRTenit/RUN7/data/train/train Lewis On Mon, Oct 23, 2017 at 8:14 AM, <

pipeline.pl failed

Hi, I've downloaded and succcessfully installed Joshua from GIT (git clone https://github.com/apache/incubator-joshua joshua) on an Ubuntu server 14.04 machine. After a pipeline run (as described in The Joshua Pipeline (6.1) I get the following error... Can you help me to fix it? Thank

Re: use the en to de language pack

maybe it was forgotten. just try any english sentence then matt (from my phone) > Le 13 oct. 2017 à 17:17, blackthirt33n . a écrit : > > in the instructions for the language pack it states the following: > # SRC and TRG are the two-character ISO 639-1 language codes > tar

Re: how can i demonstrate joshua

you have to install libbz2. this will have a package name of something like “bzip2-devel”. matt (from my phone) > Le 10 oct. 2017 à 17:08, blackthirt33n . a écrit : > > i have been following that but have hit a snag: > > vagrant@ubuntu:~/joshua$ ./jni/build_kenlm.sh >

Re: how can i demonstrate joshua

i have been following that but have hit a snag: vagrant@ubuntu:~/joshua$ ./jni/build_kenlm.sh Using JOSHUA=/home/vagrant/joshua -- The C compiler identification is GNU 6.3.0 -- The CXX compiler identification is GNU 6.3.0 -- Check for working C compiler: /usr/bin/cc -- Check for working C

Re: how can i demonstrate joshua

Hi James, The instructions should be relatively self-contained with in the following tutorial: https://cwiki.apache.org/confluence/display/JOSHUA/Language+Packs#LanguagePacks-UsingLanguagePacks The first few commands there should start you on your way; let us know if you have more specific

Re: Download links

Also from a graduation pov, we need to get off of Matt hosting downloads in his .edu space. :) On Fri, Aug 25, 2017 at 3:25 PM, Tom Barber wrote: > Hi folks > > You probably know, your download links are empty. If you don't, you do now. > > Tom > -- Tom Barber CTO

Re: Joshua

By deleting grammar.gz and re-running the pipeline script, Joshua will recognize that it needs to restart from the grammar step. If the grammar.gz file is something like 24 bytes, then it's an empty gzipped file. -John On Mon, Aug 14, 2017 at 5:57 AM, Arezoo Arjomand

Re: Joshua

Hi, i want to run Joshua on a server. how much disk space should i get to run the ldc corpus which is in the fisher folder?thank you

Re: Joshua

how can i run from the grammar step?it could be from disk space? disk space is 68 GB...

Re: Joshua

 how can i run form the grammar step? On Monday, August 14, 2017 4:58 AM, Matt Post wrote: It looks like grammar sorting is failing. Check the logs to see why. Delete grammar.* and try again from that step. On Aug 14, 2017, at 10:49 AM, Arezoo Arjomand

Re: Joshua

how can i run from the grammar step?  -- Best Regards Arezoo Arjomandzadeh MSc student in Artificial Intelligence Computer & IT engineering Shahrood University of Technology, Iran On Monday, August 14, 2017 4:58 AM, Matt Post wrote: It looks like grammar sorting is

Re: Joshua

It looks like grammar sorting is failing. Check the logs to see why. Delete grammar.* and try again from that step. > On Aug 14, 2017, at 10:49 AM, Arezoo Arjomand > wrote: > > Hi, > I add "--aligner giza" to terminal command. It

Re:

Hi Dear Thank you for your reply. I follow the instruction and  run bash download-deps.sh. after yout email, I run ./download-deps.sh. The bin folder contains bleu, debug-joshua, extract-1best, GIZA++, joshua, joshua-decoder, meteor, mkcls, pipeline.pl, snt2cooc.out. But still when I run the

Re:

Hi Azeroo, I'm replying to you and to the user@joshua mailing list. Matt is on this list, the old Google Group isn't used any more, and Hieu is not involved in Joshua development. Looks like the job died at * cmd=rm -f alignments/0/corpus.0-0.*; /joshua/scripts/training/run-giza.pl

Re: joshua prints hyphens instead of translation

Hi Nicoara, I finally had a minute to look at this, and it seems to me that everything is working fine, and this is just the normal kind of noise you might expect from MT systems when tested on data that is different from what they are trained on. You have somehow picked two sentences ("hello"

Re: joshua prints hyphens instead of translation

Hello, I think this is an important issue to solve for the following reasons: 1) this is one of only two language packs that have both *-en and en-*. 2) there seems to be no solution to running the language pack on Windows 3) German is a very circulated language Please let me know when this

Re: joshua prints hyphens instead of translation

Hello, Is the response ok ? Thank you On July 4, 2017, at 7:59 PM, Nicoara Talpes wrote: Hello, Here it is: nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ head example.SRC | ./prepare.sh | ./joshua -v 1 INFO - Parameters read from configuration file:

Re: joshua prints hyphens instead of translation

Sorry, that should be "joshua -v 1", can you show that, please? > On Jul 4, 2017, at 12:25 PM, Nicoara Talpes > wrote: > > Hello, > > Thanks for responding . > > Here it is the output, I hope it clarifies a little: > >

Re: joshua prints hyphens instead of translation

Hello, Thanks for responding . Here it is the output, I hope it clarifies a little: nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ head example.SRC hello how are you nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ head example.SRC | ./prepare.sh hello how are

Re: joshua prints hyphens instead of translation

Hi Nicoara, Sorry, I seem to have missed your followup question. Can you please debug this a little? What do you get from the following commands? head example.SRC head example.SRC | ./prepare.sh head example.SRC | ./prepare.sh | ./joshua -v matt > On Jul 3, 2017, at

Re: cannot allocate memory

Yes, the default memory is not set very well on many of these language packs. John's suggestions here should solve the problem. Please do let us know! matt > On Jun 26, 2017, at 2:09 PM, John Hewitt > wrote: > > Hi Nicoara, > >

Re: cannot allocate memory

Hi Nicoara, Machine translation is a memory-intensive task, with large amounts of memory used for storing translation information and language modeling information. >From the language packs page : add an option to the decoder

Re: Error while running the tutorial

Hi! I used your files and I got the same error. I'll check the hadoop environment again. Apparently, it's all pointing out to that as the source of the problem. Thank you! Best, Fernando On 29 November 2016 at 14:11, Matt Post wrote: > I just tried this on my machine and

Re: [VOTE] Release Apache Joshua 6.1 RC#2

+1 Tommaso Il giorno mer 23 nov 2016 alle ore 15:25 kellen sunderland < kellen.sunderl...@gmail.com> ha scritto: > +1, many thanks Lewis. > > On Wed, Nov 23, 2016 at 2:34 PM, Matt Post wrote: > > > +1 Thanks, Lewis! > > > > > > > On Nov 23, 2016, at 12:15 AM, lewis john

Re: [VOTE] Release Apache Joshua 6.1 RC#2

+1 Thanks, Lewis! > On Nov 23, 2016, at 12:15 AM, lewis john mcgibbney wrote: > > Hello user@ and dev, > Please VOTE on the Apache Joshua 6.1 Release Candidate #2. > > We solved 50 issues: https://s.apache.org/joshua6.1 > > Git source tag

Re: Apache Joshua Project

1. Yes, you can translate as much as you'd like. Do you mean lots of sentences or long sentences? 2. Yes, that is what it does. It even offers (in server mode) a Google-translate-style API. 3. There may be someone interested in helping you. What exactly are you trying to do? What do you mean

Re: test incubator

received. On Tue, Nov 22, 2016 at 11:05 PM, Matt Post wrote: > > > matt (from my phone) >

test

matt (from my phone)

test incubator

matt (from my phone)

[VOTE] Release Apache Joshua 6.1 RC#2

Hello user@ and dev, Please VOTE on the Apache Joshua 6.1 Release Candidate #2. We solved 50 issues: https://s.apache.org/joshua6.1 Git source tag (29c8be650d53216f779a340d33f8f61af4d45629): https://s.apache.org/pk2t Staging repo:

Re: Error while running the tutorial

Hi, The number is 0. The corpus I'm using is the one provided with the download: ASR. Well, I tried with Hadoop 2.7.3, 2.6.5 and 2.5.2 and I get the exact same error. What could be wrong with its setup? It's just adding the $HADOOP_HOME/bin to the PATH. By the way, I really appreciate all the

Re: Error while running the tutorial

It looks like you have a very small corpus. Can you tell me what number this command reports? gzip -cd grammar.gz | grep Infinity | wc -l matt > On Nov 22, 2016, at 5:28 PM, Fernando E Alva Manchego > wrote: > > Hello, > > I'm using Hadoop 2.7.3 and

Re: Error while running the tutorial

Hello, I'm using Hadoop 2.7.3 and Java 8. Apparently, the Hadoop setup is OK, according to the instructions given in: https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-common/SingleCluster.html#Standalone_Operation I'll try and earlier version of Hadoop and see how it goes.

Re: Error while running the tutorial

Grepping through the log file, I found the following problem: class edu.jhu.thrax.hadoop.features.annotation.AnnotationFeatureJob FAILED This is a prereq of OutputJob, hence OutputJob failed. Here's a link to a useful closed issue with an almost identical problem.

Re: Error while running the tutorial

eigen3 is not necessary. What is the file size of grammar.gz? > On Nov 22, 2016, at 7:54 AM, Fernando E Alva Manchego > wrote: > > Hello, > > Well, I ran that command and it went fine: build 100% > > However, now I ran the tutorial command again and I get: >

Re: Unable to run the language packs - facing some errors

Hi, Please send support requests to u...@joshua.apache.org . You need to increase the memory. Edit the joshua script and try doubling it. Let us know. matt (from my phone) > On Nov 21, 2016, at 7:41 AM, Dixon Daniel wrote: > > Hi, >

Re: Error while running the tutorial

Hello, Well, I ran that command and it went fine: build 100% However, now I ran the tutorial command again and I get: * Packing grammar at "grammar.gz" to "../joshua-tutorial/runs/1/tune/model/grammar.gz.packed" * Running the grammar-packer.pl script with the command:

Re: API for Language Pack Server

We will document the HTTP/REST server soon. In the meantime you can see how the ajax queries are formed in the web demo (under web/). But that is limited to one sentence per connection, so it will be lots faster if you use the TCP server mode, which is documented in the README.

Re: [RESULTS] WAS Re: [VOTE] Release Apache Joshua (Incubating) 6.1

Hi Matt, replies inline On Fri, Nov 18, 2016 at 5:54 PM, < user-digest-h...@joshua.incubator.apache.org> wrote: > > From: Matt Post > To: user@joshua.incubator.apache.org > Cc: d...@joshua.incubator.apache.org > Date: Fri, 18 Nov 2016 17:10:17 -0500 > Subject: Re: [RESULTS] WAS

Re: [VOTE] Release Apache Joshua (Incubating) 6.1

+1 Cheers, Dave > On 14 Nov 2016, at 17:16, lewis john mcgibbney wrote: > > [ ] +1, let's get it released!!! > [ ] +/-0, fine, but consider to fix few issues before... > [ ] -1, nope, because... (and please explain why)

Re: [RESULTS] WAS Re: [VOTE] Release Apache Joshua (Incubating) 6.1

I will try and VOTE today sorry for the delay great job Lewis. ++ Chris Mattmann, Ph.D. Principal Data Scientist, Engineering Administrative Office (3010) Manager, Open Source Projects Formulation and Development Office (8212) NASA

Re: [VOTE] Release Apache Joshua (Incubating) 6.1

+1 Thamme On Nov 15, 2016 6:18 AM, "Felix Hieber" wrote: > +1 > > Felix > > On Tue, Nov 15, 2016 at 10:55 AM Tommaso Teofili < > tommaso.teof...@gmail.com> > wrote: > > > +1 > > > > Tommaso > > > > Il giorno lun 14 nov 2016 alle ore 19:16 John Hewitt < > >

Re: Error while running the tutorial

Hi Folks, I submitted a PR to implement OS compatibility running on Mac OSX. https://github.com/joshua-decoder/fisher-callhome-corpus/pull/1 @Fernando I cannot reproduce your issue... I do however encounter the following issue lmcgibbn@LMC-056430 /usr/local/joshua_resources/joshua-tutorial $

Re: Error while running the tutorial

Hello, 1. Here's the list requested: archive-tmp classes generated-sources joshua-6.2-SNAPSHOT.jar joshua-6.2-SNAPSHOT-jar-with-dependencies.jar joshua-6.2-SNAPSHOT-src.tar.gz joshua-6.2-SNAPSHOT-src.zip maven-archiver maven-shared-archive-resources rat.txt surefire-reports test-classes 2.

Re: Building Language Pack's without Mandatory Arguments

Matt you had built me a specialized one and I think it lives on our xdata machine somewhere I’ll take a look but if you still have it that would be grand ++ Chris Mattmann, Ph.D. Chief Architect Instrument Software and Science Data

Re: Building Language Pack's without Mandatory Arguments

Yep, I sure can. That's the one built in to the brew package as well. This email was just a curiosity. It looks like it would be very difficult to transform a packed grammar to a language pack without the accompanying parameters.thanks for the heads up Matt. On Tuesday, April 5, 2016, Matt Post

Re: Building Language Pack's without Mandatory Arguments

Can you not use the posted Spanish → English language pack? > On Apr 5, 2016, at 12:34 PM, Lewis John Mcgibbney > wrote: > > That was my concern Matt. Thanks for the explanation. > Basically I've been passed a packed grammar for Spanish --> English > translation