Re: Cleaning up Jira

[Lewis John Mcgibbney]

DONE
ALL issues are now mapped over.
In addition the site is now hosted at Apache -
https://git-wip-us.apache.org/repos/asf?p=incubator-joshua-site.git
The site is being tracked via
https://issues.apache.org/jira/browse/INFRA-11295

On Mon, Apr 4, 2016 at 10:15 PM, Lewis John Mcgibbney <
lewis.mcgibb...@gmail.com> wrote:

> Yeah we can but the issue still persists with reopening all issues which
> are currently open over on Github.
> I'm going to do it right now. I'll try and silence as many of the messages
> as possible.
>
> On Mon, Apr 4, 2016 at 3:09 PM, Tom Barber 
> wrote:
>
>> For Jira can't we do a bulk change on all open/in progress task that's
>> fixed version is either No Version or Release Versions?
>>
>> Or did I misunderstand?
>>
>> --
>>
>> Director Meteorite.bi - Saiku Analytics Founder
>> Tel: +44(0)5603641316
>>
>> (Thanks to the Saiku community we reached our Kickstart
>> <
>> http://kickstarter.com/projects/2117053714/saiku-reporting-interactive-report-designer/
>> >
>> goal, but you can always help by sponsoring the project
>> )
>>
>> On 4 April 2016 at 22:23, Mattmann, Chris A (3980) <
>> chris.a.mattm...@jpl.nasa.gov> wrote:
>>
>> > +1 I’ll take a look tonight
>> >
>> > ++
>> > Chris Mattmann, Ph.D.
>> > Chief Architect
>> > Instrument Software and Science Data Systems Section (398)
>> > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> > Office: 168-519, Mailstop: 168-527
>> > Email: chris.a.mattm...@nasa.gov
>> > WWW:  http://sunset.usc.edu/~mattmann/
>> > ++
>> > Director, Information Retrieval and Data Science Group (IRDS)
>> > Adjunct Associate Professor, Computer Science Department
>> > University of Southern California, Los Angeles, CA 90089 USA
>> > WWW: http://irds.usc.edu/
>> > ++
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > On 4/4/16, 5:17 PM, "Lewis John Mcgibbney" 
>> > wrote:
>> >
>> > >Hi Folks,
>> > >OK so Jira [0] is a bit of a mess with the following unresolved issue
>> > stats
>> > >for following versions
>> > >
>> > >5.0 23 6.0 7 6.1 2 Unscheduled 214
>> > >Basically, we need to close off all of the issues as resolved apart
>> from
>> > >the ones currently assigned to 6.1 as unresolved.
>> > >
>> > >We then need to locate all of the issues mentioned at [1] and assign
>> them
>> > >against 6.1
>> > >
>> > >This is going to be a bit of a PITA, but once it is done we can begin
>> > agree
>> > >upon a release cycle and development roadmap in the build up to
>> ApacheCon
>> > >meetup.
>> > >Ta
>> > >
>> > >[0] https://issues.apache.org/jira/browse/JOSHUA
>> > >[1] https://github.com/joshua-decoder/joshua/issues
>> > >
>> > >--
>> > >*Lewis*
>> >
>>
>
>
>
> --
> *Lewis*
>



-- 
*Lewis*

[jira] [Updated] (JOSHUA-4) Quasi-synchronous grammar

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-4:
--
Fix Version/s: 6.1

> Quasi-synchronous grammar
> -
>
> Key: JOSHUA-4
> URL: https://issues.apache.org/jira/browse/JOSHUA-4
> Project: Joshua
>  Issue Type: New Feature
>Reporter: Courtney Napoles
> Fix For: 6.1
>
>
> In the more long term, I think it would be worth looking into 
> quasi-synchronous grammar support in the decoder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-13) Derivations in the output break MERT

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-13:
---
Fix Version/s: 6.1

> Derivations in the output break MERT
> 
>
> Key: JOSHUA-13
> URL: https://issues.apache.org/jira/browse/JOSHUA-13
> Project: Joshua
>  Issue Type: Bug
>Reporter: Joshua Decoder
> Fix For: 6.1
>
>
> Including derivations or alignments in the output breaks MERT.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-4) Quasi-synchronous grammar

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-4:
---

> Quasi-synchronous grammar
> -
>
> Key: JOSHUA-4
> URL: https://issues.apache.org/jira/browse/JOSHUA-4
> Project: Joshua
>  Issue Type: New Feature
>Reporter: Courtney Napoles
> Fix For: 6.1
>
>
> In the more long term, I think it would be worth looking into 
> quasi-synchronous grammar support in the decoder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-14) GIZA should support parallelization

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-14?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-14:


> GIZA should support parallelization
> ---
>
> Key: JOSHUA-14
> URL: https://issues.apache.org/jira/browse/JOSHUA-14
> Project: Joshua
>  Issue Type: Bug
>Reporter: Joshua Decoder
> Fix For: 6.1
>
>
> https://groups.google.com/forum/#!topic/joshua_support/bFXaCmHOPAg



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-19) Thrax dies on blank lines

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-19?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-19:
---
Fix Version/s: 6.1

> Thrax dies on blank lines
> -
>
> Key: JOSHUA-19
> URL: https://issues.apache.org/jira/browse/JOSHUA-19
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
> Fix For: 6.1
>
>
> Thrax should just skip them.  Also, the pipeline should remove blank lines 
> from the training corpora.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-13) Derivations in the output break MERT

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-13:


> Derivations in the output break MERT
> 
>
> Key: JOSHUA-13
> URL: https://issues.apache.org/jira/browse/JOSHUA-13
> Project: Joshua
>  Issue Type: Bug
>Reporter: Joshua Decoder
> Fix For: 6.1
>
>
> Including derivations or alignments in the output breaks MERT.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-14) GIZA should support parallelization

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-14?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-14:
---
Fix Version/s: 6.1

> GIZA should support parallelization
> ---
>
> Key: JOSHUA-14
> URL: https://issues.apache.org/jira/browse/JOSHUA-14
> Project: Joshua
>  Issue Type: Bug
>Reporter: Joshua Decoder
> Fix For: 6.1
>
>
> https://groups.google.com/forum/#!topic/joshua_support/bFXaCmHOPAg



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-19) Thrax dies on blank lines

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-19?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-19:


> Thrax dies on blank lines
> -
>
> Key: JOSHUA-19
> URL: https://issues.apache.org/jira/browse/JOSHUA-19
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
> Fix For: 6.1
>
>
> Thrax should just skip them.  Also, the pipeline should remove blank lines 
> from the training corpora.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-21) ZMERT shouldn't have to stop and restart the decoder

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-21:


> ZMERT shouldn't have to stop and restart the decoder
> 
>
> Key: JOSHUA-21
> URL: https://issues.apache.org/jira/browse/JOSHUA-21
> Project: Joshua
>  Issue Type: Bug
>Reporter: Joshua Decoder
> Fix For: 6.1
>
>
> Loading the models is an expensive step, and there's no reason that MERT runs 
> have to load them multiple times.  It should just load the decoder once and 
> reuse the running decoder across iterations.  This could be accomplished with 
> a special input command to Joshua that changes the model weights and resets 
> the sentence counter.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-21) ZMERT shouldn't have to stop and restart the decoder

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-21:
---
Fix Version/s: 6.1

> ZMERT shouldn't have to stop and restart the decoder
> 
>
> Key: JOSHUA-21
> URL: https://issues.apache.org/jira/browse/JOSHUA-21
> Project: Joshua
>  Issue Type: Bug
>Reporter: Joshua Decoder
> Fix For: 6.1
>
>
> Loading the models is an expensive step, and there's no reason that MERT runs 
> have to load them multiple times.  It should just load the decoder once and 
> reuse the running decoder across iterations.  This could be accomplished with 
> a special input command to Joshua that changes the model weights and resets 
> the sentence counter.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-22) Parallelize MBR computation

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-22?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-22:


> Parallelize MBR computation
> ---
>
> Key: JOSHUA-22
> URL: https://issues.apache.org/jira/browse/JOSHUA-22
> Project: Joshua
>  Issue Type: Bug
>Reporter: Joshua Decoder
> Fix For: 6.1
>
>
> MBR should be multithreaded.  This would be easy to add following the model 
> used in the InputManager.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-22) Parallelize MBR computation

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-22?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-22:
---
Fix Version/s: 6.1

> Parallelize MBR computation
> ---
>
> Key: JOSHUA-22
> URL: https://issues.apache.org/jira/browse/JOSHUA-22
> Project: Joshua
>  Issue Type: Bug
>Reporter: Joshua Decoder
> Fix For: 6.1
>
>
> MBR should be multithreaded.  This would be easy to add following the model 
> used in the InputManager.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-51) add jhclark/bigfatlm

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-51?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-51:


> add jhclark/bigfatlm
> 
>
> Key: JOSHUA-51
> URL: https://issues.apache.org/jira/browse/JOSHUA-51
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Matt Post
> Fix For: 6.1
>
>
> It would be nice to leverage more Hadoop tools in the pipeline.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-51) add jhclark/bigfatlm

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-51?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-51:
---
Fix Version/s: 6.1

> add jhclark/bigfatlm
> 
>
> Key: JOSHUA-51
> URL: https://issues.apache.org/jira/browse/JOSHUA-51
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Matt Post
> Fix For: 6.1
>
>
> It would be nice to leverage more Hadoop tools in the pipeline.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-71) OS X installation depends on coreutils to run thrax test

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-71?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-71:


> OS X installation depends on coreutils to run thrax test
> 
>
> Key: JOSHUA-71
> URL: https://issues.apache.org/jira/browse/JOSHUA-71
> Project: Joshua
>  Issue Type: Bug
>Reporter: Luke Orland
> Fix For: 6.1
>
>
> the {{gstat}} command from coreutils is not installed in Darwin by default. 
> One must resolve that dependency via Homebrew, Macports, etc.
> The {{test/thrax/test.sh}} test will fail on an OS X system that does not 
> have coreutils installed. We should either change the test so that it does 
> not require coreutils in Darwin or make it clear in the (developer) 
> installation/setup instructions that coreutils are required for this test, 
> check for coreutils when running the thrax test, and output a helpful message 
> instructing the developer to go install coreutils if {{gstat}} is not found.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-93) Clean up examples

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-93?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-93:
---
Fix Version/s: (was: 5.0)
   6.1

> Clean up examples
> -
>
> Key: JOSHUA-93
> URL: https://issues.apache.org/jira/browse/JOSHUA-93
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Juri Ganitkevitch
> Fix For: 6.1
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-75) MERT hangs with very large development sets

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-75:
---
Fix Version/s: 6.1

> MERT hangs with very large development sets
> ---
>
> Key: JOSHUA-75
> URL: https://issues.apache.org/jira/browse/JOSHUA-75
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Matt Post
> Fix For: 6.1
>
>
> From an email from Phu Le:
> > If you want to have a look, here it is:
> > http://ltvp.net/zmert.tar.gz  (zmert folder when it hangs)
> > To reproduce, you can just rerun zmert:
> > java -Xms1G -Xmx3G -cp meteor.jar:zmert.jar joshua.zmert.ZMERT -maxMem 1000 
> > zmert_config.txt
> > 3 input files (dev.matched, dev.reference, decoder_config_base) I fed to 
> > MEMT:
> > http://ltvp.net/data.tar.gz
> > Thanks in advance. Give me a starting point if you have any idea. I'll try 
> > to fix it myself if possible.
> > Regards,
> > LTVP



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-95) Vocabulary locking

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-95?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-95:


> Vocabulary locking
> --
>
> Key: JOSHUA-95
> URL: https://issues.apache.org/jira/browse/JOSHUA-95
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Juri Ganitkevitch
> Fix For: 6.1
>
>
> Vocabulary::id() is still synchronized and a potential point of contention. 
> It would be nice to resolve this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-71) OS X installation depends on coreutils to run thrax test

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-71?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-71:
---
Fix Version/s: 6.1

> OS X installation depends on coreutils to run thrax test
> 
>
> Key: JOSHUA-71
> URL: https://issues.apache.org/jira/browse/JOSHUA-71
> Project: Joshua
>  Issue Type: Bug
>Reporter: Luke Orland
> Fix For: 6.1
>
>
> the {{gstat}} command from coreutils is not installed in Darwin by default. 
> One must resolve that dependency via Homebrew, Macports, etc.
> The {{test/thrax/test.sh}} test will fail on an OS X system that does not 
> have coreutils installed. We should either change the test so that it does 
> not require coreutils in Darwin or make it clear in the (developer) 
> installation/setup instructions that coreutils are required for this test, 
> check for coreutils when running the thrax test, and output a helpful message 
> instructing the developer to go install coreutils if {{gstat}} is not found.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-93) Clean up examples

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-93?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-93:


> Clean up examples
> -
>
> Key: JOSHUA-93
> URL: https://issues.apache.org/jira/browse/JOSHUA-93
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Juri Ganitkevitch
> Fix For: 6.1
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-75) MERT hangs with very large development sets

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-75:


> MERT hangs with very large development sets
> ---
>
> Key: JOSHUA-75
> URL: https://issues.apache.org/jira/browse/JOSHUA-75
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Matt Post
> Fix For: 6.1
>
>
> From an email from Phu Le:
> > If you want to have a look, here it is:
> > http://ltvp.net/zmert.tar.gz  (zmert folder when it hangs)
> > To reproduce, you can just rerun zmert:
> > java -Xms1G -Xmx3G -cp meteor.jar:zmert.jar joshua.zmert.ZMERT -maxMem 1000 
> > zmert_config.txt
> > 3 input files (dev.matched, dev.reference, decoder_config_base) I fed to 
> > MEMT:
> > http://ltvp.net/data.tar.gz
> > Thanks in advance. Give me a starting point if you have any idea. I'll try 
> > to fix it myself if possible.
> > Regards,
> > LTVP



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-95) Vocabulary locking

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-95?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-95:
---
Fix Version/s: (was: 5.0)
   6.1

> Vocabulary locking
> --
>
> Key: JOSHUA-95
> URL: https://issues.apache.org/jira/browse/JOSHUA-95
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Juri Ganitkevitch
> Fix For: 6.1
>
>
> Vocabulary::id() is still synchronized and a potential point of contention. 
> It would be nice to resolve this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-105) Packed grammar does not get recreated when a new grammar.gz file is provided

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-105:
-

> Packed grammar does not get recreated when a new grammar.gz file is provided
> 
>
> Key: JOSHUA-105
> URL: https://issues.apache.org/jira/browse/JOSHUA-105
> Project: Joshua
>  Issue Type: Bug
>Reporter: Gaurav Kumar
>Assignee: Matt Post
> Fix For: 6.1
>
>
> When the pipeline is resumed from the TUNE stage, and a new grammar file is 
> provided (following a complete run with an invalid/incomplete grammar), the 
> packed grammar file does not get recreated in the tune and the test 
> directories within $RUNDIR/data. They are detected as cached.
> Steps to recreate : 
> 1. Complete a pipeline run with an invalid grammar file (make sure you get 
> past the TEST stage). You will most probably get BLEU scores of 0
> 2. Now resume the pipeline from the TUNE stage with a new (and proper) 
> grammar file. 
> 3. The packed grammars in $RUNDIR/data/tune/ and $RUNDIR/data/test/ will not 
> be recreated even though a new grammar file was provided.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-100) Add Shen et al. (2008) dependency LM

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-100:

Fix Version/s: 6.1

> Add Shen et al. (2008) dependency LM
> 
>
> Key: JOSHUA-100
> URL: https://issues.apache.org/jira/browse/JOSHUA-100
> Project: Joshua
>  Issue Type: New Feature
>Reporter: Matt Post
>Assignee: Matt Post
> Fix For: 6.1
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-100) Add Shen et al. (2008) dependency LM

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-100:
-

> Add Shen et al. (2008) dependency LM
> 
>
> Key: JOSHUA-100
> URL: https://issues.apache.org/jira/browse/JOSHUA-100
> Project: Joshua
>  Issue Type: New Feature
>Reporter: Matt Post
>Assignee: Matt Post
> Fix For: 6.1
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-105) Packed grammar does not get recreated when a new grammar.gz file is provided

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-105:

Fix Version/s: (was: 5.0)
   6.1

> Packed grammar does not get recreated when a new grammar.gz file is provided
> 
>
> Key: JOSHUA-105
> URL: https://issues.apache.org/jira/browse/JOSHUA-105
> Project: Joshua
>  Issue Type: Bug
>Reporter: Gaurav Kumar
>Assignee: Matt Post
> Fix For: 6.1
>
>
> When the pipeline is resumed from the TUNE stage, and a new grammar file is 
> provided (following a complete run with an invalid/incomplete grammar), the 
> packed grammar file does not get recreated in the tune and the test 
> directories within $RUNDIR/data. They are detected as cached.
> Steps to recreate : 
> 1. Complete a pipeline run with an invalid grammar file (make sure you get 
> past the TEST stage). You will most probably get BLEU scores of 0
> 2. Now resume the pipeline from the TUNE stage with a new (and proper) 
> grammar file. 
> 3. The packed grammars in $RUNDIR/data/tune/ and $RUNDIR/data/test/ will not 
> be recreated even though a new grammar file was provided.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-108) Add option to print chart cell counts post-decoding

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-108:

Fix Version/s: 6.1

> Add option to print chart cell counts post-decoding
> ---
>
> Key: JOSHUA-108
> URL: https://issues.apache.org/jira/browse/JOSHUA-108
> Project: Joshua
>  Issue Type: Bug
>Reporter: Juri Ganitkevitch
> Fix For: 6.1
>
>
> Add a debug output with number of items per chart cell, like Moses, for neat 
> debugging information.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-108) Add option to print chart cell counts post-decoding

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-108:
-

> Add option to print chart cell counts post-decoding
> ---
>
> Key: JOSHUA-108
> URL: https://issues.apache.org/jira/browse/JOSHUA-108
> Project: Joshua
>  Issue Type: Bug
>Reporter: Juri Ganitkevitch
> Fix For: 6.1
>
>
> Add a debug output with number of items per chart cell, like Moses, for neat 
> debugging information.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-107) Verbosity levels

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-107:

Fix Version/s: (was: 5.0)
   6.1

> Verbosity levels
> 
>
> Key: JOSHUA-107
> URL: https://issues.apache.org/jira/browse/JOSHUA-107
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Matt Post
> Fix For: 6.1
>
>
> Joshua should support verbosity levels with a command-line switch, so it's 
> easy to shut it up with something like {{-v 0}} or {{-q}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-107) Verbosity levels

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-107:
-

> Verbosity levels
> 
>
> Key: JOSHUA-107
> URL: https://issues.apache.org/jira/browse/JOSHUA-107
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Matt Post
> Fix For: 6.1
>
>
> Joshua should support verbosity levels with a command-line switch, so it's 
> easy to shut it up with something like {{-v 0}} or {{-q}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-115) Thrax compilation shouldn't require AWS

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-115:

Fix Version/s: 6.1

> Thrax compilation shouldn't require AWS
> ---
>
> Key: JOSHUA-115
> URL: https://issues.apache.org/jira/browse/JOSHUA-115
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Juri Ganitkevitch
> Fix For: 6.1
>
>
> Thrax compilation currently requires $AWS_SDK and $AWS_VERSION to be set. It 
> shouldn't need those!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-123) BLEU scorer parity with Moses

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-123:
-

> BLEU scorer parity with Moses
> -
>
> Key: JOSHUA-123
> URL: https://issues.apache.org/jira/browse/JOSHUA-123
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
> Fix For: 6.1
>
>
> Our BLEU scorer returns different results from the standard Moses one. Find 
> out if this is a bug or different assumptions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-111) Move to string-less feature vectors

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-111:
-

> Move to string-less feature vectors
> ---
>
> Key: JOSHUA-111
> URL: https://issues.apache.org/jira/browse/JOSHUA-111
> Project: Joshua
>  Issue Type: Bug
>Reporter: Juri Ganitkevitch
>Assignee: Juri Ganitkevitch
> Fix For: 6.1
>
>
> Drop silly feature string construction & re-parsing in packed grammars. Could 
> consider moving to faster primitive int-to-float maps for feature vector.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-111) Move to string-less feature vectors

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-111:

Fix Version/s: (was: 6.0)
   6.1

> Move to string-less feature vectors
> ---
>
> Key: JOSHUA-111
> URL: https://issues.apache.org/jira/browse/JOSHUA-111
> Project: Joshua
>  Issue Type: Bug
>Reporter: Juri Ganitkevitch
>Assignee: Juri Ganitkevitch
> Fix For: 6.1
>
>
> Drop silly feature string construction & re-parsing in packed grammars. Could 
> consider moving to faster primitive int-to-float maps for feature vector.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-115) Thrax compilation shouldn't require AWS

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-115:
-

> Thrax compilation shouldn't require AWS
> ---
>
> Key: JOSHUA-115
> URL: https://issues.apache.org/jira/browse/JOSHUA-115
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Juri Ganitkevitch
> Fix For: 6.1
>
>
> Thrax compilation currently requires $AWS_SDK and $AWS_VERSION to be set. It 
> shouldn't need those!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-123) BLEU scorer parity with Moses

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-123:

Fix Version/s: 6.1

> BLEU scorer parity with Moses
> -
>
> Key: JOSHUA-123
> URL: https://issues.apache.org/jira/browse/JOSHUA-123
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
> Fix For: 6.1
>
>
> Our BLEU scorer returns different results from the standard Moses one. Find 
> out if this is a bug or different assumptions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-135) pipeline.pl does not die gracefully

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-135:

Fix Version/s: 6.1

> pipeline.pl does not die gracefully
> ---
>
> Key: JOSHUA-135
> URL: https://issues.apache.org/jira/browse/JOSHUA-135
> Project: Joshua
>  Issue Type: Bug
>Reporter: Gaurav Kumar
>Assignee: Matt Post
> Fix For: 6.1
>
>
> When a component of the pipeline crashes (in my case, decoding lattices), the 
> pipeline.pl script and some java processes do not die gracefully and need to 
> be killed manually.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-129) Constrained decoding heuristics aren't quite right

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-129:

Fix Version/s: 6.1

> Constrained decoding heuristics aren't quite right
> --
>
> Key: JOSHUA-129
> URL: https://issues.apache.org/jira/browse/JOSHUA-129
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
> Fix For: 6.1
>
>
> To implement constrained decoding, we make sure that the LM state of each 
> proposed node matches the input sentence. This is necessary but insufficient. 
> See the test case in test/decoder/constrained, where some constrained 
> sentences have multiple outputs not all equal to the constraints.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-128) Lattice issues

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-128:

Fix Version/s: (was: 5.0)
   6.1

> Lattice issues
> --
>
> Key: JOSHUA-128
> URL: https://issues.apache.org/jira/browse/JOSHUA-128
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Matt Post
> Fix For: 6.1
>
>
> Joshua truncates sentences to 200 tokens, but turns them into a lattice first 
> and computes the shortest path between all pairs. This causes huge problems 
> for buggy input (e.g., 
> https://groups.google.com/forum/#!topic/joshua_support/-2PykKqbnU4 ). A 
> couple things that should change:
> - Don't apply an O(n^2) algorithm to buggy input. Maybe only call 
> calculateAllPairsShortestPaths() lazily.
> - Compute it more efficiently (for example, if you know the input is just a 
> sentence, you could add some shortcuts)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-128) Lattice issues

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-128:
-

> Lattice issues
> --
>
> Key: JOSHUA-128
> URL: https://issues.apache.org/jira/browse/JOSHUA-128
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Matt Post
> Fix For: 6.1
>
>
> Joshua truncates sentences to 200 tokens, but turns them into a lattice first 
> and computes the shortest path between all pairs. This causes huge problems 
> for buggy input (e.g., 
> https://groups.google.com/forum/#!topic/joshua_support/-2PykKqbnU4 ). A 
> couple things that should change:
> - Don't apply an O(n^2) algorithm to buggy input. Maybe only call 
> calculateAllPairsShortestPaths() lazily.
> - Compute it more efficiently (for example, if you know the input is just a 
> sentence, you could add some shortcuts)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-129) Constrained decoding heuristics aren't quite right

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-129:
-

> Constrained decoding heuristics aren't quite right
> --
>
> Key: JOSHUA-129
> URL: https://issues.apache.org/jira/browse/JOSHUA-129
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
> Fix For: 6.1
>
>
> To implement constrained decoding, we make sure that the LM state of each 
> proposed node matches the input sentence. This is necessary but insufficient. 
> See the test case in test/decoder/constrained, where some constrained 
> sentences have multiple outputs not all equal to the constraints.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-142) Packed grammars need a private vocabulary

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-142:
-

> Packed grammars need a private vocabulary
> -
>
> Key: JOSHUA-142
> URL: https://issues.apache.org/jira/browse/JOSHUA-142
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Juri Ganitkevitch
> Fix For: 6.1
>
>
> Currently, only one packed grammar is permitted per decoder instance, because 
> it makes its private, predetermined vocabulary the global one. Packed 
> grammars should instead keep their vocab private and map between the global 
> vocabulary, so that (a) we don't have to worry about seeding the global vocab 
> with the packed one at load time and (b) we can have more than one at a time.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-145) Add truecasing

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-145:

Fix Version/s: (was: 6.0)
   6.1

> Add truecasing
> --
>
> Key: JOSHUA-145
> URL: https://issues.apache.org/jira/browse/JOSHUA-145
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Matt Post
> Fix For: 6.1
>
>
> Joshua currently lowercases all data; a better approach is truecasing, where 
> the most frequent capitalization pattern is used for each token.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-142) Packed grammars need a private vocabulary

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-142:

Fix Version/s: 6.1

> Packed grammars need a private vocabulary
> -
>
> Key: JOSHUA-142
> URL: https://issues.apache.org/jira/browse/JOSHUA-142
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Juri Ganitkevitch
> Fix For: 6.1
>
>
> Currently, only one packed grammar is permitted per decoder instance, because 
> it makes its private, predetermined vocabulary the global one. Packed 
> grammars should instead keep their vocab private and map between the global 
> vocabulary, so that (a) we don't have to worry about seeding the global vocab 
> with the packed one at load time and (b) we can have more than one at a time.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-135) pipeline.pl does not die gracefully

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-135:
-

> pipeline.pl does not die gracefully
> ---
>
> Key: JOSHUA-135
> URL: https://issues.apache.org/jira/browse/JOSHUA-135
> Project: Joshua
>  Issue Type: Bug
>Reporter: Gaurav Kumar
>Assignee: Matt Post
>
> When a component of the pipeline crashes (in my case, decoding lattices), the 
> pipeline.pl script and some java processes do not die gracefully and need to 
> be killed manually.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-148) Process Substitution Error in run-giza.pl?

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-148:

Fix Version/s: 6.1

> Process Substitution Error in run-giza.pl?
> --
>
> Key: JOSHUA-148
> URL: https://issues.apache.org/jira/browse/JOSHUA-148
> Project: Joshua
>  Issue Type: Bug
>Reporter: Tony Fader
> Fix For: 6.1
>
>
> This line creates a command to run and stores the value in 
> {{$__ALIGNMENT_CMD}}:
> https://github.com/joshua-decoder/joshua/blob/master/scripts/training/run-giza.pl#L232
> Then the variable is passed as a command line option in this line: 
> https://github.com/joshua-decoder/joshua/blob/master/scripts/training/run-giza.pl#L265
> This breaks on my system (x86_64 linux running bash as a shell). I modified 
> the code to (I think) work on bash. 
> Here's the changes I made. They probably won't work in other shells that 
> don't have bash's {{<(blah)}} subprocess substitution. Also I found that I 
> had to replace the stdout redirection of the command ({{> output}}) to a 
> command line option ({{-o=output}}) for some reason. I'm not sure what was 
> going on there, either.
> Changes here: 
> https://github.com/afader/joshua/commit/a7540443f59856f363b7101ab4db23c4818504e3



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-145) Add truecasing

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-145:
-

> Add truecasing
> --
>
> Key: JOSHUA-145
> URL: https://issues.apache.org/jira/browse/JOSHUA-145
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Matt Post
> Fix For: 6.1
>
>
> Joshua currently lowercases all data; a better approach is truecasing, where 
> the most frequent capitalization pattern is used for each token.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-150) Add TER

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-150:
-

> Add TER
> ---
>
> Key: JOSHUA-150
> URL: https://issues.apache.org/jira/browse/JOSHUA-150
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
> Fix For: 6.1
>
>
> http://www.cs.umd.edu/~snover/tercom/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-169) LanguageModelFF should compute partial n-grams

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-169:
-

> LanguageModelFF should compute partial n-grams
> --
>
> Key: JOSHUA-169
> URL: https://issues.apache.org/jira/browse/JOSHUA-169
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
> Fix For: 6.1
>
>
> Incomplete n-grams have no estimate, which creates a problem when comparing 
> small phrases (early in decoding) and for short sentences. To fix this, the 
> LanguageModelFF should compute partial n-gram scores, caching the result and 
> the n-gram length in the DP state so that it can be subtracted off later. 
> Another advantage of this is that it would likely allow a large 
> simplification of the FeatureFunction interface, since we would no longer 
> need a computeFinal distinction



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-148) Process Substitution Error in run-giza.pl?

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-148:
-

> Process Substitution Error in run-giza.pl?
> --
>
> Key: JOSHUA-148
> URL: https://issues.apache.org/jira/browse/JOSHUA-148
> Project: Joshua
>  Issue Type: Bug
>Reporter: Tony Fader
>
> This line creates a command to run and stores the value in 
> {{$__ALIGNMENT_CMD}}:
> https://github.com/joshua-decoder/joshua/blob/master/scripts/training/run-giza.pl#L232
> Then the variable is passed as a command line option in this line: 
> https://github.com/joshua-decoder/joshua/blob/master/scripts/training/run-giza.pl#L265
> This breaks on my system (x86_64 linux running bash as a shell). I modified 
> the code to (I think) work on bash. 
> Here's the changes I made. They probably won't work in other shells that 
> don't have bash's {{<(blah)}} subprocess substitution. Also I found that I 
> had to replace the stdout redirection of the command ({{> output}}) to a 
> command line option ({{-o=output}}) for some reason. I'm not sure what was 
> going on there, either.
> Changes here: 
> https://github.com/afader/joshua/commit/a7540443f59856f363b7101ab4db23c4818504e3



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-169) LanguageModelFF should compute partial n-grams

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-169:

Fix Version/s: (was: 6.0)
   6.1

> LanguageModelFF should compute partial n-grams
> --
>
> Key: JOSHUA-169
> URL: https://issues.apache.org/jira/browse/JOSHUA-169
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
> Fix For: 6.1
>
>
> Incomplete n-grams have no estimate, which creates a problem when comparing 
> small phrases (early in decoding) and for short sentences. To fix this, the 
> LanguageModelFF should compute partial n-gram scores, caching the result and 
> the n-gram length in the DP state so that it can be subtracted off later. 
> Another advantage of this is that it would likely allow a large 
> simplification of the FeatureFunction interface, since we would no longer 
> need a computeFinal distinction



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-150) Add TER

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-150:

Fix Version/s: 6.1

> Add TER
> ---
>
> Key: JOSHUA-150
> URL: https://issues.apache.org/jira/browse/JOSHUA-150
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
> Fix For: 6.1
>
>
> http://www.cs.umd.edu/~snover/tercom/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-218) Train and testing quickstart Indian model fails in interactive shell

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-218:
-

> Train and testing quickstart Indian model fails in interactive shell
> 
>
> Key: JOSHUA-218
> URL: https://issues.apache.org/jira/browse/JOSHUA-218
> Project: Joshua
>  Issue Type: Bug
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> I am unable to follow the quickstart when attempting to verify that Joshua is 
> installed and operating correctly from within the brew Formula.
> Logging output below details the commands and output I am getting.
> Note that this is after a successful ant build with all dependencies 
> installed. 
> {code}
> bash-3.2$ ln -s indian-parallel-corpora-1.0 input
> bash-3.2$ $JOSHUA/bin/pipeline.pl --source bn --target en --no-prepare 
> --aligner berkeley --type hiero --corpus input/bn-en/tok/training.bn-en 
> --tune input/bn-en/tok/dev.bn-en --test input/bn-en/tok/devtest.bn-en
> [source-numlines] rebuilding...
>   
> dep=/private/tmp/joshua-v20151002-2032-qnt9ko/indian-parallel-corpora-1.0/bn-en/tok/training.bn-en.bn
>  [CHANGED]
>   cmd=cat 
> /private/tmp/joshua-v20151002-2032-qnt9ko/indian-parallel-corpora-1.0/bn-en/tok/training.bn-en.bn
>  | wc -l
>   took 0 seconds (0s)
> [source-numlines] retrieved cached result =>20788
> [berkeley-aligner-chunk-0] rebuilding...
>   dep=alignments/0/word-align.conf [CHANGED]
>   dep=/private/tmp/joshua-v20151002-2032-qnt9ko/data/train/splits/corpus.bn.0 
> [CHANGED]
>   dep=/private/tmp/joshua-v20151002-2032-qnt9ko/data/train/splits/corpus.en.0 
> [CHANGED]
>   dep=alignments/0/training.align [NOT FOUND]
>   cmd=java -d64 -Xmx10g -jar 
> /private/tmp/joshua-v20151002-2032-qnt9ko/lib/berkeleyaligner.jar 
> ++alignments/0/word-align.conf
>   took 270 seconds (4m30s)
> [aligner-combine] rebuilding...
>   dep=alignments/0/training.align [CHANGED]
>   dep=alignments/training.align [NOT FOUND]
>   cmd=cat alignments/0/training.align > alignments/training.align
>   took 0 seconds (0s)
> [thrax-input-file] rebuilding...
>   
> dep=/private/tmp/joshua-v20151002-2032-qnt9ko/indian-parallel-corpora-1.0/bn-en/tok/training.bn-en.bn
>  [CHANGED]
>   
> dep=/private/tmp/joshua-v20151002-2032-qnt9ko/indian-parallel-corpora-1.0/bn-en/tok/training.bn-en.en
>  [CHANGED]
>   dep=alignments/training.align [CHANGED]
>   dep=/private/tmp/joshua-v20151002-2032-qnt9ko/data/train/thrax-input-file 
> [NOT FOUND]
>   cmd=/private/tmp/joshua-v20151002-2032-qnt9ko/scripts/training/paste 
> /private/tmp/joshua-v20151002-2032-qnt9ko/indian-parallel-corpora-1.0/bn-en/tok/training.bn-en.bn
>  
> /private/tmp/joshua-v20151002-2032-qnt9ko/indian-parallel-corpora-1.0/bn-en/tok/training.bn-en.en
>  alignments/training.align | perl -pe 's/\t/ ||| /g' | grep -v '()' | grep -v 
> '||| \+$' > 
> /private/tmp/joshua-v20151002-2032-qnt9ko/data/train/thrax-input-file
>   took 0 seconds (0s)
> [thrax-prep] rebuilding...
>   dep=/private/tmp/joshua-v20151002-2032-qnt9ko/data/train/thrax-input-file 
> [CHANGED]
>   dep=grammar.gz [NOT FOUND]
>   cmd=hadoop/bin/hadoop fs -rm -r 
> pipeline-bn-en-hiero-_private_tmp_joshua-v20151002-2032-qnt9ko; 
> hadoop/bin/hadoop fs -mkdir 
> pipeline-bn-en-hiero-_private_tmp_joshua-v20151002-2032-qnt9ko; 
> hadoop/bin/hadoop fs -put 
> /private/tmp/joshua-v20151002-2032-qnt9ko/data/train/thrax-input-file 
> pipeline-bn-en-hiero-_private_tmp_joshua-v20151002-2032-qnt9ko/input-file
>   JOB FAILED (return code 1)
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:WARN Failed to set property [port] to value "".
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:WARN Failed to set property [port] to value "".
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> 15/10/02 14:39:29 WARN util.NativeCodeLoader: Unable to load native-hadoop 
> library for your platform... using builtin-java classes where applicable
> rm: Call From localhost/127.0.0.1 to localhost:9000 failed on connection 
> exception: java.net.ConnectException: Connection refused; For more details 
> see:  http://wiki.apache.org/hadoop/ConnectionRefused
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:WARN Failed to set property [por

[jira] [Updated] (JOSHUA-218) Train and testing quickstart Indian model fails in interactive shell

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-218:

Fix Version/s: 6.1

> Train and testing quickstart Indian model fails in interactive shell
> 
>
> Key: JOSHUA-218
> URL: https://issues.apache.org/jira/browse/JOSHUA-218
> Project: Joshua
>  Issue Type: Bug
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> I am unable to follow the quickstart when attempting to verify that Joshua is 
> installed and operating correctly from within the brew Formula.
> Logging output below details the commands and output I am getting.
> Note that this is after a successful ant build with all dependencies 
> installed. 
> {code}
> bash-3.2$ ln -s indian-parallel-corpora-1.0 input
> bash-3.2$ $JOSHUA/bin/pipeline.pl --source bn --target en --no-prepare 
> --aligner berkeley --type hiero --corpus input/bn-en/tok/training.bn-en 
> --tune input/bn-en/tok/dev.bn-en --test input/bn-en/tok/devtest.bn-en
> [source-numlines] rebuilding...
>   
> dep=/private/tmp/joshua-v20151002-2032-qnt9ko/indian-parallel-corpora-1.0/bn-en/tok/training.bn-en.bn
>  [CHANGED]
>   cmd=cat 
> /private/tmp/joshua-v20151002-2032-qnt9ko/indian-parallel-corpora-1.0/bn-en/tok/training.bn-en.bn
>  | wc -l
>   took 0 seconds (0s)
> [source-numlines] retrieved cached result =>20788
> [berkeley-aligner-chunk-0] rebuilding...
>   dep=alignments/0/word-align.conf [CHANGED]
>   dep=/private/tmp/joshua-v20151002-2032-qnt9ko/data/train/splits/corpus.bn.0 
> [CHANGED]
>   dep=/private/tmp/joshua-v20151002-2032-qnt9ko/data/train/splits/corpus.en.0 
> [CHANGED]
>   dep=alignments/0/training.align [NOT FOUND]
>   cmd=java -d64 -Xmx10g -jar 
> /private/tmp/joshua-v20151002-2032-qnt9ko/lib/berkeleyaligner.jar 
> ++alignments/0/word-align.conf
>   took 270 seconds (4m30s)
> [aligner-combine] rebuilding...
>   dep=alignments/0/training.align [CHANGED]
>   dep=alignments/training.align [NOT FOUND]
>   cmd=cat alignments/0/training.align > alignments/training.align
>   took 0 seconds (0s)
> [thrax-input-file] rebuilding...
>   
> dep=/private/tmp/joshua-v20151002-2032-qnt9ko/indian-parallel-corpora-1.0/bn-en/tok/training.bn-en.bn
>  [CHANGED]
>   
> dep=/private/tmp/joshua-v20151002-2032-qnt9ko/indian-parallel-corpora-1.0/bn-en/tok/training.bn-en.en
>  [CHANGED]
>   dep=alignments/training.align [CHANGED]
>   dep=/private/tmp/joshua-v20151002-2032-qnt9ko/data/train/thrax-input-file 
> [NOT FOUND]
>   cmd=/private/tmp/joshua-v20151002-2032-qnt9ko/scripts/training/paste 
> /private/tmp/joshua-v20151002-2032-qnt9ko/indian-parallel-corpora-1.0/bn-en/tok/training.bn-en.bn
>  
> /private/tmp/joshua-v20151002-2032-qnt9ko/indian-parallel-corpora-1.0/bn-en/tok/training.bn-en.en
>  alignments/training.align | perl -pe 's/\t/ ||| /g' | grep -v '()' | grep -v 
> '||| \+$' > 
> /private/tmp/joshua-v20151002-2032-qnt9ko/data/train/thrax-input-file
>   took 0 seconds (0s)
> [thrax-prep] rebuilding...
>   dep=/private/tmp/joshua-v20151002-2032-qnt9ko/data/train/thrax-input-file 
> [CHANGED]
>   dep=grammar.gz [NOT FOUND]
>   cmd=hadoop/bin/hadoop fs -rm -r 
> pipeline-bn-en-hiero-_private_tmp_joshua-v20151002-2032-qnt9ko; 
> hadoop/bin/hadoop fs -mkdir 
> pipeline-bn-en-hiero-_private_tmp_joshua-v20151002-2032-qnt9ko; 
> hadoop/bin/hadoop fs -put 
> /private/tmp/joshua-v20151002-2032-qnt9ko/data/train/thrax-input-file 
> pipeline-bn-en-hiero-_private_tmp_joshua-v20151002-2032-qnt9ko/input-file
>   JOB FAILED (return code 1)
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:WARN Failed to set property [port] to value "".
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:WARN Failed to set property [port] to value "".
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> 15/10/02 14:39:29 WARN util.NativeCodeLoader: Unable to load native-hadoop 
> library for your platform... using builtin-java classes where applicable
> rm: Call From localhost/127.0.0.1 to localhost:9000 failed on connection 
> exception: java.net.ConnectException: Connection refused; For more details 
> see:  http://wiki.apache.org/hadoop/ConnectionRefused
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:ERROR Could not connect to remote log4j server at [localhost]. We will 
> try again later.
> log4j:WARN Failed

[jira] [Reopened] (JOSHUA-172) Speed up grammar file reading with memory-mapped files

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-172:
-

> Speed up grammar file reading with memory-mapped files
> --
>
> Key: JOSHUA-172
> URL: https://issues.apache.org/jira/browse/JOSHUA-172
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
> Fix For: 6.1
>
>
> [This 
> document|http://nadeausoftware.com/articles/2008/02/java_tip_how_read_files_quickly]
>  should be helpful.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-174) Add lattice phrase decoding

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-174:
-

> Add lattice phrase decoding
> ---
>
> Key: JOSHUA-174
> URL: https://issues.apache.org/jira/browse/JOSHUA-174
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>Assignee: Matt Post
> Fix For: 6.1
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-221) ArrayIndexOutOfBoundsException when passing arguments to JoshuaDecoder.main

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-221:

Fix Version/s: 6.1

> ArrayIndexOutOfBoundsException when passing arguments to JoshuaDecoder.main
> ---
>
> Key: JOSHUA-221
> URL: https://issues.apache.org/jira/browse/JOSHUA-221
> Project: Joshua
>  Issue Type: Bug
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> {code}
> lmcgibbn@LMC-032857 /usr/local/joshua(master) $ java -jar class/joshua.jar 
> -version
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 2
>   at joshua.decoder.ArgsParser.(ArgsParser.java:43)
>   at joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:30)
> lmcgibbn@LMC-032857 /usr/local/joshua(master) $ java -jar class/joshua.jar 
> -version -v
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 2
>   at joshua.decoder.ArgsParser.(ArgsParser.java:43)
>   at joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:30)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-221) ArrayIndexOutOfBoundsException when passing arguments to JoshuaDecoder.main

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-221:
-

> ArrayIndexOutOfBoundsException when passing arguments to JoshuaDecoder.main
> ---
>
> Key: JOSHUA-221
> URL: https://issues.apache.org/jira/browse/JOSHUA-221
> Project: Joshua
>  Issue Type: Bug
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> {code}
> lmcgibbn@LMC-032857 /usr/local/joshua(master) $ java -jar class/joshua.jar 
> -version
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 2
>   at joshua.decoder.ArgsParser.(ArgsParser.java:43)
>   at joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:30)
> lmcgibbn@LMC-032857 /usr/local/joshua(master) $ java -jar class/joshua.jar 
> -version -v
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 2
>   at joshua.decoder.ArgsParser.(ArgsParser.java:43)
>   at joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:30)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-234) Unbound variable in joshua-decoder script

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-234:

Fix Version/s: 6.1

> Unbound variable in joshua-decoder script
> -
>
> Key: JOSHUA-234
> URL: https://issues.apache.org/jira/browse/JOSHUA-234
> Project: Joshua
>  Issue Type: Bug
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> This was reported by the Homebrew Jenkins CI build server
> {code}
> Error Message
> failed: brew test --verbose joshua
> Stacktrace
> Testing joshua
> ==> Using the sandbox
> /usr/bin/sandbox-exec -f /tmp/homebrew20151106-70367-hbqww0.sb 
> /System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/bin/ruby -W0 -I 
> /usr/local/Library/Homebrew -- /usr/local/Library/Homebrew/test.rb 
> /usr/local/Library/Formula/joshua.rb --verbose
> ==> /usr/local/Cellar/joshua/6.0.5/bin/joshua-decoder -version
> /usr/local/Cellar/joshua/6.0.5/bin/joshua-decoder: line 27: JOSHUA: unbound 
> variable
> Error: joshua: failed
> Failed executing: /usr/local/Cellar/joshua/6.0.5/bin/joshua-decoder -version
> /usr/local/Library/Homebrew/formula.rb:1431:in `block in system'
> /usr/local/Library/Homebrew/formula.rb:1368:in `open'
> /usr/local/Library/Homebrew/formula.rb:1368:in `system'
> /usr/local/Library/Formula/joshua.rb:59:in `block in '
> /usr/local/Library/Homebrew/formula.rb:1277:in `block in run_test'
> /usr/local/Library/Homebrew/extend/fileutils.rb:17:in `mktemp'
> /usr/local/Library/Homebrew/formula.rb:1273:in `run_test'
> /usr/local/Library/Homebrew/test.rb:28:in `block in '
> /System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/2.0.0/timeout.rb:66:in
>  `timeout'
> /usr/local/Library/Homebrew/test.rb:27:in `'
>   
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-233) Berkeleyaligner to print progress to terminal

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-233:
-

> Berkeleyaligner to print progress to terminal
> -
>
> Key: JOSHUA-233
> URL: https://issues.apache.org/jira/browse/JOSHUA-233
> Project: Joshua
>  Issue Type: Bug
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> Right now when testing Joshua from within the Homebrew recipe, a lot of time 
> is being spent on word alignment(???), I think that it would be more helpful 
> if we could see some activity whilst waiting e.g. a progress bar. 
> {code}
> lmcgibbn@LMC-032857 /usr/local(joshua) $ brew test -vd joshua
> /usr/local/Library/brew.rb (Formulary::FormulaLoader): loading 
> /usr/local/Library/Formula/joshua.rb
> Testing joshua
> /usr/local/Library/Homebrew/test.rb (Formulary::FromPathLoader): loading 
> /usr/local/Library/Formula/joshua.rb
> ==> Downloading 
> https://github.com/joshua-decoder/indian-parallel-corpora/archive/1.0.tar.gz
> Already downloaded: 
> /Library/Caches/Homebrew/joshua--indian-parallel-corpora-1.0.tar.gz
> ==> Verifying joshua--indian-parallel-corpora-1.0.tar.gz checksum
> tar xf /Library/Caches/Homebrew/joshua--indian-parallel-corpora-1.0.tar.gz
> ==> $JOSHUA/bin/pipeline.pl --source bn --target en --no-prepare 
> --aligner berkeley --type hiero --corpus 
> /usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/training.bn-en --tune 
> /usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/dev.bn-en --test 
> /usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/devtest.bn-en
> [source-numlines] rebuilding...
>   dep=/usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/training.bn-en.bn 
> [CHANGED]
>   cmd=cat /usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/training.bn-en.bn | 
> wc -l
>   took 0 seconds (0s)
> [source-numlines] retrieved cached result =>20788
> [berkeley-aligner-chunk-0] rebuilding...
>   dep=alignments/0/word-align.conf [CHANGED]
>   dep=/private/tmp/joshua20151106-17227-1kriiqu/data/train/splits/corpus.bn.0 
> [CHANGED]
>   dep=/private/tmp/joshua20151106-17227-1kriiqu/data/train/splits/corpus.en.0 
> [CHANGED]
>   dep=alignments/0/training.align [NOT FOUND]
>   cmd=java -d64 -Xmx10g -jar 
> /usr/local/Cellar/joshua/6.0.5/libexec/lib/berkeleyaligner.jar 
> ++alignments/0/word-align.conf
> {code}
> The final line above is the one taking a good while!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-233) Berkeleyaligner to print progress to terminal

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-233:

Fix Version/s: 6.1

> Berkeleyaligner to print progress to terminal
> -
>
> Key: JOSHUA-233
> URL: https://issues.apache.org/jira/browse/JOSHUA-233
> Project: Joshua
>  Issue Type: Bug
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> Right now when testing Joshua from within the Homebrew recipe, a lot of time 
> is being spent on word alignment(???), I think that it would be more helpful 
> if we could see some activity whilst waiting e.g. a progress bar. 
> {code}
> lmcgibbn@LMC-032857 /usr/local(joshua) $ brew test -vd joshua
> /usr/local/Library/brew.rb (Formulary::FormulaLoader): loading 
> /usr/local/Library/Formula/joshua.rb
> Testing joshua
> /usr/local/Library/Homebrew/test.rb (Formulary::FromPathLoader): loading 
> /usr/local/Library/Formula/joshua.rb
> ==> Downloading 
> https://github.com/joshua-decoder/indian-parallel-corpora/archive/1.0.tar.gz
> Already downloaded: 
> /Library/Caches/Homebrew/joshua--indian-parallel-corpora-1.0.tar.gz
> ==> Verifying joshua--indian-parallel-corpora-1.0.tar.gz checksum
> tar xf /Library/Caches/Homebrew/joshua--indian-parallel-corpora-1.0.tar.gz
> ==> $JOSHUA/bin/pipeline.pl --source bn --target en --no-prepare 
> --aligner berkeley --type hiero --corpus 
> /usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/training.bn-en --tune 
> /usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/dev.bn-en --test 
> /usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/devtest.bn-en
> [source-numlines] rebuilding...
>   dep=/usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/training.bn-en.bn 
> [CHANGED]
>   cmd=cat /usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/training.bn-en.bn | 
> wc -l
>   took 0 seconds (0s)
> [source-numlines] retrieved cached result =>20788
> [berkeley-aligner-chunk-0] rebuilding...
>   dep=alignments/0/word-align.conf [CHANGED]
>   dep=/private/tmp/joshua20151106-17227-1kriiqu/data/train/splits/corpus.bn.0 
> [CHANGED]
>   dep=/private/tmp/joshua20151106-17227-1kriiqu/data/train/splits/corpus.en.0 
> [CHANGED]
>   dep=alignments/0/training.align [NOT FOUND]
>   cmd=java -d64 -Xmx10g -jar 
> /usr/local/Cellar/joshua/6.0.5/libexec/lib/berkeleyaligner.jar 
> ++alignments/0/word-align.conf
> {code}
> The final line above is the one taking a good while!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-234) Unbound variable in joshua-decoder script

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-234:
-

> Unbound variable in joshua-decoder script
> -
>
> Key: JOSHUA-234
> URL: https://issues.apache.org/jira/browse/JOSHUA-234
> Project: Joshua
>  Issue Type: Bug
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> This was reported by the Homebrew Jenkins CI build server
> {code}
> Error Message
> failed: brew test --verbose joshua
> Stacktrace
> Testing joshua
> ==> Using the sandbox
> /usr/bin/sandbox-exec -f /tmp/homebrew20151106-70367-hbqww0.sb 
> /System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/bin/ruby -W0 -I 
> /usr/local/Library/Homebrew -- /usr/local/Library/Homebrew/test.rb 
> /usr/local/Library/Formula/joshua.rb --verbose
> ==> /usr/local/Cellar/joshua/6.0.5/bin/joshua-decoder -version
> /usr/local/Cellar/joshua/6.0.5/bin/joshua-decoder: line 27: JOSHUA: unbound 
> variable
> Error: joshua: failed
> Failed executing: /usr/local/Cellar/joshua/6.0.5/bin/joshua-decoder -version
> /usr/local/Library/Homebrew/formula.rb:1431:in `block in system'
> /usr/local/Library/Homebrew/formula.rb:1368:in `open'
> /usr/local/Library/Homebrew/formula.rb:1368:in `system'
> /usr/local/Library/Formula/joshua.rb:59:in `block in '
> /usr/local/Library/Homebrew/formula.rb:1277:in `block in run_test'
> /usr/local/Library/Homebrew/extend/fileutils.rb:17:in `mktemp'
> /usr/local/Library/Homebrew/formula.rb:1273:in `run_test'
> /usr/local/Library/Homebrew/test.rb:28:in `block in '
> /System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/2.0.0/timeout.rb:66:in
>  `timeout'
> /usr/local/Library/Homebrew/test.rb:27:in `'
>   
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-239) Dependency addition to Joshua-Decoder/Joshua/pom.xml

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-239:

Fix Version/s: 6.1

> Dependency addition to Joshua-Decoder/Joshua/pom.xml
> 
>
> Key: JOSHUA-239
> URL: https://issues.apache.org/jira/browse/JOSHUA-239
> Project: Joshua
>  Issue Type: Bug
>Reporter: Chris A. Mattmann
> Fix For: 6.1
>
>
>  
> args4j args4j 
> 2.32
> Joshua-Decoder/Joshua committer please add this dependency to pom.xml
> thank you/
> Martin



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-239) Dependency addition to Joshua-Decoder/Joshua/pom.xml

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-239:
-

> Dependency addition to Joshua-Decoder/Joshua/pom.xml
> 
>
> Key: JOSHUA-239
> URL: https://issues.apache.org/jira/browse/JOSHUA-239
> Project: Joshua
>  Issue Type: Bug
>Reporter: Chris A. Mattmann
> Fix For: 6.1
>
>
>  
> args4j args4j 
> 2.32
> Joshua-Decoder/Joshua committer please add this dependency to pom.xml
> thank you/
> Martin



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-238) pipeline.pl should print help

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-238:
-

> pipeline.pl should print help
> -
>
> Key: JOSHUA-238
> URL: https://issues.apache.org/jira/browse/JOSHUA-238
> Project: Joshua
>  Issue Type: Bug
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> It would be very handy if pipeline.pl prints all command line options if 
> invoked without parameters or with --help.
> This issue will address that.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-238) pipeline.pl should print help

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-238:

Fix Version/s: 6.1

> pipeline.pl should print help
> -
>
> Key: JOSHUA-238
> URL: https://issues.apache.org/jira/browse/JOSHUA-238
> Project: Joshua
>  Issue Type: Bug
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> It would be very handy if pipeline.pl prints all command line options if 
> invoked without parameters or with --help.
> This issue will address that.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-246) Feature request: Incorporate k-best MBR

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-246:

Fix Version/s: 6.1

> Feature request: Incorporate k-best MBR
> ---
>
> Key: JOSHUA-246
> URL: https://issues.apache.org/jira/browse/JOSHUA-246
> Project: Joshua
>  Issue Type: New Feature
>Reporter: Matt Post
> Fix For: 6.1
>
>
> MBR currently operates on the n-best decoder output. This should also be 
> available in the decoder itself, and triggered with a {{-mbr}} flag.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-246) Feature request: Incorporate k-best MBR

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-246:
-

> Feature request: Incorporate k-best MBR
> ---
>
> Key: JOSHUA-246
> URL: https://issues.apache.org/jira/browse/JOSHUA-246
> Project: Joshua
>  Issue Type: New Feature
>Reporter: Matt Post
> Fix For: 6.1
>
>
> MBR currently operates on the n-best decoder output. This should also be 
> available in the decoder itself, and triggered with a {{-mbr}} flag.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-247) Feature request: confidence scores

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-247:
-

> Feature request: confidence scores
> --
>
> Key: JOSHUA-247
> URL: https://issues.apache.org/jira/browse/JOSHUA-247
> Project: Joshua
>  Issue Type: New Feature
>Reporter: Matt Post
> Fix For: 6.1
>
>
> There is a lot of work on sentence-level and word-level quality estimation 
> for MT. It's pretty hard to do, but it should be possible to provide 
> coarse-level confidence scores at the word level, perhaps normalized by the 
> overall translation score.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-247) Feature request: confidence scores

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-247:

Fix Version/s: 6.1

> Feature request: confidence scores
> --
>
> Key: JOSHUA-247
> URL: https://issues.apache.org/jira/browse/JOSHUA-247
> Project: Joshua
>  Issue Type: New Feature
>Reporter: Matt Post
> Fix For: 6.1
>
>
> There is a lot of work on sentence-level and word-level quality estimation 
> for MT. It's pretty hard to do, but it should be possible to provide 
> coarse-level confidence scores at the word level, perhaps normalized by the 
> overall translation score.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Cleaning up Jira

[Lewis John Mcgibbney]

Yeah we can but the issue still persists with reopening all issues which
are currently open over on Github.
I'm going to do it right now. I'll try and silence as many of the messages
as possible.

On Mon, Apr 4, 2016 at 3:09 PM, Tom Barber  wrote:

> For Jira can't we do a bulk change on all open/in progress task that's
> fixed version is either No Version or Release Versions?
>
> Or did I misunderstand?
>
> --
>
> Director Meteorite.bi - Saiku Analytics Founder
> Tel: +44(0)5603641316
>
> (Thanks to the Saiku community we reached our Kickstart
> <
> http://kickstarter.com/projects/2117053714/saiku-reporting-interactive-report-designer/
> >
> goal, but you can always help by sponsoring the project
> )
>
> On 4 April 2016 at 22:23, Mattmann, Chris A (3980) <
> chris.a.mattm...@jpl.nasa.gov> wrote:
>
> > +1 I’ll take a look tonight
> >
> > ++
> > Chris Mattmann, Ph.D.
> > Chief Architect
> > Instrument Software and Science Data Systems Section (398)
> > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> > Office: 168-519, Mailstop: 168-527
> > Email: chris.a.mattm...@nasa.gov
> > WWW:  http://sunset.usc.edu/~mattmann/
> > ++
> > Director, Information Retrieval and Data Science Group (IRDS)
> > Adjunct Associate Professor, Computer Science Department
> > University of Southern California, Los Angeles, CA 90089 USA
> > WWW: http://irds.usc.edu/
> > ++
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > On 4/4/16, 5:17 PM, "Lewis John Mcgibbney" 
> > wrote:
> >
> > >Hi Folks,
> > >OK so Jira [0] is a bit of a mess with the following unresolved issue
> > stats
> > >for following versions
> > >
> > >5.0 23 6.0 7 6.1 2 Unscheduled 214
> > >Basically, we need to close off all of the issues as resolved apart from
> > >the ones currently assigned to 6.1 as unresolved.
> > >
> > >We then need to locate all of the issues mentioned at [1] and assign
> them
> > >against 6.1
> > >
> > >This is going to be a bit of a PITA, but once it is done we can begin
> > agree
> > >upon a release cycle and development roadmap in the build up to
> ApacheCon
> > >meetup.
> > >Ta
> > >
> > >[0] https://issues.apache.org/jira/browse/JOSHUA
> > >[1] https://github.com/joshua-decoder/joshua/issues
> > >
> > >--
> > >*Lewis*
> >
>



-- 
*Lewis*

Re: Build failed in Jenkins: joshua_master #4

[Lewis John Mcgibbney]

Is this happening when you are trying to log in to Jenkins?

On Mon, Apr 4, 2016 at 6:51 PM, Matt Post  wrote:

> "mjpost is missing the Job/ExtendedRead permission"
>
> → can you add me? Or do I need to email infrastructure?
>
> (Sorry for the constant questions!)
>
>
> > On Apr 4, 2016, at 5:19 PM, Lewis John Mcgibbney <
> lewis.mcgibb...@gmail.com> wrote:
> >
> > Hi Matt,
> > This can be edited by going into the Jenkins job configuration tab [0]
> and
> > editing away.
> > If it requests for a log in then this should be your LDAP credentials
> > associated with your Apache ID.
> > Ta
> >
> > [0]
> >
> https://builds.apache.org/view/H-L/view/Joshua/job/joshua_master/configure
> >
> > On Mon, Apr 4, 2016 at 2:17 PM, Matt Post  wrote:
> >
> >> How do we edit the build info? Is this something only you can do,
> Lewis? I
> >> see some problems that would be resolved by adding $JOSHUA/bin to the
> path.
> >>
> >> matt
> >>
> >>
> >>> On Apr 4, 2016, at 4:59 PM, Lewis John Mcgibbney <
> >> lewis.mcgibb...@gmail.com> wrote:
> >>>
> >>> OK so the build is now stable.
> >>> https://builds.apache.org/view/H-L/view/Joshua/job/joshua_master/10/
> >>> We should still utilize the docker container on builds... this is a
> >> better
> >>> idea.
> >>> We should also publish development documentation on each successful
> >> build.
> >>> This can be addressed over on
> >>> https://issues.apache.org/jira/browse/JOSHUA-250
> >>> Lewis
> >>>
> >>> On Mon, Apr 4, 2016 at 8:31 AM, Matt Post  wrote:
> >>>
>  Hi,
> 
>  Also, note that the latest build failed because it's using Java 7, but
>  Kellen's recent commits require Java 8.
> 
>  This means that those commits sort of snuck in a required Java 8
> >> upgrade.
>  I'm fine to do this as we're on development, and we can make that a
> >> formal
>  requirement as part of the next release. Java 8 is not that new.
> 
>  matt
> 
> 
> > On Apr 2, 2016, at 7:05 PM, Stian Soiland-Reyes 
>  wrote:
> >
> > BTW - which of the nodes support docker containers?
> >
> > On 1 April 2016 at 17:20, Andrew Bayer 
> wrote:
> >> Should be on any of the ubuntu-[1,2,4,5,6] boxes or H10 and H11.
>  Otherwise,
> >> probably not. As always, if you need system libraries installed, we
> >> strongly advise you run your build in a docker container, where you
> >> can
> >> control things like that.
> >>
> >> A.
> >>
> >> On Fri, Apr 1, 2016 at 9:18 AM, Lewis John Mcgibbney <
> >> lewis.mcgibb...@gmail.com> wrote:
> >>
> >>> Hi builds@,
> >>> The named library is Boost http://www.boost.org/
> >>> Is this library installed on any build slave?
> >>>
> >>> On Fri, Apr 1, 2016 at 7:29 AM, Matt Post  wrote:
> >>>
>  Thanks very much! Some of our tests are now passing (17/39), but
> >> now I
> >>> see
>  that it is unable to locate boost:
> 
>    [exec]   Unable to find the requested Boost libraries.
>    [exec]
>    [exec]   Boost version: 1.54.0
>    [exec]
>    [exec]   Boost include path: /usr/include
>    [exec]
>    [exec]   Could not find the following Boost libraries:
>    [exec]
>    [exec]   boost_system
>    [exec]   boost_thread
>    [exec]
>    [exec]   Some (but not all) of the required Boost libraries were
>  found.  You may
>    [exec]   need to install these additional Boost libraries.
>  Alternatively, set
>    [exec]   BOOST_LIBRARYDIR to the directory containing Boost
> >>> libraries
>  or BOOST_ROOT
>    [exec]   to the location of Boost.
> 
>  Can you suggest what we can do to address this?
> 
> 
> > On Apr 1, 2016, at 12:18 AM, Daniel Takamori 
>  wrote:
> >
> > The node, ubuntu3, that this job ran on runs 12.04 for
> >> compatibility
> > reasons and as such has an old version of cmake.  I've gone ahead
> >> and
> > modified your job from the label "solaris||ubuntu" to
> > "solaris||ubuntu&&!(ubuntu3)" to restrict to the newer 14.04
> nodes.
> >
> > Cheers,
> > -Pono
> >
> > On Fri, Apr 1, 2016 at 4:10 AM, Mattmann, Chris A (3980) <
> > chris.a.mattm...@jpl.nasa.gov> wrote:
> >
> >> Send mail to bui...@apache.org, I’ve CC’ed them on this
> message.
> >>
> >> builds@, please help :)
> >>
> >>
> ++
> >> Chris Mattmann, Ph.D.
> >> Chief Architect
> >> Instrument Software and Science Data Systems Section (398)
> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> Office: 168-519, Mailstop: 168-527
> >> Email: chris.a.mattm...@nasa.gov
> >> WWW:  http://sunset.usc.edu

[GitHub] incubator-joshua pull request: Performance Improvements to Joshua

[mjpost]

Github user mjpost commented on the pull request:

https://github.com/apache/incubator-joshua/pull/1#issuecomment-205633596
  
For reference, I ran this across my timing suite, running start to finish, 
single-threaded, iincluding model loading time). For two packed models:

Phrase-based es-en model, 3k sentences: 495 seconds → 368 seconds (1.3x 
faster)
Hiero zh-en model (1,357 sentences): 586 seconds → 259 seconds (2.2x 
faster)

Decoding with a RAM-loaded model (unpacked model) is the same. This merge 
basically means that packed grammars are no longer any slower than just loading 
to memory, and also don't pay the startup cost. This is obviously really 
awesome.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Build failed in Jenkins: joshua_master #4

[Matt Post]

"mjpost is missing the Job/ExtendedRead permission"

→ can you add me? Or do I need to email infrastructure?

(Sorry for the constant questions!)


> On Apr 4, 2016, at 5:19 PM, Lewis John Mcgibbney  
> wrote:
> 
> Hi Matt,
> This can be edited by going into the Jenkins job configuration tab [0] and
> editing away.
> If it requests for a log in then this should be your LDAP credentials
> associated with your Apache ID.
> Ta
> 
> [0]
> https://builds.apache.org/view/H-L/view/Joshua/job/joshua_master/configure
> 
> On Mon, Apr 4, 2016 at 2:17 PM, Matt Post  wrote:
> 
>> How do we edit the build info? Is this something only you can do, Lewis? I
>> see some problems that would be resolved by adding $JOSHUA/bin to the path.
>> 
>> matt
>> 
>> 
>>> On Apr 4, 2016, at 4:59 PM, Lewis John Mcgibbney <
>> lewis.mcgibb...@gmail.com> wrote:
>>> 
>>> OK so the build is now stable.
>>> https://builds.apache.org/view/H-L/view/Joshua/job/joshua_master/10/
>>> We should still utilize the docker container on builds... this is a
>> better
>>> idea.
>>> We should also publish development documentation on each successful
>> build.
>>> This can be addressed over on
>>> https://issues.apache.org/jira/browse/JOSHUA-250
>>> Lewis
>>> 
>>> On Mon, Apr 4, 2016 at 8:31 AM, Matt Post  wrote:
>>> 
 Hi,
 
 Also, note that the latest build failed because it's using Java 7, but
 Kellen's recent commits require Java 8.
 
 This means that those commits sort of snuck in a required Java 8
>> upgrade.
 I'm fine to do this as we're on development, and we can make that a
>> formal
 requirement as part of the next release. Java 8 is not that new.
 
 matt
 
 
> On Apr 2, 2016, at 7:05 PM, Stian Soiland-Reyes 
 wrote:
> 
> BTW - which of the nodes support docker containers?
> 
> On 1 April 2016 at 17:20, Andrew Bayer  wrote:
>> Should be on any of the ubuntu-[1,2,4,5,6] boxes or H10 and H11.
 Otherwise,
>> probably not. As always, if you need system libraries installed, we
>> strongly advise you run your build in a docker container, where you
>> can
>> control things like that.
>> 
>> A.
>> 
>> On Fri, Apr 1, 2016 at 9:18 AM, Lewis John Mcgibbney <
>> lewis.mcgibb...@gmail.com> wrote:
>> 
>>> Hi builds@,
>>> The named library is Boost http://www.boost.org/
>>> Is this library installed on any build slave?
>>> 
>>> On Fri, Apr 1, 2016 at 7:29 AM, Matt Post  wrote:
>>> 
 Thanks very much! Some of our tests are now passing (17/39), but
>> now I
>>> see
 that it is unable to locate boost:
 
   [exec]   Unable to find the requested Boost libraries.
   [exec]
   [exec]   Boost version: 1.54.0
   [exec]
   [exec]   Boost include path: /usr/include
   [exec]
   [exec]   Could not find the following Boost libraries:
   [exec]
   [exec]   boost_system
   [exec]   boost_thread
   [exec]
   [exec]   Some (but not all) of the required Boost libraries were
 found.  You may
   [exec]   need to install these additional Boost libraries.
 Alternatively, set
   [exec]   BOOST_LIBRARYDIR to the directory containing Boost
>>> libraries
 or BOOST_ROOT
   [exec]   to the location of Boost.
 
 Can you suggest what we can do to address this?
 
 
> On Apr 1, 2016, at 12:18 AM, Daniel Takamori 
 wrote:
> 
> The node, ubuntu3, that this job ran on runs 12.04 for
>> compatibility
> reasons and as such has an old version of cmake.  I've gone ahead
>> and
> modified your job from the label "solaris||ubuntu" to
> "solaris||ubuntu&&!(ubuntu3)" to restrict to the newer 14.04 nodes.
> 
> Cheers,
> -Pono
> 
> On Fri, Apr 1, 2016 at 4:10 AM, Mattmann, Chris A (3980) <
> chris.a.mattm...@jpl.nasa.gov> wrote:
> 
>> Send mail to bui...@apache.org, I’ve CC’ed them on this message.
>> 
>> builds@, please help :)
>> 
>> ++
>> Chris Mattmann, Ph.D.
>> Chief Architect
>> Instrument Software and Science Data Systems Section (398)
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 168-519, Mailstop: 168-527
>> Email: chris.a.mattm...@nasa.gov
>> WWW:  http://sunset.usc.edu/~mattmann/
>> ++
>> Director, Information Retrieval and Data Science Group (IRDS)
>> Adjunct Associate Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> WWW: http://irds.usc.edu/
>> ++

Re: Cleaning up Jira

[Tom Barber]

For Jira can't we do a bulk change on all open/in progress task that's
fixed version is either No Version or Release Versions?

Or did I misunderstand?

--

Director Meteorite.bi - Saiku Analytics Founder
Tel: +44(0)5603641316

(Thanks to the Saiku community we reached our Kickstart

goal, but you can always help by sponsoring the project
)

On 4 April 2016 at 22:23, Mattmann, Chris A (3980) <
chris.a.mattm...@jpl.nasa.gov> wrote:

> +1 I’ll take a look tonight
>
> ++
> Chris Mattmann, Ph.D.
> Chief Architect
> Instrument Software and Science Data Systems Section (398)
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 168-519, Mailstop: 168-527
> Email: chris.a.mattm...@nasa.gov
> WWW:  http://sunset.usc.edu/~mattmann/
> ++
> Director, Information Retrieval and Data Science Group (IRDS)
> Adjunct Associate Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> WWW: http://irds.usc.edu/
> ++
>
>
>
>
>
>
>
>
>
>
> On 4/4/16, 5:17 PM, "Lewis John Mcgibbney" 
> wrote:
>
> >Hi Folks,
> >OK so Jira [0] is a bit of a mess with the following unresolved issue
> stats
> >for following versions
> >
> >5.0 23 6.0 7 6.1 2 Unscheduled 214
> >Basically, we need to close off all of the issues as resolved apart from
> >the ones currently assigned to 6.1 as unresolved.
> >
> >We then need to locate all of the issues mentioned at [1] and assign them
> >against 6.1
> >
> >This is going to be a bit of a PITA, but once it is done we can begin
> agree
> >upon a release cycle and development roadmap in the build up to ApacheCon
> >meetup.
> >Ta
> >
> >[0] https://issues.apache.org/jira/browse/JOSHUA
> >[1] https://github.com/joshua-decoder/joshua/issues
> >
> >--
> >*Lewis*
>

Re: Cleaning up Jira

[Mattmann, Chris A (3980)]

+1 I’ll take a look tonight

++
Chris Mattmann, Ph.D.
Chief Architect
Instrument Software and Science Data Systems Section (398)
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 168-519, Mailstop: 168-527
Email: chris.a.mattm...@nasa.gov
WWW:  http://sunset.usc.edu/~mattmann/
++
Director, Information Retrieval and Data Science Group (IRDS)
Adjunct Associate Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
WWW: http://irds.usc.edu/
++










On 4/4/16, 5:17 PM, "Lewis John Mcgibbney"  wrote:

>Hi Folks,
>OK so Jira [0] is a bit of a mess with the following unresolved issue stats
>for following versions
>
>5.0 23 6.0 7 6.1 2 Unscheduled 214
>Basically, we need to close off all of the issues as resolved apart from
>the ones currently assigned to 6.1 as unresolved.
>
>We then need to locate all of the issues mentioned at [1] and assign them
>against 6.1
>
>This is going to be a bit of a PITA, but once it is done we can begin agree
>upon a release cycle and development roadmap in the build up to ApacheCon
>meetup.
>Ta
>
>[0] https://issues.apache.org/jira/browse/JOSHUA
>[1] https://github.com/joshua-decoder/joshua/issues
>
>-- 
>*Lewis*

Re: Build failed in Jenkins: joshua_master #4

[Lewis John Mcgibbney]

Hi Matt,
This can be edited by going into the Jenkins job configuration tab [0] and
editing away.
If it requests for a log in then this should be your LDAP credentials
associated with your Apache ID.
Ta

[0]
https://builds.apache.org/view/H-L/view/Joshua/job/joshua_master/configure

On Mon, Apr 4, 2016 at 2:17 PM, Matt Post  wrote:

> How do we edit the build info? Is this something only you can do, Lewis? I
> see some problems that would be resolved by adding $JOSHUA/bin to the path.
>
> matt
>
>
> > On Apr 4, 2016, at 4:59 PM, Lewis John Mcgibbney <
> lewis.mcgibb...@gmail.com> wrote:
> >
> > OK so the build is now stable.
> > https://builds.apache.org/view/H-L/view/Joshua/job/joshua_master/10/
> > We should still utilize the docker container on builds... this is a
> better
> > idea.
> > We should also publish development documentation on each successful
> build.
> > This can be addressed over on
> > https://issues.apache.org/jira/browse/JOSHUA-250
> > Lewis
> >
> > On Mon, Apr 4, 2016 at 8:31 AM, Matt Post  wrote:
> >
> >> Hi,
> >>
> >> Also, note that the latest build failed because it's using Java 7, but
> >> Kellen's recent commits require Java 8.
> >>
> >> This means that those commits sort of snuck in a required Java 8
> upgrade.
> >> I'm fine to do this as we're on development, and we can make that a
> formal
> >> requirement as part of the next release. Java 8 is not that new.
> >>
> >> matt
> >>
> >>
> >>> On Apr 2, 2016, at 7:05 PM, Stian Soiland-Reyes 
> >> wrote:
> >>>
> >>> BTW - which of the nodes support docker containers?
> >>>
> >>> On 1 April 2016 at 17:20, Andrew Bayer  wrote:
>  Should be on any of the ubuntu-[1,2,4,5,6] boxes or H10 and H11.
> >> Otherwise,
>  probably not. As always, if you need system libraries installed, we
>  strongly advise you run your build in a docker container, where you
> can
>  control things like that.
> 
>  A.
> 
>  On Fri, Apr 1, 2016 at 9:18 AM, Lewis John Mcgibbney <
>  lewis.mcgibb...@gmail.com> wrote:
> 
> > Hi builds@,
> > The named library is Boost http://www.boost.org/
> > Is this library installed on any build slave?
> >
> > On Fri, Apr 1, 2016 at 7:29 AM, Matt Post  wrote:
> >
> >> Thanks very much! Some of our tests are now passing (17/39), but
> now I
> > see
> >> that it is unable to locate boost:
> >>
> >>[exec]   Unable to find the requested Boost libraries.
> >>[exec]
> >>[exec]   Boost version: 1.54.0
> >>[exec]
> >>[exec]   Boost include path: /usr/include
> >>[exec]
> >>[exec]   Could not find the following Boost libraries:
> >>[exec]
> >>[exec]   boost_system
> >>[exec]   boost_thread
> >>[exec]
> >>[exec]   Some (but not all) of the required Boost libraries were
> >> found.  You may
> >>[exec]   need to install these additional Boost libraries.
> >> Alternatively, set
> >>[exec]   BOOST_LIBRARYDIR to the directory containing Boost
> > libraries
> >> or BOOST_ROOT
> >>[exec]   to the location of Boost.
> >>
> >> Can you suggest what we can do to address this?
> >>
> >>
> >>> On Apr 1, 2016, at 12:18 AM, Daniel Takamori 
> >> wrote:
> >>>
> >>> The node, ubuntu3, that this job ran on runs 12.04 for
> compatibility
> >>> reasons and as such has an old version of cmake.  I've gone ahead
> and
> >>> modified your job from the label "solaris||ubuntu" to
> >>> "solaris||ubuntu&&!(ubuntu3)" to restrict to the newer 14.04 nodes.
> >>>
> >>> Cheers,
> >>> -Pono
> >>>
> >>> On Fri, Apr 1, 2016 at 4:10 AM, Mattmann, Chris A (3980) <
> >>> chris.a.mattm...@jpl.nasa.gov> wrote:
> >>>
>  Send mail to bui...@apache.org, I’ve CC’ed them on this message.
> 
>  builds@, please help :)
> 
>  ++
>  Chris Mattmann, Ph.D.
>  Chief Architect
>  Instrument Software and Science Data Systems Section (398)
>  NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>  Office: 168-519, Mailstop: 168-527
>  Email: chris.a.mattm...@nasa.gov
>  WWW:  http://sunset.usc.edu/~mattmann/
>  ++
>  Director, Information Retrieval and Data Science Group (IRDS)
>  Adjunct Associate Professor, Computer Science Department
>  University of Southern California, Los Angeles, CA 90089 USA
>  WWW: http://irds.usc.edu/
>  ++
> 
> 
> 
> 
> 
>  -Original Message-
>  From: Matt Post 
>  Reply-To: "dev@joshua.incubator.apache.org"
>  
>  Date: Thursday, March 31, 2016 at 4:59 PM

Re: Build failed in Jenkins: joshua_master #4

[Matt Post]

How do we edit the build info? Is this something only you can do, Lewis? I see 
some problems that would be resolved by adding $JOSHUA/bin to the path.

matt


> On Apr 4, 2016, at 4:59 PM, Lewis John Mcgibbney  
> wrote:
> 
> OK so the build is now stable.
> https://builds.apache.org/view/H-L/view/Joshua/job/joshua_master/10/
> We should still utilize the docker container on builds... this is a better
> idea.
> We should also publish development documentation on each successful build.
> This can be addressed over on
> https://issues.apache.org/jira/browse/JOSHUA-250
> Lewis
> 
> On Mon, Apr 4, 2016 at 8:31 AM, Matt Post  wrote:
> 
>> Hi,
>> 
>> Also, note that the latest build failed because it's using Java 7, but
>> Kellen's recent commits require Java 8.
>> 
>> This means that those commits sort of snuck in a required Java 8 upgrade.
>> I'm fine to do this as we're on development, and we can make that a formal
>> requirement as part of the next release. Java 8 is not that new.
>> 
>> matt
>> 
>> 
>>> On Apr 2, 2016, at 7:05 PM, Stian Soiland-Reyes 
>> wrote:
>>> 
>>> BTW - which of the nodes support docker containers?
>>> 
>>> On 1 April 2016 at 17:20, Andrew Bayer  wrote:
 Should be on any of the ubuntu-[1,2,4,5,6] boxes or H10 and H11.
>> Otherwise,
 probably not. As always, if you need system libraries installed, we
 strongly advise you run your build in a docker container, where you can
 control things like that.
 
 A.
 
 On Fri, Apr 1, 2016 at 9:18 AM, Lewis John Mcgibbney <
 lewis.mcgibb...@gmail.com> wrote:
 
> Hi builds@,
> The named library is Boost http://www.boost.org/
> Is this library installed on any build slave?
> 
> On Fri, Apr 1, 2016 at 7:29 AM, Matt Post  wrote:
> 
>> Thanks very much! Some of our tests are now passing (17/39), but now I
> see
>> that it is unable to locate boost:
>> 
>>[exec]   Unable to find the requested Boost libraries.
>>[exec]
>>[exec]   Boost version: 1.54.0
>>[exec]
>>[exec]   Boost include path: /usr/include
>>[exec]
>>[exec]   Could not find the following Boost libraries:
>>[exec]
>>[exec]   boost_system
>>[exec]   boost_thread
>>[exec]
>>[exec]   Some (but not all) of the required Boost libraries were
>> found.  You may
>>[exec]   need to install these additional Boost libraries.
>> Alternatively, set
>>[exec]   BOOST_LIBRARYDIR to the directory containing Boost
> libraries
>> or BOOST_ROOT
>>[exec]   to the location of Boost.
>> 
>> Can you suggest what we can do to address this?
>> 
>> 
>>> On Apr 1, 2016, at 12:18 AM, Daniel Takamori 
>> wrote:
>>> 
>>> The node, ubuntu3, that this job ran on runs 12.04 for compatibility
>>> reasons and as such has an old version of cmake.  I've gone ahead and
>>> modified your job from the label "solaris||ubuntu" to
>>> "solaris||ubuntu&&!(ubuntu3)" to restrict to the newer 14.04 nodes.
>>> 
>>> Cheers,
>>> -Pono
>>> 
>>> On Fri, Apr 1, 2016 at 4:10 AM, Mattmann, Chris A (3980) <
>>> chris.a.mattm...@jpl.nasa.gov> wrote:
>>> 
 Send mail to bui...@apache.org, I’ve CC’ed them on this message.
 
 builds@, please help :)
 
 ++
 Chris Mattmann, Ph.D.
 Chief Architect
 Instrument Software and Science Data Systems Section (398)
 NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
 Office: 168-519, Mailstop: 168-527
 Email: chris.a.mattm...@nasa.gov
 WWW:  http://sunset.usc.edu/~mattmann/
 ++
 Director, Information Retrieval and Data Science Group (IRDS)
 Adjunct Associate Professor, Computer Science Department
 University of Southern California, Los Angeles, CA 90089 USA
 WWW: http://irds.usc.edu/
 ++
 
 
 
 
 
 -Original Message-
 From: Matt Post 
 Reply-To: "dev@joshua.incubator.apache.org"
 
 Date: Thursday, March 31, 2016 at 4:59 PM
 To: "dev@joshua.incubator.apache.org" <
> dev@joshua.incubator.apache.org>
 Cc: "p...@jgeppert.com" 
 Subject: Re: Build failed in Jenkins: joshua_master #4
 
> (To be clear, I'm asking if anyone knows how we can get a newer
> version
> of cmake installed on build.apache.org...)
> 
>> On Mar 31, 2016, at 7:50 PM, Matt Post  wrote:
>> 
>> It looks like the first failure is at KenLM. I see:
>> 
>>   CMake Error at CMakeLists.txt:1 (cmake_minimum_required):
>>[exec] 

Cleaning up Jira

[Lewis John Mcgibbney]

Hi Folks,
OK so Jira [0] is a bit of a mess with the following unresolved issue stats
for following versions

5.0 23 6.0 7 6.1 2 Unscheduled 214
Basically, we need to close off all of the issues as resolved apart from
the ones currently assigned to 6.1 as unresolved.

We then need to locate all of the issues mentioned at [1] and assign them
against 6.1

This is going to be a bit of a PITA, but once it is done we can begin agree
upon a release cycle and development roadmap in the build up to ApacheCon
meetup.
Ta

[0] https://issues.apache.org/jira/browse/JOSHUA
[1] https://github.com/joshua-decoder/joshua/issues

-- 
*Lewis*

[jira] [Resolved] (JOSHUA-176) Packing phrase tables

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved JOSHUA-176.
-
   Resolution: Fixed
Fix Version/s: (was: 6.1)

Transitioning to Resolved and Closed as part of migration to Apache.

> Packing phrase tables
> -
>
> Key: JOSHUA-176
> URL: https://issues.apache.org/jira/browse/JOSHUA-176
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>
> The packer can pack Moses phrase tables, but the decoder can't use them.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Closed] (JOSHUA-176) Packing phrase tables

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney closed JOSHUA-176.
---

> Packing phrase tables
> -
>
> Key: JOSHUA-176
> URL: https://issues.apache.org/jira/browse/JOSHUA-176
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>
> The packer can pack Moses phrase tables, but the decoder can't use them.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (JOSHUA-210) Fix nonterminalmatcher logic

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reopened JOSHUA-210:
-

> Fix nonterminalmatcher logic
> 
>
> Key: JOSHUA-210
> URL: https://issues.apache.org/jira/browse/JOSHUA-210
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>
> It's slow and overly general, and in particular, 
> Vocabulary::getNonterminalIndices() may not be thread safe.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (JOSHUA-210) Fix nonterminalmatcher logic

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved JOSHUA-210.
-
   Resolution: Fixed
Fix Version/s: (was: 6.1)

> Fix nonterminalmatcher logic
> 
>
> Key: JOSHUA-210
> URL: https://issues.apache.org/jira/browse/JOSHUA-210
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>
> It's slow and overly general, and in particular, 
> Vocabulary::getNonterminalIndices() may not be thread safe.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Closed] (JOSHUA-210) Fix nonterminalmatcher logic

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney closed JOSHUA-210.
---

> Fix nonterminalmatcher logic
> 
>
> Key: JOSHUA-210
> URL: https://issues.apache.org/jira/browse/JOSHUA-210
> Project: Joshua
>  Issue Type: Bug
>Reporter: Matt Post
>
> It's slow and overly general, and in particular, 
> Vocabulary::getNonterminalIndices() may not be thread safe.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Build failed in Jenkins: joshua_master #4

[Lewis John Mcgibbney]

OK so the build is now stable.
https://builds.apache.org/view/H-L/view/Joshua/job/joshua_master/10/
We should still utilize the docker container on builds... this is a better
idea.
We should also publish development documentation on each successful build.
This can be addressed over on
https://issues.apache.org/jira/browse/JOSHUA-250
Lewis

On Mon, Apr 4, 2016 at 8:31 AM, Matt Post  wrote:

> Hi,
>
> Also, note that the latest build failed because it's using Java 7, but
> Kellen's recent commits require Java 8.
>
> This means that those commits sort of snuck in a required Java 8 upgrade.
> I'm fine to do this as we're on development, and we can make that a formal
> requirement as part of the next release. Java 8 is not that new.
>
> matt
>
>
> > On Apr 2, 2016, at 7:05 PM, Stian Soiland-Reyes 
> wrote:
> >
> > BTW - which of the nodes support docker containers?
> >
> > On 1 April 2016 at 17:20, Andrew Bayer  wrote:
> >> Should be on any of the ubuntu-[1,2,4,5,6] boxes or H10 and H11.
> Otherwise,
> >> probably not. As always, if you need system libraries installed, we
> >> strongly advise you run your build in a docker container, where you can
> >> control things like that.
> >>
> >> A.
> >>
> >> On Fri, Apr 1, 2016 at 9:18 AM, Lewis John Mcgibbney <
> >> lewis.mcgibb...@gmail.com> wrote:
> >>
> >>> Hi builds@,
> >>> The named library is Boost http://www.boost.org/
> >>> Is this library installed on any build slave?
> >>>
> >>> On Fri, Apr 1, 2016 at 7:29 AM, Matt Post  wrote:
> >>>
>  Thanks very much! Some of our tests are now passing (17/39), but now I
> >>> see
>  that it is unable to locate boost:
> 
>  [exec]   Unable to find the requested Boost libraries.
>  [exec]
>  [exec]   Boost version: 1.54.0
>  [exec]
>  [exec]   Boost include path: /usr/include
>  [exec]
>  [exec]   Could not find the following Boost libraries:
>  [exec]
>  [exec]   boost_system
>  [exec]   boost_thread
>  [exec]
>  [exec]   Some (but not all) of the required Boost libraries were
>  found.  You may
>  [exec]   need to install these additional Boost libraries.
>  Alternatively, set
>  [exec]   BOOST_LIBRARYDIR to the directory containing Boost
> >>> libraries
>  or BOOST_ROOT
>  [exec]   to the location of Boost.
> 
>  Can you suggest what we can do to address this?
> 
> 
> > On Apr 1, 2016, at 12:18 AM, Daniel Takamori 
> wrote:
> >
> > The node, ubuntu3, that this job ran on runs 12.04 for compatibility
> > reasons and as such has an old version of cmake.  I've gone ahead and
> > modified your job from the label "solaris||ubuntu" to
> > "solaris||ubuntu&&!(ubuntu3)" to restrict to the newer 14.04 nodes.
> >
> > Cheers,
> > -Pono
> >
> > On Fri, Apr 1, 2016 at 4:10 AM, Mattmann, Chris A (3980) <
> > chris.a.mattm...@jpl.nasa.gov> wrote:
> >
> >> Send mail to bui...@apache.org, I’ve CC’ed them on this message.
> >>
> >> builds@, please help :)
> >>
> >> ++
> >> Chris Mattmann, Ph.D.
> >> Chief Architect
> >> Instrument Software and Science Data Systems Section (398)
> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> Office: 168-519, Mailstop: 168-527
> >> Email: chris.a.mattm...@nasa.gov
> >> WWW:  http://sunset.usc.edu/~mattmann/
> >> ++
> >> Director, Information Retrieval and Data Science Group (IRDS)
> >> Adjunct Associate Professor, Computer Science Department
> >> University of Southern California, Los Angeles, CA 90089 USA
> >> WWW: http://irds.usc.edu/
> >> ++
> >>
> >>
> >>
> >>
> >>
> >> -Original Message-
> >> From: Matt Post 
> >> Reply-To: "dev@joshua.incubator.apache.org"
> >> 
> >> Date: Thursday, March 31, 2016 at 4:59 PM
> >> To: "dev@joshua.incubator.apache.org" <
> >>> dev@joshua.incubator.apache.org>
> >> Cc: "p...@jgeppert.com" 
> >> Subject: Re: Build failed in Jenkins: joshua_master #4
> >>
> >>> (To be clear, I'm asking if anyone knows how we can get a newer
> >>> version
> >>> of cmake installed on build.apache.org...)
> >>>
>  On Mar 31, 2016, at 7:50 PM, Matt Post  wrote:
> 
>  It looks like the first failure is at KenLM. I see:
> 
> CMake Error at CMakeLists.txt:1 (cmake_minimum_required):
>  [exec]   CMake 2.8.8 or higher is required.  You are
> >>> running
>  version 2.8.7
> 
>  Is there any way that this can be fixed? CMake on my Mac is 3.4.3.
> >>>
> >>
> >>
> 
> 
> >>>
> >>>
> >>> --
> >>> *Lewis*
> >>>
> >
> >
> >
> > --

Jenkins build is back to normal : joshua_master #10

[Apache Jenkins Server]

See 

Build failed in Jenkins: joshua_master #9

[Apache Jenkins Server]

See 

--
[...truncated 296 lines...]
 [exec] In file included from TTables.cpp:22:0:
 [exec] TTables.h: In instantiation of 'tmodel::tmodel(const 
string&) [with COUNT = float; PROB = float; std::string = 
std::basic_string]':
 [exec] TTables.cpp:106:16:   required from here
 [exec] TTables.h:197:23: warning: variable 'oldf' set but not used 
[-Wunused-but-set-variable]
 [exec]int e,f,olde=-1,oldf=-1;
 [exec]^
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
AlignTables.cpp -o optimized/AlignTables.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
main.cpp -o optimized/main.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c 
KategProblemWBC.cpp -o KategProblemWBC.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
NTables.cpp -o optimized/NTables.o
 [exec] main.cpp: In function 'int main(int, char**)':
 [exec] main.cpp:707:10: warning: variable 'errors' set but not used 
[-Wunused-but-set-variable]
 [exec]double errors=0.0;
 [exec]   ^
 [exec] In file included from main.cpp:25:0:
 [exec] TTables.h: In instantiation of 'tmodel::tmodel(const 
string&) [with COUNT = float; PROB = float; std::string = 
std::basic_string]':
 [exec] main.cpp:534:45:   required from here
 [exec] TTables.h:197:23: warning: variable 'oldf' set but not used 
[-Wunused-but-set-variable]
 [exec]int e,f,olde=-1,oldf=-1;
 [exec]^
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
model2to3.cpp -o optimized/model2to3.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c 
KategProblem.cpp -o KategProblem.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c StatVar.cpp 
-o StatVar.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
collCounts.cpp -o optimized/collCounts.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c general.cpp 
-o general.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
alignment.cpp -o optimized/alignment.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c mkcls.cpp 
-o mkcls.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
vocab.cpp -o optimized/vocab.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
MoveSwapMatrix.cpp -o optimized/MoveSwapMatrix.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
transpair_model3.cpp -o optimized/transpair_model3.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
transpair_model5.cpp -o optimized/transpair_model5.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
transpair_model4.cpp -o optimized/transpair_model4.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -o mkcls 
GDAOptimization.o HCOptimization.o Problem.o IterOptimization.o ProblemTest.o 
RRTOptimization.o MYOptimization.o SAOptimization.o TAOptimization.o 
Optimization.o KategProblemTest.o KategProblemKBC.o KategProblemWBC.o 
KategProblem.o StatVar.o general.o mkcls.o 
 [exec] make[1]: Leaving directory 
`
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
utility.cpp -o optimized/utility.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
parse.cpp -o optimized/parse.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
reports.cpp -o optimized/reports.o
 [exec] g++   -Wall -Wno-par

Build failed in Jenkins: joshua_master #8

[Apache Jenkins Server]

See 

--
[...truncated 1051 lines...]
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c 
IterOptimization.cpp -o IterOptimization.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
model2.cpp -o optimized/model2.o
 [exec] model1.cpp: In member function 'int model1::em_with_tricks(int, 
bool, Dictionary&, bool)':
 [exec] model1.cpp:72:7: warning: variable 'pair_no' set but not used 
[-Wunused-but-set-variable]
 [exec]int pair_no;
 [exec]^
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c 
ProblemTest.cpp -o ProblemTest.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c 
RRTOptimization.cpp -o RRTOptimization.o
 [exec] model2.cpp: In member function 'int model2::em_with_tricks(int)':
 [exec] model2.cpp:64:7: warning: variable 'pair_no' set but not used 
[-Wunused-but-set-variable]
 [exec]int pair_no = 0;
 [exec]^
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
model3.cpp -o optimized/model3.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c 
MYOptimization.cpp -o MYOptimization.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c 
SAOptimization.cpp -o SAOptimization.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c 
TAOptimization.cpp -o TAOptimization.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c 
Optimization.cpp -o Optimization.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
getSentence.cpp -o optimized/getSentence.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c 
KategProblemTest.cpp -o KategProblemTest.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c 
KategProblemKBC.cpp -o KategProblemKBC.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
TTables.cpp -o optimized/TTables.o
 [exec] In file included from TTables.cpp:22:0:
 [exec] TTables.h: In instantiation of 'tmodel::tmodel(const 
string&) [with COUNT = float; PROB = float; std::string = 
std::basic_string]':
 [exec] TTables.cpp:106:16:   required from here
 [exec] TTables.h:197:23: warning: variable 'oldf' set but not used 
[-Wunused-but-set-variable]
 [exec]int e,f,olde=-1,oldf=-1;
 [exec]^
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
ATables.cpp -o optimized/ATables.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c 
KategProblemWBC.cpp -o KategProblemWBC.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
AlignTables.cpp -o optimized/AlignTables.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c 
KategProblem.cpp -o KategProblem.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
main.cpp -o optimized/main.o
 [exec] main.cpp: In function 'int main(int, char**)':
 [exec] main.cpp:707:10: warning: variable 'errors' set but not used 
[-Wunused-but-set-variable]
 [exec]double errors=0.0;
 [exec]   ^
 [exec] In file included from main.cpp:25:0:
 [exec] TTables.h: In instantiation of 'tmodel::tmodel(const 
string&) [with COUNT = float; PROB = float; std::string = 
std::basic_string]':
 [exec] main.cpp:534:45:   required from here
 [exec] TTables.h:197:23: warning: variable 'oldf' set but not used 
[-Wunused-but-set-variable]
 [exec]int e,f,olde=-1,oldf=-1;
 [exec]^
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c StatVar.cpp 
-o StatVar.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c general.cpp 
-o general.o
 [exec] g++  -Wall -W -DNDEBUG -O3 -funroll-loops -std=c++11 -c mkcls.cpp 
-o mkcls.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
NTables.cpp -o optimized/NTables.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll-loops -DNDEBUG 
-DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE -DWORDINDEX_WITH_4_BYTE  -c 
model2to3.cpp -o optimized/model2to3.o
 [exec] g++   -Wall -Wno-parentheses -std=c++11 -O3 -funroll

[GitHub] incubator-joshua pull request: Performance Improvements to Joshua

[lewismc]

Github user lewismc commented on the pull request:

https://github.com/apache/incubator-joshua/pull/1#issuecomment-205484099
  
Cool thanks for clarifying. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Podling Report Reminder - April 2016

[Matt Post]

Done, thanks!


> On Apr 4, 2016, at 4:16 PM, Lewis John Mcgibbney  
> wrote:
> 
> Hi Matt,
> Excellent. Thanks.
> Can you please send an email to gene...@incubator.apache.org requesting
> access for your wiki username?
> Thanks
> Lewis
> 
> 
> On Mon, Apr 4, 2016 at 10:13 AM, Matt Post  wrote:
> 
>> I do not seem to have write access to
>> https://wiki.apache.org/incubator/April2016, so I cannot append the
>> report. Can someone with access post this?
>> 
>> Three most important issues to address in the move towards graduation:
>> 
>>  1. Migration of the entire project over to Apache infrastructure (nearly
>> complete)
>>  2. Building up community and attracting developers
>>  3. Putting out regular Joshua releases
>> 
>> Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
>> aware of?
>> 
>>None that come to mind. We are occupied with the issues above, and
>> things are proceeding nicely.
>> 
>> How has the community developed since the last report?
>> 
>>We have voted in two new members.
>> 
>> How has the project developed since the last report?
>> 
>>We accepted a large pull request reporting large speed increases
>> due to caching, and increasing the usability of Joshua as a library.
>> 
>> Date of last release:
>> 
>>2015-11-05 (prior to incubation)
>> 
>> When were the last committers or PMC members elected?
>> 
>>- Felix Hieber
>>- Kellen Sunderland
>> 
>> 
>> 
>>> On Apr 4, 2016, at 12:15 PM, Matt Post  wrote:
>>> 
>>> I'll do it, thanks, Lewis.
>>> 
>>> 
 On Apr 4, 2016, at 12:09 PM, Lewis John Mcgibbney <
>> lewis.mcgibb...@gmail.com> wrote:
 
 Hi Matt,
> From the incubator wiki pages it seems like your right... No report has
 been filed and registered for Joshua previously.
 Thanks OK, all you need to do is look at another project which has
>> reported
 and leverage the template.
 Our main agenda right now is
 
 * migration of project over to Apache infrastructure (ongoing nearly
 complete)
 * build out joshua community, and
 * make incubating releases
 
 We're currently in the process of building the community as anyone on
 private@ knows.
 
 Once the website is hosted on Apache infrastructure the migration will
>> be
 nearly complete.
 
 If you are able to file somehow similar to the above then great. If not
 then I can do it.
 Thanks
 Lewis
 
 On Monday, April 4, 2016, Matt Post  wrote:
 
> I don't see our last report in either place. The board meeting minutes
> claim "Report was filed, but display is awaiting the approval of the
>> Board
> minutes."
> 
>  https://whimsy.apache.org/board/minutes/Joshua.html
> 
> Does someone have a copy of the last report I can use as a template
>> this
> month?
>>> 
>> 
>> 
> 
> 
> -- 
> *Lewis*

[GitHub] incubator-joshua pull request: Performance Improvements to Joshua

[mjpost]

Github user mjpost commented on the pull request:

https://github.com/apache/incubator-joshua/pull/1#issuecomment-205479059
  
It's merged into the [github 
repo](https://github.com/joshua-decoder/joshua) (which I'm still using until we 
pull off the whole switch) and also to [the Apache git 
repo](https://git-wip-us.apache.org/repos/asf?p=incubator-joshua.git;a=summary).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Podling Report Reminder - April 2016

[Lewis John Mcgibbney]

Hi Matt,
Excellent. Thanks.
Can you please send an email to gene...@incubator.apache.org requesting
access for your wiki username?
Thanks
Lewis


On Mon, Apr 4, 2016 at 10:13 AM, Matt Post  wrote:

> I do not seem to have write access to
> https://wiki.apache.org/incubator/April2016, so I cannot append the
> report. Can someone with access post this?
>
> Three most important issues to address in the move towards graduation:
>
>   1. Migration of the entire project over to Apache infrastructure (nearly
> complete)
>   2. Building up community and attracting developers
>   3. Putting out regular Joshua releases
>
> Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
> aware of?
>
> None that come to mind. We are occupied with the issues above, and
> things are proceeding nicely.
>
> How has the community developed since the last report?
>
> We have voted in two new members.
>
> How has the project developed since the last report?
>
> We accepted a large pull request reporting large speed increases
> due to caching, and increasing the usability of Joshua as a library.
>
> Date of last release:
>
> 2015-11-05 (prior to incubation)
>
> When were the last committers or PMC members elected?
>
> - Felix Hieber
> - Kellen Sunderland
>
>
>
> > On Apr 4, 2016, at 12:15 PM, Matt Post  wrote:
> >
> > I'll do it, thanks, Lewis.
> >
> >
> >> On Apr 4, 2016, at 12:09 PM, Lewis John Mcgibbney <
> lewis.mcgibb...@gmail.com> wrote:
> >>
> >> Hi Matt,
> >>> From the incubator wiki pages it seems like your right... No report has
> >> been filed and registered for Joshua previously.
> >> Thanks OK, all you need to do is look at another project which has
> reported
> >> and leverage the template.
> >> Our main agenda right now is
> >>
> >> * migration of project over to Apache infrastructure (ongoing nearly
> >> complete)
> >> * build out joshua community, and
> >> * make incubating releases
> >>
> >> We're currently in the process of building the community as anyone on
> >> private@ knows.
> >>
> >> Once the website is hosted on Apache infrastructure the migration will
> be
> >> nearly complete.
> >>
> >> If you are able to file somehow similar to the above then great. If not
> >> then I can do it.
> >> Thanks
> >> Lewis
> >>
> >> On Monday, April 4, 2016, Matt Post  wrote:
> >>
> >>> I don't see our last report in either place. The board meeting minutes
> >>> claim "Report was filed, but display is awaiting the approval of the
> Board
> >>> minutes."
> >>>
> >>>   https://whimsy.apache.org/board/minutes/Joshua.html
> >>>
> >>> Does someone have a copy of the last report I can use as a template
> this
> >>> month?
> >
>
>


-- 
*Lewis*

[GitHub] incubator-joshua pull request: Performance Improvements to Joshua

[lewismc]

Github user lewismc commented on the pull request:

https://github.com/apache/incubator-joshua/pull/1#issuecomment-205475425
  
@mjpost "...I just pulled this in ",

pulled it in to where? Thanks


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Podling Report Reminder - April 2016

[Matt Post]

I do not seem to have write access to 
https://wiki.apache.org/incubator/April2016, so I cannot append the report. Can 
someone with access post this?

Three most important issues to address in the move towards graduation:

  1. Migration of the entire project over to Apache infrastructure (nearly 
complete)
  2. Building up community and attracting developers
  3. Putting out regular Joshua releases

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

None that come to mind. We are occupied with the issues above, and 
things are proceeding nicely.

How has the community developed since the last report?

We have voted in two new members.

How has the project developed since the last report?

We accepted a large pull request reporting large speed increases due to 
caching, and increasing the usability of Joshua as a library.

Date of last release:

2015-11-05 (prior to incubation)

When were the last committers or PMC members elected?

- Felix Hieber
- Kellen Sunderland



> On Apr 4, 2016, at 12:15 PM, Matt Post  wrote:
> 
> I'll do it, thanks, Lewis.
> 
> 
>> On Apr 4, 2016, at 12:09 PM, Lewis John Mcgibbney 
>>  wrote:
>> 
>> Hi Matt,
>>> From the incubator wiki pages it seems like your right... No report has
>> been filed and registered for Joshua previously.
>> Thanks OK, all you need to do is look at another project which has reported
>> and leverage the template.
>> Our main agenda right now is
>> 
>> * migration of project over to Apache infrastructure (ongoing nearly
>> complete)
>> * build out joshua community, and
>> * make incubating releases
>> 
>> We're currently in the process of building the community as anyone on
>> private@ knows.
>> 
>> Once the website is hosted on Apache infrastructure the migration will be
>> nearly complete.
>> 
>> If you are able to file somehow similar to the above then great. If not
>> then I can do it.
>> Thanks
>> Lewis
>> 
>> On Monday, April 4, 2016, Matt Post  wrote:
>> 
>>> I don't see our last report in either place. The board meeting minutes
>>> claim "Report was filed, but display is awaiting the approval of the Board
>>> minutes."
>>> 
>>>   https://whimsy.apache.org/board/minutes/Joshua.html
>>> 
>>> Does someone have a copy of the last report I can use as a template this
>>> month?
> 

Re: Podling Report Reminder - April 2016

[Matt Post]

I'll do it, thanks, Lewis.


> On Apr 4, 2016, at 12:09 PM, Lewis John Mcgibbney  
> wrote:
> 
> Hi Matt,
>> From the incubator wiki pages it seems like your right... No report has
> been filed and registered for Joshua previously.
> Thanks OK, all you need to do is look at another project which has reported
> and leverage the template.
> Our main agenda right now is
> 
> * migration of project over to Apache infrastructure (ongoing nearly
> complete)
> * build out joshua community, and
> * make incubating releases
> 
> We're currently in the process of building the community as anyone on
> private@ knows.
> 
> Once the website is hosted on Apache infrastructure the migration will be
> nearly complete.
> 
> If you are able to file somehow similar to the above then great. If not
> then I can do it.
> Thanks
> Lewis
> 
> On Monday, April 4, 2016, Matt Post  wrote:
> 
>> I don't see our last report in either place. The board meeting minutes
>> claim "Report was filed, but display is awaiting the approval of the Board
>> minutes."
>> 
>>https://whimsy.apache.org/board/minutes/Joshua.html
>> 
>> Does someone have a copy of the last report I can use as a template this
>> month?

Re: Podling Report Reminder - April 2016

[Lewis John Mcgibbney]

Hi Matt,
>From the incubator wiki pages it seems like your right... No report has
been filed and registered for Joshua previously.
Thanks OK, all you need to do is look at another project which has reported
and leverage the template.
Our main agenda right now is

 * migration of project over to Apache infrastructure (ongoing nearly
complete)
 * build out joshua community, and
 * make incubating releases

We're currently in the process of building the community as anyone on
private@ knows.

Once the website is hosted on Apache infrastructure the migration will be
nearly complete.

If you are able to file somehow similar to the above then great. If not
then I can do it.
Thanks
Lewis

On Monday, April 4, 2016, Matt Post  wrote:

> I don't see our last report in either place. The board meeting minutes
> claim "Report was filed, but display is awaiting the approval of the Board
> minutes."
>
> https://whimsy.apache.org/board/minutes/Joshua.html
>
> Does someone have a copy of the last report I can use as a template this
> month?
>
>
> > On Mar 29, 2016, at 10:41 AM, Lewis John Mcgibbney <
> lewis.mcgibb...@gmail.com > wrote:
> >
> > Hi Matt,
> > All of our reports are compiled and archived on the incubator wiki space
> at
> > http://wiki.apache.org/incubator/
> > They are also available in 'published' format in whimsy at
> > https://whimsy.apache.org/board/minutes/
> > You will need to create an account on wiki.apache.org to enter the
> joshua
> > podling report there.
> > HTH
> > Lewis
> >
> > On Tuesday, March 29, 2016, Matt Post >
> wrote:
> >
> >> Hi folks,
> >>
> >> I just dug around for our January report and could find it. Lewis,
> didn't
> >> you file it? Can you post it to the wiki so we have a record of it? I
> >> created a page:
> >>
> >>
> >>
> https://cwiki.apache.org/confluence/display/JOSHUA/Quarterly+Incubator+Reports
> >>
> >> matt
> >>
> >>
> >>> On Mar 29, 2016, at 7:03 AM, johndam...@apache.org 
>  wrote:
> >>>
> >>> -
> >>> Apologies if you received this multiple times
> >>> -
> >>>
> >>> Dear podling,
> >>>
> >>> This email was sent by an automated system on behalf of the Apache
> >>> Incubator PMC. It is an initial reminder to give you plenty of time to
> >>> prepare your quarterly board report.
> >>>
> >>> The board meeting is scheduled for Wed, 20 April 2016, 10:30 am PDT.
> >>> The report for your podling will form a part of the Incubator PMC
> >>> report. The Incubator PMC requires your report to be submitted 2 weeks
> >>> before the board meeting, to allow sufficient time for review and
> >>> submission (Wed, April 6th).
> >>>
> >>> Please submit your report with sufficient time to allow the Incubator
> >>> PMC, and subsequently board members to review and digest. Again, the
> >>> very latest you should submit your report is 2 weeks prior to the board
> >>> meeting.
> >>>
> >>> Thanks,
> >>>
> >>> The Apache Incubator PMC
> >>>
> >>> Submitting your Report
> >>>
> >>> --
> >>>
> >>> Your report should contain the following:
> >>>
> >>> *   Your project name
> >>> *   A brief description of your project, which assumes no knowledge of
> >>>  the project or necessarily of its field
> >>> *   A list of the three most important issues to address in the move
> >>>  towards graduation.
> >>> *   Any issues that the Incubator PMC or ASF Board might wish/need to
> be
> >>>  aware of
> >>> *   How has the community developed since the last report
> >>> *   How has the project developed since the last report.
> >>>
> >>> This should be appended to the Incubator Wiki page at:
> >>>
> >>> http://wiki.apache.org/incubator/April2016
> >>>
> >>> Note: This is manually populated. You may need to wait a little before
> >>> this page is created from a template.
> >>>
> >>> Mentors
> >>> ---
> >>>
> >>> Mentors should review reports for their project(s) and sign them off on
> >>> the Incubator wiki page. Signing off reports shows that you are
> >>> following the project - projects that are not signed may raise alarms
> >>> for the Incubator PMC.
> >>>
> >>> Incubator PMC
> >>
> >>
> >
> > --
> > *Lewis*
>
>

-- 
*Lewis*

Re: Podling Report Reminder - April 2016

[Matt Post]

I don't see our last report in either place. The board meeting minutes claim 
"Report was filed, but display is awaiting the approval of the Board minutes."

https://whimsy.apache.org/board/minutes/Joshua.html

Does someone have a copy of the last report I can use as a template this month?


> On Mar 29, 2016, at 10:41 AM, Lewis John Mcgibbney 
>  wrote:
> 
> Hi Matt,
> All of our reports are compiled and archived on the incubator wiki space at
> http://wiki.apache.org/incubator/
> They are also available in 'published' format in whimsy at
> https://whimsy.apache.org/board/minutes/
> You will need to create an account on wiki.apache.org to enter the joshua
> podling report there.
> HTH
> Lewis
> 
> On Tuesday, March 29, 2016, Matt Post  wrote:
> 
>> Hi folks,
>> 
>> I just dug around for our January report and could find it. Lewis, didn't
>> you file it? Can you post it to the wiki so we have a record of it? I
>> created a page:
>> 
>> 
>> https://cwiki.apache.org/confluence/display/JOSHUA/Quarterly+Incubator+Reports
>> 
>> matt
>> 
>> 
>>> On Mar 29, 2016, at 7:03 AM, johndam...@apache.org  wrote:
>>> 
>>> -
>>> Apologies if you received this multiple times
>>> -
>>> 
>>> Dear podling,
>>> 
>>> This email was sent by an automated system on behalf of the Apache
>>> Incubator PMC. It is an initial reminder to give you plenty of time to
>>> prepare your quarterly board report.
>>> 
>>> The board meeting is scheduled for Wed, 20 April 2016, 10:30 am PDT.
>>> The report for your podling will form a part of the Incubator PMC
>>> report. The Incubator PMC requires your report to be submitted 2 weeks
>>> before the board meeting, to allow sufficient time for review and
>>> submission (Wed, April 6th).
>>> 
>>> Please submit your report with sufficient time to allow the Incubator
>>> PMC, and subsequently board members to review and digest. Again, the
>>> very latest you should submit your report is 2 weeks prior to the board
>>> meeting.
>>> 
>>> Thanks,
>>> 
>>> The Apache Incubator PMC
>>> 
>>> Submitting your Report
>>> 
>>> --
>>> 
>>> Your report should contain the following:
>>> 
>>> *   Your project name
>>> *   A brief description of your project, which assumes no knowledge of
>>>  the project or necessarily of its field
>>> *   A list of the three most important issues to address in the move
>>>  towards graduation.
>>> *   Any issues that the Incubator PMC or ASF Board might wish/need to be
>>>  aware of
>>> *   How has the community developed since the last report
>>> *   How has the project developed since the last report.
>>> 
>>> This should be appended to the Incubator Wiki page at:
>>> 
>>> http://wiki.apache.org/incubator/April2016
>>> 
>>> Note: This is manually populated. You may need to wait a little before
>>> this page is created from a template.
>>> 
>>> Mentors
>>> ---
>>> 
>>> Mentors should review reports for their project(s) and sign them off on
>>> the Incubator wiki page. Signing off reports shows that you are
>>> following the project - projects that are not signed may raise alarms
>>> for the Incubator PMC.
>>> 
>>> Incubator PMC
>> 
>> 
> 
> -- 
> *Lewis*

Re: Build failed in Jenkins: joshua_master #4

[Matt Post]

Hi,

Also, note that the latest build failed because it's using Java 7, but Kellen's 
recent commits require Java 8.

This means that those commits sort of snuck in a required Java 8 upgrade. I'm 
fine to do this as we're on development, and we can make that a formal 
requirement as part of the next release. Java 8 is not that new.

matt


> On Apr 2, 2016, at 7:05 PM, Stian Soiland-Reyes  wrote:
> 
> BTW - which of the nodes support docker containers?
> 
> On 1 April 2016 at 17:20, Andrew Bayer  wrote:
>> Should be on any of the ubuntu-[1,2,4,5,6] boxes or H10 and H11. Otherwise,
>> probably not. As always, if you need system libraries installed, we
>> strongly advise you run your build in a docker container, where you can
>> control things like that.
>> 
>> A.
>> 
>> On Fri, Apr 1, 2016 at 9:18 AM, Lewis John Mcgibbney <
>> lewis.mcgibb...@gmail.com> wrote:
>> 
>>> Hi builds@,
>>> The named library is Boost http://www.boost.org/
>>> Is this library installed on any build slave?
>>> 
>>> On Fri, Apr 1, 2016 at 7:29 AM, Matt Post  wrote:
>>> 
 Thanks very much! Some of our tests are now passing (17/39), but now I
>>> see
 that it is unable to locate boost:
 
 [exec]   Unable to find the requested Boost libraries.
 [exec]
 [exec]   Boost version: 1.54.0
 [exec]
 [exec]   Boost include path: /usr/include
 [exec]
 [exec]   Could not find the following Boost libraries:
 [exec]
 [exec]   boost_system
 [exec]   boost_thread
 [exec]
 [exec]   Some (but not all) of the required Boost libraries were
 found.  You may
 [exec]   need to install these additional Boost libraries.
 Alternatively, set
 [exec]   BOOST_LIBRARYDIR to the directory containing Boost
>>> libraries
 or BOOST_ROOT
 [exec]   to the location of Boost.
 
 Can you suggest what we can do to address this?
 
 
> On Apr 1, 2016, at 12:18 AM, Daniel Takamori  wrote:
> 
> The node, ubuntu3, that this job ran on runs 12.04 for compatibility
> reasons and as such has an old version of cmake.  I've gone ahead and
> modified your job from the label "solaris||ubuntu" to
> "solaris||ubuntu&&!(ubuntu3)" to restrict to the newer 14.04 nodes.
> 
> Cheers,
> -Pono
> 
> On Fri, Apr 1, 2016 at 4:10 AM, Mattmann, Chris A (3980) <
> chris.a.mattm...@jpl.nasa.gov> wrote:
> 
>> Send mail to bui...@apache.org, I’ve CC’ed them on this message.
>> 
>> builds@, please help :)
>> 
>> ++
>> Chris Mattmann, Ph.D.
>> Chief Architect
>> Instrument Software and Science Data Systems Section (398)
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 168-519, Mailstop: 168-527
>> Email: chris.a.mattm...@nasa.gov
>> WWW:  http://sunset.usc.edu/~mattmann/
>> ++
>> Director, Information Retrieval and Data Science Group (IRDS)
>> Adjunct Associate Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> WWW: http://irds.usc.edu/
>> ++
>> 
>> 
>> 
>> 
>> 
>> -Original Message-
>> From: Matt Post 
>> Reply-To: "dev@joshua.incubator.apache.org"
>> 
>> Date: Thursday, March 31, 2016 at 4:59 PM
>> To: "dev@joshua.incubator.apache.org" <
>>> dev@joshua.incubator.apache.org>
>> Cc: "p...@jgeppert.com" 
>> Subject: Re: Build failed in Jenkins: joshua_master #4
>> 
>>> (To be clear, I'm asking if anyone knows how we can get a newer
>>> version
>>> of cmake installed on build.apache.org...)
>>> 
 On Mar 31, 2016, at 7:50 PM, Matt Post  wrote:
 
 It looks like the first failure is at KenLM. I see:
 
CMake Error at CMakeLists.txt:1 (cmake_minimum_required):
 [exec]   CMake 2.8.8 or higher is required.  You are
>>> running
 version 2.8.7
 
 Is there any way that this can be fixed? CMake on my Mac is 3.4.3.
>>> 
>> 
>> 
 
 
>>> 
>>> 
>>> --
>>> *Lewis*
>>> 
> 
> 
> 
> -- 
> Stian Soiland-Reyes
> Apache Taverna (incubating), Apache Commons RDF (incubating)
> http://orcid.org/-0001-9842-9718