[jira] [Created] (JOSHUA-266) Refactor key interfaces and core code for a future release.

2016-05-13 Thread Kellen Sunderland (JIRA)
Kellen Sunderland created JOSHUA-266: Summary: Refactor key interfaces and core code for a future release. Key: JOSHUA-266 URL: https://issues.apache.org/jira/browse/JOSHUA-266 Project: Joshua

[jira] [Created] (JOSHUA-265) Refactor key interfaces and core code for a future release.

2016-05-13 Thread Kellen Sunderland (JIRA)
Kellen Sunderland created JOSHUA-265: Summary: Refactor key interfaces and core code for a future release. Key: JOSHUA-265 URL: https://issues.apache.org/jira/browse/JOSHUA-265 Project: Joshua

INFRA-11853 Setup Sonar analysis for Joshua (Incubating)

2016-05-13 Thread Lewis John Mcgibbney
https://issues.apache.org/jira/browse/INFRA-11853 -- *Lewis*

[jira] [Created] (JOSHUA-264) Remove system exits and replace with RuntimeExceptions

2016-05-13 Thread Kellen Sunderland (JIRA)
Kellen Sunderland created JOSHUA-264: Summary: Remove system exits and replace with RuntimeExceptions Key: JOSHUA-264 URL: https://issues.apache.org/jira/browse/JOSHUA-264 Project: Joshua

Re: Language Pack size

2016-05-13 Thread kellen sunderland
That's a great idea, can we pre-sort the grammar as well? On Fri, May 13, 2016 at 1:47 PM, Matt Post wrote: > Quantization is also supported in the grammar packer. > > Another idea: since we know the model weights when we publish a language > pack, we should pre-compute the dot

[jira] [Closed] (JOSHUA-263) Standardize logging across Joshua

2016-05-13 Thread Kellen Sunderland (JIRA)
[ https://issues.apache.org/jira/browse/JOSHUA-263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellen Sunderland closed JOSHUA-263. Resolution: Duplicate > Standardize logging across Joshua >

[jira] [Updated] (JOSHUA-263) Standardize logging across Joshua

2016-05-13 Thread Kellen Sunderland (JIRA)
[ https://issues.apache.org/jira/browse/JOSHUA-263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellen Sunderland updated JOSHUA-263: - Description: (was: We would like to standardize logging across Joshua. The purpose

[jira] [Created] (JOSHUA-263) Standardize logging across Joshua

2016-05-13 Thread Kellen Sunderland (JIRA)
Kellen Sunderland created JOSHUA-263: Summary: Standardize logging across Joshua Key: JOSHUA-263 URL: https://issues.apache.org/jira/browse/JOSHUA-263 Project: Joshua Issue Type:

Re: Language Pack size

2016-05-13 Thread Matt Post
Quantization is also supported in the grammar packer. Another idea: since we know the model weights when we publish a language pack, we should pre-compute the dot product of the weight vector against the grammar weights and reduce it to a single (quantized) score. (This would reduce the

Re: Language Pack size

2016-05-13 Thread Matt Post
Oh, yes, of course. That's in build_binary. > On May 13, 2016, at 4:39 PM, kellen sunderland > wrote: > > Could we also use quantization with the language model to reduce the size? > KenLM supports this right? > > On Fri, May 13, 2016 at 1:19 PM, Matt Post

[jira] [Commented] (JOSHUA-252) Make it possible to use Maven to build Joshua

2016-05-13 Thread Lewis John McGibbney (JIRA)
[ https://issues.apache.org/jira/browse/JOSHUA-252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283123#comment-15283123 ] Lewis John McGibbney commented on JOSHUA-252: - [~teofili] I am working on this today I will

[jira] [Updated] (JOSHUA-252) Make it possible to use Maven to build Joshua

2016-05-13 Thread Lewis John McGibbney (JIRA)
[ https://issues.apache.org/jira/browse/JOSHUA-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated JOSHUA-252: Component/s: build > Make it possible to use Maven to build Joshua >

[jira] [Updated] (JOSHUA-259) Integration tests are failing

2016-05-13 Thread Lewis John McGibbney (JIRA)
[ https://issues.apache.org/jira/browse/JOSHUA-259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated JOSHUA-259: Fix Version/s: 6.1 > Integration tests are failing > -

[jira] [Updated] (JOSHUA-260) Integrate IoC (Inversion of Control) into Joshua

2016-05-13 Thread Lewis John McGibbney (JIRA)
[ https://issues.apache.org/jira/browse/JOSHUA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated JOSHUA-260: Fix Version/s: 6.1 > Integrate IoC (Inversion of Control) into Joshua >

[jira] [Assigned] (JOSHUA-260) Integrate IoC (Inversion of Control) into Joshua

2016-05-13 Thread Kellen Sunderland (JIRA)
[ https://issues.apache.org/jira/browse/JOSHUA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellen Sunderland reassigned JOSHUA-260: Assignee: Kellen Sunderland > Integrate IoC (Inversion of Control) into Joshua >

Re: ApacheCon Meetup

2016-05-13 Thread Lewis John Mcgibbney
Hi Folks, We are sitting down now and talking about the build system. It looks like we are going to implement a Maven build. The current build is sequenced as follows compile -> thrax (Java) compile -> berkeleylm compile -> joshua (Java) compile -> GIZA++ compile -> KenLM I'm going to log an issue

[jira] [Updated] (JOSHUA-262) Implement all logging as Slf4j over Log4j

2016-05-13 Thread Lewis John McGibbney (JIRA)
[ https://issues.apache.org/jira/browse/JOSHUA-262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated JOSHUA-262: Component/s: core > Implement all logging as Slf4j over Log4j >

[jira] [Created] (JOSHUA-262) Implement all logging as Slf4j over Log4j

2016-05-13 Thread Lewis John McGibbney (JIRA)
Lewis John McGibbney created JOSHUA-262: --- Summary: Implement all logging as Slf4j over Log4j Key: JOSHUA-262 URL: https://issues.apache.org/jira/browse/JOSHUA-262 Project: Joshua Issue

[jira] [Commented] (JOSHUA-51) add jhclark/bigfatlm

2016-05-13 Thread Henri Yandell (JIRA)
[ https://issues.apache.org/jira/browse/JOSHUA-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283099#comment-15283099 ] Henri Yandell commented on JOSHUA-51: - Noting the license is LGPL 3.0. > add jhclark/bigfatlm >

Language Pack size

2016-05-13 Thread Tom Barber
Out of curiosity more than anything else I tested XZ compression on a model instead of Gzip, it takes the Spain pack down from 1.9GB to 1.5GB, not the most ever, but obviously does mean 400MB+ less in remote storage and data going over the wire. Worth considering I guess. Tom --

Re: ApacheCon Meetup

2016-05-13 Thread Henry Saputra
Looks like this is not happening? We could probably make it happen as Google hangout for next time. - Henry On Fri, May 13, 2016 at 11:34 AM, Henri Yandell wrote: > We are? :) > > Work meetings came up as urgent for this morning, so only just noticed > this. :( > > Sorry, >

Re: ApacheCon Meetup

2016-05-13 Thread Henri Yandell
We are? :) Work meetings came up as urgent for this morning, so only just noticed this. :( Sorry, Hen On Thu, May 12, 2016 at 12:32 PM, Lewis John Mcgibbney < lewis.mcgibb...@gmail.com> wrote: > Hi Folks, > Kellen, Henri and I are going to get together tomorrow 13th around > lunchtime PST to

Re: ApacheCon Meetup

2016-05-13 Thread Tommaso Teofili
sorry guys, too late for me today ... have fun, it'd be good if you could send a wrap up on the list. Regards, Tommaso Il giorno ven 13 mag 2016 alle ore 18:08 Henry Saputra < henry.sapu...@gmail.com> ha scritto: > Cool, sounds good =) > > - Henry > > On Thu, May 12, 2016 at 6:08 PM, kellen

Re: ApacheCon Meetup

2016-05-13 Thread Henry Saputra
Cool, sounds good =) - Henry On Thu, May 12, 2016 at 6:08 PM, kellen sunderland < kellen.sunderl...@gmail.com> wrote: > I just wanted to discuss it as a group. Your approach looks good to me. > > On Thu, May 12, 2016 at 6:05 PM, Henry Saputra > wrote: > > > Ah sorry,

[jira] [Commented] (JOSHUA-250) Dockerized the test CI ti specify system libraries

2016-05-13 Thread Matt Post (JIRA)
[ https://issues.apache.org/jira/browse/JOSHUA-250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282663#comment-15282663 ] Matt Post commented on JOSHUA-250: -- I'm not sure that he'd be able to contribute. But if we build one,