[jira] [Commented] (JOSHUA-286) Remove presence of all joshua-decoder.org links in codebase

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/JOSHUA-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396920#comment-15396920
 ] 

ASF GitHub Bot commented on JOSHUA-286:
---

Github user lewismc commented on a diff in the pull request:

https://github.com/apache/incubator-joshua/pull/32#discussion_r72566150
  
--- Diff: src/main/java/org/apache/joshua/decoder/Decoder.java ---
@@ -496,7 +496,7 @@ public Decoder initialize(String configFile) {
   errMsg.append("FATAL: Invalid feature weight line found in 
config file.\n");
   errMsg.append(String.format("The line was '%s'\n", pairStr));
   errMsg.append("You might be using an old version of the config 
file that is no longer supported\n");
-  errMsg.append("Check joshua-decoder.org or email 
joshua_supp...@googlegroups.com for help\n");
+  errMsg.append("Check joshua.apache.org or email 
joshua_supp...@googlegroups.com for help\n");
--- End diff --

The email should be d...@joshua.apache.org


> Remove presence of all joshua-decoder.org links in codebase
> ---
>
> Key: JOSHUA-286
> URL: https://issues.apache.org/jira/browse/JOSHUA-286
> Project: Joshua
>  Issue Type: Improvement
>  Components: documentation
>Affects Versions: 6.0.5
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> Right now, joshua-decoder.org exists in the following files, we should remove 
> it and replace it with joshua.apache.org
> {code}
> lmcgibbn@LMC-032857 /usr/local/incubator-joshua(JOSHUA-283) $ grep -lr 
> "joshua-decoder.org" .
> ./.gitignore
> ./CHANGELOG
> ./doc/mainpage.md
> ./scripts/support/make-release.sh
> ./src/main/java/org/apache/joshua/decoder/Decoder.java
> ./src/main/java/org/apache/joshua/decoder/ff/lm/KenLM.java
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (JOSHUA-286) Remove presence of all joshua-decoder.org links in codebase

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/JOSHUA-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396916#comment-15396916
 ] 

ASF GitHub Bot commented on JOSHUA-286:
---

Github user lewismc commented on a diff in the pull request:

https://github.com/apache/incubator-joshua/pull/32#discussion_r72566047
  
--- Diff: CHANGELOG ---
@@ -139,7 +139,7 @@ They include:
 
 - Significantly improved and expanded documentation (both user and 
developer)
 
-  See http://joshua-decoder.org/4.0 or ./joshua-decoder.org/4.0/index.html 
(local mirror)
+  See http://apache.joshua.org/4.0 or ./apache.joshua.org/4.0/index.html 
(local mirror)
--- End diff --

There is no such site as http://apache.joshua.org, it should be 
http://joshua.apache.org, also the CHANGELOG should not be altered at all as 
this indicates changes to previous releases.


> Remove presence of all joshua-decoder.org links in codebase
> ---
>
> Key: JOSHUA-286
> URL: https://issues.apache.org/jira/browse/JOSHUA-286
> Project: Joshua
>  Issue Type: Improvement
>  Components: documentation
>Affects Versions: 6.0.5
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> Right now, joshua-decoder.org exists in the following files, we should remove 
> it and replace it with joshua.apache.org
> {code}
> lmcgibbn@LMC-032857 /usr/local/incubator-joshua(JOSHUA-283) $ grep -lr 
> "joshua-decoder.org" .
> ./.gitignore
> ./CHANGELOG
> ./doc/mainpage.md
> ./scripts/support/make-release.sh
> ./src/main/java/org/apache/joshua/decoder/Decoder.java
> ./src/main/java/org/apache/joshua/decoder/ff/lm/KenLM.java
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (JOSHUA-286) Remove presence of all joshua-decoder.org links in codebase

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/JOSHUA-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396917#comment-15396917
 ] 

ASF GitHub Bot commented on JOSHUA-286:
---

Github user lewismc commented on a diff in the pull request:

https://github.com/apache/incubator-joshua/pull/32#discussion_r72566062
  
--- Diff: scripts/support/make-release.sh ---
@@ -40,7 +40,7 @@ echo "Bundling up joshua-$version"
 [[ ! -d release ]] && mkdir release
 rm -f joshua-$version && ln -s $JOSHUA joshua-$version
 
-wget -r http://joshua-decoder.org/
+wget -r http://joshua.apache.org/6.0/
--- End diff --

Again, this site does not exist.


> Remove presence of all joshua-decoder.org links in codebase
> ---
>
> Key: JOSHUA-286
> URL: https://issues.apache.org/jira/browse/JOSHUA-286
> Project: Joshua
>  Issue Type: Improvement
>  Components: documentation
>Affects Versions: 6.0.5
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> Right now, joshua-decoder.org exists in the following files, we should remove 
> it and replace it with joshua.apache.org
> {code}
> lmcgibbn@LMC-032857 /usr/local/incubator-joshua(JOSHUA-283) $ grep -lr 
> "joshua-decoder.org" .
> ./.gitignore
> ./CHANGELOG
> ./doc/mainpage.md
> ./scripts/support/make-release.sh
> ./src/main/java/org/apache/joshua/decoder/Decoder.java
> ./src/main/java/org/apache/joshua/decoder/ff/lm/KenLM.java
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-joshua pull request #32: JOSHUA-286 - Replace old joshua-decoder.o...

[lewismc]

Github user lewismc commented on a diff in the pull request:

https://github.com/apache/incubator-joshua/pull/32#discussion_r72566062
  
--- Diff: scripts/support/make-release.sh ---
@@ -40,7 +40,7 @@ echo "Bundling up joshua-$version"
 [[ ! -d release ]] && mkdir release
 rm -f joshua-$version && ln -s $JOSHUA joshua-$version
 
-wget -r http://joshua-decoder.org/
+wget -r http://joshua.apache.org/6.0/
--- End diff --

Again, this site does not exist.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-joshua pull request #32: JOSHUA-286 - Replace old joshua-decoder.o...

[lewismc]

Github user lewismc commented on a diff in the pull request:

https://github.com/apache/incubator-joshua/pull/32#discussion_r72566047
  
--- Diff: CHANGELOG ---
@@ -139,7 +139,7 @@ They include:
 
 - Significantly improved and expanded documentation (both user and 
developer)
 
-  See http://joshua-decoder.org/4.0 or ./joshua-decoder.org/4.0/index.html 
(local mirror)
+  See http://apache.joshua.org/4.0 or ./apache.joshua.org/4.0/index.html 
(local mirror)
--- End diff --

There is no such site as http://apache.joshua.org, it should be 
http://joshua.apache.org, also the CHANGELOG should not be altered at all as 
this indicates changes to previous releases.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-joshua pull request #32: JOSHUA-286 - Replace old joshua-decoder.o...

[lewismc]

Github user lewismc commented on a diff in the pull request:

https://github.com/apache/incubator-joshua/pull/32#discussion_r72566005
  
--- Diff: .gitignore ---
@@ -42,6 +42,7 @@ doxygen_*.tmp
 .cachepipe
 
 joshua-decoder.org
+joshua.apache.org
--- End diff --

both of these can be removed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-joshua pull request #32: JOSHUA-286 - Replace old joshua-decoder.o...

[john-hewitt]

GitHub user john-hewitt opened a pull request:

https://github.com/apache/incubator-joshua/pull/32

JOSHUA-286 - Replace old joshua-decoder.org links with joshua.apache.org

- Update links to documentation and support to reflect the 
move to Apache. 
- keep Gitignore entry for old website was kept to keep the 
repo clean. 
- Update links to the git repo as well.
- old pages in the `docs` folder unchanged. 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/john-hewitt/incubator-joshua JOSHUA-286

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-joshua/pull/32.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #32


commit 36a58e75e5deb71bdeed2980e740502fe3d516c2
Author: John Hewitt 
Date:   2016-07-28T02:57:04Z

Replace old joshua-decoder.org links with joshua.apache.org

Updating links to documentation and support to reflect the
move to Apache. Gitignore entry was kept to keep the repo
clean. References to the old git repo were updated as well.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (JOSHUA-286) Remove presence of all joshua-decoder.org links in codebase

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/JOSHUA-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396840#comment-15396840
 ] 

ASF GitHub Bot commented on JOSHUA-286:
---

GitHub user john-hewitt opened a pull request:

https://github.com/apache/incubator-joshua/pull/32

JOSHUA-286 - Replace old joshua-decoder.org links with joshua.apache.org

- Update links to documentation and support to reflect the 
move to Apache. 
- keep Gitignore entry for old website was kept to keep the 
repo clean. 
- Update links to the git repo as well.
- old pages in the `docs` folder unchanged. 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/john-hewitt/incubator-joshua JOSHUA-286

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-joshua/pull/32.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #32


commit 36a58e75e5deb71bdeed2980e740502fe3d516c2
Author: John Hewitt 
Date:   2016-07-28T02:57:04Z

Replace old joshua-decoder.org links with joshua.apache.org

Updating links to documentation and support to reflect the
move to Apache. Gitignore entry was kept to keep the repo
clean. References to the old git repo were updated as well.




> Remove presence of all joshua-decoder.org links in codebase
> ---
>
> Key: JOSHUA-286
> URL: https://issues.apache.org/jira/browse/JOSHUA-286
> Project: Joshua
>  Issue Type: Improvement
>  Components: documentation
>Affects Versions: 6.0.5
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> Right now, joshua-decoder.org exists in the following files, we should remove 
> it and replace it with joshua.apache.org
> {code}
> lmcgibbn@LMC-032857 /usr/local/incubator-joshua(JOSHUA-283) $ grep -lr 
> "joshua-decoder.org" .
> ./.gitignore
> ./CHANGELOG
> ./doc/mainpage.md
> ./scripts/support/make-release.sh
> ./src/main/java/org/apache/joshua/decoder/Decoder.java
> ./src/main/java/org/apache/joshua/decoder/ff/lm/KenLM.java
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-287) KenLM.java catches UnsatisfiedLinkError when attempting to load libken.so (libken.dylib on OSX)

[Lewis John McGibbney (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated JOSHUA-287:

Issue Type: Bug  (was: Improvement)

> KenLM.java catches UnsatisfiedLinkError when attempting to load libken.so 
> (libken.dylib on OSX)
> ---
>
> Key: JOSHUA-287
> URL: https://issues.apache.org/jira/browse/JOSHUA-287
> Project: Joshua
>  Issue Type: Bug
>  Components: core, kenlm
>Affects Versions: 6.0.5
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> As explained in 
> http://www.mail-archive.com/dev%40joshua.incubator.apache.org/msg01189.html 
> currently we have an issue, where, when checked out from master the following 
> RuntimeException is thrown.
> {code}
> ---
>  T E S T S
> ---
> Running TestSuite
> WARN - sentence 0 too long 401, truncating to length 200
> WARN - sentence 0 too long 401, truncating to length 200
> WARN - sentence 0 too long 401, truncating to length 200
> WARN - sentence 0 too long 401, truncating to length 200
> tm_pt_0=-2.000 tm_glue_0=3.000 lm_0=-206.718 lm_0_oov=2.000 
> OOVPenalty=-200.000 | -198.000
> ERROR - * FATAL: Can't find libken.so (libken.dylib on OS X) in $JOSHUA/lib
> ERROR - *This probably means that the KenLM library didn't compile.
> ERROR - *Make sure that BOOST_ROOT is set to the root of your boost
> ERROR - *installation (it's not /opt/local/, the default), change to
> ERROR - *$JOSHUA, and type 'ant kenlm'. If problems persist, see the
> ERROR - *website (joshua-decoder.org).
> WARN - no grammars supplied!  Supplying dummy glue grammar.
> WARN - no grammars supplied!  Supplying dummy glue grammar.
> WARN - no grammars supplied!  Supplying dummy glue grammar.
> WARN - no grammars supplied!  Supplying dummy glue grammar.
> WARN - no grammars supplied!  Supplying dummy glue grammar.
> WARN - no grammars supplied!  Supplying dummy glue grammar.
> WARN - no grammars supplied!  Supplying dummy glue grammar.
> WARN - no grammars supplied!  Supplying dummy glue grammar.
> {code}
> We need to fix this such that we can run static source code analysis via 
> sonar and have our results available on analysis.apache.org.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[IMPORTANT] FATAL: Can't find libken.so (libken.dylib on OS X) in $JOSHUA/lib

[Lewis John Mcgibbney]

Hi Folks,
In our build logs [0], one can see the following logging

---
 T E S T S
---
Running TestSuite
WARN - sentence 0 too long 401, truncating to length 200
WARN - sentence 0 too long 401, truncating to length 200
WARN - sentence 0 too long 401, truncating to length 200
WARN - sentence 0 too long 401, truncating to length 200
tm_pt_0=-2.000 tm_glue_0=3.000 lm_0=-206.718 lm_0_oov=2.000
OOVPenalty=-200.000 | -198.000
ERROR - * FATAL: Can't find libken.so (libken.dylib on OS X) in $JOSHUA/lib
ERROR - *This probably means that the KenLM library didn't compile.
ERROR - *Make sure that BOOST_ROOT is set to the root of your boost
ERROR - *installation (it's not /opt/local/, the default), change to
ERROR - *$JOSHUA, and type 'ant kenlm'. If problems persist, see the
ERROR - *website (joshua-decoder.org).
WARN - no grammars supplied!  Supplying dummy glue grammar.
WARN - no grammars supplied!  Supplying dummy glue grammar.
WARN - no grammars supplied!  Supplying dummy glue grammar.
WARN - no grammars supplied!  Supplying dummy glue grammar.
WARN - no grammars supplied!  Supplying dummy glue grammar.
WARN - no grammars supplied!  Supplying dummy glue grammar.
WARN - no grammars supplied!  Supplying dummy glue grammar.
WARN - no grammars supplied!  Supplying dummy glue grammar.

This means that we cannot run a Sonar analysis Job to see what a static
code analysis of the Joshua codebase looks like [1].

I thought we got rid of this stuff and it is now downloaded via the
download script. It seems that this is not the case.
Is anyone who has been working on unit tests more recently got a clue what
is going on?

[0] https://builds.apache.org/job/joshua_master/80/console
[1] https://issues.apache.org/jira/browse/INFRA-11853


-- 
*Lewis*

[jira] [Created] (JOSHUA-285) Not all RuntimeExceptions are caught

[Matt Post (JIRA)]

Matt Post created JOSHUA-285:


 Summary: Not all RuntimeExceptions are caught
 Key: JOSHUA-285
 URL: https://issues.apache.org/jira/browse/JOSHUA-285
 Project: Joshua
  Issue Type: Bug
Reporter: Matt Post
 Fix For: 6.1


In many instances Joshua threads will throw a RuntimeException that is not 
caught, causing the decoder to hang indefinitely. These should be caught and, 
if serious enough, cause the decoder to die. An example of an error that is 
caught is running out of memory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (JOSHUA-284) Phrase-based decoding changes

[Matt Post (JIRA)]

Matt Post created JOSHUA-284:


 Summary: Phrase-based decoding changes
 Key: JOSHUA-284
 URL: https://issues.apache.org/jira/browse/JOSHUA-284
 Project: Joshua
  Issue Type: Bug
Reporter: Matt Post
 Fix For: 6.1


Joshua's phrase-based decoding creates a lot of complications in the pipeline.

Currently, phrase-based rules are simply left-branching Hiero rules. This means 
that, prior to packing or loading, rules have to have a nonterminal prepended 
to them. For example, Thrax will extract

[X] ||| yo quiero ||| i want ||| ...

This has to be changed to

[X] ||| [X,1] yo quiero ||| [X,1] yo quiero ||| ...

This means, for one, that phrase tables share a format but are specific to 
either the hiero or phrase-based decoder.

A better idea would be to change the phrase-based decoder a bit so that, 
instead of using left-branching phrase rules, it made use of proper glue rules, 
the same way Hiero does. The advantages are:

- both formalisms would use the same format
- both formalisms would have a glue grammar
- there should be no impact in running time



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Podling Report Reminder - August 2016

[johndament]

Dear podling,

This email was sent by an automated system on behalf of the Apache
Incubator PMC. It is an initial reminder to give you plenty of time to
prepare your quarterly board report.

The board meeting is scheduled for Wed, 17 August 2016, 10:30 am PDT.
The report for your podling will form a part of the Incubator PMC
report. The Incubator PMC requires your report to be submitted 2 weeks
before the board meeting, to allow sufficient time for review and
submission (Wed, August 03).

Please submit your report with sufficient time to allow the Incubator
PMC, and subsequently board members to review and digest. Again, the
very latest you should submit your report is 2 weeks prior to the board
meeting.

Thanks,

The Apache Incubator PMC

Submitting your Report

--

Your report should contain the following:

*   Your project name
*   A brief description of your project, which assumes no knowledge of
the project or necessarily of its field
*   A list of the three most important issues to address in the move
towards graduation.
*   Any issues that the Incubator PMC or ASF Board might wish/need to be
aware of
*   How has the community developed since the last report
*   How has the project developed since the last report.

This should be appended to the Incubator Wiki page at:

http://wiki.apache.org/incubator/August2016

Note: This is manually populated. You may need to wait a little before
this page is created from a template.

Mentors
---

Mentors should review reports for their project(s) and sign them off on
the Incubator wiki page. Signing off reports shows that you are
following the project - projects that are not signed may raise alarms
for the Incubator PMC.

Incubator PMC