test non apache account
matt (from my phone)
[jira] [Resolved] (JOSHUA-319) test-decode decoder_command results in java.lang.NumberFormatException: For input string: "MAXSPAN"
[
https://issues.apache.org/jira/browse/JOSHUA-319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney resolved JOSHUA-319.
-
Resolution: Not A Problem
The issue is produced by the pipeline failing on the mert stage! The mert stage
is then cached as a pseudo-complete status however the final config file is
never truly produced. This causes the subsequent decoding task to fail.
I re-ran another pipeline, which just finished flawlessly.
> test-decode decoder_command results in java.lang.NumberFormatException: For
> input string: "MAXSPAN"
> ---
>
> Key: JOSHUA-319
> URL: https://issues.apache.org/jira/browse/JOSHUA-319
> Project: Joshua
> Issue Type: Bug
> Components: decoders
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
> Fix For: 6.1
>
>
> When I run the following command
> {code}
> /usr/local/incubator-joshua/bin/pipeline.pl --rundir . --type hiero --corpus
> /usr/local/joshua_resources/russian_experiments/data/commoncrawl.ru-en --tune
> /usr/local/joshua_resources/russian_experiments/data/commoncrawl.ru-en.tune
> --test
> /usr/local/joshua_resources/russian_experiments/data/commoncrawl.ru-en.test
> --source en --target ru --readme "Experiment 3 Run 1 of ru --> en model
> training" --aligner berkeley --hadoop-mem 10g --tmp
> /usr/local/hadoop-2.5.2/hadoop_tmp_dir --first-step test --grammar
> /usr/local/joshua_resources/russian_experiments/exp3/grammar.gz --joshua-mem
> 10g
> {code}
> I end up with the following message.
> {code}
> INFO - Parameters read from configuration file: joshua.config
> INFO - tm = 'TYPE -maxspan MAXSPAN -owner OWNER -path
> /usr/local/joshua_resources/russian_experiments/exp3/test/1/model/grammar.gz.packed'
> INFO - tm = 'thrax -maxspan -1 -owner glue -path
> /usr/local/joshua_resources/russian_experiments/exp3/test/1/model/grammar.glue'
> INFO - defaultnonterminal = 'X'
> INFO - goalsymbol = 'GOAL'
> INFO - markoovs = 'false'
> INFO - search = 'cky'
> INFO - pop-limit: 5000
> INFO - poplimit = '5000'
> INFO - topn = '300'
> INFO - useuniquenbest = 'true'
> INFO - outputformat = '%i ||| %s ||| %f ||| %c'
> INFO - includealignindex = 'false'
> INFO - featurefunction = 'OOVPenalty'
> INFO - featurefunction = 'WordPenalty'
> INFO - c = 'joshua.config'
> INFO - threads = '1'
> INFO - topn = '0'
> INFO - outputformat = '%s'
> INFO - Read 3 weights (0 of them dense)
> Exception in thread "main" java.lang.NumberFormatException: For input string:
> "MAXSPAN"
> at
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> at java.lang.Integer.parseInt(Integer.java:580)
> at java.lang.Integer.parseInt(Integer.java:615)
> at
> org.apache.joshua.decoder.Decoder.initializeTranslationGrammars(Decoder.java:451)
> at org.apache.joshua.decoder.Decoder.initialize(Decoder.java:389)
> at org.apache.joshua.decoder.Decoder.(Decoder.java:128)
> at org.apache.joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:69)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (JOSHUA-319) test-decode decoder_command results in java.lang.NumberFormatException: For input string: "MAXSPAN"
[
https://issues.apache.org/jira/browse/JOSHUA-319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610743#comment-15610743
]
Lewis John McGibbney commented on JOSHUA-319:
-
Some supplementary reading folks
http://www.mail-archive.com/dev%40joshua.incubator.apache.org/msg01769.html
> test-decode decoder_command results in java.lang.NumberFormatException: For
> input string: "MAXSPAN"
> ---
>
> Key: JOSHUA-319
> URL: https://issues.apache.org/jira/browse/JOSHUA-319
> Project: Joshua
> Issue Type: Bug
> Components: decoders
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
> Fix For: 6.1
>
>
> When I run the following command
> {code}
> /usr/local/incubator-joshua/bin/pipeline.pl --rundir . --type hiero --corpus
> /usr/local/joshua_resources/russian_experiments/data/commoncrawl.ru-en --tune
> /usr/local/joshua_resources/russian_experiments/data/commoncrawl.ru-en.tune
> --test
> /usr/local/joshua_resources/russian_experiments/data/commoncrawl.ru-en.test
> --source en --target ru --readme "Experiment 3 Run 1 of ru --> en model
> training" --aligner berkeley --hadoop-mem 10g --tmp
> /usr/local/hadoop-2.5.2/hadoop_tmp_dir --first-step test --grammar
> /usr/local/joshua_resources/russian_experiments/exp3/grammar.gz --joshua-mem
> 10g
> {code}
> I end up with the following message.
> {code}
> INFO - Parameters read from configuration file: joshua.config
> INFO - tm = 'TYPE -maxspan MAXSPAN -owner OWNER -path
> /usr/local/joshua_resources/russian_experiments/exp3/test/1/model/grammar.gz.packed'
> INFO - tm = 'thrax -maxspan -1 -owner glue -path
> /usr/local/joshua_resources/russian_experiments/exp3/test/1/model/grammar.glue'
> INFO - defaultnonterminal = 'X'
> INFO - goalsymbol = 'GOAL'
> INFO - markoovs = 'false'
> INFO - search = 'cky'
> INFO - pop-limit: 5000
> INFO - poplimit = '5000'
> INFO - topn = '300'
> INFO - useuniquenbest = 'true'
> INFO - outputformat = '%i ||| %s ||| %f ||| %c'
> INFO - includealignindex = 'false'
> INFO - featurefunction = 'OOVPenalty'
> INFO - featurefunction = 'WordPenalty'
> INFO - c = 'joshua.config'
> INFO - threads = '1'
> INFO - topn = '0'
> INFO - outputformat = '%s'
> INFO - Read 3 weights (0 of them dense)
> Exception in thread "main" java.lang.NumberFormatException: For input string:
> "MAXSPAN"
> at
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> at java.lang.Integer.parseInt(Integer.java:580)
> at java.lang.Integer.parseInt(Integer.java:615)
> at
> org.apache.joshua.decoder.Decoder.initializeTranslationGrammars(Decoder.java:451)
> at org.apache.joshua.decoder.Decoder.initialize(Decoder.java:389)
> at org.apache.joshua.decoder.Decoder.(Decoder.java:128)
> at org.apache.joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:69)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (JOSHUA-319) test-decode decoder_command results in java.lang.NumberFormatException: For input string: "MAXSPAN"
Lewis John McGibbney created JOSHUA-319:
---
Summary: test-decode decoder_command results in
java.lang.NumberFormatException: For input string: "MAXSPAN"
Key: JOSHUA-319
URL: https://issues.apache.org/jira/browse/JOSHUA-319
Project: Joshua
Issue Type: Bug
Components: decoders
Reporter: Lewis John McGibbney
Assignee: Lewis John McGibbney
Fix For: 6.1
When I run the following command
{code}
/usr/local/incubator-joshua/bin/pipeline.pl --rundir . --type hiero --corpus
/usr/local/joshua_resources/russian_experiments/data/commoncrawl.ru-en --tune
/usr/local/joshua_resources/russian_experiments/data/commoncrawl.ru-en.tune
--test
/usr/local/joshua_resources/russian_experiments/data/commoncrawl.ru-en.test
--source en --target ru --readme "Experiment 3 Run 1 of ru --> en model
training" --aligner berkeley --hadoop-mem 10g --tmp
/usr/local/hadoop-2.5.2/hadoop_tmp_dir --first-step test --grammar
/usr/local/joshua_resources/russian_experiments/exp3/grammar.gz --joshua-mem 10g
{code}
I end up with the following message.
{code}
INFO - Parameters read from configuration file: joshua.config
INFO - tm = 'TYPE -maxspan MAXSPAN -owner OWNER -path
/usr/local/joshua_resources/russian_experiments/exp3/test/1/model/grammar.gz.packed'
INFO - tm = 'thrax -maxspan -1 -owner glue -path
/usr/local/joshua_resources/russian_experiments/exp3/test/1/model/grammar.glue'
INFO - defaultnonterminal = 'X'
INFO - goalsymbol = 'GOAL'
INFO - markoovs = 'false'
INFO - search = 'cky'
INFO - pop-limit: 5000
INFO - poplimit = '5000'
INFO - topn = '300'
INFO - useuniquenbest = 'true'
INFO - outputformat = '%i ||| %s ||| %f ||| %c'
INFO - includealignindex = 'false'
INFO - featurefunction = 'OOVPenalty'
INFO - featurefunction = 'WordPenalty'
INFO - c = 'joshua.config'
INFO - threads = '1'
INFO - topn = '0'
INFO - outputformat = '%s'
INFO - Read 3 weights (0 of them dense)
Exception in thread "main" java.lang.NumberFormatException: For input string:
"MAXSPAN"
at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:580)
at java.lang.Integer.parseInt(Integer.java:615)
at
org.apache.joshua.decoder.Decoder.initializeTranslationGrammars(Decoder.java:451)
at org.apache.joshua.decoder.Decoder.initialize(Decoder.java:389)
at org.apache.joshua.decoder.Decoder.(Decoder.java:128)
at org.apache.joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:69)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Reopened] (JOSHUA-71) OS X installation depends on coreutils to run thrax test
[
https://issues.apache.org/jira/browse/JOSHUA-71?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney reopened JOSHUA-71:
> OS X installation depends on coreutils to run thrax test
>
>
> Key: JOSHUA-71
> URL: https://issues.apache.org/jira/browse/JOSHUA-71
> Project: Joshua
> Issue Type: Bug
>Reporter: Luke Orland
> Fix For: 6.1
>
>
> the {{gstat}} command from coreutils is not installed in Darwin by default.
> One must resolve that dependency via Homebrew, Macports, etc.
> The {{test/thrax/test.sh}} test will fail on an OS X system that does not
> have coreutils installed. We should either change the test so that it does
> not require coreutils in Darwin or make it clear in the (developer)
> installation/setup instructions that coreutils are required for this test,
> check for coreutils when running the thrax test, and output a helpful message
> instructing the developer to go install coreutils if {{gstat}} is not found.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[GitHub] incubator-joshua pull request #64: Fixed Rescoring test
GitHub user fhieber opened a pull request: https://github.com/apache/incubator-joshua/pull/64 Fixed Rescoring test You can merge this pull request into a Git repository by running: $ git pull https://github.com/fhieber/incubator-joshua 7 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-joshua/pull/64.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #64 commit 695feb33293423ab6fca1d8f03b2eb0f4fe9393a Author: Hieber, Felix <fhie...@amazon.de> Date: 2016-09-15T15:16:56Z Fixed Rescoring test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-joshua pull request #62: Fixed NumTranslationOptions test and adde...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-joshua/pull/62 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-joshua pull request #62: Fixed NumTranslationOptions test and adde...
GitHub user fhieber opened a pull request: https://github.com/apache/incubator-joshua/pull/62 Fixed NumTranslationOptions test and added deterministic output order⦠⦠of feature vectors You can merge this pull request into a Git repository by running: $ git pull https://github.com/fhieber/incubator-joshua 7 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-joshua/pull/62.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #62 commit bc050e3b5c99f71c4d5945dc9852a13e825958f7 Author: Hieber, Felix <fhie...@amazon.de> Date: 2016-09-15T14:48:58Z Fixed NumTranslationOptions test and added deterministic output order of feature vectors --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-joshua pull request #61: Fixed NAry test for 7
GitHub user fhieber opened a pull request: https://github.com/apache/incubator-joshua/pull/61 Fixed NAry test for 7 You can merge this pull request into a Git repository by running: $ git pull https://github.com/fhieber/incubator-joshua 7 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-joshua/pull/61.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #61 commit f08573b5f64a37afcc824df233db8a7e8719f7e9 Author: Hieber, Felix <fhie...@amazon.de> Date: 2016-09-15T12:28:13Z Fixed NAry test for 7 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-joshua issue #52: Moved regression tests bn-en/hiero to unit test
Github user michael-aloys commented on the issue: https://github.com/apache/incubator-joshua/pull/52 If we do not remove the old tests from master, we need to coordinate in a different way on which tests are already moved. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-joshua issue #52: Moved regression tests bn-en/hiero to unit test
Github user michael-aloys commented on the issue: https://github.com/apache/incubator-joshua/pull/52 Okay, I'll continue on 7. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-joshua issue #52: Moved regression tests bn-en/hiero to unit test
Github user mjpost commented on the issue: https://github.com/apache/incubator-joshua/pull/52 Okay, this is merged in, obviously. But merging these back into 7 is turning into a pain. Since development is stopping on master, lets just do the rest of these on the 7 branch directly, okay? @michael-aloys @KellenSunderland --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-joshua pull request #44: Moved test case files
Github user asfgit closed the pull request at: https://github.com/apache/incubator-joshua/pull/44 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-joshua pull request #44: Moved test case files
GitHub user mjpost opened a pull request: https://github.com/apache/incubator-joshua/pull/44 Moved test case files Moved test cases files from resources/ to src/test/resources. Also fixed bug in LmOovFeatureTest. You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/incubator-joshua JOSHUA-299 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-joshua/pull/44.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #44 commit 20e6bf4b069d261718f819a72c9e9b2c62bcbb26 Author: Matt Post <p...@cs.jhu.edu> Date: 2016-08-22T22:03:53Z Moved test file locations from resources/ to src/test/resources commit 4812fedee89d3a6dac4e8333a1d62242f3b5ac9c Author: Matt Post <p...@cs.jhu.edu> Date: 2016-08-23T02:36:09Z missed one commit d4fdbfd88bab99e244d3ed1fc9cff4ba5e6d124c Author: Matt Post <p...@cs.jhu.edu> Date: 2016-08-23T02:57:06Z bugfix: resetting global decoder state We are getting random failures in LmOovFeatureTest.java, but only when run as a group. I printed the stack trace around the error and noticed it's a call to getting the state index in ComputeNodeResult, with a state index of 1, which shouldn't happen because only one LM is loaded. So it seems that the bug is cause by some earlier test not calling Decoder.resetGlobalState() in cleanup. So I put a call to that in the constructor. This passes the tests but I'm not sure it's correct, and it's definitely not the right way to go about things. The ideal way to solve this is to get rid of global state. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Closed] (JOSHUA-71) OS X installation depends on coreutils to run thrax test
[
https://issues.apache.org/jira/browse/JOSHUA-71?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Post closed JOSHUA-71.
---
Resolution: Fixed
> OS X installation depends on coreutils to run thrax test
>
>
> Key: JOSHUA-71
> URL: https://issues.apache.org/jira/browse/JOSHUA-71
> Project: Joshua
> Issue Type: Bug
>Reporter: Luke Orland
> Fix For: 6.2
>
>
> the {{gstat}} command from coreutils is not installed in Darwin by default.
> One must resolve that dependency via Homebrew, Macports, etc.
> The {{test/thrax/test.sh}} test will fail on an OS X system that does not
> have coreutils installed. We should either change the test so that it does
> not require coreutils in Darwin or make it clear in the (developer)
> installation/setup instructions that coreutils are required for this test,
> check for coreutils when running the thrax test, and output a helpful message
> instructing the developer to go install coreutils if {{gstat}} is not found.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (JOSHUA-71) OS X installation depends on coreutils to run thrax test
[
https://issues.apache.org/jira/browse/JOSHUA-71?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371386#comment-15371386
]
Matt Post commented on JOSHUA-71:
-
I don't think this issue applies any more.
> OS X installation depends on coreutils to run thrax test
>
>
> Key: JOSHUA-71
> URL: https://issues.apache.org/jira/browse/JOSHUA-71
> Project: Joshua
> Issue Type: Bug
>Reporter: Luke Orland
> Fix For: 6.2
>
>
> the {{gstat}} command from coreutils is not installed in Darwin by default.
> One must resolve that dependency via Homebrew, Macports, etc.
> The {{test/thrax/test.sh}} test will fail on an OS X system that does not
> have coreutils installed. We should either change the test so that it does
> not require coreutils in Darwin or make it clear in the (developer)
> installation/setup instructions that coreutils are required for this test,
> check for coreutils when running the thrax test, and output a helpful message
> instructing the developer to go install coreutils if {{gstat}} is not found.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (JOSHUA-250) Dockerized the test CI ti specify system libraries
[ https://issues.apache.org/jira/browse/JOSHUA-250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282663#comment-15282663 ] Matt Post commented on JOSHUA-250: -- I'm not sure that he'd be able to contribute. But if we build one, that would be a good starting point. > Dockerized the test CI ti specify system libraries > -- > > Key: JOSHUA-250 > URL: https://issues.apache.org/jira/browse/JOSHUA-250 > Project: Joshua > Issue Type: Bug >Affects Versions: 6.1 >Reporter: Henry Saputra >Assignee: Henry Saputra >Priority: Minor > > Since Joshua need system library like Boost may need to be installed to do > build. > It is better to Dockerize the test environment so we do not need to update CI > machines to have them -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (JOSHUA-71) OS X installation depends on coreutils to run thrax test
[
https://issues.apache.org/jira/browse/JOSHUA-71?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney reopened JOSHUA-71:
> OS X installation depends on coreutils to run thrax test
>
>
> Key: JOSHUA-71
> URL: https://issues.apache.org/jira/browse/JOSHUA-71
> Project: Joshua
> Issue Type: Bug
>Reporter: Luke Orland
> Fix For: 6.1
>
>
> the {{gstat}} command from coreutils is not installed in Darwin by default.
> One must resolve that dependency via Homebrew, Macports, etc.
> The {{test/thrax/test.sh}} test will fail on an OS X system that does not
> have coreutils installed. We should either change the test so that it does
> not require coreutils in Darwin or make it clear in the (developer)
> installation/setup instructions that coreutils are required for this test,
> check for coreutils when running the thrax test, and output a helpful message
> instructing the developer to go install coreutils if {{gstat}} is not found.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (JOSHUA-71) OS X installation depends on coreutils to run thrax test
[
https://issues.apache.org/jira/browse/JOSHUA-71?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney updated JOSHUA-71:
---
Fix Version/s: 6.1
> OS X installation depends on coreutils to run thrax test
>
>
> Key: JOSHUA-71
> URL: https://issues.apache.org/jira/browse/JOSHUA-71
> Project: Joshua
> Issue Type: Bug
>Reporter: Luke Orland
> Fix For: 6.1
>
>
> the {{gstat}} command from coreutils is not installed in Darwin by default.
> One must resolve that dependency via Homebrew, Macports, etc.
> The {{test/thrax/test.sh}} test will fail on an OS X system that does not
> have coreutils installed. We should either change the test so that it does
> not require coreutils in Darwin or make it clear in the (developer)
> installation/setup instructions that coreutils are required for this test,
> check for coreutils when running the thrax test, and output a helpful message
> instructing the developer to go install coreutils if {{gstat}} is not found.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
