[jira] [Commented] (JOSHUA-264) Remove system exits and replace with RuntimeExceptions

[Thamme Gowda (JIRA)]

[ 
https://issues.apache.org/jira/browse/JOSHUA-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330600#comment-15330600
 ] 

Thamme Gowda commented on JOSHUA-264:
-

Yes, this task is completed and we can close this issue

> Remove system exits and replace with RuntimeExceptions
> --
>
> Key: JOSHUA-264
> URL: https://issues.apache.org/jira/browse/JOSHUA-264
> Project: Joshua
>  Issue Type: Improvement
>Reporter: Kellen Sunderland
>
> When Joshua is used a library it's much more convenient to get 
> RuntimeExceptions when a fatal error happens.  This way the host process can 
> possibly handle the error or take some appropriate action (alarm, log, etc).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [jira] [Commented] (JOSHUA-264) Remove system exits and replace with RuntimeExceptions

[Matt Post]

Go ahead :)


> On Jun 14, 2016, at 2:10 PM, Thamme Gowda (JIRA)  wrote:
> 
> 
>[ 
> https://issues.apache.org/jira/browse/JOSHUA-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330600#comment-15330600
>  ] 
> 
> Thamme Gowda commented on JOSHUA-264:
> -
> 
> Yes, this task is completed and we can close this issue
> 
>> Remove system exits and replace with RuntimeExceptions
>> --
>> 
>>Key: JOSHUA-264
>>URL: https://issues.apache.org/jira/browse/JOSHUA-264
>>Project: Joshua
>> Issue Type: Improvement
>>   Reporter: Kellen Sunderland
>> 
>> When Joshua is used a library it's much more convenient to get 
>> RuntimeExceptions when a fatal error happens.  This way the host process can 
>> possibly handle the error or take some appropriate action (alarm, log, etc).
> 
> 
> 
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)

Jenkins build is back to normal : joshua_master #58

[Apache Jenkins Server]

See 

[jira] [Created] (JOSHUA-277)

[Thamme Gowda (JIRA)]

Thamme Gowda created JOSHUA-277:
---

 Summary: 
 Key: JOSHUA-277
 URL: https://issues.apache.org/jira/browse/JOSHUA-277
 Project: Joshua
  Issue Type: Bug
Reporter: Thamme Gowda






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (JOSHUA-277)

[Thamme Gowda (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thamme Gowda updated JOSHUA-277:

Description: 
$JOSHUA/bin/pipeline.pl --source bn --target en --type hiero 
--no-prepare --aligner berkeley --corpus input/bn-en/tok/training.bn-en 
--tune input/bn-en/tok/dev.bn-en --test input/bn-en/tok/devtest.bn-en
[train-copy-and-filter] cached, skipping...
[train-vocab-bn] cached, skipping...
[train-vocab-en] cached, skipping...
[tune-copy-and-filter] cached, skipping...
[tune-vocab-bn] cached, skipping...
[tune-vocab-en.0] cached, skipping...
[tune-vocab-en.1] cached, skipping...
[tune-vocab-en.2] cached, skipping...
[tune-vocab-en.3] cached, skipping...
[test-copy-and-filter] cached, skipping...
[test-vocab-bn] cached, skipping...
[test-vocab-en.0] cached, skipping...
[test-vocab-en.1] cached, skipping...
[test-vocab-en.2] cached, skipping...
[test-vocab-en.3] cached, skipping...
[source-numlines] cached, skipping...
[source-numlines] retrieved cached result =>20788
[berkeley-aligner-chunk-0] cached, skipping...
[aligner-combine] cached, skipping...
[pack-grammar] cached, skipping...
[lm-sort-uniq] cached, skipping...
[kenlm] cached, skipping...
[compile-kenlm] cached, skipping...
[glue-tune] cached, skipping...
Error: Could not find or load main class 
joshua.util.encoding.EncoderConfiguration
[tune-bundle] cached, skipping...
[mert-1] rebuilding...
  
dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.bn
 [CHANGED]
  
dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config
 [CHANGED]
  dep=tune/model/grammar.packed/slice_0.source [CHANGED]
  
dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config.final
 [NOT FOUND]
  
cmd=/Users/thammegr/work/projects/apache/incubator-joshua/scripts/training/run_tuner.py
 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.bn
 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.en
 --tunedir 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune --tuner 
mert --decoder 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/decoder_command
 --decoder-config 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config
 --decoder-output-file 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/output.nbest
 --decoder-log-file 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.log
 --iterations 10 --metric 'BLEU 4 closest'
  JOB FAILED (return code 1)
Exception in thread "main" java.lang.RuntimeException: Unable to instantiate 
feature function 'StateMinimizingLanguageModel -lm_order 5 -lm_file 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/model/lm.kenlm'!
at 
org.apache.joshua.decoder.Decoder.initializeFeatureFunctions(Decoder.java:761)
at org.apache.joshua.decoder.Decoder.initialize(Decoder.java:514)
at org.apache.joshua.decoder.Decoder.(Decoder.java:122)
at org.apache.joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:69)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at 
org.apache.joshua.decoder.Decoder.initializeFeatureFunctions(Decoder.java:757)
... 3 more
Caused by: java.lang.ExceptionInInitializerError
at 
org.apache.joshua.decoder.ff.lm.StateMinimizingLanguageModel.initializeLM(StateMinimizingLanguageModel.java:75)
at 
org.apache.joshua.decoder.ff.lm.LanguageModelFF.(LanguageModelFF.java:156)
at 
org.apache.joshua.decoder.ff.lm.StateMinimizingLanguageModel.(StateMinimizingLanguageModel.java:50)
... 8 more
Caused by: java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: no ken 
in java.library.path
at org.apache.joshua.decoder.ff.lm.KenLM.(KenLM.java:52)
... 11 more
Caused by: java.lang.UnsatisfiedLinkError: no ken in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at org.apache.joshua.decoder.ff.lm.KenLM.(KenLM.java:43)
... 11 more
Traceback (most recent call last):
  File 
"/Users/thammegr/work/projects/apache/incubator-joshua/scripts/training/run_tuner.py",
 line 553, in 
main(sys.argv)
  File 
"/Users/thammegr/work/projects/apache/incubator-joshua/scripts/training/run_tuner.py",
 line 536, in main
   

[jira] [Updated] (JOSHUA-277) Cant find ken library

[Thamme Gowda (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thamme Gowda updated JOSHUA-277:

Summary: Cant find ken library   (was: )

> Cant find ken library 
> --
>
> Key: JOSHUA-277
> URL: https://issues.apache.org/jira/browse/JOSHUA-277
> Project: Joshua
>  Issue Type: Bug
>Reporter: Thamme Gowda
>
> $JOSHUA/bin/pipeline.pl --source bn --target en --type hiero 
> --no-prepare --aligner berkeley --corpus input/bn-en/tok/training.bn-en   
>   --tune input/bn-en/tok/dev.bn-en --test input/bn-en/tok/devtest.bn-en
> [train-copy-and-filter] cached, skipping...
> [train-vocab-bn] cached, skipping...
> [train-vocab-en] cached, skipping...
> [tune-copy-and-filter] cached, skipping...
> [tune-vocab-bn] cached, skipping...
> [tune-vocab-en.0] cached, skipping...
> [tune-vocab-en.1] cached, skipping...
> [tune-vocab-en.2] cached, skipping...
> [tune-vocab-en.3] cached, skipping...
> [test-copy-and-filter] cached, skipping...
> [test-vocab-bn] cached, skipping...
> [test-vocab-en.0] cached, skipping...
> [test-vocab-en.1] cached, skipping...
> [test-vocab-en.2] cached, skipping...
> [test-vocab-en.3] cached, skipping...
> [source-numlines] cached, skipping...
> [source-numlines] retrieved cached result =>20788
> [berkeley-aligner-chunk-0] cached, skipping...
> [aligner-combine] cached, skipping...
> [pack-grammar] cached, skipping...
> [lm-sort-uniq] cached, skipping...
> [kenlm] cached, skipping...
> [compile-kenlm] cached, skipping...
> [glue-tune] cached, skipping...
> Error: Could not find or load main class 
> joshua.util.encoding.EncoderConfiguration
> [tune-bundle] cached, skipping...
> [mert-1] rebuilding...
>   
> dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.bn
>  [CHANGED]
>   
> dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config
>  [CHANGED]
>   dep=tune/model/grammar.packed/slice_0.source [CHANGED]
>   
> dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config.final
>  [NOT FOUND]
>   
> cmd=/Users/thammegr/work/projects/apache/incubator-joshua/scripts/training/run_tuner.py
>  
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.bn
>  
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.en
>  --tunedir 
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune --tuner 
> mert --decoder 
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/decoder_command
>  --decoder-config 
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config
>  --decoder-output-file 
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/output.nbest
>  --decoder-log-file 
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.log
>  --iterations 10 --metric 'BLEU 4 closest'
>   JOB FAILED (return code 1)
> Exception in thread "main" java.lang.RuntimeException: Unable to instantiate 
> feature function 'StateMinimizingLanguageModel -lm_order 5 -lm_file 
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/model/lm.kenlm'!
>   at 
> org.apache.joshua.decoder.Decoder.initializeFeatureFunctions(Decoder.java:761)
>   at org.apache.joshua.decoder.Decoder.initialize(Decoder.java:514)
>   at org.apache.joshua.decoder.Decoder.(Decoder.java:122)
>   at org.apache.joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:69)
> Caused by: java.lang.reflect.InvocationTargetException
>   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>   at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>   at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
>   at 
> org.apache.joshua.decoder.Decoder.initializeFeatureFunctions(Decoder.java:757)
>   ... 3 more
> Caused by: java.lang.ExceptionInInitializerError
>   at 
> org.apache.joshua.decoder.ff.lm.StateMinimizingLanguageModel.initializeLM(StateMinimizingLanguageModel.java:75)
>   at 
> org.apache.joshua.decoder.ff.lm.LanguageModelFF.(LanguageModelFF.java:156)
>   at 
> org.apache.joshua.decoder.ff.lm.StateMinimizingLanguageModel.(StateMinimizingLanguageModel.java:50)
>   ... 8 more
> Caused by: java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: no ken 
> in java.library.path
>   at org.apache.joshua.decoder.ff.lm.KenLM.(KenLM.java:52)
>   ... 11 more
> Caused by: java.lang.UnsatisfiedLinkError: no ken in java.library.path
>   at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
>   at java.lang.Runtime.loadLibrary0(Runtime.java:

[jira] [Updated] (JOSHUA-277) Cant find ken library

[Thamme Gowda (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thamme Gowda updated JOSHUA-277:

Description: 
{code}
$JOSHUA/bin/pipeline.pl --source bn --target en --type hiero 
--no-prepare --aligner berkeley --corpus input/bn-en/tok/training.bn-en 
--tune input/bn-en/tok/dev.bn-en --test input/bn-en/tok/devtest.bn-en
[train-copy-and-filter] cached, skipping...
[train-vocab-bn] cached, skipping...
[train-vocab-en] cached, skipping...
[tune-copy-and-filter] cached, skipping...
[tune-vocab-bn] cached, skipping...
[tune-vocab-en.0] cached, skipping...
[tune-vocab-en.1] cached, skipping...
[tune-vocab-en.2] cached, skipping...
[tune-vocab-en.3] cached, skipping...
[test-copy-and-filter] cached, skipping...
[test-vocab-bn] cached, skipping...
[test-vocab-en.0] cached, skipping...
[test-vocab-en.1] cached, skipping...
[test-vocab-en.2] cached, skipping...
[test-vocab-en.3] cached, skipping...
[source-numlines] cached, skipping...
[source-numlines] retrieved cached result =>20788
[berkeley-aligner-chunk-0] cached, skipping...
[aligner-combine] cached, skipping...
[pack-grammar] cached, skipping...
[lm-sort-uniq] cached, skipping...
[kenlm] cached, skipping...
[compile-kenlm] cached, skipping...
[glue-tune] cached, skipping...
Error: Could not find or load main class 
joshua.util.encoding.EncoderConfiguration
[tune-bundle] cached, skipping...
[mert-1] rebuilding...
  
dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.bn
 [CHANGED]
  
dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config
 [CHANGED]
  dep=tune/model/grammar.packed/slice_0.source [CHANGED]
  
dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config.final
 [NOT FOUND]
  
cmd=/Users/thammegr/work/projects/apache/incubator-joshua/scripts/training/run_tuner.py
 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.bn
 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.en
 --tunedir 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune --tuner 
mert --decoder 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/decoder_command
 --decoder-config 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config
 --decoder-output-file 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/output.nbest
 --decoder-log-file 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.log
 --iterations 10 --metric 'BLEU 4 closest'
  JOB FAILED (return code 1)
Exception in thread "main" java.lang.RuntimeException: Unable to instantiate 
feature function 'StateMinimizingLanguageModel -lm_order 5 -lm_file 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/model/lm.kenlm'!
at 
org.apache.joshua.decoder.Decoder.initializeFeatureFunctions(Decoder.java:761)
at org.apache.joshua.decoder.Decoder.initialize(Decoder.java:514)
at org.apache.joshua.decoder.Decoder.(Decoder.java:122)
at org.apache.joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:69)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at 
org.apache.joshua.decoder.Decoder.initializeFeatureFunctions(Decoder.java:757)
... 3 more
Caused by: java.lang.ExceptionInInitializerError
at 
org.apache.joshua.decoder.ff.lm.StateMinimizingLanguageModel.initializeLM(StateMinimizingLanguageModel.java:75)
at 
org.apache.joshua.decoder.ff.lm.LanguageModelFF.(LanguageModelFF.java:156)
at 
org.apache.joshua.decoder.ff.lm.StateMinimizingLanguageModel.(StateMinimizingLanguageModel.java:50)
... 8 more
Caused by: java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: no ken 
in java.library.path
at org.apache.joshua.decoder.ff.lm.KenLM.(KenLM.java:52)
... 11 more
Caused by: java.lang.UnsatisfiedLinkError: no ken in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at org.apache.joshua.decoder.ff.lm.KenLM.(KenLM.java:43)
... 11 more
Traceback (most recent call last):
  File 
"/Users/thammegr/work/projects/apache/incubator-joshua/scripts/training/run_tuner.py",
 line 553, in 
main(sys.argv)
  File 
"/Users/thammegr/work/projects/apache/incubator-joshua/scripts/training/run_tuner.py",
 line 536, in m

[jira] [Updated] (JOSHUA-277) UnsatisfiedLinkError: no ken in java.library.path

[Thamme Gowda (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thamme Gowda updated JOSHUA-277:

Summary: UnsatisfiedLinkError: no ken in java.library.path  (was: Cant find 
ken library )

> UnsatisfiedLinkError: no ken in java.library.path
> -
>
> Key: JOSHUA-277
> URL: https://issues.apache.org/jira/browse/JOSHUA-277
> Project: Joshua
>  Issue Type: Bug
>Reporter: Thamme Gowda
>
> {code}
> $JOSHUA/bin/pipeline.pl --source bn --target en --type hiero 
> --no-prepare --aligner berkeley --corpus input/bn-en/tok/training.bn-en   
>   --tune input/bn-en/tok/dev.bn-en --test input/bn-en/tok/devtest.bn-en
> [train-copy-and-filter] cached, skipping...
> [train-vocab-bn] cached, skipping...
> [train-vocab-en] cached, skipping...
> [tune-copy-and-filter] cached, skipping...
> [tune-vocab-bn] cached, skipping...
> [tune-vocab-en.0] cached, skipping...
> [tune-vocab-en.1] cached, skipping...
> [tune-vocab-en.2] cached, skipping...
> [tune-vocab-en.3] cached, skipping...
> [test-copy-and-filter] cached, skipping...
> [test-vocab-bn] cached, skipping...
> [test-vocab-en.0] cached, skipping...
> [test-vocab-en.1] cached, skipping...
> [test-vocab-en.2] cached, skipping...
> [test-vocab-en.3] cached, skipping...
> [source-numlines] cached, skipping...
> [source-numlines] retrieved cached result =>20788
> [berkeley-aligner-chunk-0] cached, skipping...
> [aligner-combine] cached, skipping...
> [pack-grammar] cached, skipping...
> [lm-sort-uniq] cached, skipping...
> [kenlm] cached, skipping...
> [compile-kenlm] cached, skipping...
> [glue-tune] cached, skipping...
> Error: Could not find or load main class 
> joshua.util.encoding.EncoderConfiguration
> [tune-bundle] cached, skipping...
> [mert-1] rebuilding...
>   
> dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.bn
>  [CHANGED]
>   
> dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config
>  [CHANGED]
>   dep=tune/model/grammar.packed/slice_0.source [CHANGED]
>   
> dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config.final
>  [NOT FOUND]
>   
> cmd=/Users/thammegr/work/projects/apache/incubator-joshua/scripts/training/run_tuner.py
>  
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.bn
>  
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.en
>  --tunedir 
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune --tuner 
> mert --decoder 
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/decoder_command
>  --decoder-config 
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config
>  --decoder-output-file 
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/output.nbest
>  --decoder-log-file 
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.log
>  --iterations 10 --metric 'BLEU 4 closest'
>   JOB FAILED (return code 1)
> Exception in thread "main" java.lang.RuntimeException: Unable to instantiate 
> feature function 'StateMinimizingLanguageModel -lm_order 5 -lm_file 
> /Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/model/lm.kenlm'!
>   at 
> org.apache.joshua.decoder.Decoder.initializeFeatureFunctions(Decoder.java:761)
>   at org.apache.joshua.decoder.Decoder.initialize(Decoder.java:514)
>   at org.apache.joshua.decoder.Decoder.(Decoder.java:122)
>   at org.apache.joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:69)
> Caused by: java.lang.reflect.InvocationTargetException
>   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>   at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>   at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
>   at 
> org.apache.joshua.decoder.Decoder.initializeFeatureFunctions(Decoder.java:757)
>   ... 3 more
> Caused by: java.lang.ExceptionInInitializerError
>   at 
> org.apache.joshua.decoder.ff.lm.StateMinimizingLanguageModel.initializeLM(StateMinimizingLanguageModel.java:75)
>   at 
> org.apache.joshua.decoder.ff.lm.LanguageModelFF.(LanguageModelFF.java:156)
>   at 
> org.apache.joshua.decoder.ff.lm.StateMinimizingLanguageModel.(StateMinimizingLanguageModel.java:50)
>   ... 8 more
> Caused by: java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: no ken 
> in java.library.path
>   at org.apache.joshua.decoder.ff.lm.KenLM.(KenLM.java:52)
>   ... 11 more
> Caused by: java.lang.UnsatisfiedLinkError: no ken in java.library.path
>   at

[jira] [Updated] (JOSHUA-277) UnsatisfiedLinkError: no ken in java.library.path

[Thamme Gowda (JIRA)]

 [ 
https://issues.apache.org/jira/browse/JOSHUA-277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thamme Gowda updated JOSHUA-277:

Description: 

I followed this guide http://joshua.incubator.apache.org/6.0/quick-start.html 
to test the latest build.

Assuming there few things are broken due to newer maven build system, I tried 
to fix pipeline.pl to get the quick start guide working.

Which files from kenlm build should I add to JNI path? (I am unable to locate 
the library file in the kenlm build output)

Here is the full log:

{code}
$JOSHUA/bin/pipeline.pl --source bn --target en --type hiero 
--no-prepare --aligner berkeley --corpus input/bn-en/tok/training.bn-en 
--tune input/bn-en/tok/dev.bn-en --test input/bn-en/tok/devtest.bn-en
[train-copy-and-filter] cached, skipping...
[train-vocab-bn] cached, skipping...
[train-vocab-en] cached, skipping...
[tune-copy-and-filter] cached, skipping...
[tune-vocab-bn] cached, skipping...
[tune-vocab-en.0] cached, skipping...
[tune-vocab-en.1] cached, skipping...
[tune-vocab-en.2] cached, skipping...
[tune-vocab-en.3] cached, skipping...
[test-copy-and-filter] cached, skipping...
[test-vocab-bn] cached, skipping...
[test-vocab-en.0] cached, skipping...
[test-vocab-en.1] cached, skipping...
[test-vocab-en.2] cached, skipping...
[test-vocab-en.3] cached, skipping...
[source-numlines] cached, skipping...
[source-numlines] retrieved cached result =>20788
[berkeley-aligner-chunk-0] cached, skipping...
[aligner-combine] cached, skipping...
[pack-grammar] cached, skipping...
[lm-sort-uniq] cached, skipping...
[kenlm] cached, skipping...
[compile-kenlm] cached, skipping...
[glue-tune] cached, skipping...
Error: Could not find or load main class 
joshua.util.encoding.EncoderConfiguration
[tune-bundle] cached, skipping...
[mert-1] rebuilding...
  
dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.bn
 [CHANGED]
  
dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config
 [CHANGED]
  dep=tune/model/grammar.packed/slice_0.source [CHANGED]
  
dep=/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config.final
 [NOT FOUND]
  
cmd=/Users/thammegr/work/projects/apache/incubator-joshua/scripts/training/run_tuner.py
 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.bn
 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/data/tune/corpus.en
 --tunedir 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune --tuner 
mert --decoder 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/decoder_command
 --decoder-config 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.config
 --decoder-output-file 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/output.nbest
 --decoder-log-file 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/joshua.log
 --iterations 10 --metric 'BLEU 4 closest'
  JOB FAILED (return code 1)
Exception in thread "main" java.lang.RuntimeException: Unable to instantiate 
feature function 'StateMinimizingLanguageModel -lm_order 5 -lm_file 
/Users/thammegr/work/projects/apache/incubator-joshua/data/bn-en/tune/model/lm.kenlm'!
at 
org.apache.joshua.decoder.Decoder.initializeFeatureFunctions(Decoder.java:761)
at org.apache.joshua.decoder.Decoder.initialize(Decoder.java:514)
at org.apache.joshua.decoder.Decoder.(Decoder.java:122)
at org.apache.joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:69)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at 
org.apache.joshua.decoder.Decoder.initializeFeatureFunctions(Decoder.java:757)
... 3 more
Caused by: java.lang.ExceptionInInitializerError
at 
org.apache.joshua.decoder.ff.lm.StateMinimizingLanguageModel.initializeLM(StateMinimizingLanguageModel.java:75)
at 
org.apache.joshua.decoder.ff.lm.LanguageModelFF.(LanguageModelFF.java:156)
at 
org.apache.joshua.decoder.ff.lm.StateMinimizingLanguageModel.(StateMinimizingLanguageModel.java:50)
... 8 more
Caused by: java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: no ken 
in java.library.path
at org.apache.joshua.decoder.ff.lm.KenLM.(KenLM.java:52)
... 11 more
Caused by: java.lang.UnsatisfiedLinkError: no ken in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.Syste

Build failed in Jenkins: joshua_master #59

[Apache Jenkins Server]

See 

--
[...truncated 3102 lines...]
36/192 KB   32/286 KB   
40/192 KB   32/286 KB   
40/192 KB   36/286 KB   
44/192 KB   36/286 KB   
44/192 KB   40/286 KB   
48/192 KB   40/286 KB   
48/192 KB   44/286 KB   
52/192 KB   44/286 KB   
52/192 KB   48/286 KB   
56/192 KB   48/286 KB   
56/192 KB   52/286 KB   
60/192 KB   52/286 KB   
60/192 KB   56/286 KB   
64/192 KB   56/286 KB   
64/192 KB   60/286 KB   
68/192 KB   60/286 KB   
68/192 KB   64/286 KB   
72/192 KB   64/286 KB   
72/192 KB   68/286 KB   
76/192 KB   68/286 KB   
76/192 KB   72/286 KB   
80/192 KB   72/286 KB   
80/192 KB   76/286 KB   
84/192 KB   76/286 KB   
84/192 KB   80/286 KB   
88/192 KB   80/286 KB   
88/192 KB   84/286 KB   
92/192 KB   84/286 KB   
92/192 KB   88/286 KB   
96/192 KB   88/286 KB   
96/192 KB   92/286 KB   
100/192 KB   92/286 KB   
100/192 KB   96/286 KB   
104/192 KB   96/286 KB   
104/192 KB   100/286 KB   
108/192 KB   100/286 KB   
108/192 KB   104/286 KB   
112/192 KB   104/286 KB   
112/192 KB   108/286 KB   
116/192 KB   108/286 KB   
116/192 KB   112/286 KB   
120/192 KB   112/286 KB   
120/192 KB   116/286 KB   
124/192 KB   116/286 KB   
124/192 KB   120/286 KB   
128/192 KB   120/286 KB   
128/192 KB   124/286 KB   
132/192 KB   124/286 KB   
132/192 KB   128/286 KB   
136/192 KB   128/286 KB   
136/192 KB   132/286 KB   
140/192 KB   132/286 KB   
140/192 KB   136/286 KB   
144/192 KB   136/286 KB   
144/192 KB   140/286 KB   
148/192 KB   140/286 KB   
148/192 KB   144/286 KB   
152/192 KB   144/286 KB   
152/192 KB   148/286 KB   
156/192 KB   148/286 KB   
156/192 KB   152/286 KB   
160/192 KB   152/286 KB   
160/192 KB   156/286 KB   
164/192 KB   156/286 KB   
164/192 KB   160/286 KB   
168/192 KB   160/286 KB   
168/192 KB   164/286 KB   
172/192 KB   164/286 KB   
172/192 KB   168/286 KB   
176/192 KB   168/286 KB   
176/192 KB   172/286 KB   
180/192 KB   172/286 KB   
180/192 KB   176/286 KB   
184/192 KB   176/286 KB   
184/192 KB   180/286 KB   
188/192 KB   180/286 KB   
188/192 KB   184/286 KB   
192/192 KB   184/286 KB   
192/192 KB   188/286 KB   
192/192 KB   188/286 KB   
192/192 KB   192/286 KB   
192/192 KB   196/286 KB   
192/192 KB   200/286 KB   
192/192 KB   204/286 KB   
192/192 KB   208/286 KB   
192/192 KB   212/286 KB   
192/192 KB   216/286 KB   
192/192 KB   220/286 KB   
192/192 KB   224/286 KB   
4/45 KB   192/192 KB   224/286 KB   
8/45 KB   192/192 KB   228/286 KB   
12/45 KB   192/192 KB   228/286 KB   
16/45 KB   192/192 KB   228/286 KB   
20/45 KB   192/192 KB   228/286 KB   
24/45 KB   192/192 KB   228/286 KB   
28/45 KB   192/192 KB   228/286 KB   
32/45 KB   192/192 KB   228/286 KB   
36/45 KB   192/192 KB   228/286 KB   
40/45 KB   192/192 KB   228/286 KB   
44/45 KB   192/192 KB   228/286 KB   
45/45 KB   192/192 KB   228/286 KB   
4/45 KB   192/192 KB   228/286 KB   
45/45 KB   192/192 KB   232/286 KB   
45/45 KB   192/192 KB   236/286 KB   
45/45 KB   192/192 KB   240/286 KB   
45/45 KB   192/192 KB   244/286 KB   
45/45 KB   192/192 KB   248/286 KB   
45/45 KB   192/192 KB   252/286 KB   
45/45 KB   192/192 KB   256/286 KB   
45/45 KB   192/192 KB   260/286 KB   
45/45 KB   192/192 KB   264/286 KB   
45/45 KB   192/192 KB   268/286 KB   
45/45 KB   192/192 KB   272/286 KB   
45/45 KB   192/192 KB   276/286 KB   
45/45 KB   192/192 KB   280/286 KB   
45/45 KB   192/192 KB   284/286 KB   
45/45 KB   192/192 KB   286/286 KB   
 
Downloaded: 
http://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/2.19.1/surefire-api-2.19.1.jar
 (192 KB at 7659.1 KB/sec)
 
Downloaded: 
http://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/2.19.1/surefire-booter-2.19.1.jar
 (45 KB at 1532.2 KB/sec)
 
Downloaded: 
http://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/2.19.1/maven-surefire-common-2.19.1.jar
 (286 KB at 8926.5 KB/sec)
Downloading: 
http://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-testng/2.19.1/surefire-testng-2.19.1.pom
3/3 KB   
 
Downloaded: 
http://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-testng/2.19.1/surefire-testng-2.19.1.pom
 (3 KB at 113.5 KB/sec)
Downloading: 
http://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/2.19.1/surefire-providers-2.19.1.pom
3/3 KB   
 
Downloaded: 
http://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/2.19.1/surefire-providers-2.19.1.pom
 (3 KB at 131.7 KB/sec)
Downloading: 
http://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/2.19.1/common-java5-2.19.1.pom
3/3 KB   
 
Downloaded: 
http://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/2.19.1/common-java5-2.19.1.pom
 (3 KB at

Re junit in eclipse

[Lewis John Mcgibbney]

Hi Matt,

On Thu, Jun 2, 2016 at 7:15 AM,  wrote:

> From: Matt Post 
> To: dev@joshua.incubator.apache.org
> Cc:
> Date: Wed, 1 Jun 2016 23:25:12 -0400
> Subject: junit in eclipse
> Has anyone successfully run JUnit tests in Eclipse?


Yes it is very easy. All you need to do is

mvn eclipse:eclipse

This build the Eclipse project and classpath. You can then import the
project into Eclipse as an exiating Maven project and use either the JUnit
or TestNG plugins to do your unit test debugging.


> I'd love to integrate them but am not sure how to go about setting it up.
> I thought I'd ask before burning the time on Google. I'll volunteer to
> write a wiki article if you can help me out :)
>
>
Sorry for the late reply. This got lost.
Lewis