[
https://issues.apache.org/jira/browse/JOSHUA-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15614495#comment-15614495
]
ASF GitHub Bot commented on JOSHUA-316:
---
Github user lewismc commented on the issue:
https://github.com/apache/incubator-joshua/pull/73
A further comment, I just closed off
https://issues.apache.org/jira/browse/JOSHUA-319, this is because I am able to
run end to end pipelines without a hitch now. The only barrier is ensuring that
enough memory is allocated to the processes.
I ran with this PR on my local joshua code and it ran like a charm.
> run_bundler.py returning JOB FAILED (return code 1) TypeError: memoryview: a
> bytes-like object is required, not 'str'
> -
>
> Key: JOSHUA-316
> URL: https://issues.apache.org/jira/browse/JOSHUA-316
> Project: Joshua
> Issue Type: Bug
> Components: bundler
>Affects Versions: 6.0.5
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
>Priority: Critical
> Fix For: 6.1
>
>
> {code}
> [glue-tune] rebuilding...
>
> dep=/usr/local/joshua_resources/russian_experiments/exp2/grammar.packed/slice_0.source
> [CHANGED]
>
> dep=/usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue
> [NOT FOUND]
> cmd=/usr/local/incubator-joshua/scripts/support/create_glue_grammar.sh
> /usr/local/joshua_resources/russian_experiments/exp2/grammar.packed >
> /usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue
> took 1 seconds (1s)
> [tune-bundle] rebuilding...
>
> dep=/usr/local/incubator-joshua/scripts/training/templates/tune/joshua.config
> [CHANGED]
>
> dep=/usr/local/joshua_resources/russian_experiments/exp2/grammar.packed/slice_0.source
> [CHANGED]
>
> dep=/usr/local/joshua_resources/russian_experiments/exp2/tune/model/run-joshua.sh
> [NOT FOUND]
> cmd=/usr/local/incubator-joshua/scripts/support/run_bundler.py --force
> --symlink --absolute --verbose -T /usr/local/hadoop-2.5.2/hadoop_tmp_dir
> /usr/local/incubator-joshua/scripts/training/templates/tune/joshua.config
> /usr/local/joshua_resources/russian_experiments/exp2/tune/model
> --copy-config-options '-top-n 300 -output-format "%i ||| %s ||| %f ||| %c"
> -mark-oovs false -search cky -weights "lm_0 1 tm_pt_0 1 tm_pt_1 1 tm_pt_2 1
> tm_pt_3 1 tm_pt_4 1 tm_pt_5 1 tm_glue_0 1 " -feature-function
> "StateMinimizingLanguageModel -lm_order 5 -lm_file
> /usr/local/joshua_resources/russian_experiments/exp2/lm.kenlm" -tm0/type
> hiero -tm0/owner pt -tm0/maxspan 20 -tm1/owner glue' --pack-tm
> /usr/local/joshua_resources/russian_experiments/exp2/grammar.packed --tm
> /usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue
> JOB FAILED (return code 1)
> * Running the copy-config.pl script with the command:
> /usr/local/incubator-joshua/scripts/copy-config.pl -top-n 300 -output-format
> "%i ||| %s ||| %f ||| %c" -mark-oovs false -search cky -weights "lm_0 1
> tm_pt_0 1 tm_pt_1 1 tm_pt_2 1 tm_pt_3 1 tm_pt_4 1 tm_pt_5 1 tm_glue_0 1 "
> -feature-function "StateMinimizingLanguageModel -lm_order 5 -lm_file
> /usr/local/joshua_resources/russian_experiments/exp2/lm.kenlm" -tm0/type
> hiero -tm0/owner pt -tm0/maxspan 20 -tm1/owner glue
> Traceback (most recent call last):
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line
> 748, in main
> operations = collect_operations(opts)
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line
> 637, in collect_operations
> opts.copy_config_options
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line
> 202, in filter_through_copy_config_script
> result, err = p.communicate(config_text)
> File "/Users/lmcgibbn/miniconda3/lib/python3.5/subprocess.py", line 1072,
> in communicate
> stdout, stderr = self._communicate(input, endtime, timeout)
> File "/Users/lmcgibbn/miniconda3/lib/python3.5/subprocess.py", line 1700,
> in _communicate
> input_view = memoryview(self._input)
> TypeError: memoryview: a bytes-like object is required, not 'str'
> During handling of the above exception, another exception occurred:
> Traceback (most recent call last):
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line
> 760, in
> main(sys.argv)
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line
> 751, in main
> error_quit(e.message)
> AttributeError: 'TypeError' object has no attribute 'message'
> * WARNING: no key 'outputformat' found in config file (appending to end)
> * WARNING: no key 'search' found in config file (appending to end)
> * WARNING: no key 'topn' found in config file (appending to end)
> *
