Hello folks,
Trying to get started running the python word count example against the
portable runner using the beam 2.15 download.
In on terminal I have:
gradle :runners:spark:job-server:runShadow
And another:
gradle portableWordCount -PjobEndpoint=localhost:8099
-PenvironmentType=LOOPBACK
But when it starts it says:
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File
"/home/ubuntu/beam-release-2.15.0/sdks/python/apache_beam/examples/wordcount.py",
line 135, in <module>
run()
File
"/home/ubuntu/beam-release-2.15.0/sdks/python/apache_beam/examples/wordcount.py",
line 115, in run
result.wait_until_finish()
File
"/home/ubuntu/beam-release-2.15.0/sdks/python/apache_beam/runners/portability/portable_runner.py",
line 446, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
BeamApp-ubuntu-0916232552-dd0af6d7_90675fc0-c39c-4ca7-93fc-c7c7e980f546
failed in state FAILED: java.lang.ClassCastException:
org.apache.beam.sdk.coders.LengthPrefixCoder cannot be cast to
org.apache.beam.sdk.coders.KvCoder
And I have no clue where to start looking to fix that as I’d assume the
demos should just run?
Tom
--
Spicule Limited is registered in England & Wales. Company Number:
09954122. Registered office: First Floor, Telecom House, 125-135 Preston
Road, Brighton, England, BN1 6AF. VAT No. 251478891.
All engagements
are subject to Spicule Terms and Conditions of Business. This email and its
contents are intended solely for the individual to whom it is addressed and
may contain information that is confidential, privileged or otherwise
protected from disclosure, distributing or copying. Any views or opinions
presented in this email are solely those of the author and do not
necessarily represent those of Spicule Limited. The company accepts no
liability for any damage caused by any virus transmitted by this email. If
you have received this message in error, please notify us immediately by
reply email before deleting it from your system. Service of legal notice
cannot be effected on Spicule Limited by email.
