Oscar Westra van Holthe - Kind created AVRO-4154:
----------------------------------------------------
Summary: Python tests (running in Docker) fail
Key: AVRO-4154
URL: https://issues.apache.org/jira/browse/AVRO-4154
Project: Apache Avro
Issue Type: Bug
Reporter: Oscar Westra van Holthe - Kind
Log snippet:
{noformat}
ERROR: test_tether_word_count
(avro.test.test_tether_word_count.TestTetherWordCount)
Check that a tethered map-reduce job produces the output expected locally.
----------------------------------------------------------------------
Traceback (most recent call last):
File "/avro/lang/py/avro/test/test_tether_word_count.py", line 168, in
test_tether_word_count
subprocess.check_call(args, env={"PYTHONPATH": _PYTHON_PATH, "PATH":
os.environ["PATH"]})
File "/opt/pypy3.10/lib/pypy3.10/subprocess.py", line 369, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '('java', '-jar',
'/avro/lang/java/tools/target/avro-tools-1.13.0-SNAPSHOT.jar', 'tether',
'--protocol', 'http', '--in', '/tmp/test_tether_word_count9bg9zhjt/in',
'--out', '/tmp/test_tether_word_count9bg9zhjt/out', '--outschema',
'/tmp/test_tether_word_count9bg9zhjt/output.avsc', '--program',
'/avro/lang/py/.tox/pypy3.10/bin/python', '--exec_args', '-m
avro.tether.tether_task_runner word_count_task.WordCountTask')' returned
non-zero exit status 1.
Stdout:
Command:
java -jar /avro/lang/java/tools/target/avro-tools-1.13.0-SNAPSHOT.jar
tether --protocol http --in /tmp/test_tether_word_count9bg9zhjt/in --out
/tmp/test_tether_word_count9bg9zhjt/out --outschema
/tmp/test_tether_word_count9bg9zhjt/output.avsc --program
/avro/lang/py/.tox/pypy3.10/bin/python --exec_args -m
avro.tether.tether_task_runner word_count_task.WordCountTask
{noformat}
This is caused by:
{noformat}
25/06/12 06:57:03 WARN impl.MetricsConfig: Cannot locate configuration: tried
hadoop-metrics2-jobtracker.properties,hadoop-metrics2.properties
Exception in thread "main" java.util.ServiceConfigurationError:
java.net.spi.InetAddressResolverProvider: Provider
org.xbill.DNS.spi.DnsjavaInetAddressResolverProvider not found
at java.base/java.util.ServiceLoader.fail(ServiceLoader.java:593)
at
java.base/java.util.ServiceLoader$LazyClassPathLookupIterator.nextProviderClass(ServiceLoader.java:1219)
...
{noformat}
Links on the problem and a solution:
* [https://github.com/dnsjava/dnsjava/issues/338]
* [https://github.com/dnsjava/dnsjava/issues/329#issuecomment-2346138242]
*
[https://stackoverflow.com/questions/53049346/is-log4j2-compatible-with-java-11/54713830#54713830]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
