Hanfee commented on issue #10514:
URL: https://github.com/apache/pulsar/issues/10514#issuecomment-836374584
I replace core-site.xml and hdfs-site.xml resolve this problem, but I find a
new problem
hdfs2 connectors/pulsar-io-hdfs2-2.7.1.nar lack hadoop-lzo-0.4.21U2.jar
```
16:26:16.839 [main] INFO org.apache.pulsar.functions.LocalRunner -
RuntimeSpawner quit because of
java.lang.IllegalArgumentException: Compression codec
com.hadoop.compression.lzo.LzoCodec not found.
at
org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:139)
~[?:?]
at
org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:179)
~[?:?]
at
org.apache.pulsar.io.hdfs2.AbstractHdfsConnector.getCompressionCodecFactory(AbstractHdfsConnector.java:202)
~[?:?]
at
org.apache.pulsar.io.hdfs2.AbstractHdfsConnector.getCompressionCodec(AbstractHdfsConnector.java:194)
~[?:?]
at
org.apache.pulsar.io.hdfs2.sink.text.HdfsAbstractTextFileSink.openHdfsStream(HdfsAbstractTextFileSink.java:74)
~[?:?]
at
org.apache.pulsar.io.hdfs2.sink.text.HdfsAbstractTextFileSink.createWriter(HdfsAbstractTextFileSink.java:47)
~[?:?]
at
org.apache.pulsar.io.hdfs2.sink.HdfsAbstractSink.open(HdfsAbstractSink.java:68)
~[?:?]
at
org.apache.pulsar.functions.instance.JavaInstanceRunnable.setupOutput(JavaInstanceRunnable.java:784)
~[org.apache.pulsar-pulsar-functions-instance-2.7.1.jar:2.7.1]
at
org.apache.pulsar.functions.instance.JavaInstanceRunnable.setup(JavaInstanceRunnable.java:212)
~[org.apache.pulsar-pulsar-functions-instance-2.7.1.jar:2.7.1]
at
org.apache.pulsar.functions.instance.JavaInstanceRunnable.run(JavaInstanceRunnable.java:234)
~[org.apache.pulsar-pulsar-functions-instance-2.7.1.jar:2.7.1]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_152]
Caused by: java.lang.ClassNotFoundException: Class
com.hadoop.compression.lzo.LzoCodec not found
at
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2273)
~[?:?]
at
org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:132)
~[?:?]
... 10 more
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
