s.
>>
>> Will appreciate any help or a direction how to attack this issue.
>>
>> User class threw exception: org.apache.spark.SparkException: Job aborted
>> due to stage failure: Task 0 in stage 1.0 failed 4 times, most recent
>> failure: Lost task 0.3 in stage 1.0 (TID 3,
ailed 4 times, most recent
> failure: Lost task 0.3 in stage 1.0 (TID 3, xx, executor 1):
> *java.lang.RuntimeException:
> native-lzo library not available*
> *at
> com.hadoop.compression.lzo.LzoCodec.getDecompressorType(LzoCodec.java:193)*
> at org.apache.hadoop.io.compress.CodecPool.get
Jar is not enough, you need native library (*.so) - see if your "native"
directory contains it
drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Oct 4 2017 native
and whether java.library.path or LD_LIBRARY_PATH points/includes directory
where your *.so library resides
On Thursday, May 3,
: Job aborted
due to stage failure: Task 0 in stage 1.0 failed 4 times, most recent
failure: Lost task 0.3 in stage 1.0 (TID 3, xx, executor 1):
*java.lang.RuntimeException:
native-lzo library not available*
*at
com.hadoop.compression.lzo.LzoCodec.getDecompressorType(LzoCodec.java:193
