op.dll/winutils.exe etc hadoop windows support package in HADOOP_HOME,
> if you didn’t do that yet.
>
>
>
> Best Regards
>
> Richard
>
>
>
>
>
> *From: *Junfeng Chen
> *Date: *Monday, December 4, 2017 at 3:53 AM
> *To: *"Qiao, Richard"
> *Cc: *
park.apache.org"
Subject: Re: Add snappy support for spark in Windows
But I am working on my local development machine, so it should have no relative
to workers/executers.
I find some documents about enable snappy on hadoop. If I want to use snappy
with spark, do I need to config spark as hado
But I am working on my local development machine, so it should have no
relative to workers/executers.
I find some documents about enable snappy on hadoop. If I want to use
snappy with spark, do I need to config spark as hadoop or have some easy
way to access it?
Regard,
Junfeng Chen
On Mon, Dec
It seems a common mistake that the path is not accessible by workers/executors.
Best regards
Richard
Sent from my iPhone
On Dec 3, 2017, at 22:32, Junfeng Chen
mailto:darou...@gmail.com>> wrote:
I am working on importing snappy compressed json file into spark rdd or
dataset. However I meet t
I am working on importing snappy compressed json file into spark rdd or
dataset. However I meet this error: java.lang.UnsatisfiedLinkError:
org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z
I have set the following configuration:
SparkConf conf = new SparkConf()
.setAppNa
