Re: How to use a custom filesystem provider?

2016-09-21 Thread Jean-Philippe Martin
> > There's a bit of confusion setting in here; the FileSystem implementations > spark uses are subclasses of org.apache.hadoop.fs.FileSystem; the nio > class with the same name is different. > grab the google cloud storage connector and put it on your classpath I was using the gs:// filesystem

Re: How to use a custom filesystem provider?

2016-09-21 Thread Steve Loughran
On 21 Sep 2016, at 20:10, Jean-Philippe Martin > wrote: The full source for my example is available on github. I'm using maven to depend on

How to use a custom filesystem provider?

2016-09-21 Thread Jean-Philippe Martin
The full source for my example is available on github . I'm using maven to depend on gcloud-java-nio , which provides a Java FileSystem for Google Cloud Storage, via