Can you set the config property "fs.maprfs.impl" to the MapR
implementation class of org.apache.hadoop.fs.FileSystem and try again?
I think you can set this property in any of the cluster site xmls,
preferably core-site.xml.
-Gour
On 2/17/17, 11:14 AM, "jonma...@gmail.com" <jonma...@gmail.com> wrote:
>My guess is there's actually a need to have the MapR hadoop common jar
>(the
>one I would assume has an updated file system implementation) be
>pre-pended
>to the class path. I don't have an installation in front of me, but I'd
>look into modifying slider-env or the like to prepend at least that one
>jar
>to the class path.
>
>On Fri, Feb 17, 2017 at 12:19 PM, Nicolás Velásquez O.
><gnico...@gmail.com>
>wrote:
>
>> Hey,
>> It's great to initiate MapR to slider!
>> Unfortunately, following the suggestions did not work (remove the
>>classpath
>> modification on slider-env.sh and copied mapr's jars to slider's lib
>> folder).
>>
>> I'm guessing support for parsing the fs.defaultFS string ("maprfs:///")
>>has
>> to be added to Slider's code. Something similar to
>> https://issues.apache.org/jira/browse/FLINK-1006.
>>
>> Should I just open an incident on Jira?
>>
>> Thanks!
>> Nicolas
>>
>>
>>
>> On Fri, Feb 17, 2017 at 4:40 PM, Billie Rinaldi
>><billie.rina...@gmail.com>
>> wrote:
>>
>> > I don't think anyone has tried running Slider on MapR yet, so you are
>> > breaking new ground. I would not try to change CLASSPATH in
>> slider-env.sh.
>> > Slider has a standalone lib directory, meaning that all of its
>>required
>> > jars are in the lib dir (including hadoop jars). It might be the case
>> that
>> > more jars are needed from the mapr lib directory. I would try copying
>>all
>> > the jars from the mapr lib directory to the slider lib directory and
>>see
>> if
>> > that makes a difference. If it works, then you might be able to remove
>> some
>> > of the jars.
>> >
>> > On Fri, Feb 17, 2017 at 3:32 AM, Nicolás Velásquez O. <
>> gnico...@gmail.com>
>> > wrote:
>> >
>> > > Hi,
>> > >
>> > > I'm having problems to run Solr using Apache Slider on MapR.
>> > Specifically,
>> > > when I try to install the slider package it fails because slider
>> doesn't
>> > > have support for maprfs:
>> > > $ slider install-package --replacepkg --name solr --package
>> > > ~/inst/solr/solr-slider/solr-on-yarn.zip
>> > > 2017-02-17 12:08:28,635 [main] INFO service.AbstractService -
>>Service
>> > > Slider Client failed in state INITED; cause: java.io.IOException: No
>> > > FileSystem for scheme: maprfs
>> > > java.io.IOException: No FileSystem for scheme: maprfs
>> > > at
>> > > org.apache.hadoop.fs.FileSystem.getFileSystemClass(
>> FileSystem.java:2644)
>> > > at
>> > >
>>org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2651)
>> > > at org.apache.hadoop.fs.FileSystem.access$200(
>> > FileSystem.java:92)
>> > > at
>> > > org.apache.hadoop.fs.FileSystem$Cache.getInternal(
>> FileSystem.java:2687)
>> > > at org.apache.hadoop.fs.FileSystem$Cache.get(
>> > FileSystem.java:2669)
>> > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371)
>> > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:170)
>> > > at
>> > > org.apache.slider.common.tools.CoreFileSystem.<init>(
>> > > CoreFileSystem.java:82)
>> > > at
>> > > org.apache.slider.common.tools.SliderFileSystem.<init>(
>> > > SliderFileSystem.java:38)
>> > > at
>> > > org.apache.slider.client.SliderClient.initHadoopBinding(
>> > > SliderClient.java:498)
>> > > at
>> > > org.apache.slider.client.SliderClient.serviceInit(
>> SliderClient.java:318)
>> > > at
>> > > org.apache.hadoop.service.AbstractService.init(
>> AbstractService.java:163)
>> > > at
>> > > org.apache.slider.core.main.ServiceLauncher.launchService(
>> > > ServiceLauncher.java:182)
>> > > at
>> > > org.apache.slider.core.main.ServiceLauncher.launchServiceRobustly(
>> > > ServiceLauncher.java:475)
>> > > at
>> > > org.apache.slider.core.main.ServiceLauncher.launchServiceAndExit(
>> > > ServiceLauncher.java:403)
>> > > at
>> > > org.apache.slider.core.main.ServiceLauncher.serviceMain(
>> > > ServiceLauncher.java:630)
>> > > at org.apache.slider.Slider.main(Slider.java:49)
>> > > Exception: java.io.IOException: No FileSystem for scheme: maprfs
>> > > 2017-02-17 12:08:28,637 [main] ERROR main.ServiceLauncher -
>>Exception:
>> > > java.io.IOException: No FileSystem for scheme: maprfs
>> > > org.apache.hadoop.service.ServiceStateException:
>>java.io.IOException:
>> No
>> > > FileSystem for scheme: maprfs
>> > > at
>> > > org.apache.hadoop.service.ServiceStateException.convert(
>> > > ServiceStateException.java:59)
>> > > at
>> > > org.apache.hadoop.service.AbstractService.init(
>> AbstractService.java:172)
>> > > at
>> > > org.apache.slider.core.main.ServiceLauncher.launchService(
>> > > ServiceLauncher.java:182)
>> > > at
>> > > org.apache.slider.core.main.ServiceLauncher.launchServiceRobustly(
>> > > ServiceLauncher.java:475)
>> > > at
>> > > org.apache.slider.core.main.ServiceLauncher.launchServiceAndExit(
>> > > ServiceLauncher.java:403)
>> > > at
>> > > org.apache.slider.core.main.ServiceLauncher.serviceMain(
>> > > ServiceLauncher.java:630)
>> > > at org.apache.slider.Slider.main(Slider.java:49)
>> > > Caused by: java.io.IOException: No FileSystem for scheme: maprfs
>> > > at
>> > > org.apache.hadoop.fs.FileSystem.getFileSystemClass(
>> FileSystem.java:2644)
>> > > at
>> > >
>>org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2651)
>> > > at org.apache.hadoop.fs.FileSystem.access$200(
>> > FileSystem.java:92)
>> > > at
>> > > org.apache.hadoop.fs.FileSystem$Cache.getInternal(
>> FileSystem.java:2687)
>> > > at org.apache.hadoop.fs.FileSystem$Cache.get(
>> > FileSystem.java:2669)
>> > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371)
>> > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:170)
>> > > at
>> > > org.apache.slider.common.tools.CoreFileSystem.<init>(
>> > > CoreFileSystem.java:82)
>> > > at
>> > > org.apache.slider.common.tools.SliderFileSystem.<init>(
>> > > SliderFileSystem.java:38)
>> > > at
>> > > org.apache.slider.client.SliderClient.initHadoopBinding(
>> > > SliderClient.java:498)
>> > > at
>> > > org.apache.slider.client.SliderClient.serviceInit(
>> SliderClient.java:318)
>> > > at
>> > > org.apache.hadoop.service.AbstractService.init(
>> AbstractService.java:163)
>> > > ... 5 more
>> > > 2017-02-17 12:08:28,639 [main] INFO util.ExitUtil - Exiting with
>> status
>> > 56
>> > >
>> > > I have tried (with no success) to copy the maprfs jar to the slider
>>lib
>> > > path, and to set the CLASSPATH on slider-env.sh as:
>> > > export CLASSPATH=/opt/mapr/lib/maprfs-5.2.0-mapr.jar
>> > > and
>> > > export CLASSPATH=`hadoop classpath`
>> > >
>> > > Has anybody got apache slider to work on top of mapr?
>> > >
>> > > Thanks!
>> > > Nicolas
>> > >
>> >
>>
>>
>>
>> --
>> Nicolás Velásquez O.
>> Mobile +41.767189348
>>
>
>
>
>--
>Sent from some random computer....
