Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Sven Hodapp
Hi there, is it possible for MiniAccumuloCluster to reuse a given directory? Sadly, I haven't found anything in the docs? I’ll fire up my instance like this: val dict = new File("/tmp/accumulo-mini-cluster") val accumulo = new MiniAccumuloCluster(dict, "test“) If I’ll restart my JVM it wi

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Corey Nolet
Sven, What version of Accumulo are you running? We have a ticket for this [1] which has had a lot of discussion on it. Christopher Tubbs mentioned that he had gotten this to work. [1] https://issues.apache.org/jira/browse/ACCUMULO-1378 On Wed, Sep 16, 2015 at 9:20 AM, Sven Hodapp wrote: > Hi t

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Andrew Wells
I created a util for doing this, but i haven't worked on it in a while... You could see if it still works https://github.com/agwells0714/AccumuloDeveloperUtil On Wed, Sep 16, 2015 at 10:31 AM, Corey Nolet wrote: > Sven, > > What version of Accumulo are you running? We have a ticket for this [1

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Sven Hodapp
quot; > Gesendet: Mittwoch, 16. September 2015 16:31:02 > Betreff: Re: Mini Accumulo Cluster reusing the directory > Sven, > > What version of Accumulo are you running? We have a ticket for this [1] > which has had a lot of discussion on it. Christopher Tubbs mentioned

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Andrew Wells
btw, my solution revolved around this issue: https://issues.apache.org/jira/browse/ACCUMULO-2851 which let users save their data off somewhere, then load it into the new mac cluster On Wed, Sep 16, 2015 at 10:37 AM, Andrew Wells wrote: > I created a util for doing this, but i haven't worked on

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Christopher
r somewhere deployed? > > Currently I'm using version 1.7 > > Regards, > Sven > > - Ursprüngliche Mail - > > Von: "Corey Nolet" > > An: "user" > > Gesendet: Mittwoch, 16. September 2015 16:31:02 > > Betreff: Re: Mini Accumulo Clus

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Corey Nolet
;> Regards, >> Sven >> >> - Ursprüngliche Mail - >> > Von: "Corey Nolet" >> > An: "user" >> > Gesendet: Mittwoch, 16. September 2015 16:31:02 >> > Betreff: Re: Mini Accumulo Cluster reusing the directory >> >

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Josh Elser
Best as I can tell, we don't actually have the ability to do this. We can use external ZooKeeper servers and we can start a MAC instance on top of an already running ZK from a different MAC instance, but it doesn't look like we have the ability to reuse the same storage directory. That sounds

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Josh Elser
n/m, didn't read the whole thread. Sounds like ACCUMULO-1378 does capture what you asked for :) Josh Elser wrote: Best as I can tell, we don't actually have the ability to do this. We can use external ZooKeeper servers and we can start a MAC instance on top of an already running ZK from a diff

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Christopher
> >>> Regards, >>> Sven >>> >>> ----- Ursprüngliche Mail - >>> > Von: "Corey Nolet" >>> > An: "user" >>> > Gesendet: Mittwoch, 16. September 2015 16:31:02 >>> > Betreff: Re: Mini Accumulo

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Keith Turner
Would you be able to provide more informaiton about your use case? Was wondering if other solutions could be of use, like configuring regular Accumulo to use the local filesystem. This can be done, but care needs to be taken to make walogs work correctly. If interested I could provide more info

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread mohit.kaushik
Keith, How can I configure Accumulo to use local file system??? On 09/17/2015 01:11 AM, Keith Turner wrote: Would you be able to provide more informaiton about your use case? Was wondering if other solutions could be of use, like configuring regular Accumulo to use the local filesystem. This

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Josh Elser
MiniAccumuloCluster by default already uses the local file system. To get the correct sync semantics that Keith mentioned you need to set "fs.file.impl" in the Hadoop Configuration you pass to the MiniAccumuloConfig. See https://github.com/apache/accumulo/blob/master/test/src/main/java/org/a

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Josh Elser
And, to be explicit, if you want to configure not-MiniAccumuloCluster to use the local FS (you only run on one node), just use file:///... in instance.volumes (or instance.dfs.uri) instead of hdfs://namenode:port/... Wasn't sure if it would be implied to look at how MAC does this from my previ

Re: Mini Accumulo Cluster reusing the directory

2015-09-17 Thread mohit.kaushik
Thanks Josh :) On 09/17/2015 10:09 AM, Josh Elser wrote: And, to be explicit, if you want to configure not-MiniAccumuloCluster to use the local FS (you only run on one node), just use file:///... in instance.volumes (or instance.dfs.uri) instead of hdfs://namenode:port/... Wasn't sure if it

Re: Mini Accumulo Cluster reusing the directory

2015-09-17 Thread Keith Turner
On Thu, Sep 17, 2015 at 12:38 AM, Josh Elser wrote: > MiniAccumuloCluster by default already uses the local file system. > > To get the correct sync semantics that Keith mentioned you need to set > "fs.file.impl" in the Hadoop Configuration you pass to the > MiniAccumuloConfig. > Yeah thats the

Re: Mini Accumulo Cluster reusing the directory

2015-09-22 Thread Sven Hodapp
n.hod...@scai.fraunhofer.de www.scai.fraunhofer.de - Ursprüngliche Mail - > Von: "Keith Turner" > An: "user" > Gesendet: Mittwoch, 16. September 2015 21:41:00 > Betreff: Re: Mini Accumulo Cluster reusing the directory > Would you be able to provide mo

Re: Mini Accumulo Cluster reusing the directory

2015-09-22 Thread Andrew Wells
stin, Germany > sven.hod...@scai.fraunhofer.de > www.scai.fraunhofer.de > > - Ursprüngliche Mail - > > Von: "Keith Turner" > > An: "user" > > Gesendet: Mittwoch, 16. September 2015 21:41:00 > > Betreff: Re: Mini Accumulo Cluster reusing the directory