Re: Mini Accumulo Cluster reusing the directory

2015-09-22 Thread Sven Hodapp
...@scai.fraunhofer.de www.scai.fraunhofer.de - Ursprüngliche Mail - > Von: "Keith Turner" <ke...@deenlo.com> > An: "user" <user@accumulo.apache.org> > Gesendet: Mittwoch, 16. September 2015 21:41:00 > Betreff: Re: Mini Accumulo Cluster reusing the di

Re: Mini Accumulo Cluster reusing the directory

2015-09-17 Thread mohit.kaushik
Thanks Josh :) On 09/17/2015 10:09 AM, Josh Elser wrote: And, to be explicit, if you want to configure not-MiniAccumuloCluster to use the local FS (you only run on one node), just use file:///... in instance.volumes (or instance.dfs.uri) instead of hdfs://namenode:port/... Wasn't sure if it

Re: Mini Accumulo Cluster reusing the directory

2015-09-17 Thread Keith Turner
On Thu, Sep 17, 2015 at 12:38 AM, Josh Elser wrote: > MiniAccumuloCluster by default already uses the local file system. > > To get the correct sync semantics that Keith mentioned you need to set > "fs.file.impl" in the Hadoop Configuration you pass to the >

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Andrew Wells
I created a util for doing this, but i haven't worked on it in a while... You could see if it still works https://github.com/agwells0714/AccumuloDeveloperUtil On Wed, Sep 16, 2015 at 10:31 AM, Corey Nolet wrote: > Sven, > > What version of Accumulo are you running? We have

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Andrew Wells
btw, my solution revolved around this issue: https://issues.apache.org/jira/browse/ACCUMULO-2851 which let users save their data off somewhere, then load it into the new mac cluster On Wed, Sep 16, 2015 at 10:37 AM, Andrew Wells wrote: > I created a util for doing this,

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Christopher
code from Christopher somewhere deployed? > > Currently I'm using version 1.7 > > Regards, > Sven > > - Ursprüngliche Mail - > > Von: "Corey Nolet" <cjno...@gmail.com> > > An: "user" <user@accumulo.apache.org> > > Ge

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Corey Nolet
Sven, What version of Accumulo are you running? We have a ticket for this [1] which has had a lot of discussion on it. Christopher Tubbs mentioned that he had gotten this to work. [1] https://issues.apache.org/jira/browse/ACCUMULO-1378 On Wed, Sep 16, 2015 at 9:20 AM, Sven Hodapp

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Sven Hodapp
> An: "user" <user@accumulo.apache.org> > Gesendet: Mittwoch, 16. September 2015 16:31:02 > Betreff: Re: Mini Accumulo Cluster reusing the directory > Sven, > > What version of Accumulo are you running? We have a ticket for this [1] > which has had a lot of discussion

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Corey Nolet
>> >> Currently I'm using version 1.7 >> >> Regards, >> Sven >> >> - Ursprüngliche Mail - >> > Von: "Corey Nolet" <cjno...@gmail.com> >> > An: "user" <user@accumulo.apache.org> >> > Gesendet: Mittwoc

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Josh Elser
n/m, didn't read the whole thread. Sounds like ACCUMULO-1378 does capture what you asked for :) Josh Elser wrote: Best as I can tell, we don't actually have the ability to do this. We can use external ZooKeeper servers and we can start a MAC instance on top of an already running ZK from a

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Josh Elser
Best as I can tell, we don't actually have the ability to do this. We can use external ZooKeeper servers and we can start a MAC instance on top of an already running ZK from a different MAC instance, but it doesn't look like we have the ability to reuse the same storage directory. That

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Keith Turner
Would you be able to provide more informaiton about your use case? Was wondering if other solutions could be of use, like configuring regular Accumulo to use the local filesystem. This can be done, but care needs to be taken to make walogs work correctly. If interested I could provide more

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Christopher
where deployed? >>> >>> Currently I'm using version 1.7 >>> >>> Regards, >>> Sven >>> >>> - Ursprüngliche Mail - >>> > Von: "Corey Nolet" <cjno...@gmail.com> >>> > An: "user" <user@accumu

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Josh Elser
And, to be explicit, if you want to configure not-MiniAccumuloCluster to use the local FS (you only run on one node), just use file:///... in instance.volumes (or instance.dfs.uri) instead of hdfs://namenode:port/... Wasn't sure if it would be implied to look at how MAC does this from my

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Josh Elser
MiniAccumuloCluster by default already uses the local file system. To get the correct sync semantics that Keith mentioned you need to set "fs.file.impl" in the Hadoop Configuration you pass to the MiniAccumuloConfig. See

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread mohit.kaushik
Keith, How can I configure Accumulo to use local file system??? On 09/17/2015 01:11 AM, Keith Turner wrote: Would you be able to provide more informaiton about your use case? Was wondering if other solutions could be of use, like configuring regular Accumulo to use the local filesystem.