Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Andrew Wells
I created a util for doing this, but i haven't worked on it in a while... You could see if it still works https://github.com/agwells0714/AccumuloDeveloperUtil On Wed, Sep 16, 2015 at 10:31 AM, Corey Nolet wrote: > Sven, > > What version of Accumulo are you running? We have

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Andrew Wells
btw, my solution revolved around this issue: https://issues.apache.org/jira/browse/ACCUMULO-2851 which let users save their data off somewhere, then load it into the new mac cluster On Wed, Sep 16, 2015 at 10:37 AM, Andrew Wells wrote: > I created a util for doing this,

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Christopher
Hi Sven, I think Corey was mistaken. I don't recall working on that, exactly. On Wed, Sep 16, 2015, 10:40 Sven Hodapp wrote: > Hi Corey, > > thanks for your reply and the link. Sounds good, if that will be available > in the future! > Is the code from Christopher

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Corey Nolet
Sven, What version of Accumulo are you running? We have a ticket for this [1] which has had a lot of discussion on it. Christopher Tubbs mentioned that he had gotten this to work. [1] https://issues.apache.org/jira/browse/ACCUMULO-1378 On Wed, Sep 16, 2015 at 9:20 AM, Sven Hodapp

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Sven Hodapp
Hi Corey, thanks for your reply and the link. Sounds good, if that will be available in the future! Is the code from Christopher somewhere deployed? Currently I'm using version 1.7 Regards, Sven - Ursprüngliche Mail - > Von: "Corey Nolet" > An: "user"

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Corey Nolet
Christopher, my reply to Sven was just going off of your last comment on the ticket. Perhaps I misread the comment. On Wed, Sep 16, 2015 at 10:50 AM, Christopher wrote: > Hi Sven, I think Corey was mistaken. I don't recall working on that, > exactly. > > On Wed, Sep 16,

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Josh Elser
n/m, didn't read the whole thread. Sounds like ACCUMULO-1378 does capture what you asked for :) Josh Elser wrote: Best as I can tell, we don't actually have the ability to do this. We can use external ZooKeeper servers and we can start a MAC instance on top of an already running ZK from a

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Josh Elser
Best as I can tell, we don't actually have the ability to do this. We can use external ZooKeeper servers and we can start a MAC instance on top of an already running ZK from a different MAC instance, but it doesn't look like we have the ability to reuse the same storage directory. That

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Keith Turner
Would you be able to provide more informaiton about your use case? Was wondering if other solutions could be of use, like configuring regular Accumulo to use the local filesystem. This can be done, but care needs to be taken to make walogs work correctly. If interested I could provide more

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Christopher
The class I created is included in Accumulo (since 1.6?), but only enables connecting to an existing mini instance based on its directory. It doesn't enable restarting mini. On Wed, Sep 16, 2015, 11:40 Corey Nolet wrote: > Christopher, my reply to Sven was just going off of

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Josh Elser
And, to be explicit, if you want to configure not-MiniAccumuloCluster to use the local FS (you only run on one node), just use file:///... in instance.volumes (or instance.dfs.uri) instead of hdfs://namenode:port/... Wasn't sure if it would be implied to look at how MAC does this from my

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread Josh Elser
MiniAccumuloCluster by default already uses the local file system. To get the correct sync semantics that Keith mentioned you need to set "fs.file.impl" in the Hadoop Configuration you pass to the MiniAccumuloConfig. See

Re: Mini Accumulo Cluster reusing the directory

2015-09-16 Thread mohit.kaushik
Keith, How can I configure Accumulo to use local file system??? On 09/17/2015 01:11 AM, Keith Turner wrote: Would you be able to provide more informaiton about your use case? Was wondering if other solutions could be of use, like configuring regular Accumulo to use the local filesystem.