Configure accumulo-env.sh with 40GB of memory

2015-06-04 Thread Revan1988
Hi, In my server (only one cluster) i've got 40GB of memory size. I configured my accumulo-env.sh in this way: is it a good configuration? on my hardware (8 core/40gb/btfs hdd 7200) i've got about 50k~150k ingest/second... it's a good performance?

Re: Configure accumulo-env.sh with 40GB of memory

2015-06-04 Thread Eric Newton
The apache mailing lists do not pass through email attachments. You could try posting your config on https://paste.apache.org/. 150K / node for small, independent mutations is very good. Make sure you have 20-80 splits (total) per node, for the tables you are ingesting. You may be limited by th

ACCUMULO-3871

2015-06-04 Thread Eric Newton
Hi Devs, I've been working on running our long-running tests via map-reduce in order to speed up testing. In particular, when making sweeping changes to critical code (say, ACCUMULO-3423 (1) ), it's helpful to re-run these tests quickly to make sure that instability hasn't been introduced. The 3

Thrift as Public API?

2015-06-04 Thread Mike Drob
Do we intend for our thrift RPC implementation to be consumable as public API? This question is inspired by recent "How to get the Accumulo statistic data" thread over on user@, where we point a user at the GetMasterStats class. How stable is that in theory? I understand that in practice it proba

Re: Thrift as Public API?

2015-06-04 Thread Adam Fuchs
IMO we do not. The thrift interface that we currently have is not easily consumable (you have to understand a lot about the metadata and cluster layout), and we don't include it in SemVer. Additional features like GetMasterStats should be plumbed through to the Java API if we want to expose them.

Re: Thrift as Public API?

2015-06-04 Thread Josh Elser
Agreed. I think in the case of GetMasterStats, we don't have any other way to actually do it via public API now. It would be nice to have something in the future, but that wouldn't help in the present. Adam Fuchs wrote: IMO we do not. The thrift interface that we currently have is not easily

Re: Thrift as Public API?

2015-06-04 Thread Christopher
I agree. The thrift API should not be public API (except the proxy, of course). -- Christopher L Tubbs II http://gravatar.com/ctubbsii On Thu, Jun 4, 2015 at 12:48 PM, Adam Fuchs wrote: > IMO we do not. The thrift interface that we currently have is not easily > consumable (you have to understa

Accumulo Meetup in San Jose 6/11

2015-06-04 Thread Billie Rinaldi
Hello all, Is anyone attending the Hadoop Summit in San Jose, or going to be in the Bay Area next week? There will be an Accumulo meetup on Thursday, June 11 at 4:00 pm. Conference attendance is not required. Hope to see some of you there! http://www.meetup.com/Hadoop-Summit-Community-San-Jose