[GitHub] accumulo issue #199: DO NOT MERGE: PROOF OF CONCEPT

2017-01-09 Thread joshelser
Github user joshelser commented on the issue: https://github.com/apache/accumulo/pull/199 > I think an admin should be able to define the pools and max resources in the configuration, and then have the ability to allow users to use specific pools or something to that effect (thinking

[GitHub] accumulo issue #199: DO NOT MERGE: PROOF OF CONCEPT

2017-01-09 Thread joshelser
Github user joshelser commented on the issue: https://github.com/apache/accumulo/pull/199 > Clearly I've modify the thrift calls so that we can allow scans to create resource requests, but is this a good idea I think I've heard that HDFS has the notion of a "resource coupon" t

[GitHub] accumulo issue #199: DO NOT MERGE: PROOF OF CONCEPT

2017-01-09 Thread dlmarion
Github user dlmarion commented on the issue: https://github.com/apache/accumulo/pull/199 @phrocker - Just thinking about multi-tenancy and competition for resources, allowing an administrator to define upper limits, and making sure that user operations don't trump an administrator try

[GitHub] accumulo issue #199: DO NOT MERGE: PROOF OF CONCEPT

2017-01-09 Thread phrocker
Github user phrocker commented on the issue: https://github.com/apache/accumulo/pull/199 @dlmarion Some of these things aren't well defined in Property.java yet as I was worried about going in a direction and it being all wrong. I take your comment as a 'feature request' sort of. To b

[GitHub] accumulo issue #199: DO NOT MERGE: PROOF OF CONCEPT

2017-01-09 Thread dlmarion
Github user dlmarion commented on the issue: https://github.com/apache/accumulo/pull/199 I see in Property.java the definition of queues / pools. Are the high water marks for the requested resources set there also? I could not tell from the PR, but I think an admin should be able to d

[GitHub] accumulo issue #199: DO NOT MERGE: PROOF OF CONCEPT

2017-01-09 Thread phrocker
Github user phrocker commented on the issue: https://github.com/apache/accumulo/pull/199 Oh and tests will fail. Again, just a thought provoking PR. I like the idea of submitting a PR to get ideas and if someone has ideas pointing to code this is a great way for them to point it out s

[GitHub] accumulo pull request #199: DO NOT MERGE: PROOF OF CONCEPT

2017-01-09 Thread phrocker
GitHub user phrocker opened a pull request: https://github.com/apache/accumulo/pull/199 DO NOT MERGE: PROOF OF CONCEPT Hello this is a proof of concept that will hopefully begin the discussion of changing how we request resources. First of all there are a lot of changes her

[GitHub] accumulo-testing pull request #1: Accumulo 4510

2017-01-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/accumulo-testing/pull/1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

Re: january 2017 board report draft

2017-01-09 Thread Sean Busbey
+1 On Mon, Jan 9, 2017 at 1:58 PM, Josh Elser wrote: > LGTM > > > Billie Rinaldi wrote: >> >> Hello all, >> >> The Apache Accumulo PMC has decided to start drafting its quarterly board >> reports on the dev list. Here is a draft of our report which is due on >> Wednesday. Let me know if you have

[GitHub] accumulo-testing issue #1: Accumulo 4510

2017-01-09 Thread mikewalch
Github user mikewalch commented on the issue: https://github.com/apache/accumulo-testing/pull/1 I think that this pull request is ready to merged. Before this is merged, I want to mention two more commits that were added to PR in case any one wants to review: * 45b9dbfbbcaf -

[GitHub] accumulo-testing pull request #1: Accumulo 4510

2017-01-09 Thread mikewalch
Github user mikewalch commented on a diff in the pull request: https://github.com/apache/accumulo-testing/pull/1#discussion_r95236835 --- Diff: conf/accumulo-testing-env.sh.example --- @@ -0,0 +1,25 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +#

Re: Implementing Index Table for Accumulo Hive Queries

2017-01-09 Thread Josh Elser
If you have that info, yeah I think you could. The lifecycle of those queries is a bit strange (and, IIRC, different depending on the execution engine Hive uses). Experimentation is definitely the way forward :). Let me know if you need any help -- I'm happy to at least try to help. If you co

Re: Implementing Index Table for Accumulo Hive Queries

2017-01-09 Thread Fagan, Michael
Josh, Thanks, it looks like If I can override the getRanges() from the AccumuloPredicateHandler I might be able to build correct ranges based on matching index rows. Does this sound feasible? Regards, Mike Fagan On 1/9/17, 12:38 PM, "Josh Elser" wrote: Hi Mike, As far as I unde

Re: january 2017 board report draft

2017-01-09 Thread Josh Elser
LGTM Billie Rinaldi wrote: Hello all, The Apache Accumulo PMC has decided to start drafting its quarterly board reports on the dev list. Here is a draft of our report which is due on Wednesday. Let me know if you have any suggestions! Billie -- The Apache Accumulo sorted, distributed key/

Re: january 2017 board report draft

2017-01-09 Thread Mike Drob
+1 On Mon, Jan 9, 2017 at 1:27 PM, Keith Turner wrote: > +1 > > On Mon, Jan 9, 2017 at 11:46 AM, Billie Rinaldi wrote: > > Hello all, > > > > The Apache Accumulo PMC has decided to start drafting its quarterly board > > reports on the dev list. Here is a draft of our report which is due on > >

Re: january 2017 board report draft

2017-01-09 Thread Michael Wall
+1 On Mon, Jan 9, 2017 at 2:27 PM, Keith Turner wrote: > +1 > > On Mon, Jan 9, 2017 at 11:46 AM, Billie Rinaldi wrote: > > Hello all, > > > > The Apache Accumulo PMC has decided to start drafting its quarterly board > > reports on the dev list. Here is a draft of our report which is due on > >

Re: Implementing Index Table for Accumulo Hive Queries

2017-01-09 Thread Josh Elser
Hi Mike, As far as I understand it, the Hive storage handler APIs (which is how the Accumulo integration is implemented) doesn't expose any ability to do use index tables to answer some query. This means that the only thing you can do to make queries faster, would be to create a number of ta

Re: Time for a 1.8.1?

2017-01-09 Thread Christopher
+1 for a 1.8.1 and a 1.7.3 both within the next 2 weeks, if we can. I can help. There are a few outstanding bugs marked for 1.7.3 (59) and 1.8.1 (161), but most of those can be punted to a future bugfix release. We don't need to wait on them to push out an update. We just need to know people will

Time for a 1.8.1?

2017-01-09 Thread Michael Wall
Thinking it is time for a 1.8.1 release. I'm happy to be the release manager since I did the 1.8.0. Just trying to get a sense for where people think we are. Mike

Re: january 2017 board report draft

2017-01-09 Thread Keith Turner
+1 On Mon, Jan 9, 2017 at 11:46 AM, Billie Rinaldi wrote: > Hello all, > > The Apache Accumulo PMC has decided to start drafting its quarterly board > reports on the dev list. Here is a draft of our report which is due on > Wednesday. Let me know if you have any suggestions! > > Billie > > --

[GitHub] accumulo pull request #195: ACCUMULO-4446 Added log INFO when acquiring Moni...

2017-01-09 Thread lstav
Github user lstav commented on a diff in the pull request: https://github.com/apache/accumulo/pull/195#discussion_r95222550 --- Diff: server/tserver/src/main/java/org/apache/accumulo/tserver/TabletServer.java --- @@ -2360,7 +2360,7 @@ public void run() { zoo.putPersist

Implementing Index Table for Accumulo Hive Queries

2017-01-09 Thread Fagan, Michael
Hi, I am looking to utilize an index table to avoid full table scans and speed up hive queries against an external accumulo table. Has anyone done this yet? Can someone point me in the right direction? Regards, Mike Fagan

[GitHub] accumulo-testing pull request #1: Accumulo 4510

2017-01-09 Thread keith-turner
Github user keith-turner commented on a diff in the pull request: https://github.com/apache/accumulo-testing/pull/1#discussion_r95216302 --- Diff: README.md --- @@ -1 +1,54 @@ # Apache Accumulo Testing Suite + +The Apache Accumulo testing suite contains applications tha

[GitHub] accumulo pull request #195: ACCUMULO-4446 Added log INFO when acquiring Moni...

2017-01-09 Thread lstav
Github user lstav commented on a diff in the pull request: https://github.com/apache/accumulo/pull/195#discussion_r95209902 --- Diff: server/tserver/src/main/java/org/apache/accumulo/tserver/TabletServer.java --- @@ -2360,7 +2360,7 @@ public void run() { zoo.putPersist

[GitHub] accumulo pull request #195: ACCUMULO-4446 Added log INFO when acquiring Moni...

2017-01-09 Thread lstav
Github user lstav commented on a diff in the pull request: https://github.com/apache/accumulo/pull/195#discussion_r95209827 --- Diff: server/master/src/main/java/org/apache/accumulo/master/Master.java --- @@ -1424,7 +1424,7 @@ private void getMasterLock(final String zMasterLoc) th

[GitHub] accumulo pull request #195: ACCUMULO-4446 Added log INFO when acquiring Moni...

2017-01-09 Thread ctubbsii
Github user ctubbsii commented on a diff in the pull request: https://github.com/apache/accumulo/pull/195#discussion_r95208393 --- Diff: server/master/src/main/java/org/apache/accumulo/master/Master.java --- @@ -1424,7 +1424,7 @@ private void getMasterLock(final String zMasterLoc)

[GitHub] accumulo pull request #195: ACCUMULO-4446 Added log INFO when acquiring Moni...

2017-01-09 Thread ctubbsii
Github user ctubbsii commented on a diff in the pull request: https://github.com/apache/accumulo/pull/195#discussion_r95208787 --- Diff: server/tserver/src/main/java/org/apache/accumulo/tserver/TabletServer.java --- @@ -2360,7 +2360,7 @@ public void run() { zoo.putPers

[GitHub] accumulo-testing pull request #1: Accumulo 4510

2017-01-09 Thread mikewalch
Github user mikewalch commented on a diff in the pull request: https://github.com/apache/accumulo-testing/pull/1#discussion_r95201587 --- Diff: README.md --- @@ -1 +1,54 @@ # Apache Accumulo Testing Suite + +The Apache Accumulo testing suite contains applications that t

january 2017 board report draft

2017-01-09 Thread Billie Rinaldi
Hello all, The Apache Accumulo PMC has decided to start drafting its quarterly board reports on the dev list. Here is a draft of our report which is due on Wednesday. Let me know if you have any suggestions! Billie -- The Apache Accumulo sorted, distributed key/value store is a robust, scala