Re: Minimum supported Hadoop?

2016-06-02 Thread Christopher
Yes, I believe so. Good point. On Fri, Jun 3, 2016, 00:15 Mike Drob wrote: > The ITs pass on certain Java versions, right? We can doc that and iterate > from there. > On Thu, Jun 2, 2016 at 11:09 PM Christopher wrote: > > > Yeah, me either... but it does raise the question: if we can't provide

Re: Minimum supported Hadoop?

2016-06-02 Thread Mike Drob
The ITs pass on certain Java versions, right? We can doc that and iterate from there. On Thu, Jun 2, 2016 at 11:09 PM Christopher wrote: > Yeah, me either... but it does raise the question: if we can't provide > proper Kerberos support (ITs don't even pass, IIRC) using a dependency > older than 2

[GitHub] accumulo issue #106: ACCUMULO-4153: Update the getCodec method to no longer ...

2016-06-02 Thread madrob
Github user madrob commented on the issue: https://github.com/apache/accumulo/pull/106 I'm looking at branching after ACCUMULO-4157 makes it in, so there is still time. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

Re: Minimum supported Hadoop?

2016-06-02 Thread Christopher
Yeah, me either... but it does raise the question: if we can't provide proper Kerberos support (ITs don't even pass, IIRC) using a dependency older than 2.6.1, how much can we really say 1.7.2 works on those older versions? On Thu, Jun 2, 2016 at 11:50 PM Mike Drob wrote: > I would not feel comf

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread madrob
Github user madrob commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65654201 --- Diff: server/gc/src/main/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogs.java --- @@ -410,4 +556,41 @@ static boolean isUUID(String name) {

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread madrob
Github user madrob commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65654141 --- Diff: server/gc/src/main/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogs.java --- @@ -410,4 +556,41 @@ static boolean isUUID(String name) {

Re: Minimum supported Hadoop?

2016-06-02 Thread Mike Drob
I would not feel comfortable bumping the min req Hadoop in 1.7.2 On Wed, Jun 1, 2016 at 6:39 PM Christopher wrote: > Perhaps. But the tests pass with 2.6.1, I think. Shouldn't be that much > different in terms of support, so I figured go with the minimum we can test > with. FWIW, this affects 1.

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread keith-turner
Github user keith-turner commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65652662 --- Diff: server/gc/src/test/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogsTest.java --- @@ -234,4 +257,288 @@ public void testIsUUID() {

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread keith-turner
Github user keith-turner commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65652304 --- Diff: server/gc/src/test/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogsTest.java --- @@ -234,4 +257,288 @@ public void testIsUUID() {

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread keith-turner
Github user keith-turner commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65651454 --- Diff: server/gc/src/test/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogsTest.java --- @@ -234,4 +257,288 @@ public void testIsUUID() {

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread keith-turner
Github user keith-turner commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65651340 --- Diff: server/gc/src/test/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogsTest.java --- @@ -234,4 +257,288 @@ public void testIsUUID() {

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread keith-turner
Github user keith-turner commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65650715 --- Diff: server/gc/src/main/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogs.java --- @@ -170,76 +184,203 @@ boolean holdsLock(HostAndPort ad

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread keith-turner
Github user keith-turner commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65649944 --- Diff: server/gc/src/main/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogs.java --- @@ -170,76 +184,203 @@ boolean holdsLock(HostAndPort ad

[GitHub] accumulo pull request #108: ACCUMULO-4326 Accept Text and CharSeq in Value

2016-06-02 Thread joshelser
Github user joshelser commented on a diff in the pull request: https://github.com/apache/accumulo/pull/108#discussion_r65627746 --- Diff: core/src/main/java/org/apache/accumulo/core/data/Value.java --- @@ -48,6 +50,30 @@ public Value() { } /** + * Creates a

[GitHub] accumulo pull request #108: ACCUMULO-4326 Accept Text and CharSeq in Value

2016-06-02 Thread keith-turner
Github user keith-turner commented on a diff in the pull request: https://github.com/apache/accumulo/pull/108#discussion_r65626882 --- Diff: core/src/main/java/org/apache/accumulo/core/data/Value.java --- @@ -48,6 +50,30 @@ public Value() { } /** + * Create

[GitHub] accumulo issue #108: ACCUMULO-4326 Accept Text and CharSeq in Value

2016-06-02 Thread joshelser
Github user joshelser commented on the issue: https://github.com/apache/accumulo/pull/108 :+1: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] accumulo pull request #108: ACCUMULO-4326 Accept Text and CharSeq in Value

2016-06-02 Thread keith-turner
GitHub user keith-turner opened a pull request: https://github.com/apache/accumulo/pull/108 ACCUMULO-4326 Accept Text and CharSeq in Value You can merge this pull request into a Git repository by running: $ git pull https://github.com/keith-turner/accumulo ACCUMULO-4326 Alter

Re: Hadoop

2016-06-02 Thread Christopher
Well, I wouldn't be surprised with some issues across a fedup (which is a way to do an upgrade between Fedora versions), but it should have been stable with normal/routine yum/dnf upgrades. Were you using the Fedora-provided packages, or the BigTop ones? Or another set? On Thu, Jun 2, 2016 at 5:0

Re: Hadoop

2016-06-02 Thread Corey Nolet
This may not be directly related but I've noticed Hadoop packages have been not uninstalling/updating well the past year or so. The last couple times I've run fedup, I've had to go back in manually and remove/update a bunch of the Hadoop packages like Zookeeper and Parquet. On Thu, Jun 2, 2016 at

Re: Hadoop

2016-06-02 Thread Christopher
That first post was intended for the Fedora developer list. Apologies for sending to the wrong list. If anybody is curious, it seems the Fedora community support around Hadoop and Big Data is really dying... the packager for Flume and HTrace has abandoned their efforts to package for Fedora, and n

Re: Hadoop

2016-06-02 Thread Christopher
Sorry, wrong list. On Thu, Jun 2, 2016 at 4:20 PM Christopher wrote: > So, it would seem at some point, without me noticing (certainly my fault, > for not paying attention enough), the Hadoop packages got orphaned and/or > retired? in Fedora. > > This is a big problem for me, because the main pa

Hadoop

2016-06-02 Thread Christopher
So, it would seem at some point, without me noticing (certainly my fault, for not paying attention enough), the Hadoop packages got orphaned and/or retired? in Fedora. This is a big problem for me, because the main package I work on is dependent upon Hadoop. What's the state of Hadoop in Fedora t

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread mjwall
Github user mjwall commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65604304 --- Diff: server/gc/src/main/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogs.java --- @@ -55,12 +56,16 @@ import org.apache.zookeeper.KeeperEx

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread mjwall
Github user mjwall commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65577463 --- Diff: server/gc/src/main/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogs.java --- @@ -55,12 +56,16 @@ import org.apache.zookeeper.KeeperEx

[GitHub] accumulo issue #107: ACCUMULO-4157 Bug fix for removing WALs to quickly

2016-06-02 Thread mjwall
Github user mjwall commented on the issue: https://github.com/apache/accumulo/pull/107 Thanks for reviewing @joshelser --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread joshelser
Github user joshelser commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65576260 --- Diff: server/gc/src/main/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogs.java --- @@ -55,12 +56,16 @@ import org.apache.zookeeper.Keepe

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread mjwall
Github user mjwall commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65575725 --- Diff: server/gc/src/main/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogs.java --- @@ -170,76 +175,117 @@ boolean holdsLock(HostAndPort addr) {

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread mjwall
Github user mjwall commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65575618 --- Diff: server/gc/src/main/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogs.java --- @@ -55,12 +56,16 @@ import org.apache.zookeeper.KeeperEx

[GitHub] accumulo issue #104: ACCUMULO-4318 Made writers and scanners auto closeable

2016-06-02 Thread keith-turner
Github user keith-turner commented on the issue: https://github.com/apache/accumulo/pull/104 Merged this to 1.8. Thanks @joshelser and @dhutchis for taking a look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] accumulo pull request #104: ACCUMULO-4318 Made writers and scanners auto clo...

2016-06-02 Thread keith-turner
Github user keith-turner closed the pull request at: https://github.com/apache/accumulo/pull/104 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] accumulo pull request #106: ACCUMULO-4153: Update the getCodec method to no ...

2016-06-02 Thread phrocker
Github user phrocker commented on a diff in the pull request: https://github.com/apache/accumulo/pull/106#discussion_r65571229 --- Diff: core/src/main/java/org/apache/accumulo/core/file/rfile/bcfile/Compression.java --- @@ -81,38 +89,60 @@ public void flush() throws IOException {

[GitHub] accumulo issue #107: ACCUMULO-4157 Bug fix for removing WALs to quickly

2016-06-02 Thread joshelser
Github user joshelser commented on the issue: https://github.com/apache/accumulo/pull/107 The general approach seems to be pretty solid. The edge cases I could think about were correctly handled (e.g. if the GC dies, the "time to wait" would be reset and we woudn't delete the WAL too

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread joshelser
Github user joshelser commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65567462 --- Diff: server/gc/src/main/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogs.java --- @@ -170,76 +175,117 @@ boolean holdsLock(HostAndPort addr)

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread joshelser
Github user joshelser commented on a diff in the pull request: https://github.com/apache/accumulo/pull/107#discussion_r65568599 --- Diff: server/gc/src/main/java/org/apache/accumulo/gc/GarbageCollectWriteAheadLogs.java --- @@ -55,12 +56,16 @@ import org.apache.zookeeper.Keepe

[GitHub] accumulo pull request #107: ACCUMULO-4157 Bug fix for removing WALs to quick...

2016-06-02 Thread mjwall
GitHub user mjwall opened a pull request: https://github.com/apache/accumulo/pull/107 ACCUMULO-4157 Bug fix for removing WALs to quickly Keep track of first time a tserver is seen down and only remove WALs for that server if past configurated threshhold Much work left to be

[GitHub] accumulo pull request #106: ACCUMULO-4153: Update the getCodec method to no ...

2016-06-02 Thread joshelser
Github user joshelser commented on a diff in the pull request: https://github.com/apache/accumulo/pull/106#discussion_r65560601 --- Diff: core/src/main/java/org/apache/accumulo/core/file/rfile/bcfile/Compression.java --- @@ -81,38 +89,60 @@ public void flush() throws IOException {

[GitHub] accumulo pull request #103: ACCUMULO-4165 Added a user facing API for RFile

2016-06-02 Thread keith-turner
Github user keith-turner closed the pull request at: https://github.com/apache/accumulo/pull/103 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] accumulo pull request #106: ACCUMULO-4153: Update the getCodec method to no ...

2016-06-02 Thread phrocker
Github user phrocker commented on a diff in the pull request: https://github.com/apache/accumulo/pull/106#discussion_r65523717 --- Diff: core/src/main/java/org/apache/accumulo/core/file/rfile/bcfile/Compression.java --- @@ -81,38 +89,60 @@ public void flush() throws IOException {