[jira] Reopened: (HBASE-1507) iCMS as default JVM

2009-06-13 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack reopened HBASE-1507: -- Reopening to address Dave's criticism. > iCMS as default JVM > --- > > Key: HBASE-

[jira] Issue Comment Edited: (HBASE-1507) iCMS as default JVM

2009-06-13 Thread ryan rawson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719225#action_12719225 ] ryan rawson edited comment on HBASE-1507 at 6/13/09 9:45 PM: - I

[jira] Issue Comment Edited: (HBASE-1507) iCMS as default JVM

2009-06-13 Thread ryan rawson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719225#action_12719225 ] ryan rawson edited comment on HBASE-1507 at 6/13/09 9:44 PM: - I

[jira] Commented: (HBASE-1507) iCMS as default JVM

2009-06-13 Thread ryan rawson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719225#action_12719225 ] ryan rawson commented on HBASE-1507: I agree, the config should be in hbase-env.sh sinc

[jira] Commented: (HBASE-1495) IllegalArgumentException in halfhfilereader#next

2009-06-13 Thread ryan rawson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719224#action_12719224 ] ryan rawson commented on HBASE-1495: my patch is bogus. it's out of date now. I'll be

[jira] Updated: (HBASE-1495) IllegalArgumentException in halfhfilereader#next

2009-06-13 Thread ryan rawson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ryan rawson updated HBASE-1495: --- Attachment: (was: HBASE-1495.patch) > IllegalArgumentException in halfhfilereader#next >

[jira] Commented: (HBASE-1495) IllegalArgumentException in halfhfilereader#next

2009-06-13 Thread ryan rawson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719223#action_12719223 ] ryan rawson commented on HBASE-1495: my IDE says this.row = row is self assigning 'row'

[jira] Commented: (HBASE-1507) iCMS as default JVM

2009-06-13 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719219#action_12719219 ] Dave Latham commented on HBASE-1507: With 8 cores, I've been running without -XX:+CMSIn

[jira] Resolved: (HBASE-1518) Delete Trackers using compareRow, should just use raw binary comparator

2009-06-13 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-1518. -- Resolution: Fixed Committed. Thanks for patch jgray. > Delete Trackers using compareRow, should just use raw

[jira] Assigned: (HBASE-1495) IllegalArgumentException in halfhfilereader#next

2009-06-13 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack reassigned HBASE-1495: Assignee: stack > IllegalArgumentException in halfhfilereader#next > --

[jira] Commented: (HBASE-1495) IllegalArgumentException in halfhfilereader#next

2009-06-13 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719217#action_12719217 ] stack commented on HBASE-1495: -- I'm going out. As of this evening, item 1 in comment '12/Jun/

[jira] Updated: (HBASE-1503) hbase-1304 dropped updating list of store files on flush

2009-06-13 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-1503: - Status: Patch Available (was: Open) Marking patch available... this patch seems to work in my testing and it loo

[jira] Commented: (HBASE-1518) Delete Trackers using compareRow, should just use raw binary comparator

2009-06-13 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719215#action_12719215 ] stack commented on HBASE-1518: -- +1 on patch (one test needs to be brought into alignment with

[jira] Created: (HBASE-1519) NPE in org.apache.hadoop.hbase.io.hfile.BoundedRangeFileInputStream.read

2009-06-13 Thread stack (JIRA)
NPE in org.apache.hadoop.hbase.io.hfile.BoundedRangeFileInputStream.read Key: HBASE-1519 URL: https://issues.apache.org/jira/browse/HBASE-1519 Project: Hadoop HBase Iss

[jira] Updated: (HBASE-1513) Compactions too slow

2009-06-13 Thread Justin Lynn (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justin Lynn updated HBASE-1513: --- Summary: Compactions too slow (was: Compactions to slow) > Compactions too slow > --

Re: commits without entries in CHANGES.txt

2009-06-13 Thread Andrew Purtell
If it's possible to autogenerate CHANGES.txt, I'd vote for that. - Andy From: stack To: hbase-dev@hadoop.apache.org Sent: Saturday, June 13, 2009 3:09:25 PM Subject: Re: commits without entries in CHANGES.txt They both seem to be Ryan issues. JIRA can be

[jira] Updated: (HBASE-1518) Delete Trackers using compareRow, should just use raw binary comparator

2009-06-13 Thread Jonathan Gray (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Gray updated HBASE-1518: - Attachment: HBASE-1518-v1.patch As described in issue. > Delete Trackers using compareRow, shoul

[jira] Created: (HBASE-1518) Delete Trackers using compareRow, should just use raw binary comparator

2009-06-13 Thread Jonathan Gray (JIRA)
Delete Trackers using compareRow, should just use raw binary comparator --- Key: HBASE-1518 URL: https://issues.apache.org/jira/browse/HBASE-1518 Project: Hadoop HBase Issue

[jira] Commented: (HBASE-1513) Compactions to slow

2009-06-13 Thread Billy Pearson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719206#action_12719206 ] Billy Pearson commented on HBASE-1513: -- second patch will not apply to trunk {code} p

[jira] Updated: (HBASE-1516) Investigate if StoreScanner will not return the next row if earlied-out of previous row

2009-06-13 Thread Jonathan Gray (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Gray updated HBASE-1516: - Status: Patch Available (was: Reopened) > Investigate if StoreScanner will not return the next r

[jira] Updated: (HBASE-1516) Investigate if StoreScanner will not return the next row if earlied-out of previous row

2009-06-13 Thread Jonathan Gray (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Gray updated HBASE-1516: - Attachment: HBASE-1516-v1.patch Removes the comment. > Investigate if StoreScanner will not retu

[jira] Reopened: (HBASE-1516) Investigate if StoreScanner will not return the next row if earlied-out of previous row

2009-06-13 Thread Jonathan Gray (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Gray reopened HBASE-1516: -- > Investigate if StoreScanner will not return the next row if earlied-out of > previous row >

[jira] Resolved: (HBASE-1516) Investigate if StoreScanner will not return the next row if earlied-out of previous row

2009-06-13 Thread Jonathan Gray (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Gray resolved HBASE-1516. -- Resolution: Invalid Looks like this is not a bug because the StoreScanner doesn't use the DONE

[jira] Created: (HBASE-1517) Implement inexpensive seek operations in HFile

2009-06-13 Thread Jonathan Gray (JIRA)
Implement inexpensive seek operations in HFile -- Key: HBASE-1517 URL: https://issues.apache.org/jira/browse/HBASE-1517 Project: Hadoop HBase Issue Type: Improvement Affects Versions: 0.20.0

[jira] Created: (HBASE-1516) Investigate if StoreScanner will not return the next row if earlied-out of previous row

2009-06-13 Thread Jonathan Gray (JIRA)
Investigate if StoreScanner will not return the next row if earlied-out of previous row --- Key: HBASE-1516 URL: https://issues.apache.org/jira/browse/HBASE-1516 Proj

[jira] Updated: (HBASE-1513) Compactions to slow

2009-06-13 Thread ryan rawson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ryan rawson updated HBASE-1513: --- Attachment: HBASE-1513-v2.patch the previous patch removed delete tracking, which was bad, and this o

[jira] Commented: (HBASE-1329) Visibility into ZooKeeper

2009-06-13 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719195#action_12719195 ] stack commented on HBASE-1329: -- zk.patch looks good. You going to make up a new zk jar to inc

[jira] Commented: (HBASE-1503) hbase-1304 dropped updating list of store files on flush

2009-06-13 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719187#action_12719187 ] stack commented on HBASE-1503: -- Saw this w/ v2: {code} Caused by: java.lang.NullPointerExcepti

Re: commits without entries in CHANGES.txt

2009-06-13 Thread stack
They both seem to be Ryan issues. JIRA can be a bit tricky too when it comes to saying fixed in branch and trunk (Can you mark it as fixed in two places? I haven't figured it). I'm up for whatever lads think is the easiest. We could copy/paste text-only version from time to time into CHANGES.tx

[jira] Updated: (HBASE-1503) hbase-1304 dropped updating list of store files on flush

2009-06-13 Thread Jonathan Gray (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Gray updated HBASE-1503: - Attachment: HBASE-1503-v2.patch Removes the read/write lock in favor of only object-level synchro

commits without entries in CHANGES.txt

2009-06-13 Thread Andrew Purtell
There are commits in the tree without entries in CHANGES.txt, at least these:   HBASE-1304   HBASE-1514 maybe more. With the release note tools provided by JIRA, do we even need a manually updated CHANGES.txt? Otherwise I'd say this file is getting out of sync with what is in the tree.    - A

[jira] Updated: (HBASE-1503) hbase-1304 dropped updating list of store files on flush

2009-06-13 Thread Jonathan Gray (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Gray updated HBASE-1503: - Attachment: HBASE-1503-v1.patch Rebuilds the KVHeap in the StoreScanner when readers have changed

[jira] Assigned: (HBASE-1503) hbase-1304 dropped updating list of store files on flush

2009-06-13 Thread Jonathan Gray (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Gray reassigned HBASE-1503: Assignee: Jonathan Gray > hbase-1304 dropped updating list of store files on flush > --

[jira] Commented: (HBASE-1500) KeyValue$KeyComparator array overrun

2009-06-13 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719173#action_12719173 ] Andrew Purtell commented on HBASE-1500: --- Testing with patch for HBASE-1495 changes th

[jira] Commented: (HBASE-1495) IllegalArgumentException in halfhfilereader#next

2009-06-13 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719172#action_12719172 ] stack commented on HBASE-1495: -- And things below should be inside try/finallys: {code} +

[jira] Issue Comment Edited: (HBASE-1495) IllegalArgumentException in halfhfilereader#next

2009-06-13 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719171#action_12719171 ] Andrew Purtell edited comment on HBASE-1495 at 6/13/09 11:50 AM:

[jira] Updated: (HBASE-1495) IllegalArgumentException in halfhfilereader#next

2009-06-13 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-1495: -- Attachment: HBASE-1495.patch Fixed up patch for trunk. > IllegalArgumentException in halfhfile

[jira] Commented: (HBASE-1495) IllegalArgumentException in halfhfilereader#next

2009-06-13 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719170#action_12719170 ] stack commented on HBASE-1495: -- Excellent Ryan. Testing now. Comments on patch: Why remove

[jira] Commented: (HBASE-1495) IllegalArgumentException in halfhfilereader#next

2009-06-13 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719169#action_12719169 ] Andrew Purtell commented on HBASE-1495: --- Patch HBASE-1495 does not apply cleanly to t

Re: and thus splits were fixed

2009-06-13 Thread Ryan Rawson
It was an api contract mismatch. It turns out in half hfile reader if you are persistent you can next() thru the entire file by ignoring the returen code! On Jun 13, 2009 9:29 AM, "Erik Holstad" wrote: Nice going Ryan! Yeah, we might have to look over the how scanners work so that we end up with

[jira] Commented: (HBASE-1513) Compactions to slow

2009-06-13 Thread Erik Holstad (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719155#action_12719155 ] Erik Holstad commented on HBASE-1513: - @Ryan What does the new minor compaction do and

Re: and thus splits were fixed

2009-06-13 Thread Erik Holstad
Nice going Ryan! Yeah, we might have to look over the how scanners work so that we end up with returning next only if we actually have a next, cause right now it can cause some confusion.

[jira] Commented: (HBASE-1513) Compactions to slow

2009-06-13 Thread Billy Pearson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719124#action_12719124 ] Billy Pearson commented on HBASE-1513: -- +1 on minor compaction 1mins, 17sec for 103.3M

[jira] Commented: (HBASE-1513) Compactions to slow

2009-06-13 Thread Billy Pearson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719122#action_12719122 ] Billy Pearson commented on HBASE-1513: -- testing minor compaction is major compaction

and thus splits were fixed

2009-06-13 Thread Ryan Rawson
So it turns out that the heap infrastructure was using the scanner in a way that wasnt previously expected. Right now the heap ignores 'next' return value, assuming that getKeyValue() return null at the end. But this is not the case in a HalfHFileReader - it turns out that during a split, one hal

[jira] Updated: (HBASE-1495) IllegalArgumentException in halfhfilereader#next

2009-06-13 Thread ryan rawson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ryan rawson updated HBASE-1495: --- Attachment: HBASE-1495.patch compactions are fucking up - the bottom half gets both, and the top half

[jira] Updated: (HBASE-1513) Compactions to slow

2009-06-13 Thread ryan rawson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ryan rawson updated HBASE-1513: --- Status: Patch Available (was: Open) minor compactor previously was too complex and did too much logi

[jira] Updated: (HBASE-1513) Compactions to slow

2009-06-13 Thread ryan rawson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ryan rawson updated HBASE-1513: --- Attachment: HBASE-1513.patch looks like the logic to do the minor compaction is too expensive during

[jira] Assigned: (HBASE-1513) Compactions to slow

2009-06-13 Thread ryan rawson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ryan rawson reassigned HBASE-1513: -- Assignee: ryan rawson > Compactions to slow > --- > > Key: HBAS

[jira] Commented: (HBASE-1515) Address part of config option hbase.regionserver unnecessary

2009-06-13 Thread ryan rawson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719092#action_12719092 ] ryan rawson commented on HBASE-1515: To run on EC2 and similar systems we now support t