[jira] [Commented] (HBASE-15295) MutateTableAccess.multiMutate() does not get high priority causing a deadlock

2016-03-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212152#comment-15212152 ] stack commented on HBASE-15295: --- First, nice digging [~enis]. Good one. RPC while holding

[jira] [Commented] (HBASE-15499) Add multiple data type support for increment

2016-03-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212300#comment-15212300 ] stack commented on HBASE-15499: --- Why? Looks like non-controversial feature addition to me.

[jira] [Commented] (HBASE-15496) Throw RowTooBigException only for user scan/get

2016-03-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212303#comment-15212303 ] stack commented on HBASE-15496: --- For a huge KeyValue, there is nothing to do if it already

[jira] [Commented] (HBASE-15496) Throw RowTooBigException only for user scan/get

2016-03-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212312#comment-15212312 ] stack commented on HBASE-15496: --- Patch LGTM. No good throwing RowTooBigException for intern

[jira] [Updated] (HBASE-15496) Throw RowTooBigException only for user scan/get

2016-03-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15496: -- Attachment: HBASE-15496.patch Retry even though the failures are well-known flakies a > Throw RowTooBigExcepti

[jira] [Commented] (HBASE-15418) Clean up un-used warning in test util

2016-03-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212564#comment-15212564 ] stack commented on HBASE-15418: --- LGTM > Clean up un-used warning in test util > --

[jira] [Commented] (HBASE-15535) HBase Reference Guide has an incorrect link for Trafodion

2016-03-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212575#comment-15212575 ] stack commented on HBASE-15535: --- Mind putting up a patch [~atanumishra]? Thanks. > HBase R

[jira] [Commented] (HBASE-15499) Add multiple data type support for increment

2016-03-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212591#comment-15212591 ] stack commented on HBASE-15499: --- Patch looks good to me. I like your use of our existing ty

[jira] [Commented] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212780#comment-15212780 ] stack commented on HBASE-15265: --- Go for it. In another issue we can work out if we should m

[jira] [Commented] (HBASE-14921) Memory optimizations

2016-03-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212838#comment-15212838 ] stack commented on HBASE-14921: --- Reviewed again after another read of the attached diagram.

[jira] [Commented] (HBASE-14921) Memory optimizations

2016-03-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212842#comment-15212842 ] stack commented on HBASE-14921: --- I still don't get this sentence from the diagram attachmen

[jira] [Commented] (HBASE-14920) Compacting Memstore

2016-03-26 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212981#comment-15212981 ] stack commented on HBASE-14920: --- A few notes on the patch Is the comment right when it say

[jira] [Commented] (HBASE-15506) FSDataOutputStream.write() allocates new byte buffer on each operation

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214414#comment-15214414 ] stack commented on HBASE-15506: --- HDFS-7276 adds 4 new configs (5 including the enable) wher

[jira] [Commented] (HBASE-14921) Memory optimizations

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214437#comment-15214437 ] stack commented on HBASE-14921: --- bq. As you have mentioned, CellBlock is implementing Concu

[jira] [Commented] (HBASE-15525) OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214526#comment-15214526 ] stack commented on HBASE-15525: --- So in your patch, ByteBufferPool is a FixedSizeBBP? So we

[jira] [Commented] (HBASE-15525) OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214538#comment-15214538 ] stack commented on HBASE-15525: --- Oh, so, it addresses this issue because sizing of the offh

[jira] [Created] (HBASE-15549) Change TABLES_ON_MASTER to false in master branch

2016-03-28 Thread stack (JIRA)
stack created HBASE-15549: - Summary: Change TABLES_ON_MASTER to false in master branch Key: HBASE-15549 URL: https://issues.apache.org/jira/browse/HBASE-15549 Project: HBase Issue Type: Bug

[jira] [Updated] (HBASE-15549) Change TABLES_ON_MASTER to 'none' in master branch

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15549: -- Summary: Change TABLES_ON_MASTER to 'none' in master branch (was: Change TABLES_ON_MASTER to false in master b

[jira] [Updated] (HBASE-15549) Undo HMaster carrying regions in master branch as default

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15549: -- Summary: Undo HMaster carrying regions in master branch as default (was: Change TABLES_ON_MASTER to 'none' in

[jira] [Updated] (HBASE-15549) Undo HMaster carrying regions in master branch as default

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15549: -- Attachment: 15549.patch Add a means of disabling master-as-regionserver. Default in patch is that master CAN

[jira] [Commented] (HBASE-15549) Undo HMaster carrying regions in master branch as default

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214956#comment-15214956 ] stack commented on HBASE-15549: --- bq. What's not finished? What Master's personality is go

[jira] [Commented] (HBASE-15549) Undo HMaster carrying regions in master branch as default

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214963#comment-15214963 ] stack commented on HBASE-15549: --- bq. How is this different from hbase.balancer.tablesOnMast

[jira] [Commented] (HBASE-15544) HFileReaderImpl.readBlock allocates memory for HFileBlock on every call

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214983#comment-15214983 ] stack commented on HBASE-15544: --- Yeah, we allocate buffers to do compression. What you sugg

[jira] [Commented] (HBASE-15525) OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15215009#comment-15215009 ] stack commented on HBASE-15525: --- So, just to note, on read side, we are already reading in

[jira] [Created] (HBASE-15550) Backport HBASE-12220 hedgedRead metrics to 1.2+

2016-03-28 Thread stack (JIRA)
stack created HBASE-15550: - Summary: Backport HBASE-12220 hedgedRead metrics to 1.2+ Key: HBASE-15550 URL: https://issues.apache.org/jira/browse/HBASE-15550 Project: HBase Issue Type: Sub-task

[jira] [Updated] (HBASE-15550) Backport HBASE-12220 hedgedRead metrics to 1.2+

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15550: -- Attachment: 15550.branch-1.2.txt Lets see how this patch does. > Backport HBASE-12220 hedgedRead metrics to 1.

[jira] [Updated] (HBASE-15550) Backport HBASE-12220 hedgedRead metrics to 1.2+

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15550: -- Assignee: stack Affects Version/s: 1.2.2 1.3.0 Status: Patch

[jira] [Created] (HBASE-15555) Memory Management

2016-03-28 Thread stack (JIRA)
stack created HBASE-1: - Summary: Memory Management Key: HBASE-1 URL: https://issues.apache.org/jira/browse/HBASE-1 Project: HBase Issue Type: Umbrella Reporter: stack Umbrel

[jira] [Updated] (HBASE-15555) Memory Management

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-1: -- Attachment: download.svg Start of a diagram identifying current bigbuffer allocations. > Memory Management > -

[jira] [Updated] (HBASE-15513) hbase.hregion.memstore.chunkpool.maxsize is 0.0 by default

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15513: -- Issue Type: Sub-task (was: Improvement) Parent: HBASE-1 > hbase.hregion.memstore.chunkpool.maxsize

[jira] [Updated] (HBASE-14613) Remove MemStoreChunkPool?

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-14613: -- Issue Type: Sub-task (was: Brainstorming) Parent: HBASE-1 > Remove MemStoreChunkPool? > --

[jira] [Updated] (HBASE-15525) OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts

2016-03-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15525: -- Issue Type: Sub-task (was: Bug) Parent: HBASE-1 > OutOfMemory could occur when using BoundedByteBu

[jira] [Commented] (HBASE-15295) MutateTableAccess.multiMutate() does not get high priority causing a deadlock

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15215977#comment-15215977 ] stack commented on HBASE-15295: --- bq. Phoenix defines its own RPCScheduler and controller wh

[jira] [Commented] (HBASE-15555) Memory Management

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216003#comment-15216003 ] stack commented on HBASE-1: --- bq. we use BBs from the pool (BoundedByteBufferPool) and r

[jira] [Commented] (HBASE-15555) Memory Management

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216004#comment-15216004 ] stack commented on HBASE-1: --- Linking HBASE-15542 (Can't make it a subtask because it ha

[jira] [Updated] (HBASE-15555) Memory Management

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-1: -- Description: Umbrella issue on memory management. One-stop shop to learn how we're doing it, tenets, and work

[jira] [Commented] (HBASE-15543) HFileScannerImpl.getCell() allocates cell object on every call

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216018#comment-15216018 ] stack commented on HBASE-15543: --- The method creates a variety of Cell types dependent on se

[jira] [Commented] (HBASE-15362) Compression Algorithm does not respect config params from hbase-site

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216025#comment-15216025 ] stack commented on HBASE-15362: --- Please raise your observation that we may be able to do w/

[jira] [Updated] (HBASE-15362) Compression Algorithm does not respect config params from hbase-site

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15362: -- Issue Type: Sub-task (was: Bug) Parent: HBASE-1 > Compression Algorithm does not respect config pa

[jira] [Commented] (HBASE-15362) Compression Algorithm does not respect config params from hbase-site

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216050#comment-15216050 ] stack commented on HBASE-15362: --- On the patch, I think the original code is wrong where it

[jira] [Commented] (HBASE-15499) Add multiple data type support for increment

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216054#comment-15216054 ] stack commented on HBASE-15499: --- Patch looks good. What did you change [~heliangliang]? Tha

[jira] [Commented] (HBASE-14921) Memory optimizations

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216085#comment-15216085 ] stack commented on HBASE-14921: --- bq. We want CellSet to have different types of delegatees,

[jira] [Commented] (HBASE-15550) Backport HBASE-12220 hedgedRead metrics to 1.2+

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216100#comment-15216100 ] stack commented on HBASE-15550: --- Thanks [~busbey]. Think it'd be ok for 1.2? These metrics

[jira] [Commented] (HBASE-15549) Undo HMaster carrying regions in master branch as default

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216108#comment-15216108 ] stack commented on HBASE-15549: --- bq. With a large enough cluster I get double assignments,

[jira] [Commented] (HBASE-15549) Undo HMaster carrying regions in master branch as default

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216207#comment-15216207 ] stack commented on HBASE-15549: --- bq. There's no times that we need to finalize a risky oper

[jira] [Commented] (HBASE-13639) SyncTable - rsync for HBase tables

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216210#comment-15216210 ] stack commented on HBASE-13639: --- If you post a paragraph or two, I can help massage it into

[jira] [Commented] (HBASE-15555) Memory Management

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216213#comment-15216213 ] stack commented on HBASE-1: --- Is there an issue for this? Seems kinda important. Good on

[jira] [Commented] (HBASE-15327) Canary will always invoke admin.balancer() in each sniffing period when writeSniffing is enabled

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216305#comment-15216305 ] stack commented on HBASE-15327: --- +1 on patch and on rerunning hadoopqa > Canary will alway

[jira] [Commented] (HBASE-14921) Memory optimizations

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216318#comment-15216318 ] stack commented on HBASE-14921: --- I tried changing CNM to NM and it fails because we use tai

[jira] [Reopened] (HBASE-15295) MutateTableAccess.multiMutate() does not get high priority causing a deadlock

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack reopened HBASE-15295: --- This patch causes TestMasterNoCluster#testFailover to fail always. > MutateTableAccess.multiMutate() does not ge

[jira] [Commented] (HBASE-15555) Memory Management

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216539#comment-15216539 ] stack commented on HBASE-1: --- bq. Do you want to raise a JIRA for this? I think the subt

[jira] [Commented] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216662#comment-15216662 ] stack commented on HBASE-15265: --- It took me a while but a 2B run on 9-node cluster passes w

[jira] [Commented] (HBASE-15295) MutateTableAccess.multiMutate() does not get high priority causing a deadlock

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216684#comment-15216684 ] stack commented on HBASE-15295: --- Understood [~enis] Tests passed when you tried the patch b

[jira] [Commented] (HBASE-14920) Compacting Memstore

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216720#comment-15216720 ] stack commented on HBASE-14920: --- I like the notion of a 'CompactionMemStore' instead of a p

[jira] [Commented] (HBASE-14920) Compacting Memstore

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216812#comment-15216812 ] stack commented on HBASE-14920: --- I see/remember why the isCompactingMemStore method. Makes

[jira] [Commented] (HBASE-14920) Compacting Memstore

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216864#comment-15216864 ] stack commented on HBASE-14920: --- s/startCompact/startCompaction/g s/doCompact/doCompaction/

[jira] [Updated] (HBASE-14920) Compacting Memstore

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-14920: -- Attachment: move.to.junit4.patch Patch to integrate which changes TestMemStoreDefault to be junit4... if it he

[jira] [Commented] (HBASE-15560) TinyLFU-based BlockCache

2016-03-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15217028#comment-15217028 ] stack commented on HBASE-15560: --- Patch looks good. Not too interested in giving folks a ch

[jira] [Commented] (HBASE-14920) Compacting Memstore

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218098#comment-15218098 ] stack commented on HBASE-14920: --- bq. which reside in a segment and have very small sequ

[jira] [Updated] (HBASE-15324) Jitter may cause desiredMaxFileSize overflow in ConstantSizeRegionSplitPolicy and trigger unexpected split

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15324: -- Attachment: HBASE-15324_v3.patch > Jitter may cause desiredMaxFileSize overflow in ConstantSizeRegionSplitPolic

[jira] [Commented] (HBASE-15324) Jitter may cause desiredMaxFileSize overflow in ConstantSizeRegionSplitPolicy and trigger unexpected split

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218102#comment-15218102 ] stack commented on HBASE-15324: --- +1 on patch. Let me rerun it. > Jitter may cause desiredM

[jira] [Commented] (HBASE-15506) FSDataOutputStream.write() allocates new byte buffer on each operation

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218113#comment-15218113 ] stack commented on HBASE-15506: --- bq. In any case, we should be able to create some single s

[jira] [Commented] (HBASE-15525) OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218139#comment-15218139 ] stack commented on HBASE-15525: --- bq. This is some thing I discussed with you offline some t

[jira] [Commented] (HBASE-15509) Avoid copy of block data in HFileBlock$Writer.finishBlock

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218218#comment-15218218 ] stack commented on HBASE-15509: --- What is the mysterious 'len'? 84 * @param len -

[jira] [Commented] (HBASE-15509) Avoid copy of block data in HFileBlock$Writer.finishBlock

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218289#comment-15218289 ] stack commented on HBASE-15509: --- bq. How do we mitigate case where a Cell is 1G? All my thr

[jira] [Commented] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218558#comment-15218558 ] stack commented on HBASE-15536: --- An overnight run passed (10B ITBLL with chaos monkeys on 8

[jira] [Commented] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218703#comment-15218703 ] stack commented on HBASE-15536: --- I reviewed HBASE-15407 and HBASE-15538. They seem good to

[jira] [Commented] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218712#comment-15218712 ] stack commented on HBASE-15265: --- There I go asking for same stuff again... Thanks for filin

[jira] [Created] (HBASE-15566) Add timeouts on TestMobFlushSnapshotFromClient and TestRegionMergeTransactionOnCluster

2016-03-30 Thread stack (JIRA)
stack created HBASE-15566: - Summary: Add timeouts on TestMobFlushSnapshotFromClient and TestRegionMergeTransactionOnCluster Key: HBASE-15566 URL: https://issues.apache.org/jira/browse/HBASE-15566 Project: HBa

[jira] [Updated] (HBASE-15566) Add timeouts on TestMobFlushSnapshotFromClient and TestRegionMergeTransactionOnCluster

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15566: -- Attachment: timeouts.patch Let me push this. > Add timeouts on TestMobFlushSnapshotFromClient and > TestRegio

[jira] [Resolved] (HBASE-15566) Add timeouts on TestMobFlushSnapshotFromClient and TestRegionMergeTransactionOnCluster

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-15566. --- Resolution: Fixed Assignee: stack Fix Version/s: 2.0.0 Pushed to master > Add timeouts on Te

[jira] [Updated] (HBASE-15324) Jitter may cause desiredMaxFileSize overflow in ConstantSizeRegionSplitPolicy and trigger unexpected split

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15324: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 1.4.0 1.3.0

[jira] [Commented] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218822#comment-15218822 ] stack commented on HBASE-15536: --- I did a rough compare where I ran ycsb load against a sing

[jira] [Commented] (HBASE-15537) Add multi WAL support for AsyncFSWAL

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218899#comment-15218899 ] stack commented on HBASE-15537: --- When would there ever be more than one provider? In Region

[jira] [Commented] (HBASE-15549) Undo HMaster carrying regions in master branch as default

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15219097#comment-15219097 ] stack commented on HBASE-15549: --- Balancer gets messed up if master is not carrying regions:

[jira] [Commented] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15219295#comment-15219295 ] stack commented on HBASE-15536: --- Running this compare from HBASE-10156 {code} $ for i in 1

[jira] [Commented] (HBASE-15537) Add multi WAL support for AsyncFSWAL

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15219310#comment-15219310 ] stack commented on HBASE-15537: --- [~busbey] Your opinion appreciated here. A provider insid

[jira] [Commented] (HBASE-15569) Make Bytes.toStringBinary faster

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15219324#comment-15219324 ] stack commented on HBASE-15569: --- Smile. +1 > Make Bytes.toStringBinary faster > --

[jira] [Updated] (HBASE-15569) Make Bytes.toStringBinary faster

2016-03-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15569: -- Status: Patch Available (was: Open) > Make Bytes.toStringBinary faster > > >

[jira] [Commented] (HBASE-14920) Compacting Memstore

2016-03-31 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15219986#comment-15219986 ] stack commented on HBASE-14920: --- [~eshcar] I suggested changing stopCompact to stopCompacti

[jira] [Commented] (HBASE-15556) need extensible ConsistencyControl interface

2016-03-31 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221102#comment-15221102 ] stack commented on HBASE-15556: --- bq. Hold that thought about our custom bit...don't want to

[jira] [Commented] (HBASE-15571) Make MasterProcedureManagerHost accessible through MasterServices

2016-03-31 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221130#comment-15221130 ] stack commented on HBASE-15571: --- You fellows get the bit that we want to keep the *Services

[jira] [Updated] (HBASE-15569) Make Bytes.toStringBinary faster

2016-03-31 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15569: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 1.2.2 1.4.0

[jira] [Commented] (HBASE-15480) Bloom Filter check needs to be more efficient for array

2016-03-31 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221152#comment-15221152 ] stack commented on HBASE-15480: --- Group check sounds good. The new API would be used by uppe

[jira] [Commented] (HBASE-15572) Adding optional timestamp semantics to HBase-Spark

2016-03-31 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221217#comment-15221217 ] stack commented on HBASE-15572: --- bq. Normally the docs mentioned above can be added to this

[jira] [Commented] (HBASE-15576) Support stateless scanning and scanning cursor

2016-04-01 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221841#comment-15221841 ] stack commented on HBASE-15576: --- Hello [~yangzhe1991] bq. Now for ResultScanner.next(), we

[jira] [Comment Edited] (HBASE-15576) Support stateless scanning and scanning cursor

2016-04-01 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221841#comment-15221841 ] stack edited comment on HBASE-15576 at 4/1/16 3:27 PM: --- Hello [~yan

[jira] [Commented] (HBASE-15576) Support stateless scanning and scanning cursor

2016-04-01 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221954#comment-15221954 ] stack commented on HBASE-15576: --- bq. So for users, ResultScanner.next() will still be block

[jira] [Commented] (HBASE-14921) Memory optimizations

2016-04-01 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221995#comment-15221995 ] stack commented on HBASE-14921: --- Nice review [~anoop.hbase] On not needing third int, I lik

[jira] [Commented] (HBASE-15562) Gc pause increases when the incoming requests are pooled

2016-04-01 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1551#comment-1551 ] stack commented on HBASE-15562: --- SurvivorRatio? We'd be making less garbage when using pool

[jira] [Commented] (HBASE-15581) Reduce garbage created by PB in write path

2016-04-01 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15222305#comment-15222305 ] stack commented on HBASE-15581: --- Hurray. Want to go to PB2.6? We'll have to shade? > Reduc

[jira] [Commented] (HBASE-15576) Support stateless scanning and scanning cursor

2016-04-01 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15222315#comment-15222315 ] stack commented on HBASE-15576: --- bq. we think we should save mvcc in HFile to solve some is

[jira] [Commented] (HBASE-15537) Add multi WAL support for AsyncFSWAL

2016-04-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15223638#comment-15223638 ] stack commented on HBASE-15537: --- Skimmed. Looks great.+1 [~busbey] when you get a chance,

[jira] [Commented] (HBASE-15560) TinyLFU-based BlockCache

2016-04-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15224913#comment-15224913 ] stack commented on HBASE-15560: --- Yes (didn't realize it jdk8 only)... I still owe basic per

[jira] [Commented] (HBASE-15537) Add multi WAL support for AsyncFSWAL

2016-04-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225647#comment-15225647 ] stack commented on HBASE-15537: --- bq. Or could you further clarify your concern if I misunde

[jira] [Commented] (HBASE-15537) Add multi WAL support for AsyncFSWAL

2016-04-05 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226562#comment-15226562 ] stack commented on HBASE-15537: --- bq. Is it enough to get the statistics you want? Yes. I c

[jira] [Created] (HBASE-15594) [YCSB] Improvements

2016-04-05 Thread stack (JIRA)
stack created HBASE-15594: - Summary: [YCSB] Improvements Key: HBASE-15594 URL: https://issues.apache.org/jira/browse/HBASE-15594 Project: HBase Issue Type: Umbrella Reporter: stack Runn

[jira] [Updated] (HBASE-15594) [YCSB] Improvements

2016-04-05 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-15594: -- Priority: Critical (was: Major) > [YCSB] Improvements > --- > > Key: HBASE-155

[jira] [Commented] (HBASE-15594) [YCSB] Improvements

2016-04-05 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226612#comment-15226612 ] stack commented on HBASE-15594: --- I think this a critical issue given we should be able to u

[jira] [Commented] (HBASE-15594) [YCSB] Improvements

2016-04-05 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226655#comment-15226655 ] stack commented on HBASE-15594: --- branch-1. branch-1 because I want to bring fixes into bran

<    3   4   5   6   7   8   9   10   11   12   >