Re: Questions about HBase replication

2014-12-16 Thread Jean-Daniel Cryans
To add to what Jieshan said: On Fri, Nov 21, 2014 at 8:32 PM, Cliff wrote: > 1. > Why does "HBase replication" need replicationSink? > I think replicationSource can do replicationSink's work as well. > And if we don't use replicationSink, we just need one time I/O. > If you were to use HTable f

Re: Replication terminology "master-master"

2014-11-25 Thread Jean-Daniel Cryans
On Mon, Nov 24, 2014 at 8:29 PM, lars hofhansl wrote: > Hmm... From that angle all we really have is master-slave replication, > without limit as how it can be setup.A master can be slave too, and a slave > a master, and cycles are allowed. > I find "cyclical replication" more confusing than "mas

[jira] [Resolved] (HBASE-11388) The order parameter is wrong when invoking the constructor of the ReplicationPeer In the method "getPeer" of the class ReplicationPeersZKImpl

2014-07-25 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-11388. Resolution: Fixed Fix Version/s: (was: 0.99.0) Hadoop Flags

Re: jdk 1.7 & trunk

2014-06-25 Thread Jean-Daniel Cryans
On Wed, Jun 25, 2014 at 11:48 AM, Nicolas Liochon wrote: > Ok Enis I like the definition you put in the thread. > > Dropping support explicitly means that we stop building against > JDK6 in jenkins, and won't try to fix issues if they are jdk6 only. Release > testing and unit tests are done on jd

[jira] [Resolved] (HBASE-10990) Running CompressionTest yields unrelated schema metrics configuration errors.

2014-05-16 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-10990. Resolution: Duplicate I'm fixing this in HBASE-11188. > Running Compres

[jira] [Resolved] (HBASE-10946) hbase.metrics.showTableName cause run “hbase xxx.Hfile” report Inconsistent configuration

2014-05-16 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-10946. Resolution: Duplicate I'm fixing this in HBASE-

[jira] [Resolved] (HBASE-11188) "Inconsistent configuration" for SchemaMetrics is always shown

2014-05-16 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-11188. Resolution: Fixed Release Note: Region servers with the default value for

[jira] [Created] (HBASE-11188) "Inconsistent configuration" for SchemaMetrics is always shown

2014-05-16 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-11188: -- Summary: "Inconsistent configuration" for SchemaMetrics is always shown Key: HBASE-11188 URL: https://issues.apache.org/jira/browse/HBASE-11188

Re: Comparing the performance of 0.98.2 RC0 and 0.98.0 using YCSB

2014-05-15 Thread Jean-Daniel Cryans
Nice, thanks for running this. J-D On Tue, May 6, 2014 at 6:58 PM, Andrew Purtell wrote: > Comparing the relative performance of 0.98.2 RC0 and 0.98.0 on Hadoop 2.2.0 > using YCSB. > > The hardware used is different than for the previous report comparing > 0.98.1 to 0.98.0. However the results

Re: Root and Meta removed in 0.96?

2014-04-28 Thread Jean-Daniel Cryans
Only ROOT https://issues.apache.org/jira/browse/HBASE-3171 On Mon, Apr 28, 2014 at 10:00 AM, Demai Ni wrote: > hi, > > a quick question. I remembered that these two are removed starting 0.96? > not sure my memory serves me well on this. I googled but can't find the > jira or document for this.

[jira] [Resolved] (HBASE-10932) Improve RowCounter to allow mapper number set/control

2014-04-25 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-10932. Resolution: Won't Fix Resolving as won't fix. If you want to work

[jira] [Created] (HBASE-11008) Align bulk load, flush, and compact to require Action.CREATE

2014-04-16 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-11008: -- Summary: Align bulk load, flush, and compact to require Action.CREATE Key: HBASE-11008 URL: https://issues.apache.org/jira/browse/HBASE-11008 Project

[jira] [Created] (HBASE-10967) CatalogTracker.waitForMeta should not wait indefinitely silently

2014-04-11 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-10967: -- Summary: CatalogTracker.waitForMeta should not wait indefinitely silently Key: HBASE-10967 URL: https://issues.apache.org/jira/browse/HBASE-10967 Project

[jira] [Created] (HBASE-10958) [dataloss] Bulk loading with seqids can prevent some log entries from being replayed

2014-04-10 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-10958: -- Summary: [dataloss] Bulk loading with seqids can prevent some log entries from being replayed Key: HBASE-10958 URL: https://issues.apache.org/jira/browse/HBASE-10958

[jira] [Resolved] (HBASE-5222) Stopping replication via the "stop_replication" command in hbase shell on a slave cluster isn't acknowledged in the replication sink

2014-03-31 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-5222. --- Resolution: Invalid The kill switch was completely removed, closing. > Stopp

[jira] [Resolved] (HBASE-5211) org.apache.hadoop.hbase.replication.TestMultiSlaveReplication#testMultiSlaveReplication is flakey

2014-03-31 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-5211. --- Resolution: Cannot Reproduce Stale jira, closing

Re: [VOTE] The 1st hbase 0.94.18 release candidate is available for download

2014-03-21 Thread Jean-Daniel Cryans
Downloaded the non-secure tarball, checked the md5, ran some PE load, looked at the logs, made sure the rows were all there. +1 J-D On Fri, Mar 14, 2014 at 11:44 PM, lars hofhansl wrote: > The 1st 0.94.18 RC is available for download at > http://people.apache.org/~larsh/hbase-0.94.18-rc0/ > S

[jira] [Created] (HBASE-10755) MutableHistogram is capitalizing the metric names

2014-03-14 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-10755: -- Summary: MutableHistogram is capitalizing the metric names Key: HBASE-10755 URL: https://issues.apache.org/jira/browse/HBASE-10755 Project: HBase

[jira] [Created] (HBASE-10518) DirectMemoryUtils.getDirectMemoryUsage spams when none is configured

2014-02-12 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-10518: -- Summary: DirectMemoryUtils.getDirectMemoryUsage spams when none is configured Key: HBASE-10518 URL: https://issues.apache.org/jira/browse/HBASE-10518

Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download

2014-02-12 Thread Jean-Daniel Cryans
+1 Downloaded the hadoop2 tarball, ran some PE, everything looks good except for the annoying "Failed to retrieve nio.BufferPool direct MemoryUsed" debug line... J-D On Thu, Feb 6, 2014 at 6:14 PM, Andrew Purtell wrote: > The 3rd HBase 0.98.0 release candidate (RC2) is available for download

[jira] [Created] (HBASE-10482) ReplicationSyncUp doesn't clean up its ZK, needed for tests

2014-02-06 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-10482: -- Summary: ReplicationSyncUp doesn't clean up its ZK, needed for tests Key: HBASE-10482 URL: https://issues.apache.org/jira/browse/HBASE-10482 Pr

[jira] [Created] (HBASE-10271) [regression] Cannot use the wildcard address since HBASE-9593

2014-01-02 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-10271: -- Summary: [regression] Cannot use the wildcard address since HBASE-9593 Key: HBASE-10271 URL: https://issues.apache.org/jira/browse/HBASE-10271 Project

[jira] [Created] (HBASE-9898) Have a way to set a different default compression on HCD

2013-11-05 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9898: - Summary: Have a way to set a different default compression on HCD Key: HBASE-9898 URL: https://issues.apache.org/jira/browse/HBASE-9898 Project: HBase

[jira] [Created] (HBASE-9744) Set io.serializations correctly in HFileOutputFormat.configureIncrementalLoad

2013-10-10 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9744: - Summary: Set io.serializations correctly in HFileOutputFormat.configureIncrementalLoad Key: HBASE-9744 URL: https://issues.apache.org/jira/browse/HBASE-9744

Re: Upcoming HBase bay area user and dev meetups

2013-10-07 Thread Jean-Daniel Cryans
While we're on the topic of upcoming meetups, there's also a meetup at Facebook's NYC office the week of Strata/Hadoop World (10/28). There's still room for about 50 attendees. http://www.meetup.com/HBase-NYC/events/135434632/ J-D On Mon, Oct 7, 2013 at 2:10 PM, Enis Söztutar wrote: > Hi guys

[jira] [Created] (HBASE-9707) [ref guide] make the client configurations easier to find

2013-10-03 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9707: - Summary: [ref guide] make the client configurations easier to find Key: HBASE-9707 URL: https://issues.apache.org/jira/browse/HBASE-9707 Project: HBase

Re: [Replication] how ReplicationLogCleaner is triggered during hbase start up?

2013-10-02 Thread Jean-Daniel Cryans
Once hbase.replication is true it will get picked up by CleanerChore as set by Resplication.decorateMasterConfiguration J-D On Wed, Oct 2, 2013 at 12:39 PM, Demai Ni wrote: > hi, folks, > > I am trying to figure out this logic and probably leverage it. > > When HBase started, it will exam the

[jira] [Resolved] (HBASE-8711) Requests count is completely off

2013-09-26 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-8711. --- Resolution: Fixed Fix Version/s: 0.98.0 Hadoop Flags: Reviewed Thanks

Re: [jira] [Commented] (HBASE-9647) Add a test in TestAsyncProcess to check the number of threads created

2013-09-25 Thread Jean-Daniel Cryans
TIL English :) On Wed, Sep 25, 2013 at 11:10 AM, Nick Dimiduk (JIRA) wrote: > > [ > https://issues.apache.org/jira/browse/HBASE-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777833#comment-13777833] > > Nick Dimiduk commented on HBASE-9647: > -

Re: [VOTE] The 4th hbase-0.96.0 release candidate is available for download

2013-09-23 Thread Jean-Daniel Cryans
-1, HBASE-9642 seems like something that would kill clusters with a lot of region movements or just long running ones. J-D On Sat, Sep 21, 2013 at 3:50 PM, Stack wrote: > hbase-0.96.0 will be our next major release. It is intended to supplant > the 0.94.x series. > > hbase-0.96.0RC3 is our fo

[jira] [Created] (HBASE-9642) AM ZK Workers stuck doing 100% CPU on HashMap.put

2013-09-23 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9642: - Summary: AM ZK Workers stuck doing 100% CPU on HashMap.put Key: HBASE-9642 URL: https://issues.apache.org/jira/browse/HBASE-9642 Project: HBase

Random reads are 5x faster in 0.96.0! Or not

2013-09-23 Thread Jean-Daniel Cryans
Hey devs, I was testing performance of 0.96.0RC3 vs 0.94.12 and found that random reads are 5x faster out of the box in the former, party! But wait, no, HBASE-7008 disabled Nagle's algo and it was only applied to 0.95, so if you configure that in 0.94 it becomes even faster than 0.96 by a small ma

Re: [VOTE] The 3rd hbase 0.94.12 release candidate is available for download

2013-09-23 Thread Jean-Daniel Cryans
+1 I'm currently using it as a store for opentsdb in a pseudo-distributed mode. I also did some PE testing on a cluster with 5 nodes when trying to compare thread and memory usage VS 0.96.0 J-D On Thu, Sep 19, 2013 at 11:19 PM, lars hofhansl wrote: > Third time's the charm... > > The 3rd - a

[jira] [Created] (HBASE-9601) Use a faster balancer when the imbalance is in the hundreds of regions

2013-09-20 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9601: - Summary: Use a faster balancer when the imbalance is in the hundreds of regions Key: HBASE-9601 URL: https://issues.apache.org/jira/browse/HBASE-9601

[jira] [Created] (HBASE-9602) Cannot show the master's web UI when splitting logs at start time

2013-09-20 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9602: - Summary: Cannot show the master's web UI when splitting logs at start time Key: HBASE-9602 URL: https://issues.apache.org/jira/browse/HBASE-9602 Pr

[jira] [Created] (HBASE-9591) [replication] getting "Current list of sinks is out of date" all the time when a source is recovered

2013-09-19 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9591: - Summary: [replication] getting "Current list of sinks is out of date" all the time when a source is recovered Key: HBASE-9591 URL: https://issues.apache.org/j

Re: [VOTE] The 3rd hbase-0.96.0 release candidate is available for download

2013-09-19 Thread Jean-Daniel Cryans
On Wed, Sep 18, 2013 at 9:39 PM, Stack wrote: > hbase-0.96.0 will be our next major release. It is intended to supplant > the 0.94.x series. > > hbase-0.96.0RC2 is our third hbase-0.96.0 release candidate. > > The signed tarballs are available here: > > http://people.apache.org/~stack/hbase-0.9

Re: [Question: Replication] how to detect whether there is a replication pending?

2013-09-18 Thread Jean-Daniel Cryans
Yeah, with HLog queue you can be a whole 64MB in the worst case :) Pretty hard to say for a single table what the status is, but if it was cluster-wide you'd just have to look at the shipped ops/batch rates (if it sits at 0, you're not replicating, unless there's some problem preventing replicatio

Re: src/test/ruby anyone?

2013-09-13 Thread Jean-Daniel Cryans
See TestShell. J-D On Fri, Sep 13, 2013 at 1:26 PM, Nick Dimiduk wrote: > I see we have ruby tests. How do I run those? I don't seem them included > the regular mvn runs. > > Taking a wild guess, it looks like they've suffered some bit-rot: > > $ ./bin/hbase shell hbase-server/src/test/ruby/te

[jira] [Created] (HBASE-9505) Enable replication by default

2013-09-11 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9505: - Summary: Enable replication by default Key: HBASE-9505 URL: https://issues.apache.org/jira/browse/HBASE-9505 Project: HBase Issue Type: Task

Re: Please welcome our newest committer, Nick Dimiduk

2013-09-10 Thread Jean-Daniel Cryans
Welcome to the tribe, Nick! J-D On Tue, Sep 10, 2013 at 3:54 PM, Enis Söztutar wrote: > Hi, > > Please join me in welcoming Nick as our new addition to the list of > committers. Nick is exceptionally good with user-facing issues, and has > done major contributions in mapreduce related areas, h

Re: Rolling restart from 0.92 to 0.94

2013-09-04 Thread Jean-Daniel Cryans
Link to this discussion we had in April about binary compatibility: http://search-hadoop.com/m/Lg90wHGW981 On Wed, Sep 4, 2013 at 3:04 PM, James Taylor wrote: > My two cents: if we want to ensure we're backward compatible, we need to do > two things: define clear boundaries of the classes and/o

[jira] [Created] (HBASE-9428) Regex filters are at least an order of magnitude slower since 0.94.3

2013-09-03 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9428: - Summary: Regex filters are at least an order of magnitude slower since 0.94.3 Key: HBASE-9428 URL: https://issues.apache.org/jira/browse/HBASE-9428 Project

Re: 0.96.0 keep logging "Memstore is above high water mark"

2013-09-03 Thread Jean-Daniel Cryans
t's normal to see a ZK warning each time a client > disconnect? Or it's because PE is not disconnecting correctly? > Le 2013-09-03 17:48, "Jean-Daniel Cryans" a écrit : > > > I ran the command line you are using, it actually creates 100 clients and > &g

[jira] [Created] (HBASE-9425) Starting a LocalHBaseCluster when 2181 is occupied results in "Too many open files"

2013-09-03 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9425: - Summary: Starting a LocalHBaseCluster when 2181 is occupied results in "Too many open files" Key: HBASE-9425 URL: https://issues.apache.org/jira/browse/

Re: 0.96.0 keep logging "Memstore is above high water mark"

2013-09-03 Thread Jean-Daniel Cryans
the logs. I did not count them but sound like > > it's one per client. > > > > I will re-run the test and wc the lines to see if it's really one for > > one... > > > > JM > > > > > > 2013/9/3 Jean-Daniel Cryans > > > >>

Re: 0.96.0 keep logging "Memstore is above high water mark"

2013-09-03 Thread Jean-Daniel Cryans
with only 1 thread and got the same exception. > > So it's not making any difference. > > > 2013/9/3 Jean-Daniel Cryans > > > Alright so your ZK is running inside the master and that's where you're > > seeing those lines, and they are norma

Re: 0.96.0 keep logging "Memstore is above high water mark"

2013-09-03 Thread Jean-Daniel Cryans
gt; Thanks, > > JM > > > 2013/9/3 Kevin O'dell > > > Please don't remove the warn. It is important for troubleshooting and > > sizing. > > On Sep 3, 2013 1:29 PM, "Jean-Daniel Cryans" > wrote: > > > > > On Mon, Sep 2, 201

Re: 0.96.0 keep logging "Memstore is above high water mark"

2013-09-03 Thread Jean-Daniel Cryans
nd you'd have a whole lot less log spam. Also, just to make sure I understand you, you say the warn is important for troubleshooting, but have you used it? It's only in 0.95+. > On Sep 3, 2013 1:29 PM, "Jean-Daniel Cryans" wrote: > > > On Mon, Sep 2, 201

Re: 0.96.0 keep logging "Memstore is above high water mark"

2013-09-03 Thread Jean-Daniel Cryans
t; Oh, ok ;) I just un-packed the jar and ran it. So my config file is: > > > > > > 2013/9/3 Jean-Daniel Cryans > > > On Tue, Sep 3, 2013 at 10:35 AM, Jean-Marc Spaggiari < > > jean-m...@spaggiari.org> wrote: > > > > > > Your 10 clients are

Re: 0.96.0 keep logging "Memstore is above high water mark"

2013-09-03 Thread Jean-Daniel Cryans
On Mon, Sep 2, 2013 at 12:04 PM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > While running PE with 10 clients, server keep logging: > 2013-09-02 14:56:59,919 WARN [RpcServer.handler=5,port=44439] > regionserver.MemStoreFlusher: Memstore is above high water mark and > block 2362ms > 20

[jira] [Created] (HBASE-9394) [replication] size accounting is completely off in the source

2013-08-30 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9394: - Summary: [replication] size accounting is completely off in the source Key: HBASE-9394 URL: https://issues.apache.org/jira/browse/HBASE-9394 Project: HBase

[jira] [Created] (HBASE-9388) [replication] ZK Dump prints the raw PBUF for the HLog positions

2013-08-29 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9388: - Summary: [replication] ZK Dump prints the raw PBUF for the HLog positions Key: HBASE-9388 URL: https://issues.apache.org/jira/browse/HBASE-9388 Project

[jira] [Created] (HBASE-9382) replicateWALEntry doesn't use the replication handlers

2013-08-29 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9382: - Summary: replicateWALEntry doesn't use the replication handlers Key: HBASE-9382 URL: https://issues.apache.org/jira/browse/HBASE-9382 Project:

Re: [UPDATE] Finishing up 0.96 --> WAS Re: 0.95 and 0.96 remaining issues

2013-08-29 Thread Jean-Daniel Cryans
It looks like there's data loss in replication... My gut feeling is it has to do with how we detect when to switch from one log to another. Running more tests today. On Wed, Aug 28, 2013 at 10:35 PM, Stack wrote: > Almost there. A bunch of stuff got resolved in the last few days. JD is > runn

[jira] [Resolved] (HBASE-9371) Eliminate log spam when tailing files

2013-08-28 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-9371. --- Resolution: Fixed Assignee: Jean-Daniel Cryans Hadoop Flags: Reviewed

[jira] [Created] (HBASE-9373) Fix more log spam in replication for 0.96.0

2013-08-28 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9373: - Summary: Fix more log spam in replication for 0.96.0 Key: HBASE-9373 URL: https://issues.apache.org/jira/browse/HBASE-9373 Project: HBase Issue

[jira] [Created] (HBASE-9371) Eliminate log spam when tailing files

2013-08-28 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9371: - Summary: Eliminate log spam when tailing files Key: HBASE-9371 URL: https://issues.apache.org/jira/browse/HBASE-9371 Project: HBase Issue Type

[jira] [Created] (HBASE-9333) hbase.hconnection.threads.max should not be configurable else you get RejectedExecutionException

2013-08-23 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9333: - Summary: hbase.hconnection.threads.max should not be configurable else you get RejectedExecutionException Key: HBASE-9333 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HBASE-9330) Refactor PE to create HTable the correct way

2013-08-23 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9330: - Summary: Refactor PE to create HTable the correct way Key: HBASE-9330 URL: https://issues.apache.org/jira/browse/HBASE-9330 Project: HBase Issue

[jira] [Created] (HBASE-9326) ServerName is created using getLocalSocketAddress, breaks binding to the wildcard address

2013-08-23 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9326: - Summary: ServerName is created using getLocalSocketAddress, breaks binding to the wildcard address Key: HBASE-9326 URL: https://issues.apache.org/jira/browse/HBASE-9326

[jira] [Created] (HBASE-9322) Contention on the SoftValueSortedMap with multiple clients

2013-08-23 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9322: - Summary: Contention on the SoftValueSortedMap with multiple clients Key: HBASE-9322 URL: https://issues.apache.org/jira/browse/HBASE-9322 Project: HBase

[jira] [Created] (HBASE-9321) Contention getting the current user in RpcClient$Connection.writeRequest

2013-08-23 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9321: - Summary: Contention getting the current user in RpcClient$Connection.writeRequest Key: HBASE-9321 URL: https://issues.apache.org/jira/browse/HBASE-9321

[jira] [Created] (HBASE-9314) Dropping a table always prints a TableInfoMissingException in the master log

2013-08-22 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9314: - Summary: Dropping a table always prints a TableInfoMissingException in the master log Key: HBASE-9314 URL: https://issues.apache.org/jira/browse/HBASE-9314

[jira] [Created] (HBASE-9313) NamespaceJanitor is spammy when the namespace table moves

2013-08-22 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9313: - Summary: NamespaceJanitor is spammy when the namespace table moves Key: HBASE-9313 URL: https://issues.apache.org/jira/browse/HBASE-9313 Project: HBase

[jira] [Created] (HBASE-9312) Lower StochasticLoadBalancer's default max run time

2013-08-22 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9312: - Summary: Lower StochasticLoadBalancer's default max run time Key: HBASE-9312 URL: https://issues.apache.org/jira/browse/HBASE-9312 Project:

[jira] [Created] (HBASE-9309) The links in the backup masters template are bad

2013-08-22 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9309: - Summary: The links in the backup masters template are bad Key: HBASE-9309 URL: https://issues.apache.org/jira/browse/HBASE-9309 Project: HBase

[jira] [Created] (HBASE-9307) HalfStoreFileReader needs to handle the faked key else compactions go into infinite loops

2013-08-22 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9307: - Summary: HalfStoreFileReader needs to handle the faked key else compactions go into infinite loops Key: HBASE-9307 URL: https://issues.apache.org/jira/browse/HBASE-9307

Re: [question] command line to get replication metrics info

2013-08-21 Thread Jean-Daniel Cryans
quot;ReplicationLoad" for you or something like that. > > Many thanks > > Demai > > > > On Mon, Aug 19, 2013 at 3:27 PM, Demai Ni wrote: > > > JD, thanks a lot. I will look into it Demai > > > > > > On Mon, Aug 19, 2013 at 2:44 PM, Jean

Re: VOTE: hbase-0.95.2 release candidate 0 is available for download

2013-08-19 Thread Jean-Daniel Cryans
I'm +1 on this release but there are definitely things we need to fix for 0.96: - https://issues.apache.org/jira/browse/HBASE-9267 "StochasticLoadBalancer goes over its processing time limit" I guess this has been present for a while, but it seems to imply you can't let a clusters run for too lon

[jira] [Created] (HBASE-9268) Client doesn't recover from a stalled region server

2013-08-19 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9268: - Summary: Client doesn't recover from a stalled region server Key: HBASE-9268 URL: https://issues.apache.org/jira/browse/HBASE-9268 Project:

[jira] [Created] (HBASE-9267) StochasticLoadBalancer goes over its processing time limit

2013-08-19 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9267: - Summary: StochasticLoadBalancer goes over its processing time limit Key: HBASE-9267 URL: https://issues.apache.org/jira/browse/HBASE-9267 Project: HBase

Re: [question] command line to get replication metrics info

2013-08-19 Thread Jean-Daniel Cryans
See what the "status" command calls in the shell, I would suggest following similar flows. Maybe you could also add to it, like a "status 'replication'" option, instead of having a different command. J-D On Mon, Aug 19, 2013 at 10:23 AM, Demai Ni wrote: > hi, folks > > Looking for your kind s

Re: [VOTE] The 1st hbase 0.94.11 release candidate is available for download

2013-08-15 Thread Jean-Daniel Cryans
+1 Used both tars against each other, loaded some PE data, ran scans and reads, checked out the logs/UIs, did some jstack'ing to make sure nothing weird was in there. J-D On Tue, Aug 13, 2013 at 11:26 PM, lars hofhansl wrote: > The 1st 0.94.11 RC is available for download at > http://people.a

[jira] [Created] (HBASE-9211) "ERROR: undefined method `message' for nil:NilClass" in the shell on error

2013-08-13 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9211: - Summary: "ERROR: undefined method `message' for nil:NilClass" in the shell on error Key: HBASE-9211 URL: https://issues.apache.org/jira/br

[jira] [Resolved] (HBASE-8919) TestReplicationQueueFailover (and Compressed) can fail because the recovered queue gets stuck on ClosedByInterruptException

2013-08-13 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-8919. --- Resolution: Cannot Reproduce I'm closing as Cannot Repro because I haven't

[jira] [Created] (HBASE-9172) Adapt the web UIs to namespaces

2013-08-09 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9172: - Summary: Adapt the web UIs to namespaces Key: HBASE-9172 URL: https://issues.apache.org/jira/browse/HBASE-9172 Project: HBase Issue Type

[jira] [Resolved] (HBASE-8785) revise zookeeper session timeout setting

2013-08-07 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-8785. --- Resolution: Fixed Fix Version/s: 0.98.0 Assignee: Jean-Daniel Cryans

[jira] [Created] (HBASE-9111) Put back TestReplicationKill* except for the MasterRSCompressed one

2013-08-01 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9111: - Summary: Put back TestReplicationKill* except for the MasterRSCompressed one Key: HBASE-9111 URL: https://issues.apache.org/jira/browse/HBASE-9111 Project

Re: HBase read perfomnance and HBase client

2013-07-30 Thread Jean-Daniel Cryans
o block cache and all request are directed to the >> > same Region to guarantee single RS testing. >> > >> > To Ted: >> > >> > Yes, its CDH 4.3 . What the difference between 94.10 and 94.6 with >> respect >> > to read performance? >> > >>

Re: HBase read perfomnance and HBase client

2013-07-30 Thread Jean-Daniel Cryans
nce between 94.10 and 94.6 with respect > to read performance? > > > On Tue, Jul 30, 2013 at 12:06 PM, Jean-Daniel Cryans > wrote: > >> That's a tough one. >> >> One thing that comes to mind is socket reuse. It used to come up more >> more often but this

Re: HBase read perfomnance and HBase client

2013-07-30 Thread Jean-Daniel Cryans
That's a tough one. One thing that comes to mind is socket reuse. It used to come up more more often but this is an issue that people hit when doing loads of random reads. Try enabling tcp_tw_recycle but I'm not guaranteeing anything :) Also if you _just_ want to saturate something, be it CPU or

Re: [question about replication] how to apply delta from Master to Slave after crash ?

2013-07-26 Thread Jean-Daniel Cryans
ate it... Demai > > > On Fri, Jul 26, 2013 at 1:08 PM, Jean-Daniel Cryans > wrote: > >> https://issues.apache.org/jira/browse/HBASE-9047 >> >> On Fri, Jul 26, 2013 at 12:59 PM, Jean-Daniel Cryans >> wrote: >> > I guess I didn't explain my ideas

[jira] [Created] (HBASE-9047) Tool to handle finishing replication when the cluster is offline

2013-07-26 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9047: - Summary: Tool to handle finishing replication when the cluster is offline Key: HBASE-9047 URL: https://issues.apache.org/jira/browse/HBASE-9047 Project

Re: [question about replication] how to apply delta from Master to Slave after crash ?

2013-07-26 Thread Jean-Daniel Cryans
https://issues.apache.org/jira/browse/HBASE-9047 On Fri, Jul 26, 2013 at 12:59 PM, Jean-Daniel Cryans wrote: > I guess I didn't explain my ideas clearly. > > So, first, replication in HBase is master-push, so you don't want to > reverse the process. It means that this to

Re: [question about replication] how to apply delta from Master to Slave after crash ?

2013-07-26 Thread Jean-Daniel Cryans
I guess I didn't explain my ideas clearly. So, first, replication in HBase is master-push, so you don't want to reverse the process. It means that this tool needs to run on the master cluster. Then I don't think you need to specify a timestamp since the replication state is in ZK. Basically that

Re: [question about replication] how to apply delta from Master to Slave after crash ?

2013-07-26 Thread Jean-Daniel Cryans
; > that is why I am looking for a way. Can you please give me some pointers to > start with? many thanks > > Demai > > > On Fri, Jul 26, 2013 at 10:08 AM, Jean-Daniel Cryans > wrote: > >> As soon as you restart your master, it will continue replicating from >>

Re: [question about replication] how to apply delta from Master to Slave after crash ?

2013-07-26 Thread Jean-Daniel Cryans
As soon as you restart your master, it will continue replicating from where it was, so it will send that delta. J-D On Mon, Jul 22, 2013 at 4:42 PM, Demai Ni wrote: > hi, folks, > > I am trying to address a recovery scenario after Master crash. > > In a simple Master - Slave replication setup fo

[jira] [Resolved] (HBASE-9040) TestReplicationKillMasterRSCompressed.killOneMasterRS

2013-07-25 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-9040. --- Resolution: Duplicate This is the same as HBASE-8615. I'm trying to repro unde

[jira] [Created] (HBASE-9038) Compaction WALEdit gives NPEs with Replication enabled

2013-07-24 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9038: - Summary: Compaction WALEdit gives NPEs with Replication enabled Key: HBASE-9038 URL: https://issues.apache.org/jira/browse/HBASE-9038 Project: HBase

Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download

2013-07-24 Thread Jean-Daniel Cryans
Yeah AFAIK it's almost always been like this. J-D On Wed, Jul 24, 2013 at 11:17 AM, lars hofhansl wrote: > Thanks Stack! > > Hmm... That log message is not new. That's a pretty small block cache, so > probably needs to evict often. > Could be a little less verbose about it, or make this trace.

[jira] [Created] (HBASE-9033) Add tracing to ReplicationSource and enable it in tests

2013-07-23 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9033: - Summary: Add tracing to ReplicationSource and enable it in tests Key: HBASE-9033 URL: https://issues.apache.org/jira/browse/HBASE-9033 Project: HBase

Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download

2013-07-23 Thread Jean-Daniel Cryans
Tried out the secure tar on a single node, ran some PE, +1 J-D On Fri, Jul 19, 2013 at 2:33 PM, lars hofhansl wrote: > The 1st 0.94.10 RC is available for download at > http://people.apache.org/~larsh/hbase-0.94.10-rc0/ > Signed with my code signing key: C7CFE328 > > Like the previous point re

[jira] [Created] (HBASE-9021) Create a unit test for ReplicationHLogReaderManager

2013-07-22 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-9021: - Summary: Create a unit test for ReplicationHLogReaderManager Key: HBASE-9021 URL: https://issues.apache.org/jira/browse/HBASE-9021 Project: HBase

[jira] [Resolved] (HBASE-8975) NPE/HTTP 500 when opening the master's web UI too early

2013-07-19 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-8975. --- Resolution: Fixed Hadoop Flags: Reviewed Committed to 0.95 and trunk, thanks

[jira] [Resolved] (HBASE-8855) TestTableInputFormatScan1/2 fail semi-silently with the hadoop 2 profile

2013-07-18 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-8855. --- Resolution: Fixed Assignee: Jean-Daniel Cryans Release Note: Unit tests

[jira] [Reopened] (HBASE-8983) HBaseConnection#deleteAllConnections does not always delete

2013-07-18 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans reopened HBASE-8983: --- I attached a new patch where in MiniHBaseCluster I pass

[jira] [Resolved] (HBASE-8988) Reuse the thread pool in the shell to not run out of threads

2013-07-18 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans resolved HBASE-8988. --- Resolution: Fixed Hadoop Flags: Reviewed Committed to trunk and branch, thanks

[jira] [Created] (HBASE-8988) Reuse the thread pool in the shell to not run out of threads

2013-07-18 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-8988: - Summary: Reuse the thread pool in the shell to not run out of threads Key: HBASE-8988 URL: https://issues.apache.org/jira/browse/HBASE-8988 Project: HBase

[jira] [Created] (HBASE-8987) ProtobufUtil.toException doesn't handle plain RemoteException, gets a NoSuchMethodException

2013-07-18 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-8987: - Summary: ProtobufUtil.toException doesn't handle plain RemoteException, gets a NoSuchMethodException Key: HBASE-8987 URL: https://issues.apache.org/jira/browse/

  1   2   3   4   5   6   7   >