[jira] [Created] (HBASE-10374) add jemalloc into the choice of memstore allocation

2014-01-17 Thread Bing Jiang (JIRA)
Bing Jiang created HBASE-10374: -- Summary: add jemalloc into the choice of memstore allocation Key: HBASE-10374 URL: https://issues.apache.org/jira/browse/HBASE-10374 Project: HBase Issue Type:

Re: hbase pull request: 0.98

2014-01-17 Thread Ted Yu
Is there a JIRA for this feature ? HBase hasn't migrated to git repository yet. Submitting patch is the preferred way of contribution. Cheers On Jan 16, 2014, at 10:06 PM, yuchao86 g...@git.apache.org wrote: GitHub user yuchao86 opened a pull request:

Re: HBase 0.94.15: writes stalls periodically even under moderate steady load (AWS EC2)

2014-01-17 Thread Michael Segel
Guys, Trying to benchmark on AWS is a waste of time. You end up chasing ghosts. You want to benchmark, you need to isolate your systems to reduce extraneous factors. You need real hardware, real network in a controlled environment. Sent from a remote device. Please excuse any typos... Mike

Re: HBase 0.94.15: writes stalls periodically even under moderate steady load (AWS EC2)

2014-01-17 Thread Michael Segel
I need to apologize and clarify this statement… First, running benchmarks on AWS is ok, if you’re attempting to get a rough idea of how HBase will perform on a certain class of machines and you’re comparing m1.large to m1.xlarge or m3.xlarge … so that you can get a rough scale on sizing.

Re: 答复: 答复: HBase 0.94.15: writes stalls periodically even under moderate steady load (AWS EC2)

2014-01-17 Thread lars hofhansl
One other question: Did you give the RS the default 1000mb heap? For real work you have to increase that. Maybe try with 4000 or 8000 on those boxes. (In any case that will not solve any problem with unreachable or unavailable data nodes) -- Lars - Original Message - From: Vladimir

Re: [VOTE] The 1st hbase 0.94.16 release candidate is available for download

2014-01-17 Thread lars hofhansl
Thanks. Will release 0.94.16 today. -- Lars - Original Message - From: Jean-Marc Spaggiari jean-m...@spaggiari.org To: dev dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: Sent: Thursday, January 16, 2014 1:18 PM Subject: Re: [VOTE] The 1st hbase 0.94.16 release candidate is

[jira] [Created] (HBASE-10375) hbase-default.xml hbase.status.multicast.address.port does not match code

2014-01-17 Thread Jonathan Hsieh (JIRA)
Jonathan Hsieh created HBASE-10375: -- Summary: hbase-default.xml hbase.status.multicast.address.port does not match code Key: HBASE-10375 URL: https://issues.apache.org/jira/browse/HBASE-10375

Re: HBase 0.94.15: writes stalls periodically even under moderate steady load (AWS EC2)

2014-01-17 Thread Andrew Purtell
I generally agree. However, the High I/O and Cluster Compute types are HVM single tenant on the server, and the IO stack uses SR-IOV so MMIO and interrupts are directly going to the VM, and 10GE network paths with no traffic but your own. The locally attached storage is SSD. This is pretty close

Re: HBase 0.94.15: writes stalls periodically even under moderate steady load (AWS EC2)

2014-01-17 Thread Vladimir Rodionov
I just started ycsb on our real cluster: ./bin/ycsb load hbase -P workloads/load20m -p columnfamily=family -s -threads 100 -target 15000 This is beginning of a ycsb log on real grid run (looks even worse than on AWS): 10 sec: 150231 operations; 14984.14 current ops/sec; [INSERT

Re: HBase 0.94.15: writes stalls periodically even under moderate steady load (AWS EC2)

2014-01-17 Thread Nick Dimiduk
You can also grep your logs for entries from JvmPauseMonitor. When you're trying to track down an anomaly, it can help you locate the ballpark of at least when it happened. Correlate it back into your Ganglia, OpenTSDB, CloudWatch, c systems and look for more info. I think it makes a statement

Re: HBase 0.94.15: writes stalls periodically even under moderate steady load (AWS EC2)

2014-01-17 Thread Ted Yu
JvmPauseMonitor is not in 0.94 branch. Maybe HBASE-9630 should be backported to 0.94 ? Cheers On Fri, Jan 17, 2014 at 10:54 AM, Nick Dimiduk ndimi...@gmail.com wrote: You can also grep your logs for entries from JvmPauseMonitor. When you're trying to track down an anomaly, it can help you

[jira] [Reopened] (HBASE-10327) remove(K, V) of type PoolMapK,V has the same erasure

2014-01-17 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell reopened HBASE-10327: Assignee: Eric Charles remove(K, V) of type PoolMapK,V has the same erasure

Fwd: Where are we in ZOOKEEPER-1416

2014-01-17 Thread Andrew Purtell
What is going on with this thread over on dev@zookeeper? Bringing it to the attention of people over here. -- Forwarded message -- From: Ted Dunning ted.dunn...@gmail.com Date: Fri, Jan 17, 2014 at 2:41 PM Subject: Re: Where are we in ZOOKEEPER-1416 To: d...@zookeeper.apache.org

[jira] [Created] (HBASE-10376) Backport JvmPauseMonitor to 0.94 branch

2014-01-17 Thread Ted Yu (JIRA)
Ted Yu created HBASE-10376: -- Summary: Backport JvmPauseMonitor to 0.94 branch Key: HBASE-10376 URL: https://issues.apache.org/jira/browse/HBASE-10376 Project: HBase Issue Type: Task

[jira] [Created] (HBASE-10377) Add test for HBASE-10370 Compaction in out-of-date Store causes region split failure

2014-01-17 Thread Ted Yu (JIRA)
Ted Yu created HBASE-10377: -- Summary: Add test for HBASE-10370 Compaction in out-of-date Store causes region split failure Key: HBASE-10377 URL: https://issues.apache.org/jira/browse/HBASE-10377 Project:

[jira] [Resolved] (HBASE-10376) Backport JvmPauseMonitor to 0.94 branch

2014-01-17 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-10376. --- Resolution: Invalid Resolving as invalid -- unfortunately there is no 'silly' in the resolution drop down

[jira] [Resolved] (HBASE-10327) Remove remove(K, V) from type PoolMapK,V

2014-01-17 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-10327. Resolution: Fixed Fix Version/s: 0.99.0 Hadoop Flags: Reviewed Committed to

[jira] [Resolved] (HBASE-10370) Compaction in out-of-date Store causes region split failure

2014-01-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-10370. Resolution: Fixed Compaction in out-of-date Store causes region split failure

[jira] [Reopened] (HBASE-10371) Compaction creates empty hfile, then selects this file for compaction and creates empty hfile and over again

2014-01-17 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl reopened HBASE-10371: --- Lemme keep this open until we have committed to 0.94 and (I guess) 0.96. Compaction creates

Re: Where are we in ZOOKEEPER-1416

2014-01-17 Thread Stack
On Fri, Jan 17, 2014 at 2:53 PM, Andrew Purtell apurt...@apache.org wrote: What is going on with this thread over on dev@zookeeper? Bringing it to the attention of people over here. Ted? St.Ack -- Forwarded message -- From: Ted Dunning ted.dunn...@gmail.com Date: