Re: HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread Jim Huang
Good to see this patch is already in action, so we can avoid others spending time on this once this is committed. On Mon, Apr 7, 2014 at 7:09 PM, liushaohui wrote: > Please see https://issues.apache.org/jira/browse/HBASE-10692 > > This issue is about this problem. > > May someone help to push i

[jira] [Created] (HBASE-10928) Add timerange support to thrift1

2014-04-07 Thread stack (JIRA)
stack created HBASE-10928: - Summary: Add timerange support to thrift1 Key: HBASE-10928 URL: https://issues.apache.org/jira/browse/HBASE-10928 Project: HBase Issue Type: Task Reporter: sta

[jira] [Created] (HBASE-10927) Add undrain option to RollingRestart

2014-04-07 Thread Rishit Shroff (JIRA)
Rishit Shroff created HBASE-10927: - Summary: Add undrain option to RollingRestart Key: HBASE-10927 URL: https://issues.apache.org/jira/browse/HBASE-10927 Project: HBase Issue Type: Bug

Re: HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread liushaohui
Please see https://issues.apache.org/jira/browse/HBASE-10692 This issue is about this problem. May someone help to push it ? Thanks. - Shaohui Liu On 04/08/2014 05:48 AM, Ted Yu wrote: You are talking about this method, right ? public static void initTableMapperJob(List scans, Cla

Re: HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread Jim Huang
Yes, that's precisely the method that should get initCredentials(job) as well. All the other overloaded methods with table are covered. On Mon, Apr 7, 2014 at 2:48 PM, Ted Yu wrote: > You are talking about this method, right ? > > public static void initTableMapperJob(List scans, > Clas

[jira] [Created] (HBASE-10926) Use global procedure to flush table memstore cache

2014-04-07 Thread Jerry He (JIRA)
Jerry He created HBASE-10926: Summary: Use global procedure to flush table memstore cache Key: HBASE-10926 URL: https://issues.apache.org/jira/browse/HBASE-10926 Project: HBase Issue Type: Improv

Bringing consensus based strong consistency into HBase

2014-04-07 Thread Konstantin Boudnik
Guys, As some of you might have noticed there is a number of new JIRAs opened recently that are aiming on abstracting and separating ZK out of HBase guts and making it an implementation detail, rather than a center of attention for some parts of the HBase. I would like to send around a short docu

Re: Hadoop Summit EU

2014-04-07 Thread Mikhail Antonov
Well...Since that was mentioned anyway, allow me a tiny correction/clarification.. :) It's ConsensusNode, not ConsistencyNode, and it's not really custom Paxos implementation, it's more like interface for coordination service atop standard NameNode, which may be backed by any consensus library/alg

Re: HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread Ted Yu
Looking at references to this method, it is used by MultiTableInputFormat. It seems the next step is to enable MultiTableInputFormat in secure cluster. Cheers On Mon, Apr 7, 2014 at 2:48 PM, Ted Yu wrote: > You are talking about this method, right ? > > public static void initTableMapperJob

Re: HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread Nick Dimiduk
I vaguely recall a ticket being raised and committed for this problem, but the bug is clearly present and I'm not finding the issue. Maybe @larsh recalls? On Mon, Apr 7, 2014 at 2:48 PM, Ted Yu wrote: > You are talking about this method, right ? > > public static void initTableMapperJob(List

Re: HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread Ted Yu
You are talking about this method, right ? public static void initTableMapperJob(List scans, Class mapper, Class outputKeyClass, Class outputValueClass, Job job, boolean addDependencyJars) throws IOException { Looks like it should call initCredentials(job) as well. On

[jira] [Created] (HBASE-10925) Do not OOME, throw RowTooBigException instead

2014-04-07 Thread stack (JIRA)
stack created HBASE-10925: - Summary: Do not OOME, throw RowTooBigException instead Key: HBASE-10925 URL: https://issues.apache.org/jira/browse/HBASE-10925 Project: HBase Issue Type: Bug R

HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread Jim Huang
I am looking at the 0.94 branch and I have noticed that the overloaded methods for "initTableMapperJob" behaves differently in that one of them calls the "initCredentials(job);" while the others don't. For people who are using Kerberos security on their cluster, the initCredentials(job) sets up th

[jira] [Resolved] (HBASE-10816) CatalogTracker abortable usage

2014-04-07 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang resolved HBASE-10816. - Resolution: Won't Fix I looked into it, and prefer not to do anything for now. > CatalogTracker

Re: Hadoop Summit EU

2014-04-07 Thread Enis Söztutar
Ops sorry this was intented for internal lists. Apologies for any confusion. Enis On Monday, April 7, 2014, Enis Söztutar wrote: > Me and Devaraj attended their talk on their solution for paxos based > namenode and HBase replication. > > They have two solutions, one for single datacenter, and t

[jira] [Created] (HBASE-10924) [region_mover]: Adjust region_mover script to retry unloading a server a configurable number of times in case of region splits/merges

2014-04-07 Thread Aleksandr Shulman (JIRA)
Aleksandr Shulman created HBASE-10924: - Summary: [region_mover]: Adjust region_mover script to retry unloading a server a configurable number of times in case of region splits/merges Key: HBASE-10924 URL: htt

[jira] [Created] (HBASE-10923) Control where to put meta region

2014-04-07 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HBASE-10923: --- Summary: Control where to put meta region Key: HBASE-10923 URL: https://issues.apache.org/jira/browse/HBASE-10923 Project: HBase Issue Type: Improvement

[jira] [Created] (HBASE-10922) Log splitting seems to hang

2014-04-07 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HBASE-10922: --- Summary: Log splitting seems to hang Key: HBASE-10922 URL: https://issues.apache.org/jira/browse/HBASE-10922 Project: HBase Issue Type: Bug Component

[jira] [Created] (HBASE-10921) Port HBASE-10323 'Auto detect data block encoding in HFileOutputFormat' to 0.94 / 0.96

2014-04-07 Thread Ted Yu (JIRA)
Ted Yu created HBASE-10921: -- Summary: Port HBASE-10323 'Auto detect data block encoding in HFileOutputFormat' to 0.94 / 0.96 Key: HBASE-10921 URL: https://issues.apache.org/jira/browse/HBASE-10921 Project: H

[jira] [Resolved] (HBASE-10817) Add some tests on a real cluster for replica: multi master, replication

2014-04-07 Thread Nicolas Liochon (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon resolved HBASE-10817. - Resolution: Fixed Hadoop Flags: Reviewed > Add some tests on a real cluster for re

[jira] [Resolved] (HBASE-10920) HBase HConnectionManager.createConnection throws java.io.IOException: java.lang.reflect.InvocationTargetException

2014-04-07 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar resolved HBASE-10920. --- Resolution: Not a Problem TableMapReduceUtil methods should be setting the correct classpath

RE: One question regarding bulk load

2014-04-07 Thread ashish singhi
Yes. Thanks Kashif for pointing it out. There was an empty line at the end of the file. Regards Ashish -Original Message- From: Kashif Jawed Siddiqui [mailto:kashi...@huawei.com] Sent: 07 April 2014 15:28 To: u...@hbase.apache.org Cc: dev@hbase.apache.org Subject: RE: One question regard

Re: Hadoop Summit EU

2014-04-07 Thread Enis Söztutar
Me and Devaraj attended their talk on their solution for paxos based namenode and HBase replication. They have two solutions, one for single datacenter, and the other multi DC geo replication. For the namenode, there is a wrapper, called ConsistencyNode, that basically gets the requests, replicat

RE: One question regarding bulk load

2014-04-07 Thread Kashif Jawed Siddiqui
Hi, Please check if your file contains empty lines(maybe in the beginning or the end). Since -Dimporttsv.skip.bad.lines=false is set, any empty lines will cause this error. Regards KASHIF -Original Message- From: ashish singhi [mailto:ashish.sin...@huawei.com] Sent: 0

One question regarding bulk load

2014-04-07 Thread ashish singhi
Hi all. I have one question regarding bulk load. How to load data with table empty column values in few rows using bulk load tool ? I tried the following simple example in HBase 0.94.11 and Hadoop-2, with table having three columns and second column value is empty in few rows using bulk load t