One question regarding bulk load

2014-04-07 Thread ashish singhi
Hi all. I have one question regarding bulk load. How to load data with table empty column values in few rows using bulk load tool ? I tried the following simple example in HBase 0.94.11 and Hadoop-2, with table having three columns and second column value is empty in few rows using bulk load t

RE: One question regarding bulk load

2014-04-07 Thread Kashif Jawed Siddiqui
Hi, Please check if your file contains empty lines(maybe in the beginning or the end). Since -Dimporttsv.skip.bad.lines=false is set, any empty lines will cause this error. Regards KASHIF -Original Message- From: ashish singhi [mailto:[email protected]] Sent: 0

Re: Hadoop Summit EU

2014-04-07 Thread Enis Söztutar
Me and Devaraj attended their talk on their solution for paxos based namenode and HBase replication. They have two solutions, one for single datacenter, and the other multi DC geo replication. For the namenode, there is a wrapper, called ConsistencyNode, that basically gets the requests, replicat

RE: One question regarding bulk load

2014-04-07 Thread ashish singhi
Yes. Thanks Kashif for pointing it out. There was an empty line at the end of the file. Regards Ashish -Original Message- From: Kashif Jawed Siddiqui [mailto:[email protected]] Sent: 07 April 2014 15:28 To: [email protected] Cc: [email protected] Subject: RE: One question regard

[jira] [Resolved] (HBASE-10920) HBase HConnectionManager.createConnection throws java.io.IOException: java.lang.reflect.InvocationTargetException

2014-04-07 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar resolved HBASE-10920. --- Resolution: Not a Problem TableMapReduceUtil methods should be setting the correct classpath

[jira] [Resolved] (HBASE-10817) Add some tests on a real cluster for replica: multi master, replication

2014-04-07 Thread Nicolas Liochon (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon resolved HBASE-10817. - Resolution: Fixed Hadoop Flags: Reviewed > Add some tests on a real cluster for re

[jira] [Created] (HBASE-10921) Port HBASE-10323 'Auto detect data block encoding in HFileOutputFormat' to 0.94 / 0.96

2014-04-07 Thread Ted Yu (JIRA)
Ted Yu created HBASE-10921: -- Summary: Port HBASE-10323 'Auto detect data block encoding in HFileOutputFormat' to 0.94 / 0.96 Key: HBASE-10921 URL: https://issues.apache.org/jira/browse/HBASE-10921 Project: H

[jira] [Created] (HBASE-10922) Log splitting seems to hang

2014-04-07 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HBASE-10922: --- Summary: Log splitting seems to hang Key: HBASE-10922 URL: https://issues.apache.org/jira/browse/HBASE-10922 Project: HBase Issue Type: Bug Component

[jira] [Created] (HBASE-10923) Control where to put meta region

2014-04-07 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HBASE-10923: --- Summary: Control where to put meta region Key: HBASE-10923 URL: https://issues.apache.org/jira/browse/HBASE-10923 Project: HBase Issue Type: Improvement

[jira] [Created] (HBASE-10924) [region_mover]: Adjust region_mover script to retry unloading a server a configurable number of times in case of region splits/merges

2014-04-07 Thread Aleksandr Shulman (JIRA)
Aleksandr Shulman created HBASE-10924: - Summary: [region_mover]: Adjust region_mover script to retry unloading a server a configurable number of times in case of region splits/merges Key: HBASE-10924 URL: htt

Re: Hadoop Summit EU

2014-04-07 Thread Enis Söztutar
Ops sorry this was intented for internal lists. Apologies for any confusion. Enis On Monday, April 7, 2014, Enis Söztutar wrote: > Me and Devaraj attended their talk on their solution for paxos based > namenode and HBase replication. > > They have two solutions, one for single datacenter, and t

[jira] [Resolved] (HBASE-10816) CatalogTracker abortable usage

2014-04-07 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang resolved HBASE-10816. - Resolution: Won't Fix I looked into it, and prefer not to do anything for now. > CatalogTracker

HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread Jim Huang
I am looking at the 0.94 branch and I have noticed that the overloaded methods for "initTableMapperJob" behaves differently in that one of them calls the "initCredentials(job);" while the others don't. For people who are using Kerberos security on their cluster, the initCredentials(job) sets up th

[jira] [Created] (HBASE-10925) Do not OOME, throw RowTooBigException instead

2014-04-07 Thread stack (JIRA)
stack created HBASE-10925: - Summary: Do not OOME, throw RowTooBigException instead Key: HBASE-10925 URL: https://issues.apache.org/jira/browse/HBASE-10925 Project: HBase Issue Type: Bug R

Re: HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread Ted Yu
You are talking about this method, right ? public static void initTableMapperJob(List scans, Class mapper, Class outputKeyClass, Class outputValueClass, Job job, boolean addDependencyJars) throws IOException { Looks like it should call initCredentials(job) as well. On

Re: HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread Nick Dimiduk
I vaguely recall a ticket being raised and committed for this problem, but the bug is clearly present and I'm not finding the issue. Maybe @larsh recalls? On Mon, Apr 7, 2014 at 2:48 PM, Ted Yu wrote: > You are talking about this method, right ? > > public static void initTableMapperJob(List

Re: HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread Ted Yu
Looking at references to this method, it is used by MultiTableInputFormat. It seems the next step is to enable MultiTableInputFormat in secure cluster. Cheers On Mon, Apr 7, 2014 at 2:48 PM, Ted Yu wrote: > You are talking about this method, right ? > > public static void initTableMapperJob

Re: Hadoop Summit EU

2014-04-07 Thread Mikhail Antonov
Well...Since that was mentioned anyway, allow me a tiny correction/clarification.. :) It's ConsensusNode, not ConsistencyNode, and it's not really custom Paxos implementation, it's more like interface for coordination service atop standard NameNode, which may be backed by any consensus library/alg

Bringing consensus based strong consistency into HBase

2014-04-07 Thread Konstantin Boudnik
Guys, As some of you might have noticed there is a number of new JIRAs opened recently that are aiming on abstracting and separating ZK out of HBase guts and making it an implementation detail, rather than a center of attention for some parts of the HBase. I would like to send around a short docu

[jira] [Created] (HBASE-10926) Use global procedure to flush table memstore cache

2014-04-07 Thread Jerry He (JIRA)
Jerry He created HBASE-10926: Summary: Use global procedure to flush table memstore cache Key: HBASE-10926 URL: https://issues.apache.org/jira/browse/HBASE-10926 Project: HBase Issue Type: Improv

Re: HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread Jim Huang
Yes, that's precisely the method that should get initCredentials(job) as well. All the other overloaded methods with table are covered. On Mon, Apr 7, 2014 at 2:48 PM, Ted Yu wrote: > You are talking about this method, right ? > > public static void initTableMapperJob(List scans, > Clas

Re: HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread liushaohui
Please see https://issues.apache.org/jira/browse/HBASE-10692 This issue is about this problem. May someone help to push it ? Thanks. - Shaohui Liu On 04/08/2014 05:48 AM, Ted Yu wrote: You are talking about this method, right ? public static void initTableMapperJob(List scans, Cla

[jira] [Created] (HBASE-10927) Add undrain option to RollingRestart

2014-04-07 Thread Rishit Shroff (JIRA)
Rishit Shroff created HBASE-10927: - Summary: Add undrain option to RollingRestart Key: HBASE-10927 URL: https://issues.apache.org/jira/browse/HBASE-10927 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-10928) Add timerange support to thrift1

2014-04-07 Thread stack (JIRA)
stack created HBASE-10928: - Summary: Add timerange support to thrift1 Key: HBASE-10928 URL: https://issues.apache.org/jira/browse/HBASE-10928 Project: HBase Issue Type: Task Reporter: sta

Re: HBase 0.94 - TableMapReduceUtil class, overloaded method "initTableMapperJob" behaves differently

2014-04-07 Thread Jim Huang
Good to see this patch is already in action, so we can avoid others spending time on this once this is committed. On Mon, Apr 7, 2014 at 7:09 PM, liushaohui wrote: > Please see https://issues.apache.org/jira/browse/HBASE-10692 > > This issue is about this problem. > > May someone help to push i