Re: 答复: 答复: Should we set the property "hbase.local.dir" to a list of directories on different disks to spread I/O?

2013-12-20 Thread Tao Xiao
To all: Thank you all. Now I understand how to set "hbase.local.dir" and the reason 2013/12/20 Jean-Marc Spaggiari > Barath's respons is a good summary. > > There almost nothing going into hbase.local.dir. It's like in your local > linux box. You don't specify more than one tmp di

Re: ANNOUNCE: hbase-0.96.1.1 available for download.

2013-12-20 Thread Ted Yu
Steve is on vacation. bq. which version of hbase is expected to contain the Hoya stuff? HBase and Hoya are separate projects. You can use 0.96.1.1 tar ball in Hoya deployment. Cheers On Fri, Dec 20, 2013 at 6:01 AM, Jay Vyas wrote: > ... I assume you mean the latest hdfs versions... Since hb

Re: ANNOUNCE: hbase-0.96.1.1 available for download.

2013-12-20 Thread Biju G.S Nair
Tried to run a simple program using 0.96 Hadoop2 against Hadoop 2 cluster and getting errors about some cloudera class not found. Following are the details. Which other jars need to be included in the classpath? Executed Code: public static void main(String[] args) throws IOException { Confi

Re: ANNOUNCE: hbase-0.96.1.1 available for download.

2013-12-20 Thread Ted Yu
You need the following: htrace-core-2.04.jar Cheers On Fri, Dec 20, 2013 at 9:04 AM, Biju G.S Nair wrote: > Tried to run a simple program using 0.96 Hadoop2 against Hadoop 2 cluster > and getting errors about some cloudera class not found. Following are the > details. Which other jars need to

Re: Why so many unexpected files like partitions_xxxx are created?

2013-12-20 Thread Ted Yu
} catch (IOException e) { LOG.error("Encountered unrecoverable error from region server", e); The IOException came from region server. During execution of LoadIncrementalHFiles, there would be some error on region server. Cheers On Thu, Dec 19, 2013 at 10:18 PM, Tao Xiao wrote: > Hi

Re: ANNOUNCE: hbase-0.96.1.1 available for download.

2013-12-20 Thread Jean-Marc Spaggiari
Hi Jignesh, I'm running 0.96.1.1 on Hadoop 2.2.0. So far I have not seen anything wrong. But it's not yet a production cluster. JM 2013/12/20 Jay Vyas > ... I assume you mean the latest hdfs versions... Since hbase 96 doesn't > run on YARN container nodes yet. (See Hoya project which aims to

Re: ANNOUNCE: hbase-0.96.1.1 available for download.

2013-12-20 Thread Jay Vyas
... I assume you mean the latest hdfs versions... Since hbase 96 doesn't run on YARN container nodes yet. (See Hoya project which aims to port it over). While were on the subject... @steve which version of hbase is expected to contain the Hoya stuff? Sent from my iPhone > On Dec 20, 2013, at 8

Re: ANNOUNCE: hbase-0.96.1.1 available for download.

2013-12-20 Thread Jignesh Patel
Just curious !!! has anybody started using hbase-0.96.1.1 with hadoop 2.x? How stable it is? On Thu, Dec 19, 2013 at 6:39 PM, Elliott Clark wrote: > Thanks. > > Should we now go remove the 0.96.1 release from mirrors ? > > > On Thu, Dec 19, 2013 at 1:29 PM, Jonathan Hsieh wrote: > > > The HBas

Re: 答复: 答复: Should we set the property "hbase.local.dir" to a list of directories on different disks to spread I/O?

2013-12-20 Thread Jean-Marc Spaggiari
Barath's respons is a good summary. There almost nothing going into hbase.local.dir. It's like in your local linux box. You don't specify more than one tmp directory. It's the same thing here. There will not be really any benefit of adding that. 2013/12/20 Bharath Vissapragada > Hbase uses HDF

Re: 答复: 答复: Should we set the property "hbase.local.dir" to a list of directories on different disks to spread I/O?

2013-12-20 Thread Bharath Vissapragada
Hbase uses HDFS for data storage and region servers just use HDFS API to write files. So you should be looking at balancing disk IO at datanode level (dfs.datanode.data.dir as mentioned in other response). The path you mentioned (hbase.local.dir) is just used for storing temporary files or CP/dynam

答复: 答复: Should we set the property "hbase.local.dir" to a list of directories on different disks to spread I/O?

2013-12-20 Thread 谢良
maybe you have a misunderstanding about "hbase.local.dir", please refer to HBASE-6824 for why it was introduced. Thanks, 发件人: Tao Xiao [xiaotao.cs@gmail.com] 发送时间: 2013年12月20日 16:30 收件人: user 主题: Re: 答复: Should we set the property "hbase.local.dir" to

Re: 答复: Should we set the property "hbase.local.dir" to a list of directories on different disks to spread I/O?

2013-12-20 Thread Tao Xiao
Since "hbase.local.dir" specifes local directory, why doesn't it specify multiple directories on different disks to spread I/O, just as what "dfs.datanode.data.dir" does ? 2013/12/20 谢良 > Please take a look at "dfs.datanode.data.dir" in hdfs-site.xml. > P.S. "hbase.local.dir" supports one dir o

答复: Should we set the property "hbase.local.dir" to a list of directories on different disks to spread I/O?

2013-12-20 Thread 谢良
Please take a look at "dfs.datanode.data.dir" in hdfs-site.xml. P.S. "hbase.local.dir" supports one dir only, don't specify it with a list:) Thanks, 发件人: Tao Xiao [xiaotao.cs@gmail.com] 发送时间: 2013年12月20日 15:11 收件人: user 主题: Should we set the property "h