after QJM failover,hbase can not write

2014-11-27 Thread 聪聪
hi,there: I encount a problem,it let me upset. I use version of hadoop is hadoop-2.3.0-cdh5.1.0,namenode HA use the Quorum Journal Manager (QJM) feature ,dfs.ha.fencing.methods option is following: dfs.ha.fencing.methods sshfence shell(q_hadoop_fence.sh $target_h

Re: Newbie Question about 37TB binary storage on HDFS

2014-11-27 Thread Aleks Laz
Am 27-11-2014 21:05, schrieb Wilm Schumacher: Am 27.11.2014 um 20:44 schrieb Aleks Laz: [snipp] Please can you try to answer the questions below for hbase or should I subscribe to https://hbase.apache.org/mail-lists.html => User List and ask there? you should ask there, so we do not bothe

Re: Newbie Question about 37TB binary storage on HDFS

2014-11-27 Thread Wilm Schumacher
Am 27.11.2014 um 20:44 schrieb Aleks Laz: > After a quick look to > > https://hbase.apache.org/book/architecture.html#arch.overview > > this sounds a real option. > Is this in the current version? nope. You have to compile it into your hbase-version. But I didn't do any performance tests. You s

Re: Newbie Question about 37TB binary storage on HDFS

2014-11-27 Thread Aleks Laz
Hi. Am 27-11-2014 18:16, schrieb Wilm Schumacher: Hi, I would like to open up another option for you. You could pump the data into hbase directly. Together with https://issues.apache.org/jira/browse/HBASE-11339 this would be a good fit. Thank you. After a quick look to https://hbase.apache

Re: Newbie Question about 37TB binary storage on HDFS

2014-11-27 Thread Wilm Schumacher
Hi, I would like to open up another option for you. You could pump the data into hbase directly. Together with https://issues.apache.org/jira/browse/HBASE-11339 this would be a good fit. And I would like to ask a question of the mean size of the images. If it is ~10MB (large but normal sized ima

Re: Detailing on how UPDATE is performed in Hive

2014-11-27 Thread Yakubovich, Alexey
Thanks, Nalinj. From: Nitin Pawar mailto:nitinpawar...@gmail.com>> Reply-To: "user@hadoop.apache.org" mailto:user@hadoop.apache.org>> Date: Thursday, November 27, 2014 at 6:05 AM To: "user@hadoop.apache.org" mailto:user@hadoop.apache.

Newbie Question about 37TB binary storage on HDFS

2014-11-27 Thread Aleks Laz
Dear All. We have since ~2012 collected a lot of binary data (jpg's). The Storage hierarchy is like this. // /cams//2014/11/19/ The binary data are in the directory below ~1000 Files per directory and mounted with xfs. Due to the fact that the platform now grows up we n

Re: Detailing on how UPDATE is performed in Hive

2014-11-27 Thread Nitin Pawar
https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions entire implementation is under jira here https://issues.apache.org/jira/browse/HIVE-5317 On Thu, Nov 27, 2014 at 4:11 PM, unmesha sreeveni wrote: > Hi friends > Where can I find details on how update is performed in Hive. > >

Detailing on how UPDATE is performed in Hive

2014-11-27 Thread unmesha sreeveni
Hi friends Where can I find details on how update is performed in Hive. ​1. When an update is performed,whether HDFS will write that block elsewhere with the new value. 2. whether the old block is unallocated and is allowed for further writes. 3. Whether this process create fragmentation ? 4. wh