Re: Data migration in Hadoop

thanks Ayon and sonal, one more thing *question:- does the imbalance size in cluster is of any datanode create a problem...or have any bad impact* Acc to what you are saying my cluster would be of 10 DN of (2tb hdd) and 1 DN of (8tb HDD) does this make any bad impact. please suggest.. this al

HBase and Hivehandler compatibly

Dear All, Hello I have Hadoop 0-20.2 append version and HBase-0.90.3. I am trying to build Hive 0.9.0-SNAPSHOT for aforementioned versions of Hadoop and HBase. I have to integrate Hive and HBase. For this purpose *I want to know about the compatibility of Hive 0.9.0-SNAPSHOT version with HBase-0.9

Re: Data migration in Hadoop

Vikas, I would suggest running the production clusters with replication factor of 3. Then you could decommission 2 nodes as Ayon suggests. Else one node at a time. Best Regards, Sonal Crux: Reporting for HBase Nube Technologies

Re: Change in serdeproperties does not update existing partitions

Thanks Ashutosh for your answer. I actually use external tables so that i don't drop my partitions data. This is still an odd behavior to me and I don't get why someone would expect it. Whenever I need to add a column to a table (my table here represent a log, and it is common to add fields to log

Re: Data migration in Hadoop

What you can do for each node: 1. decommission node (or 2 nodes if you want to do this faster). You can do this with the excludes file. 2. Wait for blocks to be moved off the decommed node(s) 3. Replace the disks and put them back in service. 4. Repeat until done.   -Ayon See My Photos on Flickr A

Re: Change in serdeproperties does not update existing partitions

Hey Maxime, Yeah, thats intended behavior. After you do alter on table, all subsequent actions on table and partitions will inherit from it. If you want to modify properties of already existing partitions, you should be able to do something like 'alter table test_table partition (day='2011-09-02')

Re: Hive issue

+ user@hive Siddharth, >> java.sql.SQLException: Method not supported >> at org.apache.hadoop.hive.jdbc.HiveConnection.createStatement(HiveConnection.java:207) Hive's jdbc implementation is not fully jdbc compliant yet and doesn't support all the features. Hope it helps, Ashutosh On Tue, Sep

Change in serdeproperties does not update existing partitions

Hello, I am using Hive 0.7 from cloudera cdh3u0 and I encounter a strange behavior when I update the serdeproperties of a table (for example for the RegexSerDe). If you have a simple partitioned table like create external table test_table ( id int) partitioned by (day string) row format serd

question about applying patch

Hi, I am trying to import sqlserver table in to hive table using sqoop. The import failed on nvarchar field. There is a patch released as per https://issues.apache.org/jira/browse/SQOOP-323?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel#issue-tabs. How do I apply this pat

Re: Data migration in Hadoop

hey sonal!! Actually right now we have 11 node cluster each having 8 disks of 3oogb and 8gb ram, now what we want to do is to replace those 300gb disks with 1 tb disks so that we can have more space per server. we have replication factor 2. my suggestion is .. 1:- Add a node of 8 tb in cluster

Re: Data migration in Hadoop

Hi Vikas, This was discussed in the groups recently: http://lucene.472066.n3.nabble.com/Fixing-a-bad-HD-tt2863634.html#none Are you looking at replacing all your datanodes, or only a few? how big is your cluster? Best Regards, Sonal Crux: Reporting for HBase

Data migration in Hadoop

HI , can ny1 tell me how we can migrate hadoop or replace old hard disks with new big size hdd. actually i need to replace old hdd of 300 tbs to 1 tb so how can i do this efficiently!!! ploblem is to migrate data from 1 hdd to other -- With Regards Vikas Srivastava DWH & Analytics Team Mob:+

how to run command in hive and script hive

Hello: I have analysis apache log from hive, but there is a problem When I write hive command in Script file and use crontab for schedule it The result is different with run in hive container The attachment file is 2 way process detail Hive_error.txt is run hive command in script Hiv