Re: Exceptions while running Hive

2013-11-10 Thread Sonal Goyal
on it. Thank you for your time. > > > Regards > VN > From: Sonal Goyal > Reply-To: "user@hive.apache.org" > Date: Thursday, November 7, 2013 10:50 AM > To: "user@hive.apache.org" > Subject: Re: Exceptions while running Hive > > Does your

Re: Exceptions while running Hive

2013-11-07 Thread Sonal Goyal
Does your hive classpath contain the jar having com.dyuproject.protostuff.Schema ? Best Regards, Sonal Nube Technologies On Thu, Nov 7, 2013 at 9:16 PM, Narla,Venkatesh wrote: > Hello, > > > I am getting the following exceptio

Re: Where to get hive serde jars.

2013-10-16 Thread Sonal Goyal
You can get the ser de from https://github.com/cloudera/cdh-twitter-example. I am not sure if there is a prebuilt version in any Cloudera repo, but you can check with the Cloudera team. Sent from my iPad On Oct 16, 2013, at 7:12 PM, Panshul Whisper wrote: > Hello, > > I am trying to imple

Re: Hive to HDFS directly using INSERT OVERWRITE DIRECTORY Imcompatible issue

2013-10-14 Thread Sonal Goyal
You could create an external table at a location of your choice with the format desired. Then do a select into the table. The data at the location of your table will be in the format you desire, which you can copy over. Best Regards, Sonal Nube Technologies

Re: Wikipedia Dump Analysis..

2013-10-08 Thread Sonal Goyal
t;> not.one thing which came to mind was tracking contributors and just thought >> about that. >> >> Is it really possible? >> On 7 Oct 2013 11:13, "Ajeet S Raina" wrote: >> >>> I could see that revision history could be the target factor but

Re: How to load /t /n file to Hive

2013-10-06 Thread Sonal Goyal
Do you have the option to escape your tabs and newlines in your base file? Best Regards, Sonal Nube Technologies On Sat, Sep 21, 2013 at 12:34 AM, Raj Hadoop wrote: > Hi, > > I have a file which is delimted by a tab. Also, ther

Re: Wikipedia Dump Analysis..

2013-10-06 Thread Sonal Goyal
Sorry, where is the contributor information coming from? Best Regards, Sonal Nube Technologies On Thu, Oct 3, 2013 at 11:57 AM, Ajeet S Raina wrote: > > Hello, > > > > > > > > I have Hadoop running on HDFS with Hive installed.

Re: Hive Connection Pooling

2013-10-06 Thread Sonal Goyal
Yes, the Hive MetaStore does support JDBC connection pooling to the underlying metastore database. You can configure this in hive-site.xml datanucleus.connectionPoolingType DBCP Uses a DBCP connection pool for JDBC metastore In addition, you can also pool threads that service the reques

Re: how to treat an existing partition data file as a table?

2013-10-06 Thread Sonal Goyal
You can always alter your table to add partitions later on. See the syntax below https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-AddPartitions Best Regards, Sonal Nube Technologies On Tue, Oc

Re: how to treat an existing partition data file as a table?

2013-09-29 Thread Sonal Goyal
Is your table partitioned ? Sent from my iPad On Sep 30, 2013, at 2:09 AM, Yang wrote: > we have a huge table, including browsing data for the past 5 years, let's > say. > > now I want to take a few samples to play around with it. so I did > select * from mytable limit 10; > but it actually

Re: Twitter Data analyse with HIVE

2012-06-05 Thread Sonal Goyal
Lfs means local file system. Hadoop fs -copyFromLocal will help to copy data from your local file system to the Hadoop distributed file system. Not sure what kind of cluster setup you have, are you running in local or pseudo distributed mode? Here is a link to get you started on hive https://c

Re: Data migration in Hadoop

2011-09-13 Thread Sonal Goyal
lance the load. > 2:- free any 1 node(repalcement node). > > question:- does the imbalance size in cluster is of any datanode create a > problem...or have any bad impact > > regards > Vikas Srivastava > > > On Tue, Sep 13, 2011 at 5:37 PM, Sonal Goyal wrote: > >

Re: Data migration in Hadoop

2011-09-13 Thread Sonal Goyal
Hi Vikas, This was discussed in the groups recently: http://lucene.472066.n3.nabble.com/Fixing-a-bad-HD-tt2863634.html#none Are you looking at replacing all your datanodes, or only a few? how big is your cluster? Best Regards, Sonal Crux: Reporting for HBase

Re: Opposite of explode?

2011-02-10 Thread Sonal Goyal
Is collect_set what you are looking for? I havent used it myself, but it seems to remove the duplicates.. http://wiki.apache.org/hadoop/Hive/LanguageManual/UDF#Built-in_Aggregate_Functions_.28UDAF.29 Thanks and Regards, Sonal Connect Hadoop with databases, Sale

Re: hive newbie - importing data into hive

2010-12-14 Thread Sonal Goyal
Sean, You can refer to http://wiki.apache.org/hadoop/Hive/LanguageManual/DDL#Create.2BAC8-Drop_Table You can define the ROW FORMAT DELIMITED as part of the table definition and then load your data into the table. Thanks and Regards, Sonal Connect Hadoop with d

Re: Only a single expression in the SELECT clause is supported with UDTF's

2010-11-08 Thread Sonal Goyal
Hi Tim, I guess you are running into limitations while using UDTFs. Check http://wiki.apache.org/hadoop/Hive/LanguageManual/UDF#UDTF. I think you should be able to use lateral view in your query. Thanks and Regards, Sonal Sonal Goyal | Founder and CEO | Nube Technologies LLP http

Re: Unions causing many scans of input - workaround?

2010-11-07 Thread Sonal Goyal
Hey Tim, You have an interesting problem. Have you tried creating a UDTF for your case, so that you can possibly emit more than one record for each row of your input? http://wiki.apache.org/hadoop/Hive/DeveloperGuide/UDTF Thanks and Regards, Sonal Sonal Goyal | Founder and CEO | Nube

Hive and Hadoop 0.21.0

2010-10-22 Thread Sonal Goyal
Hi, I need to get Hive working on a 0.21.0 Hadoop cluster. Can someone please let me know how it can be done. I tried HIVE-1612 but it did not work for me. Am I missing something? Thanks and Regards, Sonal Sonal Goyal | Founder and CEO | Nube Technologies LLP http://www.nubetech.co | http