RE: How to install hive?

Hi, You can also use a VM from Cloudera website : https://ccp.cloudera.com/display/SUPPORT/CDH+Downloads#CDHDownloads-CDH4PackagesandDownloads which includes Hive. Guillaume Polaert | Cyrès -Message d'origine- De : Mohammad Tariq [mailto:donta...@gmail.com] Envoyé : mercredi 6 juin 20

Re: subquery syntax error

The columns you ORDER BY must be SELECTed. If you don't want identifier2 in the output, you will need to wrap your query with another SELECT. Hope this helps. igor decide.com On Tue, Jun 5, 2012 at 10:53 PM, Avdeev V. M. wrote: > Hello! > > I can't understand what's wrong. > >drop table if

subquery syntax error

Hello! I can't understand what's wrong. drop table if exists t0; create table t0 (short_descr string) STORED AS SEQUENCEFILE; from ( select cast(2 as int) identifier2, short_descr area_name from t0) asdf select *--area_name order by identifier2 desc, area_name asc ; The query works fine

Re:Custom UDF in Python?

udfs need extends or implements the UDF class or other interface.so just java. At 2012-06-06 12:21:03,"Saurabh S" wrote: Is it possible to write Hive UDFs in Python? I googled but didn't find anything. I would be happy with RTFM replies if you can give link to the manual.

Custom UDF in Python?

Is it possible to write Hive UDFs in Python? I googled but didn't find anything. I would be happy with RTFM replies if you can give link to the manual.

Re: Multi-group-by select always scans entire table

Hi Jan, The quick answer is I don't know but may be someone else on the mailing list does:-) Looking at the wiki page for Lateral view( https://cwiki.apache.org/confluence/display/Hive/LanguageManual+LateralView), there was a problem related to predicate pushdown on UDTF's ( https://issues.apache.

Question on Archive, Shims & “hive.archive.har.parentdir.settable” setting

Hi Guys, While I am trying to understand the archive functionality/code in HIVE. I noticed that the default value of “hive.archive.har.parentdir.settable” setting is false. But shim is using this setting to pass one of the mandatory argument “–P” to HadoopArchives class. Is there any place wher

Re: Need help running query over "yesterday". getting "No partition predicate found" errors

Thanks, Mark. I was hoping the expressions could be evaluated at query time, but generating the query works just as well. On Mon, Jun 4, 2012 at 7:42 PM, Mark Grover wrote: > Hi Matthew, > unix_timestamp() is being executed on the Hive server in your case. > Therefore, as your query progresses,

Re: How to install hive?

Hi Rafael, Just download Hive from apache and set all the variables properly, and you are good to go. For detailed help you can visit - "https://cwiki.apache.org/confluence/display/Hive/GettingStarted";... And this is the official wikipage - "https://cwiki.apache.org/confluence/display/Hive/Ho

How to install hive?

Hello everyone, I develop a scientific research for my college, where I conduct experiments involving hive and I wonder what is the easiest way to install the hive. I've tried installing using claudera, but I had trouble picking up the mirrors. I'd rather install it using ubuntu or other debian

Re: Developing Hive UDF in eclipse

Put hive-exec*.jar in your eclipse classpath. (project properties-> java build path -> libraries) On Tue, Jun 5, 2012 at 8:52 AM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > Did you try this[1]? It had got me most of my way through the process. > > [1] https://cwiki.apache.o

Re: Error while Creating Table in Hive

no I'm not working on CDH.Is there a way to test if my Hadoop works fine or not? On Tue, Jun 5, 2012 at 9:55 PM, Bejoy KS wrote: > ** > Hi Babak > > You gotta follow those instructions in the apace site to set up hadoop > from scratch and ensure that hdfs is working first. You should be able to

Re: Error while Creating Table in Hive

Hi Babak You gotta follow those instructions in the apace site to set up hadoop from scratch and ensure that hdfs is working first. You should be able to read and write files to hdfs before you do your next steps. Are you on CDH or apache distribution of hadoop? If it is CDH there are detailed

Re: Error while Creating Table in Hive

@Bejoy: I set the fs.default.name in the core-site.xml and I did all of thing that was mentioned in the reference but no effect On Tue, Jun 5, 2012 at 8:43 PM, Babak Bastan wrote: > Ok sorry but that was my Mistake .I thought it works but no. > I wrote the command without ; and then I think It w

Re: Error while Creating Table in Hive

Ok sorry but that was my Mistake .I thought it works but no. I wrote the command without ; and then I think It works but with ; at the end of command CREATE TABLE pokes (foo INT, bar STRING); does'nt work On Tue, Jun 5, 2012 at 8:34 PM, shashwat shriparv wrote: > inside configuration. all pro

Re: Error while Creating Table in Hive

inside configuration. all properties will be inside the configuration tags On Tue, Jun 5, 2012 at 11:53 PM, Babak Bastan wrote: > Thank you so much my friend your idee works fine(no error) you are the > best :) > > > On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan wrote: > >> It must be inside the

Re: Error while Creating Table in Hive

Thank you so much my friend your idee works fine(no error) you are the best :) On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan wrote: > It must be inside the or outside this? > > > On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv < > dwivedishash...@gmail.com> wrote: > >> It will be inside hive/c

Re: Error while Creating Table in Hive

It must be inside the or outside this? On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv wrote: > It will be inside hive/conf > > > On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan wrote: > >> Thanks sShashwat, and where is this hive-site.xml >> >> On Tue, Jun 5, 2012 at 8:02 PM, shashwat shripar

Re: Error while Creating Table in Hive

/etc/hive/conf/hive-site.xml check out at above folder there you make changes for help i am sending you link https://ccp.cloudera.com/display/CDHDOC/Hive+Installation On Tue, Jun 5, 2012 at 11:45 PM, shashwat shriparv < dwivedishash...@gmail.com> wrote: > It will be inside hive/conf > > > On T

Re: Error while Creating Table in Hive

It will be inside hive/conf On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan wrote: > Thanks sShashwat, and where is this hive-site.xml > > On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv < > dwivedishash...@gmail.com> wrote: > >> set >> >> hive.metastore.warehouse.dir in hive-site.xml >> >> >>

Re: Error while Creating Table in Hive

Thanks sShashwat, and where is this hive-site.xml On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv wrote: > set > > hive.metastore.warehouse.dir in hive-site.xml > > > hive.metastore.local > true > > > hive.metastore.warehouse.dir >/home//hivefolder >locati

Re: Error while Creating Table in Hive

set hive.metastore.warehouse.dir in hive-site.xml hive.metastore.local true hive.metastore.warehouse.dir /home//hivefolder location of default database for the warehouse On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan wrote: > Hello Experts , > > I'm

Re: Error while Creating Table in Hive

HI Babak It looks like a hadoop configuration problem for me. Have you configured your 'fs.default.name'  in core-site.xl to point to hdfs:// instead of file:/// ? If not that is likely to be the issue. Also if you are usinh hdfs for first time there are other steps like formatting namenode and

Re: Twitter Data analyse with HIVE

Hi Babak Looks like your hadoop is not configured correctly. The list gives me a pulse that it is showing lfs rather than hdfs.  Have you configured your 'fs.default.name'  in core-site.xl to point to hdfs:// instead of file:/// . You may need to revisit your hadoop setup. Try out the book I re

Error while Creating Table in Hive

Hello Experts , I'm new in Hive .When try to create a test Table in Hive I get an error.I want to run this command: *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* but this error occured: FAILED: Error in metadata: MetaException(message:Got exception: java.io.FileNotFoundException

Hive /w hbase-0.94.0

We're currently using hive-0.8.1 with hbase-0.92.0 and looking to rev both. Has anyone tried using hive with hbase-0.94.0? Is there a particular version of hive that we would need to use? The newer versions of hive look like they still have the 0.92 jars. Thanks Sean

Re: Twitter Data analyse with HIVE

Thank you Bejoy for your complete answer :) if I run this command: hadoop fs -ls / I get this results: drwxr-xr-x - root root 4096 2011-04-26 01:06 /var drwxrwxrwx - root root 4096 2012-06-05 18:38 /tmp drwxr-xr-x - root root 12288 2012-06-05 17:44 /etc -rw-r--r-- 1 root

Re: Twitter Data analyse with HIVE

Lfs means local file system. Hadoop fs -copyFromLocal will help to copy data from your local file system to the Hadoop distributed file system. Not sure what kind of cluster setup you have, are you running in local or pseudo distributed mode? Here is a link to get you started on hive https://c

Re: Twitter Data analyse with HIVE

Hi Babak In very simple terms, you have a set of machines on linux OS. You may have your files in that linux file system . From this linux file system you need to copy to hdfs. In hdfs create a directory like you do in normal systems which ought to be your destination directory. copy the file/d

RE: Twitter Data analyse with HIVE

If you type "hadoop fs -ls /" it will show you the folders that currently exist on your hadoop cluster. Regards, [02AXP_4C_grad] Anurag Gulati | Lead Programmer Analyst | Disruptive Innovation - Socializing Acquisition ' (602) 537-7265 | * anurag.gul...@aexp.com

Re: Twitter Data analyse with HIVE

Thank you for your answer location of file in lfs That means the location of my *txt file on my computer ? and I have no destination address in hdfs,where can I get this location? could you please write an example? On Tue, Jun 5, 2012 at 4:29 PM, Bejoy Ks wrote: > Hi Babak > > There isn't anythi

Re: Developing Hive UDF in eclipse

Did you try this[1]? It had got me most of my way through the process. [1] https://cwiki.apache.org/Hive/gettingstarted-eclipsesetup.html On Tue, Jun 5, 2012 at 8:49 AM, Arun Prakash wrote: > Hi Friends, > I tried to develop udf for hive but i am getting package import error > in eclipse. > > im

Re: getStructFieldData method on StructObjectInspector

Thanks Edward for your reply on this. Would you mind giving a very small example on how a struct corresponds to a Map? I am having hard time understanding what the K/V pairs in the map would look like. Thanks again. On Tue, May 29, 2012 at 10:16 AM, Edward Capriolo wrote: > Returning custom wri

Re: Twitter Data analyse with HIVE

Hi Babak There isn't anything called hdfs files. Hdfs is just a file system that can store any type of file. You just need to transfer your file from lfs to hdfs and the following command helps you out for that hadoop fs -copyFromLocal Regards Bejoy KS Fr

Re: Twitter Data analyse with HIVE

ok, no difference for me records in a line or not 2009-06-08 21:49:37 - http://twitter.com/ blablabla- I think data mining is awesome! 2009-06-08 21:49:37 - http://twitter.com/ bliblibli - I don’t think so. I don’t like data mining How

Re: Twitter Data analyse with HIVE

If you get output onto a single line it will be much easier for hive to process. On Tue, Jun 5, 2012 at 5:20 AM, Babak Bastan wrote: > Hi experts > > I'm very new in Hive and Hadoop and I want to create a very simple demo to > analyse sample twitts like this: > > T 2009-06-08 21:49:37 > U http://

Re: Multi-GroupBy-Insert optimization

Hi Shan, If you happen to have a lot of repeated data (in the most general grouping), you might get some speedup by little pre-aggregation. The following code should produce the same results as the example in your first post: >From ( SELECT a, b , c, count(*) AS cnt FROM X group by a,b,c )

Twitter Data analyse with HIVE

Hi experts I'm very new in Hive and Hadoop and I want to create a very simple demo to analyse sample twitts like this: T 2009-06-08 21:49:37 U http://twitter.com/evion W I think data mining is awesome! T 2009-06-08 21:49:37 U http://twitter.com/hyungjin W I don’t think so. I don’t like data mini