Re: FileNotFoundException

2012-06-03 Thread Nitin Pawar
settings. What I do wrong? How can I fix it? Thank you! Best regards Mezentsev Pavel Russia -- Nitin Pawar

Re: HADOOP_HOME

2012-06-02 Thread Nitin Pawar
Use export command On Jun 2, 2012 2:50 PM, Babak Bastan babak...@gmail.com wrote: Hello experts How can I set HADOOP _HOME? in which file I can find this variable? I should set this variable with the path in that I downloaded hadoop? thank you so much

Re: Hive UDF error : numberformat exception (String to Integer) conversion

2012-05-30 Thread Nitin Pawar
not able to use the string into int in my java. Very strange issue. Can someone please tell me what stupid mistake I am doing ? Is there any other UDF that does string to int/long coversion ? Regards, Praveenesh -- Nitin Pawar

Re: dynamic partition import

2012-05-29 Thread Nitin Pawar
: dynamic partition import Is there anything interesting in the datanode logs? Phil. On 29 May 2012 10:37, Nitin Pawar nitinpawar...@gmail.com wrote: can you check atleast one datanode is running and is not part of blacklisted nodes On Tue, May 29, 2012 at 3:01 PM, Nimra Choudhary nim

Re: odd header behavior?

2012-05-26 Thread Nitin Pawar
? Thanks, Stephen -- Nitin Pawar

Re: start hive cli error

2012-05-22 Thread Nitin Pawar
(RunJar.java:156) -- Nitin Pawar

Re: Multi Table Join count Distinct

2012-05-21 Thread Nitin Pawar
not giving distinct value count SELECT C1,C2,C3 ,COUNT(DISTINCT B.C2) C2_CNT ,COUNT(C.C2) CC_CNT FROM TABLE_A A JOIN TABLE_B B on (A.C1=B.C1 ) left outer join TABLE_C C on (B.C2 = C.C2 ) group by C1,C2,C3 -- Nitin Pawar

Re: Is my Use Case possible with Hive?

2012-05-15 Thread Nitin Pawar
, Nitin Pawar nitinpawar...@gmail.comwrote: partitioning is mainly used when you want to access the table based on value of a particular column and dont want to go through entire table for same operation. This actually means if there are few columns whose values are repeated in all the records

Re: Date format - any easier way

2012-05-15 Thread Nitin Pawar
you! Zoltan -- Nitin Pawar

Re: Date format - any easier way

2012-05-15 Thread Nitin Pawar
zoltan.tothczi...@softonic.com wrote: Nitin, Thank you. As you see below I know and use this function. My problem is that it doesn't give MMDD format, but -MM-DD instead, and formatting is not trivial as you can see it too. -- *From:* Nitin Pawar [nitinpawar

Re: Date format - any easier way

2012-05-15 Thread Nitin Pawar
problem is that it doesn't give MMDD format, but -MM-DD instead, and formatting is not trivial as you can see it too. -- *From:* Nitin Pawar [nitinpawar...@gmail.com] *Sent:* Tuesday, May 15, 2012 3:24 PM *To:* user@hive.apache.org *Subject:* Re: Date

Re: Is my Use Case possible with Hive?

2012-05-14 Thread Nitin Pawar
?* If possible what should I do in my program to increase the performance? *And If not possible what is the other good way to implement this Use Case?* Please reply me. Thanks -- Regards, Bhavesh Shah -- Nitin Pawar

Re: Is my Use Case possible with Hive?

2012-05-14 Thread Nitin Pawar
also tried this on Amazon Elastic Mapreduce with 10 nodes. But the time taken to execute the complete program is same as that on my single local machine. On Mon, May 14, 2012 at 1:13 PM, Nitin Pawar nitinpawar...@gmail.comwrote: how many # records? what is your hadoop cluster setup? how

Re: Is my Use Case possible with Hive?

2012-05-14 Thread Nitin Pawar
. :) -- Regards, Bhavesh Shah On Mon, May 14, 2012 at 2:07 PM, Nitin Pawar nitinpawar...@gmail.comwrote: with a 10 node cluster the performance should improve. how many maps and reducers are being launched? On Mon, May 14, 2012 at 1:18 PM, Bhavesh Shah bhavesh25s...@gmail.comwrote: I have near

Re: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.MapRedTask

2012-05-09 Thread Nitin Pawar
the query issued through the JDBC driver doesn't get scheduled in a stipulated amount of time. Has anyone seen a similar error before? How did you fix it? Thank you in advance, Mark Mark Grover, Business Intelligence Analyst OANDA Corporation www: oanda.com www: fxtrade.com -- Nitin Pawar

Re: Want to improve the performance for execution of Hive Jobs.

2012-05-07 Thread Nitin Pawar
for it as I don't know? -- Regards, Bhavesh Shah On Tue, May 8, 2012 at 10:31 AM, Nitin Pawar nitinpawar...@gmail.comwrote: 1) check the jobtracker url to see how many maps/reducers have been launched 2) if you have a large dataset and wants to execute it fast, you set mapred.min.split.size

Re: ENV variables from CLI

2012-05-03 Thread Nitin Pawar
the location of the jar file. What are my options ? Generating the .hiverc file everytime there s a change can only a second-best option . Sam William sa...@stumbleupon.com -- Nitin Pawar

Re: Any column search in HIVE

2012-04-30 Thread Nitin Pawar
and review by persons other than the intended recipient. Thank you. -- Nitin Pawar

Re: Any column search in HIVE

2012-04-30 Thread Nitin Pawar
in a row is not comma separated. ** ** How can we achieve this. ** ** ** ** Thanks Regards, *Rinku Garg* *From:* Nitin Pawar [mailto:nitinpawar...@gmail.com] *Sent:* 30 April 2012 12:18 *To:* user@hive.apache.org *Subject:* Re: Any column search in HIVE

Re: Error related Hadoop while running Amazon EMR Job

2012-04-26 Thread Nitin Pawar
be the reason while SHUTTING DOWN the Job Flow in AMazon EMR? Many Thanks. -- Regards, Bhavesh Shah -- Nitin Pawar

Re: When/how to use partitions and buckets usefully?

2012-04-24 Thread Nitin Pawar
on this subject but I can’t really seem to find them!? Any help would be appreciated, thanks in advance J -- Nitin Pawar

Re: Possible to use regex column specification with WHERE clause?

2012-04-24 Thread Nitin Pawar
'; where $1 represents a column that was matched by the regex. Any ideas? Thanks, Thomas Ryabin -- Nitin Pawar

Re: When/how to use partitions and buckets usefully?

2012-04-24 Thread Nitin Pawar
hiveSET hive.optimize.bucketmapjoin=true https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Joins Regards Bejoy From: Nitin Pawar nitinpawar...@gmail.com To: user@hive.apache.org Sent: Tuesday, April 24, 2012 12:46 PM Subject: Re: When/how

Re: Possible to use regex column specification with WHERE clause?

2012-04-24 Thread Nitin Pawar
purposes. - The following query select all columns except ds and hr. SELECT `(ds|hr)?+.+` FROM sales Shashwat Shripar On Tue, Apr 24, 2012 at 1:00 PM, Nitin Pawar nitinpawar...@gmail.comwrote: you may want to have a programmatic approach for doing this and provide hive with a final

Re: removing hdfs table data directory does not throw error in hive

2012-04-24 Thread Nitin Pawar
. -Sukhendu On Mon, Apr 23, 2012 at 8:28 PM, Nitin Pawar nitinpawar...@gmail.com wrote: hive table meta data is stored into a meta data store which will retain the table structure and other meta info even if you delete hdfs table directory as its stored in metadata store db. When you

Re: removing hdfs table data directory does not throw error in hive

2012-04-23 Thread Nitin Pawar
an error when the underlying table file is removed ? -Sukhendu -- Nitin Pawar

Re: nested UDFs on Partition column

2012-04-19 Thread Nitin Pawar
the query. Is this behaviour intentional ? And is there a workaround other than hardcoding the date or using a param? Thanks, Ramkumar -- Nitin Pawar

Re: how to split the value of hbase into hive

2012-04-18 Thread Nitin Pawar
a problem. I have an hbase table, with key-value pair like user1001:12,1223,string. And now how can I split the value into three fields ID,phone,and memo and then insert into hive table? does hive support this? thanks 2012-04-18 -- Andes ** -- Nitin Pawar

Re: Re: how to split the value of hbase into hive

2012-04-18 Thread Nitin Pawar
-- ** Best Regards Andes ** -- *发件人:*Nitin Pawar *发送时间:*2012-04-18 15:43 *主题:*Re: how to split the value of hbase into hive *收件人:*useruser@hive.apache.org *抄送:* you can use the inbuilt udf split(string str, string pat

Re: Incremental import from PostgreSQL to Hive having issues

2012-04-13 Thread Nitin Pawar
) at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57) According to the above, it identify the updated data from postgreSQL, but it says output directory already exists. Could someone please help me to correct this issue. Thanks. -- Nitin Pawar

Re: Incremental import from PostgreSQL to Hive having issues

2012-04-13 Thread Nitin Pawar
wrote: Hadoop - 0.20.2 Hive - 0.8.1 Thanks. On Fri, Apr 13, 2012 at 5:03 PM, Nitin Pawar nitinpawar...@gmail.comwrote: can you tell us what is 1) hive version 2) hadoop version that you are using? On Fri, Apr 13, 2012 at 12:23 PM, Roshan Pradeep codeva...@gmail.comwrote: Hi I

Re: Lag function in Hive

2012-04-11 Thread Nitin Pawar
(registered no. 1026167). Registered Office: 1 Churchill Place, London, E14 5HP, United Kingdom. Barclays Bank PLC is authorised and regulated by the Financial Services Authority. -- Nitin Pawar

Re: Why BucketJoinMap consume too much memory

2012-04-05 Thread Nitin Pawar
,* ** ** ** ** ** ** -- Nitin Pawar

Re: Why BucketJoinMap consume too much memory

2012-04-05 Thread Nitin Pawar
Exception in thread Thread-1 java.lang.OutOfMemoryError: Java heap space ** ** *Best regards* Nguyen Thanh Binh (Mr) Cell phone: (+84)98.226.0622 ** ** *From:* Nitin Pawar [mailto:nitinpawar...@gmail.com] *Sent:* Thursday, April 05, 2012 5:36 PM *To:* user@hive.apache.org

Re: Initializing hive sessions with Jars/temp functions

2012-04-05 Thread Nitin Pawar
are my options ? Sam William sa...@stumbleupon.com -- Nitin Pawar

Re: Table Statistics In Hive

2012-04-03 Thread Nitin Pawar
I do a DESCRIBE EXTENDED [TABLENAME] after the stats collection has been completed, I see the number of rows is still 0. Is there anything I am missing here? I am using Hive 0.7.1 Thanks Anand -- Nitin Pawar

Re: How to check for year condition in hive

2012-04-02 Thread Nitin Pawar
-- Nitin Pawar

Re: Hive Queries Performance Tuning - Map side joins, Map side aggregations, Partitioning/Clustering

2012-04-01 Thread Nitin Pawar
on. Are there any other parameters or Hive features that can help improve the performance of Hive queries. Thanks Anand ** ** -- Nitin Pawar

Re: sqoop question - could not post- the message came back undeplivered

2012-03-29 Thread Nitin Pawar
know if this is possible? I could have sworn it was but can't find any mention of some OUTPUT TO clause on the Hive Wiki. Many thanks, Paul -- Nitin Pawar

Re: sqoop question - could not post- the message came back undeplivered

2012-03-29 Thread Nitin Pawar
limit. It looks like sqoop exporting kind of merge all the rows. (rows * number of columns 2100). ** ** Thank you, Chalcy ** ** *From:* Nitin Pawar [mailto:nitinpawar...@gmail.com] *Sent:* Thursday, March 29, 2012 10:03 AM *To:* user@hive.apache.org *Subject:* Re: sqoop

Re: What is the rule of job name generation in Hive?

2012-03-22 Thread Nitin Pawar
,neighborid(Stage-4) What is the rule of generating such a name? -- Nitin Pawar

Re: need some Clarification about tmp folder(urgent)

2012-03-13 Thread Nitin Pawar
/ * Is it part of data stored in hdfs or its just a temporary data , which left after killing queries. regards Vikas Srivastava -- Nitin Pawar

Re: Why the name HIVE?

2012-02-26 Thread Nitin Pawar
., == Cell: +91-9902382263 Alt Email: bkchandan...@yahoo.com -- Nitin Pawar

<    1   2   3   4   5