Re: Storing result of a query in a variable

2014-06-03 Thread Mohammad Tariq
Hi Chhaya, Try this : var=`hive -S -e "YOUR_HIVE_QUERY;"` *Warm regards,* *Mohammad Tariq* *cloudfront.blogspot.com <http://cloudfront.blogspot.com>* On Tue, Jun 3, 2014 at 4:47 PM, Chhaya Vishwakarma < chhaya.vishwaka...@lntinfotech.com> wrote: > ./hive -e --h

Re: alter table add more columns

2014-06-02 Thread Mohammad Tariq
Sorry for answering in a hurry. By "yes" I meant adding new partition value and not the partition column. @Ashish : Thanks for the correction. *Warm regards,* *Mohammad Tariq* *cloudfront.blogspot.com <http://cloudfront.blogspot.com>* On Tue, Jun 3, 2014 at 2:52 AM, Ashish Ga

Re: alter table add more columns

2014-06-02 Thread Mohammad Tariq
Yes. *Warm regards,* *Mohammad Tariq* *cloudfront.blogspot.com <http://cloudfront.blogspot.com>* On Tue, Jun 3, 2014 at 2:08 AM, Patcharee Thongtra < patcharee.thong...@uni.no> wrote: > Hi, > > Can I add a partition column? > > Patcharee > > > On 06/02

Re: alter table add more columns

2014-06-02 Thread Mohammad Tariq
*Warm regards,* *Mohammad Tariq* *cloudfront.blogspot.com <http://cloudfront.blogspot.com>* On Tue, Jun 3, 2014 at 1:36 AM, Patcharee Thongtra < patcharee.thong...@uni.no> wrote: > Hi, > > I have a table named fino31 with the following schema > > h

Re: Input from Hbase into Hive partition

2014-03-28 Thread Mohammad Tariq
Hi Manju, How are you storing your data in HBase?What is your rowkey? Warm Regards, Tariq cloudfront.blogspot.com On Fri, Mar 28, 2014 at 12:03 PM, Manju M wrote: > How can i scan one day's data from Hbase table and insert that into Hbase > partition ( date) ? > > is it possible? >

Re: Reading hive table using Pig script

2014-02-26 Thread Mohammad Tariq
Hi Chhaya, I totally agree with AbdelRahman. HCatalog is the correct way to do that. See *this*for more details. Warm Regards, Tariq cloudfront.blogspot.com On Wed, Feb 26, 2014 at 11:

Re: Strange hive error

2013-09-11 Thread Mohammad Tariq
Could you please show us your query? Warm Regards, Tariq cloudfront.blogspot.com On Thu, Sep 12, 2013 at 1:49 AM, Siddharth Tiwari wrote: > Hi Team > > I am getting following error when I am trying to load csv file in my hive > table:- > > FAILED: Parse Error: line 1:71 character '' not suppor

Re: New to hive.

2013-07-17 Thread Mohammad Tariq
d fixed it. > Got the plan.xml and jobconf.xml now will debug hadoop to get the rest of > info. > > Thanks, > Warm regards, > Bharati > > On Jul 17, 2013, at 12:08 PM, Mohammad Tariq wrote: > > Hello ma'm, > > Apologies first of all for responding so late. Stuck

Re: New to hive.

2013-07-17 Thread Mohammad Tariq
; ** ** > > But don't forget the Hive wiki: > >- Hive Home -- https://cwiki.apache.org/confluence/display/Hive/Home ** >** >- Getting Started -- >https://cwiki.apache.org/confluence/display/Hive/GettingStarted >- Hiv

Re: Correct way of using regexserde

2013-07-02 Thread Mohammad Tariq
No luck. Warm Regards, Tariq cloudfront.blogspot.com On Tue, Jul 2, 2013 at 1:03 PM, Matouk IFTISSEN wrote: > Yes it is to create an external table that points your data with the > regexp passed with the SERDE. > good day > > > 2013/7/2 Mohammad Tariq > >> Hello the

Re: Hive Table to CSV file

2013-07-01 Thread Mohammad Tariq
Do you have permissions to write to this path?And make sure you are looking into the local FS, as Stephen has specified. Warm Regards, Tariq cloudfront.blogspot.com On Tue, Jul 2, 2013 at 5:25 AM, Stephen Sprague wrote: > you gotta admit that's kinda funny. Your stderr output shows not only >

Re: Correct way of using regexserde

2013-07-01 Thread Mohammad Tariq
n > or you have it in all Hadoop tasktrackers > like this: > add jar path_where_is_the_jar_in_hive_lib\hive-contrib-0.9.0.jar ; > > Good luck > > > 2013/7/1 Mohammad Tariq > >> Hello list, >> >> I would really appreciate if someone could show me the corr

Re: "show table" throwing strange error

2013-06-30 Thread Mohammad Tariq
server2 (if u r running that) >>> >>> >>> And check hive.log ? >>> >>> Also can u paste the CREATE TABLe script verbatim here…I feel if u are >>> using some custom INPUTFORMAT / OUTPUTFORMAT class that have to be >>> specified in q

Correct way of using regexserde

2013-06-30 Thread Mohammad Tariq
Hello list, I would really appreciate if someone could show me the correct way of using regexserde as i'm having some hard time using it. I have verified my regex through http://www.regexplanet.com/advanced/java/index.html and it's working fine there. But when i'm using the same pattern w

Re:

2013-06-29 Thread Mohammad Tariq
What the hell is this Warm Regards, Tariq cloudfront.blogspot.com On Sun, Jun 30, 2013 at 12:08 PM, wrote: > > http://pcvsokolka.com.pl/wel.come.php > >

Re: Unable to execute a query in hive

2013-06-27 Thread Mohammad Tariq
Yes. It'll. Have you changed all the env. vars, like HADOOP_HOME, HIEV_HOME etc according to your new environment? Warm Regards, Tariq cloudfront.blogspot.com On Thu, Jun 27, 2013 at 11:43 PM, Manickam P wrote: > Hi Tariq, > > It is a very simple query like select * from table. > Actually i've

Re: Unable to execute a query in hive

2013-06-27 Thread Mohammad Tariq
What's your query? Warm Regards, Tariq cloudfront.blogspot.com On Thu, Jun 27, 2013 at 11:17 PM, Manickam P wrote: > Hi, > > I checked all the nodes. All are up and running. normal hive queries like > show tables are working fine. Queries with map reduce is throwing exception. > > > Thanks, >

Re: Unable to execute a query in hive

2013-06-27 Thread Mohammad Tariq
Hello Manickam, Please make sure your hadoop daemons are running. Warm Regards, Tariq cloudfront.blogspot.com On Thu, Jun 27, 2013 at 9:55 PM, Manickam P wrote: > Hi, > > I tried to execute a query in hive but i got the below exception. I dont > know the reason. > Please help me to

Re: "show table" throwing strange error

2013-06-20 Thread Mohammad Tariq
Thank you for the response ma'am. It didn't help either. Warm Regards, Tariq cloudfront.blogspot.com On Thu, Jun 20, 2013 at 8:43 AM, Sunita Arvind wrote: > Your issue seems familiar. Try logging out of hive session and re-login. > > Sunita > > > On Wed, Jun 19, 201

Re: "show table" throwing strange error

2013-06-19 Thread Mohammad Tariq
That error is gone after I recreated hive-site.xml and restarted hive. But now there seems to be some problem with metastore settings. It's not going to mysql. Anyways, thank you both for the help. Warm Regards, Tariq cloudfront.blogspot.com On Thu, Jun 20, 2013 at 7:29 AM, Mohammad

Re: "show table" throwing strange error

2013-06-19 Thread Mohammad Tariq
b ? > > Sent from my iPhone > > On Jun 19, 2013, at 6:44 PM, Mohammad Tariq wrote: > > It actually seems to be ignoring hive-site.xml. No effect of the > properties set in hive-site.xml file. > > Warm Regards, > Tariq > cloudfront.blogspot.com > > > On Thu

Re: "show table" throwing strange error

2013-06-19 Thread Mohammad Tariq
It actually seems to be ignoring hive-site.xml. No effect of the properties set in hive-site.xml file. Warm Regards, Tariq cloudfront.blogspot.com On Thu, Jun 20, 2013 at 7:12 AM, Mohammad Tariq wrote: > It looks OK to me, > > > > > javax.jdo.option.Connection

Re: "show table" throwing strange error

2013-06-19 Thread Mohammad Tariq
Is it properly formatted and connection strings correct ? > > Sent from my iPhone > > On Jun 19, 2013, at 6:30 PM, Mohammad Tariq wrote: > > Hello Anurag, > >Thank you for the quick response. Log files is full of such lines along > with a trace that says it is some parsi

Re: "show table" throwing strange error

2013-06-19 Thread Mohammad Tariq
Did you check in your hive query log under /tmp to see if it says > something in the log ? > > > Sent from my iPhone > > On Jun 19, 2013, at 5:53 PM, Mohammad Tariq wrote: > > Hello list, > > I have a hive(0.9.0) setup on my Ubuntu box running hadoop-1.0.4

"show table" throwing strange error

2013-06-19 Thread Mohammad Tariq
Hello list, I have a hive(0.9.0) setup on my Ubuntu box running hadoop-1.0.4. Everything was going smooth till now. But today when I issued *show tables*I got some strange error on the CLI. Here is the error : hive> show tables; FAILED: Parse Error: line 1:0 character '' not supported he

Re: New to hive.

2013-06-19 Thread Mohammad Tariq
Hello ma'am, Hive queries are parsed using ANTLR and and are converted into corresponding MR jobs(actually a lot of things happen under the hood). I had answered a similar question

Re: parse_url returning NULL

2013-06-10 Thread Mohammad Tariq
dward Capriolo wrote: > It is not a valid URL if it does not have a scheme and can not be parsed. > > SELECT if (column like 'http%', column, concat( 'http://', column) ) as > column might do what you need. > > > On Mon, Jun 10, 2013 at 5:59 PM, Mohammad Tariq w

parse_url returning NULL

2013-06-10 Thread Mohammad Tariq
Hello list, I have a file stored in my HDFS which contains some urls. File looks like this : abc.in xyz.net http://tariq.com http://tariq.in/sompath And i'm trying to get the hostnames from these urls using *parse_url*. It works fine except for the urls which do not contain any scheme. S

Re: Correct way to use Hive Java API

2013-06-07 Thread Mohammad Tariq
edded hive. > thanks > Prasad > > > > On Fri, Jun 7, 2013 at 7:59 AM, Haidar Hadi wrote: >> >> Hello all, >> I have similar issue, any idea? >> >> On Jun 4, 2013, at 11:00 PM, Mohammad Tariq wrote: >> >> Hello list, >> I am trying to a

Correct way to use Hive Java API

2013-06-04 Thread Mohammad Tariq
Hello list, I am trying to access data stored in my Hive table through the Java API but looks like I am not using it in the correct manner. Would really appreciate some help. Here is the small piece of code I am trying to use : public static void main(String[] args) throws HiveMetaException

Re: HADOOP and Query Capabilities

2013-05-13 Thread Mohammad Tariq
Sorry for the typo in the 3rd answer. I meant, question 1 covers this. Warm Regards, Tariq cloudfront.blogspot.com On Mon, May 13, 2013 at 10:13 PM, Mohammad Tariq wrote: > Hello Nalin, > > Please find my comments embedded below : > > 1. What tools are available to Query

Re: HADOOP and Query Capabilities

2013-05-13 Thread Mohammad Tariq
Hello Nalin, Please find my comments embedded below : 1. What tools are available to Query Hadoop data in real time vs batch? >> Real time : Cloudera Impala, Batch : Hive and Pig..You might wanna have a look at Apache Drill as well. 2. I bel

Re: Reflect MySQL updates into Hive

2012-12-26 Thread Mohammad Tariq
, when I run the >> update query it will add the updated data on a new partition (success or >> shipped for example) and it will keep the old data (confirmed or paid for >> example), right? >> >> >> -- >> Ibrahim >> >> >> On Tue, Dec

Re: Reg:

2012-12-25 Thread Mohammad Tariq
Hello Kshiva, Hive is batch a processing system and not meant for real time stuff as said by Nitin. Hive queries actually get converted into MapReduce jobs under the hood and then give you the result. If you want to query your data in real time, then give "Impala" a shot. It does the sa

Re: Reflect MySQL updates into Hive

2012-12-24 Thread Mohammad Tariq
Also, have a look at this : http://www.catb.org/~esr/faqs/smart-questions.html Best Regards, Tariq +91-9741563634 https://mtariq.jux.com/ On Tue, Dec 25, 2012 at 11:26 AM, Mohammad Tariq wrote: > Have a look at Beeswax. > > BTW, do you have access to Google at your station?Same qu

Re: Reflect MySQL updates into Hive

2012-12-24 Thread Mohammad Tariq
Have a look at Beeswax. BTW, do you have access to Google at your station?Same question on the Pig mailing list as well, that too twice. Best Regards, Tariq +91-9741563634 https://mtariq.jux.com/ On Tue, Dec 25, 2012 at 11:20 AM, Kshiva Kps wrote: > Hi, > > Is there any Hive editors and where

Re: Reflect MySQL updates into Hive

2012-12-24 Thread Mohammad Tariq
n. >> >> On Monday, December 24, 2012, Ibrahim Yakti wrote: >> >>> This already done, but Hive does not support update nor deletion of >>> data, so when I import the data after specific "last_update_time" records, >>> hive will append it not replace.

Re: Reflect MySQL updates into Hive

2012-12-24 Thread Mohammad Tariq
gt; > On Mon, Dec 24, 2012 at 5:03 PM, Mohammad Tariq wrote: > >> You can use Apache Oozie to schedule your imports. >> >> Alternatively, you can have an additional column in your SQL table, say >> LastUpdatedTime or something. As soon as there is a change in this column >

Re: Reflect MySQL updates into Hive

2012-12-24 Thread Mohammad Tariq
tes to hadoop/hive, this is our > problem now. > > > -- > Ibrahim > > > On Mon, Dec 24, 2012 at 4:35 PM, Mohammad Tariq wrote: > >> Cool. Then go ahead :) >> >> Just in case you need something in realtime, you can have a look at >> Impala.(I know no

Re: Reflect MySQL updates into Hive

2012-12-24 Thread Mohammad Tariq
mad, No, we do not have any plans to replace our RDBMS with > Hive. Hadoop/Hive will be used as Data Warehouse & batch processing > computing, as I said we want to use Hive for analytical queries. > > > -- > Ibrahim > > > On Mon, Dec 24, 2012 at 4:19 PM, Mohamm

Re: Reflect MySQL updates into Hive

2012-12-24 Thread Mohammad Tariq
Hello Ibrahim, A quick questio. Are you planning to replace your SQL DB with Hive? If that is the case, I would not suggest to do that. Both are meant for entirely different purposes. Hive is for batch processing and not for real time system. So if you are requirements involve real time thing

Re: Incresing map reduce tasks will increse the time of the cpu does this seem to be correct

2012-12-13 Thread Mohammad Tariq
I said that because under the hood each query(Hive or Pig) gets converted into a MapReduce job first, and gives you the result. Regards, Mohammad Tariq On Thu, Dec 13, 2012 at 7:51 PM, imen Megdiche wrote: > I don t understand why you mean with "Same holds good for Hive or Pig

Re: Incresing map reduce tasks will increse the time of the cpu does this seem to be correct

2012-12-13 Thread Mohammad Tariq
depends mainly on the no. of InputSplits created by the InputFormat you are using to process you data and the no. of reducers depend on the no of partitions created after the map phase. HTH Regards, Mohammad Tariq On Thu, Dec 13, 2012 at 6:25 PM, imen Megdiche wrote: > thank you for you

Re: Incresing map reduce tasks will increse the time of the cpu does this seem to be correct

2012-12-13 Thread Mohammad Tariq
node where frees lots are available and it will consume time and it is also against the most basic principle of Hadoop i.e data localization. So, the no. of maps and reduces should be raised keeping all the factors in mind, otherwise you may face performance issues. HTH Regards, Mohammad

Re: Modify the number of map tasks

2012-12-12 Thread Mohammad Tariq
Hi Imen, I am sorry, I didn't get the question. Are you asking about creating a distributed cluster? Yeah, I have done that. Regards, Mohammad Tariq On Wed, Dec 12, 2012 at 7:45 PM, imen Megdiche wrote: > have you please commented the configuration of hadoop on

Re: Modify the number of map tasks

2012-12-12 Thread Mohammad Tariq
I wonder how you are able to run the job without a JT. You must have this on your mapred-site.xml file : mapred.job.tracker localhost:9001 Also add "hadoop.tmp.dir" in core-site.xml, and "dfs.name.dir" & "dfs.data.dir" in hdfs-site.xml. Regards,

Re: Modify the number of map tasks

2012-12-12 Thread Mohammad Tariq
Can I have a look at your config files? Regards, Mohammad Tariq On Wed, Dec 12, 2012 at 6:31 PM, imen Megdiche wrote: > i run the start-all.sh and all daemons starts without problems. But i the > log of the tasktracker look like this : > > > 2012-12-12 13

Re: Modify the number of map tasks

2012-12-12 Thread Mohammad Tariq
and remove 'command' from the statement) HTH Regards, Mohammad Tariq On Wed, Dec 12, 2012 at 6:14 PM, imen Megdiche wrote: > My goal is to analyze the response time of MapReduce depending on the size > of the input files. I need to change the number of map and / or Redu

Re: Modify the number of map tasks

2012-12-12 Thread Mohammad Tariq
Are you working locally?What exactly is the issue? Regards, Mohammad Tariq On Wed, Dec 12, 2012 at 6:00 PM, imen Megdiche wrote: > no > > > 2012/12/12 Mohammad Tariq > >> Any luck with "localhost:50030"?? >> >> Regards, >> Mohammad

Re: Modify the number of map tasks

2012-12-12 Thread Mohammad Tariq
Any luck with "localhost:50030"?? Regards, Mohammad Tariq On Wed, Dec 12, 2012 at 5:53 PM, imen Megdiche wrote: > i run the job through the command line > > > 2012/12/12 Mohammad Tariq > >> You have to replace "JobTrackerHost" in "JobTra

Re: Modify the number of map tasks

2012-12-12 Thread Mohammad Tariq
and line or some IDE? Regards, Mohammad Tariq On Wed, Dec 12, 2012 at 5:42 PM, imen Megdiche wrote: > excuse me the data size is 98 MB > > > 2012/12/12 imen Megdiche > >> the size of data 49 MB and n of map 4 >> the web UI JobTrackerHost:50030 does not wok, what should i d

Re: Modify the number of map tasks

2012-12-12 Thread Mohammad Tariq
right now? Regards, Mohammad Tariq On Wed, Dec 12, 2012 at 5:11 PM, imen Megdiche wrote: > Thank you Mohammad but the number of map tasks still the same in the > execution. Do you know how to capture the time spent on execution. > > > 2012/12/12 Mohammad Tariq > >&

Re: Modify the number of map tasks

2012-12-12 Thread Mohammad Tariq
Hi Imen, You can add "mapred.map.tasks" property in your mapred-site.xml file. But, it is just a hint for the InputFormat. Actually no. of maps is actually determined by the no of InputSplits created by the InputFormat. HTH Regards, Mohammad Tariq On Wed, Dec 12, 2012

Re:

2012-11-18 Thread Mohammad Tariq
Hello Dlia, You can visit these link to see how Hadoop can be configured on Mac. http://blogs.msdn.com/b/brandonwerner/archive/2011/11/13/how-to-set-up-hadoop-on-os-x-lion-10-7.aspx http://ragrawal.wordpress.com/2012/04/28/installing-hadoop-on-mac-osx-lion/ Regards, Mohammad Tariq

Re:

2012-11-16 Thread Mohammad Tariq
Thank you so much for the link Alex. Regards, Mohammad Tariq On Fri, Nov 16, 2012 at 2:19 PM, Alexander Alten-Lorenz wrote: > https://help.ubuntu.com/community/VMware/Player > > - Alex > > On Nov 16, 2012, at 9:47 AM, Mohammad Tariq wrote: > > > Hello Carl, &g

Re: Re:

2012-11-16 Thread Mohammad Tariq
me out. Many thanks. Regards, Mohammad Tariq On Fri, Nov 16, 2012 at 3:49 AM, Kanna Karanam wrote: > Hi Dean, HDInsight enables the developers to deploy and run Hadoop on > Windows based personal computers. You can download and install it from > http://www.microsoft.com/en-us

Re: How to load csv data into HIVE

2012-09-07 Thread Mohammad Tariq
I said this assuming that a Hadoop cluster is available since Sandeep is planning to use Hive. If that is the case then MapReduce would be faster for such large files. Regards, Mohammad Tariq On Fri, Sep 7, 2012 at 8:27 PM, Connell, Chuck wrote: > I cannot promise which is faster. A

Re: How to load csv data into HIVE

2012-09-07 Thread Mohammad Tariq
Hello Sandeep, I would suggest you to write a MapReduce job instead of usual sequential program to transform your files. It would be much faster. Then use Hive to load the data. Regards, Mohammad Tariq On Fri, Sep 7, 2012 at 8:11 PM, Sandeep Reddy P wrote: > Hi, > I wrote a

Re: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask MapReduce Jobs Launched:

2012-07-24 Thread Mohammad Tariq
gt;>> If i do operations like. >>> select * from dummysite, >>> or >>> select * from dummysite where id=10; >>> >>> such command shows proper result and doesn't through any error. >>> >>> Please suggest. >>> >>> Regards >>> Yog

Re: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask MapReduce Jobs Launched:

2012-07-24 Thread Mohammad Tariq
Hello Yogesh, Are any proxy settings involved??Error code 407 indicates that the client must first authenticate itself with the proxy in order to proceed further. Just make sure everything is in place. Regards, Mohammad Tariq On Tue, Jul 24, 2012 at 1:55 PM, wrote: > Hi

Re: hive opload shows NULL from hdfs

2012-07-12 Thread Mohammad Tariq
Did it work fine?? Regards, Mohammad Tariq On Thu, Jul 12, 2012 at 4:33 PM, wrote: > Thanks Mohammad :-) > > Regards > Yogesh Kumar > ____ > From: Mohammad Tariq [donta...@gmail.com] > Sent: Thursday, July 12, 2012 3:52 PM >

Re: hive opload shows NULL from hdfs

2012-07-12 Thread Mohammad Tariq
Create your table using this command : create table parthp (no INT , name STRING , result STRING , class INT ) row format delimited fields terminated by "," ; In hive the delimiters are assumed to be ^A(ctrl-a), by default. Regards, Mohammad Tariq On Thu, Jul 12, 2012 at 3:46 P

Re: Hive-site.xml is not present

2012-07-12 Thread Mohammad Tariq
a file with name hive-site.xml and list down the properties you want to override. Regards, Mohammad Tariq On Thu, Jul 12, 2012 at 12:38 PM, wrote: > Hi all, > > I have downloaded hive-0.8.1 and even hive-0.9.0, > after extracting it I found that > hive-site.xml > is n

Re: hi all

2012-07-11 Thread Mohammad Tariq
Try it out using "distcp" command. Regards, Mohammad Tariq On Wed, Jul 11, 2012 at 8:09 PM, shaik ahamed wrote: > Hi All, > >As i have a data of 100GB in HDFS as i want this 100 gb file to > move or copy to the hive directory or path how can i achieve t

Re: hi users

2012-07-05 Thread Mohammad Tariq
Increase your replication factor as suggested by Nitin. Replication factor > 1 is a must to avoid data loss. And you can use "fsck" command to check the HDFS. Also verify whether you are able to see all the datanodes at the namenode WEBUI page. Regards, Mohammad Tariq On Thu, J

Re: hi users

2012-07-04 Thread Mohammad Tariq
Hello shaik, Were you able to fetch the data earlier. I mean is it happening for the first time or you were not able to fetch the data even once?? Regards, Mohammad Tariq On Thu, Jul 5, 2012 at 12:17 PM, shaik ahamed wrote: > Hi All, > > >Im not a

Re: Hive mapper creation

2012-06-28 Thread Mohammad Tariq
Ok Bejoy. I'll proceed as directed by you and get back to you in case of any difficulty. Thanks again for the help. Regards,     Mohammad Tariq On Fri, Jun 29, 2012 at 12:59 AM, Bejoy KS wrote: >  Hi Mohammed > > If it is to control the split size and there by the number of

Re: Hive mapper creation

2012-06-28 Thread Mohammad Tariq
one split instead of taking each individual row, I can use nlineinput format.Is it possible to do something similar at Hive's level or do I need to look into the source code?? Regards,     Mohammad Tariq On Fri, Jun 29, 2012 at 12:37 AM, Bejoy KS wrote: > Hi Mohammed > > Sp

Re: Hive mapper creation

2012-06-28 Thread Mohammad Tariq
Hello Nitin, Bejoy, Thanks a lot for the quick response. Could you please tell me what is the default criterion of split creation??How the splits for a Hive query are created??(Pardon my ignorance). Regards,     Mohammad Tariq On Fri, Jun 29, 2012 at 12:22 AM, Bejoy KS wrote: >

Hive mapper creation

2012-06-28 Thread Mohammad Tariq
. Regards,     Mohammad Tariq

Re: namenode starting error

2012-06-20 Thread Mohammad Tariq
this is because you are you are not able to contact the namenode as it is not running.not only -ls, none of the Hdfs command will work in such a situation..was your NN stopped after getting started, or it didn't start even once??Can you paste your logs here?? Regards,     Mohammad Tariq O

Re: namenode starting error

2012-06-20 Thread Mohammad Tariq
change the line "127.0.1.1" in your /etc/hosts file to "127.0.0.1"..Also check if there is any problem with the configuration properties. Regards,     Mohammad Tariq On Wed, Jun 20, 2012 at 2:52 PM, soham sardar wrote: > the thing is i have updated my JAVA_HOME in

Re: Unable to compile and run unit tests against custom/local version of Hadoop

2012-06-08 Thread Mohammad Tariq
also visit this link on official wiki page - https://cwiki.apache.org/Hive/developerguide.html#DeveloperGuide-Unittestsanddebugging Regards,     Mohammad Tariq On Sat, Jun 9, 2012 at 2:32 AM, Mohammad Tariq wrote: > Kanna, you can visit the link given below..it talks about Hive Unit > T

Re: Unable to compile and run unit tests against custom/local version of Hadoop

2012-06-08 Thread Mohammad Tariq
Kanna, you can visit the link given below..it talks about Hive Unit Testing in detail. http://dev.bizo.com/2011/04/hive-unit-testing.html Regards,     Mohammad Tariq On Sat, Jun 9, 2012 at 1:04 AM, Kanna Karanam wrote: > Thanks Mohammad - I downloaded the Hadoop & Hive source from apa

Re: Unable to compile and run unit tests against custom/local version of Hadoop

2012-06-08 Thread Mohammad Tariq
Hello Kanna, If you are facing problem with your build, you can download Hadoop and Hive directly from Apache and use them. Regards,     Mohammad Tariq On Fri, Jun 8, 2012 at 9:06 PM, Kanna Karanam wrote: > Hi Gurus, > > > > It would be a great help if anyone can help me r

Re: Error while Creating Table in Hive

2012-06-06 Thread Mohammad Tariq
27;ll add more properties if you need detailed help you can also visit - http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/ Regards,     Mohammad Tariq On Thu, Jun 7, 2012 at 3:04 AM, Babak Bastan wrote: > I try to install another one in blog,most of

Re: Error while Creating Table in Hive

2012-06-06 Thread Mohammad Tariq
ok..we'll give it a final shot..then i'll email configured hadoop to your email address..delete the hdfs directory which contains tmp, data and name..recreate it..format hdfs again and then start the processes. Regards,     Mohammad Tariq On Thu, Jun 7, 2012 at 2:22 AM, Babak Bastan

Re: Error while Creating Table in Hive

2012-06-06 Thread Mohammad Tariq
. Regards,     Mohammad Tariq On Thu, Jun 7, 2012 at 1:52 AM, Babak Bastan wrote: > by the way,you are a very nice man my friend:Thank you so much :) > > what do you mean aboat this post in stackoverflow? > > I am assuming that is your first installation of hadoop. > > At the

Re: Error while Creating Table in Hive

2012-06-06 Thread Mohammad Tariq
.if you further face any problem, i'll send you a configured copy of hadoop. Regards,     Mohammad Tariq On Thu, Jun 7, 2012 at 1:45 AM, Babak Bastan wrote: > I checked it but no hadoop folder :( > yes you are right.I'm a student and I want to make a very very simple > progr

Re: Error while Creating Table in Hive

2012-06-06 Thread Mohammad Tariq
check your /var/log/hadoop/...also when you do something wrong your will find your terminal full of many error messages, you can use them as well..and by the way learning something new requires great deal of patience Regards,     Mohammad Tariq On Thu, Jun 7, 2012 at 1:25 AM, Babak Bastan

Re: Error while Creating Table in Hive

2012-06-06 Thread Mohammad Tariq
go to your HADOOP_HOME i.e your hadoop directory(that includes bin, conf etc)..you can find logs directory there.. Regards,     Mohammad Tariq On Thu, Jun 7, 2012 at 1:09 AM, Babak Bastan wrote: > hoe can I get my log mohammad? > > > On Wed, Jun 6, 2012 at 9:36 PM, Mohammad

Re: Error while Creating Table in Hive

2012-06-06 Thread Mohammad Tariq
could you post your logs???that would help me in understanding the problem properly. Regards,     Mohammad Tariq On Thu, Jun 7, 2012 at 1:02 AM, Babak Bastan wrote: > Thank you very much mohamad for your attention.I followed the steps but the > error is the same as the last time. >

Re: Error while Creating Table in Hive

2012-06-06 Thread Mohammad Tariq
also change the permissions of these directories to 777. Regards,     Mohammad Tariq On Wed, Jun 6, 2012 at 11:54 PM, Mohammad Tariq wrote: > create a directory "/home/username/hdfs" (or at some place of your > choice)..inside this hdfs directory create three sub directorie

Re: Error while Creating Table in Hive

2012-06-06 Thread Mohammad Tariq
n mind you have to give same names as values of above specified properties in your configuration files. (give full path of these directories, not just the name of the directory) After this follow the steps provided in the previous reply. Regards,     Mohammad Tariq On Wed, Jun 6, 201

Re: Error while Creating Table in Hive

2012-06-06 Thread Mohammad Tariq
start JT & TT) after this use jps to check if everything is alright or point your browser to localhost:50070..if you further find any problem provide us with the error logs..:) Regards,     Mohammad Tariq On Wed, Jun 6, 2012 at 11:22 PM, Babak Bastan wrote: > were you able to format hdfs p

Re: Error while Creating Table in Hive

2012-06-06 Thread Mohammad Tariq
if you are getting only this, it means your hadoop is not running..were you able to format hdfs properly??? Regards,     Mohammad Tariq On Wed, Jun 6, 2012 at 11:17 PM, Babak Bastan wrote: > Hi MohammadmI irun jps in my shel I can see this result: > 2213 Jps > > > On Wed, Jun

Re: Error while Creating Table in Hive

2012-06-06 Thread Mohammad Tariq
you can also use "jps" command at your shell to see whether Hadoop processes are running or not. Regards,     Mohammad Tariq On Wed, Jun 6, 2012 at 11:12 PM, Mohammad Tariq wrote: > Hi Babak, > >  You have to type it in you web browser..Hadoop provides us a web GUI > that

Re: Error while Creating Table in Hive

2012-06-06 Thread Mohammad Tariq
a Hive or Pig job or a Mapreduce job, you can point your browser to http://localhost:50030 to see the status and logs of your job. Regards,     Mohammad Tariq On Wed, Jun 6, 2012 at 8:28 PM, Babak Bastan wrote: > Thank you shashwat for the answer, > where should I type http://localhost

Re: How to install hive?

2012-06-05 Thread Mohammad Tariq
ce/display/Hive/Home"; Regards,     Mohammad Tariq On Wed, Jun 6, 2012 at 3:42 AM, Rafael Maffud Carlini wrote: > Hello everyone, I develop a scientific research for my college, where > I conduct experiments involving hive and I wonder what is the easiest > way to install the hi

Re: HADOOP_HOME

2012-06-02 Thread Mohammad Tariq
r You can use this to set any variable permanently. Restart your system in order to apply the changes. Regards,     Mohammad Tariq On Sat, Jun 2, 2012 at 2:59 PM, Nitin Pawar wrote: > Use export command > > > On Jun 2, 2012 2:50 PM, "Babak Bastan" wrote: >> >&g

Re: Hbase vs Hive ve Hbase/Hive vs Pig

2012-01-22 Thread Mohammad Tariq
://permalink.gmane.org/gmane.comp.jakarta.lucene.hadoop.user/13187 Regards,     Mohammad Tariq 2012/1/22 Dalia Sobhy : > H all, > > I know I have asked this question before.. But I want to state more > specific... > > Whats the difference in performance between Hive, Hbase, Hive/Hbase

Re: Questions

2012-01-19 Thread Mohammad Tariq
h?v=0EFrXf_rgBg"; Regards,     Mohammad Tariq 2012/1/19 Dalia Sobhy : > > Hey Vikas, > > I want to develop a medical API ... > > I want to ask whether Hive Hbase Integration performance is good or not, > because I found that Hive queries are faster according to some bl

Re: Hive-Hbase integration

2011-12-17 Thread Mohammad Tariq
Hi Bejoy, Thank you so much for your help again..Your way of explaining things is really great..And the query provided by you is working absolutely fine. Regards,     Mohammad Tariq On Sun, Dec 18, 2011 at 12:35 AM, Bejoy Ks wrote: > Hi Tariq >     From the stack trace, I belie

Hive-Hbase integration

2011-12-17 Thread Mohammad Tariq
istake??Also, I would like to know whether the field "key" corresponds to each row in the Hbase table i.e emp1 and emp2 or am I getting the concept wrong??I was going through the wiki, but could not find the proper explanation there.Sorry if my question seems childish. Many thanks. Regards,     Mohammad Tariq

Re: Fetching Hbase data through Hive

2011-12-15 Thread Mohammad Tariq
Hi Bejoy, Thanks a lot for the valuable info and the link..I was just going through the HbaseIntegration document..:) Regards,     Mohammad Tariq On Fri, Dec 16, 2011 at 1:11 AM, Bejoy Ks wrote: > Hi Tariq > You need to issue a ddl where you specify to hive how the row k

Fetching Hbase data through Hive

2011-12-15 Thread Mohammad Tariq
Hello all, Is there any way to fetch the data from a table which is already present in Hbase using Hive directly??Or do I need to create the corresponding table in the Hive first?? Regards,     Mohammad Tariq

Re: New to hive

2011-12-13 Thread Mohammad Tariq
et/cwsteinbach/hive-quick-start-tutorial"; Regards,     Mohammad Tariq On Tue, Dec 13, 2011 at 5:04 PM, praveenesh kumar wrote: > Guys, > > I have been using hadoop for 3,4 months. > Tried Map Reduce, HBase, Pig. > Now wanted to learn HIVE. > I hope it must be as exciting

Re: Hive-Hbase integration require Hbase in Pseudo distributed??

2011-12-02 Thread Mohammad Tariq
Anyone there, cud you please confirm if I can use hive-hbase in standalone mode??? will it work? or should i go for Pseudo distributed mode ? Regards,     Mohammad Tariq On Fri, Dec 2, 2011 at 5:54 PM, Alok Kumar wrote: > hi, > > yeah i've used > > $HIVE_HOME/bin/hive --

Re: Hive-Hbase integration require Hbase in Pseudo distributed??

2011-12-02 Thread Mohammad Tariq
I am facing the same problem, the master is running though. I am able to create tables directly through Hbase and Hive shell, but when I am trying to do it using Hive and Hbase together I am facing this problem. I am using Hbase-0.90.4 and Hive-0.7.0 Regards,     Mohammad Tariq On Fri, Dec 2

Hive-Hbase integration

2011-12-01 Thread Mohammad Tariq
Hello list, Could anyone tell me the basic (and must) requirements for integrating Hive and Hbase??? I have followed the " Hive HBase Integration " link on cwiki but I am not able to do it. Need some urgent help.Many thanks in advance. Regards,     Mohammad Tariq

  1   2   >