Re: .sql vs. .hql
Basically, hive does only support its own SQL witch is called HQL. The prefix of the files, as hinted by Matt, is only a convention. You could put whatever you want, that won't impact hive. Regards Bertrand On Fri, May 31, 2013 at 11:02 PM, Sanjay Subramanian < sanjay.subraman...@wizecommerce.com> wrote: > Ok cool > > On 5/31/13 2:00 PM, "Keith Wiley" wrote: > > >On May 31, 2013, at 13:52 , Sanjay Subramanian wrote: > > > >> First u need to setup some files in HDFS and define some Hive tables > >>ands > >> point to the location and then start your journey ! > >> > >> sanjay > > > > > >Oh I'm miles past that. I've been deploying Hive systems for well over a > >year now. I'm just not used to working with input files. I (and my > >end-users) have been one-query-at-a-time console queriers up until now > >(often batched through bash scripts and such), so all I need is to come > >up to speed on using .sql and .hql files. > > > >Thanks. > > > >__ > >__ > >Keith Wiley kwi...@keithwiley.com keithwiley.com > >music.keithwiley.com > > > >"And what if we picked the wrong religion? Every week, we're just making > >God > >madder and madder!" > > -- Homer Simpson > >__ > >__ > > > > > > > CONFIDENTIALITY NOTICE > == > This email message and any attachments are for the exclusive use of the > intended recipient(s) and may contain confidential and privileged > information. Any unauthorized review, use, disclosure or distribution is > prohibited. If you are not the intended recipient, please contact the > sender by reply email and destroy all copies of the original message along > with any attachments, from your computer system. If you are the intended > recipient, please be advised that the content of this message is subject to > access, review and disclosure by the sender's Email System Administrator. > > -- Bertrand Dechoux
Re: .sql vs. .hql
Ok cool On 5/31/13 2:00 PM, "Keith Wiley" wrote: >On May 31, 2013, at 13:52 , Sanjay Subramanian wrote: > >> First u need to setup some files in HDFS and define some Hive tables >>ands >> point to the location and then start your journey ! >> >> sanjay > > >Oh I'm miles past that. I've been deploying Hive systems for well over a >year now. I'm just not used to working with input files. I (and my >end-users) have been one-query-at-a-time console queriers up until now >(often batched through bash scripts and such), so all I need is to come >up to speed on using .sql and .hql files. > >Thanks. > >__ >__ >Keith Wiley kwi...@keithwiley.com keithwiley.com >music.keithwiley.com > >"And what if we picked the wrong religion? Every week, we're just making >God >madder and madder!" > -- Homer Simpson >__ >__ > > CONFIDENTIALITY NOTICE == This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: .sql vs. .hql
Hi Keith,
In regards to filename conventions, there isn't a hard requirement to use a
specific extension. Aside from the two extensions already mentioned
('.hql','.sql'), there is a 3rd option commonly used in the Hive test
queries:
'.q'.
I stay with '.q' as well, so that Hive code can be easily differentiated
from other SQL code.
Matt
On Fri, May 31, 2013 at 1:52 PM, Sanjay Subramanian <
sanjay.subraman...@wizecommerce.com> wrote:
> http://www.amazon.com/Programming-Hive-Edward-Capriolo/dp/1449319335
>
>
> There are some variances and limitations in the IN and JOIN constructs as
> I recall but u have to make sure...
>
> But I would start by running some queries from simple to complex to more
> complexhard to find one document where it will illustrate all the
> variances...
>
> First u need to setup some files in HDFS and define some Hive tables ands
> point to the location and then start your journey !
>
> Good luck
>
> sanjay
>
>
>
> On 5/31/13 1:47 PM, "Keith Wiley" wrote:
>
> >Thanks! I'm always up for a good book. Our case is a little open-ended
> >right now, a little difficult to nail down or describe. Basically, I'm
> >deploying Hive systems for a SQl-comfortable data analyst (who is also
> >quite versed in Hive) who would like to run .sql files in Hive and I need
> >to clearly understand how Hive uses input files and how .sql and .hql may
> >differ.
> >
> >Cheers!
> >
> >On May 31, 2013, at 13:20 , Sanjay Subramanian wrote:
> >
> >> For Hive u need the other bible by Dean Wampler , Edward Capriolo et al
> >> Also if u tell us what use cases u have we could provide helpŠ
> >>
> >> sanjay
> >>
> >> On 5/31/13 1:17 PM, "Keith Wiley" wrote:
> >>
> >>> I'm looking for documentation on how to use .sql and .hql files in Hive
> >>> and what the differences are between the two file types. I'm not even
> >>> certain .hql is a real thing, but I'm looking. I didn't see any
> >>>mention
> >>> of this issue in White's Hadoop book, at least not clearly indicated in
> >>> the index.
> >>>
> >>> Thanks.
> >>>
> >>>
> >>>
> >>>__
> >>> __
> >>> Keith Wiley kwi...@keithwiley.com keithwiley.com
> >>> music.keithwiley.com
> >>>
> >>> "Luminous beings are we, not this crude matter."
> >>> -- Yoda
> >>>
> >>>
> >>>__
> >>> __
> >>>
> >>>
> >>
> >>
> >> CONFIDENTIALITY NOTICE
> >> ==
> >> This email message and any attachments are for the exclusive use of the
> >>intended recipient(s) and may contain confidential and privileged
> >>information. Any unauthorized review, use, disclosure or distribution is
> >>prohibited. If you are not the intended recipient, please contact the
> >>sender by reply email and destroy all copies of the original message
> >>along with any attachments, from your computer system. If you are the
> >>intended recipient, please be advised that the content of this message
> >>is subject to access, review and disclosure by the sender's Email System
> >>Administrator.
> >>
> >
> >
> >__
> >__
> >Keith Wiley kwi...@keithwiley.com keithwiley.com
> >music.keithwiley.com
> >
> >"I do not feel obliged to believe that the same God who has endowed us
> >with
> >sense, reason, and intellect has intended us to forgo their use."
> > -- Galileo Galilei
> >__
> >__
> >
> >
>
>
> CONFIDENTIALITY NOTICE
> ==
> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
>
>
Re: .sql vs. .hql
On May 31, 2013, at 13:52 , Sanjay Subramanian wrote: > First u need to setup some files in HDFS and define some Hive tables ands > point to the location and then start your journey ! > > sanjay Oh I'm miles past that. I've been deploying Hive systems for well over a year now. I'm just not used to working with input files. I (and my end-users) have been one-query-at-a-time console queriers up until now (often batched through bash scripts and such), so all I need is to come up to speed on using .sql and .hql files. Thanks. Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "And what if we picked the wrong religion? Every week, we're just making God madder and madder!" -- Homer Simpson
Re: .sql vs. .hql
http://www.amazon.com/Programming-Hive-Edward-Capriolo/dp/1449319335 There are some variances and limitations in the IN and JOIN constructs as I recall but u have to make sure... But I would start by running some queries from simple to complex to more complexhard to find one document where it will illustrate all the variances... First u need to setup some files in HDFS and define some Hive tables ands point to the location and then start your journey ! Good luck sanjay On 5/31/13 1:47 PM, "Keith Wiley" wrote: >Thanks! I'm always up for a good book. Our case is a little open-ended >right now, a little difficult to nail down or describe. Basically, I'm >deploying Hive systems for a SQl-comfortable data analyst (who is also >quite versed in Hive) who would like to run .sql files in Hive and I need >to clearly understand how Hive uses input files and how .sql and .hql may >differ. > >Cheers! > >On May 31, 2013, at 13:20 , Sanjay Subramanian wrote: > >> For Hive u need the other bible by Dean Wampler , Edward Capriolo et al >> Also if u tell us what use cases u have we could provide helpŠ >> >> sanjay >> >> On 5/31/13 1:17 PM, "Keith Wiley" wrote: >> >>> I'm looking for documentation on how to use .sql and .hql files in Hive >>> and what the differences are between the two file types. I'm not even >>> certain .hql is a real thing, but I'm looking. I didn't see any >>>mention >>> of this issue in White's Hadoop book, at least not clearly indicated in >>> the index. >>> >>> Thanks. >>> >>> >>> >>>__ >>> __ >>> Keith Wiley kwi...@keithwiley.com keithwiley.com >>> music.keithwiley.com >>> >>> "Luminous beings are we, not this crude matter." >>> -- Yoda >>> >>> >>>__ >>> __ >>> >>> >> >> >> CONFIDENTIALITY NOTICE >> == >> This email message and any attachments are for the exclusive use of the >>intended recipient(s) and may contain confidential and privileged >>information. Any unauthorized review, use, disclosure or distribution is >>prohibited. If you are not the intended recipient, please contact the >>sender by reply email and destroy all copies of the original message >>along with any attachments, from your computer system. If you are the >>intended recipient, please be advised that the content of this message >>is subject to access, review and disclosure by the sender's Email System >>Administrator. >> > > >__ >__ >Keith Wiley kwi...@keithwiley.com keithwiley.com >music.keithwiley.com > >"I do not feel obliged to believe that the same God who has endowed us >with >sense, reason, and intellect has intended us to forgo their use." > -- Galileo Galilei >__ >__ > > CONFIDENTIALITY NOTICE == This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: .sql vs. .hql
Thanks! I'm always up for a good book. Our case is a little open-ended right now, a little difficult to nail down or describe. Basically, I'm deploying Hive systems for a SQl-comfortable data analyst (who is also quite versed in Hive) who would like to run .sql files in Hive and I need to clearly understand how Hive uses input files and how .sql and .hql may differ. Cheers! On May 31, 2013, at 13:20 , Sanjay Subramanian wrote: > For Hive u need the other bible by Dean Wampler , Edward Capriolo et al > Also if u tell us what use cases u have we could provide helpŠ > > sanjay > > On 5/31/13 1:17 PM, "Keith Wiley" wrote: > >> I'm looking for documentation on how to use .sql and .hql files in Hive >> and what the differences are between the two file types. I'm not even >> certain .hql is a real thing, but I'm looking. I didn't see any mention >> of this issue in White's Hadoop book, at least not clearly indicated in >> the index. >> >> Thanks. >> >> __ >> __ >> Keith Wiley kwi...@keithwiley.com keithwiley.com >> music.keithwiley.com >> >> "Luminous beings are we, not this crude matter." >> -- Yoda >> __ >> __ >> >> > > > CONFIDENTIALITY NOTICE > == > This email message and any attachments are for the exclusive use of the > intended recipient(s) and may contain confidential and privileged > information. Any unauthorized review, use, disclosure or distribution is > prohibited. If you are not the intended recipient, please contact the sender > by reply email and destroy all copies of the original message along with any > attachments, from your computer system. If you are the intended recipient, > please be advised that the content of this message is subject to access, > review and disclosure by the sender's Email System Administrator. > Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "I do not feel obliged to believe that the same God who has endowed us with sense, reason, and intellect has intended us to forgo their use." -- Galileo Galilei
Re: .sql vs. .hql
For Hive u need the other bible by Dean Wampler , Edward Capriolo et al Also if u tell us what use cases u have we could provide helpŠ sanjay On 5/31/13 1:17 PM, "Keith Wiley" wrote: >I'm looking for documentation on how to use .sql and .hql files in Hive >and what the differences are between the two file types. I'm not even >certain .hql is a real thing, but I'm looking. I didn't see any mention >of this issue in White's Hadoop book, at least not clearly indicated in >the index. > >Thanks. > >__ >__ >Keith Wiley kwi...@keithwiley.com keithwiley.com >music.keithwiley.com > >"Luminous beings are we, not this crude matter." > -- Yoda >__ >__ > > CONFIDENTIALITY NOTICE == This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
.sql vs. .hql
I'm looking for documentation on how to use .sql and .hql files in Hive and what the differences are between the two file types. I'm not even certain .hql is a real thing, but I'm looking. I didn't see any mention of this issue in White's Hadoop book, at least not clearly indicated in the index. Thanks. Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "Luminous beings are we, not this crude matter." -- Yoda
