Re: Measuring the execution time of Hive queries through Ambari

gericht Mannheim > Registernummer | Register No.: HRB 110579 > USt-ID | VAT ID: DE234663798 > > *Informationen zum Datenschutz | Information about privacy policy* > https://www.solute.de/ger/datenschutz/grundsaetze-der-datenverarbeitung.php > > > > -

AW: Measuring the execution time of Hive queries through Ambari

enverarbeitung.php Von: Mich Talebzadeh Gesendet: Montag, 22. Juni 2020 14:23:51 An: user Betreff: Re: Measuring the execution time of Hive queries through Ambari Hi Julien. It is as I see is standard Ambari. Has TEZ UI but when I run the query and check TEZ UI it says TEZ view is not deployed

Re: Measuring the execution time of Hive queries through Ambari

/grundsaetze-der-datenverarbeitung.php *Von:* Mich Talebzadeh mailto:mich.talebza...@gmail.com>> *Gesendet:* Montag, 22. Juni 2020 12:57:27 *An:* user *Betreff:* Measuring the e

Re: Measuring the execution time of Hive queries through Ambari

> USt-ID | VAT ID: DE234663798 > > *Informationen zum Datenschutz | Information about privacy policy* > https://www.solute.de/ger/datenschutz/grundsaetze-der-datenverarbeitung.php > > > > -- > *Von:* Mich Talebzadeh > *Gesendet:* Montag, 22. Juni 2020 12:

AW: Measuring the execution time of Hive queries through Ambari

Datenschutz | Information about privacy policy https://www.solute.de/ger/datenschutz/grundsaetze-der-datenverarbeitung.php Von: Mich Talebzadeh Gesendet: Montag, 22. Juni 2020 12:57:27 An: user Betreff: Measuring the execution time of Hive queries through Ambari Hi,

Measuring the execution time of Hive queries through Ambari

Hi, Using Ambari to connect to Hive, is there any way of measuring the query time? Please be aware that this is through Ambari not through beeline etc. The tool we have at the moment is Ambari to Prod. We do not have any other luxury! Thanks LinkedIn * https://www.linkedin.com/profile/vie

Re: Running Hive queries from Ambari or from edge node via beeline

| VAT ID: DE234663798 > > *Informationen zum Datenschutz | Information about privacy policy* > https://www.solute.de/ger/datenschutz/grundsaetze-der-datenverarbeitung.php > > > > -- > *Von:* Mich Talebzadeh > *Gesendet:* Montag, 15. Juni 2020 21:26:20 >

AW: Running Hive queries from Ambari or from edge node via beeline

__ Von: Mich Talebzadeh Gesendet: Montag, 15. Juni 2020 21:26:20 An: user Betreff: Running Hive queries from Ambari or from edge node via beeline Hi, I am not a user of Ambari but I believe it is a GUI interface to Hive. it can be run on your laptop and connect to Hive via ODBC or JDBC. There is

Running Hive queries from Ambari or from edge node via beeline

Hi, I am not a user of Ambari but I believe it is a GUI interface to Hive. it can be run on your laptop and connect to Hive via ODBC or JDBC. There is also another tool DB Visualizer Pro that uses JDBC to connect to Hive thrift server. My view is that if one is a developer the best best would be

Re: Clustering and Large-scale analysis of Hive Queries

> I am interested in working on a project that takes a large number of Hive > queries (as well as their meta data like amount of resources used etc) and > find out common sub queries and expensive query groups etc. This was roughly the central research topic of one of the Hive

Re: Clustering and Large-scale analysis of Hive Queries

sted in hearing about good and bad about Dr Elephant w/ Hive. > > Sent from my iPhone > > On Jul 25, 2018, at 12:13 PM, Zheng Shao wrote: > > Hi, > > I am interested in working on a project that takes a large number of Hive > queries (as well as their meta data like amo

Re: Clustering and Large-scale analysis of Hive Queries

. Sent from my iPhone > On Jul 25, 2018, at 12:13 PM, Zheng Shao wrote: > > Hi, > > I am interested in working on a project that takes a large number of Hive > queries (as well as their meta data like amount of resources used etc) and > find out common sub queries and expen

Clustering and Large-scale analysis of Hive Queries

Hi, I am interested in working on a project that takes a large number of Hive queries (as well as their meta data like amount of resources used etc) and find out common sub queries and expensive query groups etc. Are there any existing work in this domain? Happy to collaborate as well if there

Any hooks to invoke the custom database's statistics for aggregate hive queries

above queries instead of full table scan, storageHandler should be able to invoke our totalCount, max, min etc. methods So are there any hooks to invoke these statistics api's for aggregate hive queries which can do simple look up of these statistics? Thanks, Amey

Re: Maintaining big and complex Hive queries

I have been contemplating attaching meta data for the query lineage to each table such that I can know where the data came from and have a 1 click regenerate button. On Wed, Dec 21, 2016 at 3:02 PM, Stephen Sprague wrote: > my 2 cents. :) > > as soon as you say "complex query" i would submit you

Re: Maintaining big and complex Hive queries

my 2 cents. :) as soon as you say "complex query" i would submit you've lost the upperhand and you're behind the eight-ball right off the bat. And you know this too otherwise you wouldn't have posted here. ha! i use cascading CTAS statements so that i can examine the intermediate tables. Anothe

Re: Maintaining big and complex Hive queries

Hi Elliot, Thanks for letting me know. HPL-SQL sounded particularly interesting. But in the documentation I could not see any way to pass output generated by one Hive query to the next one. The tool looks good as a homogeneous PL-SQL platform for multiple big-data systems (http://www.hplsql.org/ab

Re: Maintaining big and complex Hive queries

I notice that HPL/SQL is not mentioned on the page I referenced, however I expect that is another approach that you could use to modularise: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=59690156 http://www.hplsql.org/doc On 15 December 2016 at 17:17, Elliot West wrote: > Som

Re: Maintaining big and complex Hive queries

Some options are covered here, although there is no definitive guidance as far as I know: https://cwiki.apache.org/confluence/display/Hive/Unit+Testing+Hive+SQL#UnitTestingHiveSQL-Modularisation On 15 December 2016 at 17:08, Saumitra Shahapure < saumitra.offic...@gmail.com> wrote: > Hello, > > W

Maintaining big and complex Hive queries

Hello, We are running and maintaining quite big and complex Hive SELECT query right now. It's basically a single SELECT query which performs JOIN of about ten other SELECT query outputs. A simplest way to refactor that we can think of is to break this query down into multiple views and then join

Re: Hive queries rejected under heavy load

gotta start by looking at the logs and run the local client to eliminate HS2. perhaps running hive as such: $ hive -hiveconf hive.root.logger=DEBUG,console do you see any smoking gun? On Wed, Sep 28, 2016 at 7:34 AM, Jose Rozanec wrote: > Hi, > > We have a Hive cluster (Hive 2.1.0+Tez 0.8.4)

Hive queries rejected under heavy load

Hi, We have a Hive cluster (Hive 2.1.0+Tez 0.8.4) which works well for most queries. Though for some heavy ones we observe that sometimes are able to execute and sometimes get rejected. We are not sure why we get a rejection instead of getting them enqueued and wait for execution until resources i

Running multiple hive queries in the same jvm

Team, I want to know whether there is any way in which I can run 3 hive queries sequentially in a single jvm. From the docs, I found that setting " mapreduce.framework.name=local" might achieve what I am looking for. Can some one confirm? - Rahul

Re: How to run large Hive queries in PySpark 1.2.1

, 2016 at 1:34 AM, Jörn Franke wrote: > Both have outdated versions, usually one can support you better if you > upgrade to the newest. > Firewall could be an issue here. > > > On 26 May 2016, at 10:11, Nikolay Voronchikhin > wrote: > > Hi PySpark users, > > We

Re: How to run large Hive queries in PySpark 1.2.1

Both have outdated versions, usually one can support you better if you upgrade to the newest. Firewall could be an issue here. > On 26 May 2016, at 10:11, Nikolay Voronchikhin > wrote: > > Hi PySpark users, > > We need to be able to run large Hive queries in PySpar

Fwd: How to run large Hive queries in PySpark 1.2.1

Hi PySpark users, We need to be able to run large Hive queries in PySpark 1.2.1. Users are running PySpark on an Edge Node, and submit jobs to a Cluster that allocates YARN resources to the clients. We are using MapR as the Hadoop Distribution on top of Hive 0.13 and Spark 1.2.1. Currently, our

Varying vcores/ram for hive queries running Tez engine

I was trying to benchmark some hive queries. I am using the tez execution engine. I varied the values of the following properties: 1. hive.tez.container.size 2. tez.task.resource.memory.mb 3. tez.task.resource.cpu.vcores Changes in values for property 1 is reflected properly

RE: Mappers spawning Hive queries

I'm not aware of any particular reason that this shouldn't "inherently" work, but for debugging purposes I'd be wondering about the nested environment variables related to the hadoop job.the bash shell where you are trying to launch subsequent hive queries alread

Re: Mappers spawning Hive queries

-- a streaming MR job spawning multiple hive queries that in turn spawn mr jobs. Shirish On Mon, Apr 18, 2016 at 1:31 PM, Ryan Harris wrote: > My $0.02 > > > > If you are running multiple concurrent queries on the data, you are > probably doing it wrong (or at least ine

RE: Mappers spawning Hive queries

nt: Monday, April 18, 2016 2:00 PM To: user@hive.apache.org Subject: Re: Mappers spawning Hive queries Hi John, 2) The shell script is invoked in the mappers of a Hadoop streaming job. 1) The use case is that I have to process multiple entities in parallel. Each entity is associated with its ow

Re: Mappers spawning Hive queries

th its own data set. The processing involves a > few hive queries to do joins and aggregations, which is followed by some > code in Python. My thought process is to put the hive queries and python > invocation in a shell script, and invoke the shell script on multiple > entities in parall

Re: Mappers spawning Hive queries

Hi John, 2) The shell script is invoked in the mappers of a Hadoop streaming job. 1) The use case is that I have to process multiple entities in parallel. Each entity is associated with its own data set. The processing involves a few hive queries to do joins and aggregations, which is followed

Re: Mappers spawning Hive queries

Just out of curiosity, what is the use case behind this? How do you call the shell script? > On 16 Apr 2016, at 00:24, Shirish Tatikonda > wrote: > > Hello, > > I am trying to run multiple hive queries in parallel by submitting them > through a map-reduce job. > Mor

Mappers spawning Hive queries

Hello, I am trying to run multiple hive queries in parallel by submitting them through a map-reduce job. More specifically, I have a map-only hadoop streaming job where each mapper runs a shell script that does two things -- 1) parses input lines obtained via streaming; and 2) submits a very

Re: Running hive queries in different queue

;user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Subject: Re: Running hive queries in different queue I think in your hive script you can do set mapreduce.job.queuename=; Thanks Sathi From: Rajit Saha Reply-To: "user@hive.apache.org<mailto:user@hi

Re: Running hive queries in different queue

Hello. What Hive client are you using? beeline Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On 27 Feb

Re: Running hive queries in different queue

I think in your hive script you can do set mapreduce.job.queuename=; Thanks Sathi From: Rajit Saha Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" Date: Friday, February 26, 2016 at 5:34 PM To: "user@hive.apache.org<mailto:user@hive.apache.org>"

Running hive queries in different queue

Hi I want to run hive query in a queue others than "default" queue from hive client command line . Can anybody please suggest a way to do it. Regards Rajit On Feb 26, 2016, at 07:36, Patrick Duin mailto:patd...@gmail.com>> wrote: Hi Prasanth. Thanks for the quick reply! The logs don't show

Re: Is it ok to build an entire ETL/ELT data flow using HIVE queries?

unch, Scrunch, Scalding, > etc. > > Elliot. > > > On Tuesday, 16 February 2016, Ramasubramanian < > ramasubramanian.naraya...@gmail.com> wrote: > >> Hi, >> >> Is it ok to build an entire ETL/ELT data flow using HIVE queries? >> >> Data is s

Re: Is it ok to build an entire ETL/ELT data flow using HIVE queries?

o build an entire ETL/ELT data flow using HIVE queries? > > Data is stored in HIVE. We have transactional and reference data. We need > to build a small warehouse. > > Need suggestion on alternatives too. > > Regards, > Rams

Re: Is it ok to build an entire ETL/ELT data flow using HIVE queries?

A combination of both normally See below https://www.linkedin.com/pulse/etl-elt-use-case-mich-talebzadeh-ph-d-?trk=pulse_spock-articles [1] HTH. Mich On 16/02/2016 06:19, Ramasubramanian wrote: > Hi, > > Is it ok to build an entire ETL/ELT data flow using HIVE queries? >

Re: Is it ok to build an entire ETL/ELT data flow using HIVE queries?

My company do ETL data flow using HIVE + Pig, it is OK now. 2016-02-16 14:55 GMT+08:00 Jörn Franke : > Why should it not be ok if you do not miss any functionality? You can use > oozie + hive queries to have more sophisticated logging and scheduling. Do > not forget to do proper

Re: Is it ok to build an entire ETL/ELT data flow using HIVE queries?

Why should it not be ok if you do not miss any functionality? You can use oozie + hive queries to have more sophisticated logging and scheduling. Do not forget to do proper capacity/queue management. > On 16 Feb 2016, at 07:19, Ramasubramanian > wrote: > > Hi, > > Is

Is it ok to build an entire ETL/ELT data flow using HIVE queries?

Hi, Is it ok to build an entire ETL/ELT data flow using HIVE queries? Data is stored in HIVE. We have transactional and reference data. We need to build a small warehouse. Need suggestion on alternatives too. Regards, Rams

Re: how to set a job name for hive queries

Please see this, its possible with Tez in Hive 1.2.1 https://community.hortonworks.com/questions/9004/naming-tez-hive-session.html On Jan 19, 2016 11:06 AM, "Frank Luo" wrote: > We are in a multi-tenant environment wanting to add a client’s name into > each job name hence they can be informed/inv

how to set a job name for hive queries

We are in a multi-tenant environment wanting to add a client’s name into each job name hence they can be informed/involved when job fails. We can easily do that with M/R jobs, but I haven’t figure out a way to do so for hive job. I googled and found the answer below, but I couldn’t get it to wor

RE: python libraries to execute or call hive queries

Hi Gopal Have you tried pyhs2 libraryIt has many useful functions to retrieve the data thanksrakesh > Date: Fri, 28 Aug 2015 11:53:20 -0700 > Subject: Re: python libraries to execute or call hive queries > From: gop...@apache.org > To: user@hive.apache.org > > > > Can a

Re: python libraries to execute or call hive queries

> Can anyone suggest any python libraries to call hive queries from python >scripts ? https://cwiki.apache.org/confluence/display/Hive/HiveClient#HiveClient-Pyth on Though I suspect that's out of date. https://github.com/t3rmin4t0r/amplab-benchmark/blob/master/runner/run_query .p

python libraries to execute or call hive queries

Hi All, Can anyone suggest any python libraries to call hive queries from python scripts ? what is the best practice to execute queries from python like using hive cli , beeline, jdbc etc.., Thanks Giri

Re: How to match three letter month name in Hive queries

Thanks a lot Furcy. It works. Regards, Thimuth On Sun, Dec 21, 2014 at 4:34 PM, Furcy Pin wrote: > Hi Thimut, > > I believe that the UDF unix_timestamp uses the java class SimpleDateFormat. > http://docs.oracle.com/javase/6/docs/api/java/text/SimpleDateFormat.html > > From the doc, you can see

Re: How to match three letter month name in Hive queries

Hi Thimut, I believe that the UDF unix_timestamp uses the java class SimpleDateFormat. http://docs.oracle.com/javase/6/docs/api/java/text/SimpleDateFormat.html >From the doc, you can see that "m" denotes a minute while "M" denotes a month. For your problem, "-MMM-dd" should do the trick. Reg

How to match three letter month name in Hive queries

Hi, How can we match a date value like *2014-Dec-20* in unix_timestamp()? The pattern *-MM-dd* matches 2014-12-20 format. But -mmm-dd or -m-dd is not doing the trick for matching the month name. Thanks and regards, Thimuth

Re: Hive queries returning all NULL values.

Raymond - you were the closest. Parquet field names contained '::' ex. bag1::user_name Hope it will help anyone in the future Thanks for all your help Tor On Sun, Aug 17, 2014 at 7:50 PM, Raymond Lau wrote: > Do your field names in your parquet files contain upper case letters by > any chan

Re: Hive queries returning all NULL values.

Do your field names in your parquet files contain upper case letters by any chance ex. userName? Hive will not read the data of external tables if they are not completely lower case field names, it doesn't convert them properly in the case of external tables. On Aug 17, 2014 8:00 AM, "hadoop hive"

Re: Hive queries returning all NULL values.

Take a small set of data like 2-5 line and insert it... After that you can try insert first 10 column and then next 10 till you fund your problematic column On Aug 17, 2014 8:37 PM, "Tor Ivry" wrote: > Is there any way to debug this? > > We are talking about many fields here. > How can I see whi

Re: Hive queries returning all NULL values.

Is there any way to debug this? We are talking about many fields here. How can I see which field has the mismatch? On Sun, Aug 17, 2014 at 4:30 PM, hadoop hive wrote: > Hi, > > You check the data type you have provided while creating external table, > it should match with data in files. > > T

Re: Hive queries returning all NULL values.

Hi, You check the data type you have provided while creating external table, it should match with data in files. Thanks Vikas Srivastava On Aug 17, 2014 7:07 PM, "Tor Ivry" wrote: > Hi > > > > I have a hive (0.11) table with the following create syntax: > > > > CREATE EXTERNAL TABLE events( > >

Hive queries returning all NULL values.

Hi I have a hive (0.11) table with the following create syntax: CREATE EXTERNAL TABLE events( … ) PARTITIONED BY(dt string) ROW FORMAT SERDE 'parquet.hive.serde.ParquetHiveSerDe' STORED AS INPUTFORMAT "parquet.hive.DeprecatedParquetInputFormat" OUTPUTFORMAT "parquet.hive.De

Hive queries returning all NULL values.

Hi I have a hive (0.11) table with the following create syntax: CREATE EXTERNAL TABLE events( … ) PARTITIONED BY(dt string) ROW FORMAT SERDE 'parquet.hive.serde.ParquetHiveSerDe' STORED AS INPUTFORMAT "parquet.hive.DeprecatedParquetInputFormat" OUTPUTFORMAT "parquet.hive.De

Hive queries returning all NULL values.

Hi I have a hive (0.11) table with the following create syntax: CREATE EXTERNAL TABLE events( … ) PARTITIONED BY(dt string) ROW FORMAT SERDE 'parquet.hive.serde.ParquetHiveSerDe' STORED AS INPUTFORMAT "parquet.hive.DeprecatedParquetInputFormat" OUTPUTFORMAT "parquet.hive.De

Re: Query execution time for Hive queries in Hue Web UI

in the result page click on the m/r job on the left , then click on metadata Stephane On Mon, Jun 23, 2014 at 3:42 AM, Ravi Prasad wrote: > Hi all, > > I have created the Hive table ( million of records). > I am using Hue Web UI to run the Hive queires > > I am running the same queries in

Query execution time for Hive queries in Hue Web UI

Hi all, I have created the Hive table ( million of records). I am using Hue Web UI to run the Hive queires I am running the same queries in both Hive UI ( Beeswax) and Cloudera Impala ( Web UI) in Hue to find our the performance. In the Hue, I am not able to find the query execution tim

Re: Executing Hive Queries in Parallel

>>- To display screen session active >> - screen -x >>- To attach to a screen session >> - screen -x hive_query1 >> >> >> Thanks >> >> Warm Regards >> >> >> Sanjay >> >> >>From: saurab

Re: Executing Hive Queries in Parallel

on >- Repeat for each hive query u want to run > - I.e. Say 5 screen sessions, each running a have query >- To display screen session active > - screen -x >- To attach to a screen session > - screen -x hive_query1 > > > Thanks >

Re: Executing Hive Queries in Parallel

1:53 PM To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Subject: Executing Hive Queries in Parallel Hi, I need some inputs to execute hive queries in parallel. I tried doing this using CLI (by opening multiple ssh connection) and execute

Executing Hive Queries in Parallel

Hi, I need some inputs to execute hive queries in parallel. I tried doing this using CLI (by opening multiple ssh connection) and executed 4 HQL's; it was observed that the queries are getting executed sequentially. All the FOUR queries got submitted however while the first one was in exec

Tuning Hive queries that uses underlying HBase Table

I am querying Hive table ( mapped to HBase Table ) . What are the techniques to tune the Hive query and to avoid HBase scans. Query uses multiple SPLIT and SUBSTR functions and WHERE condition something like select col1, col2, ...,count(*) from hiveTable where split( col1)[0] > timestamp1 an

Hive queries for disk usage analysis

Hello All, We are doing some analysis for which we need to determine things like size of the largest row or size of the largest column. By size, I am referring to disk space usage. Does HIVE provide any functions to run such queries? Thanks, Surbhi Mungre Software Engineer www.cerner.com

Re: Formatting hive queries

know, whether any specific utilities exist already for >> formatting hive queries. >> >> -- >> Thanks, >> Pandeeswaran

Re: Formatting hive queries

Because, formatting is one of the tedious task and i would like to come up > with an utility for that. > Please let me know, whether any specific utilities exist already for > formatting hive queries. > > -- > Thanks, > Pandeeswaran

Formatting hive queries

Hi, I would like to come up with a code which automatically formats your hql files. Because, formatting is one of the tedious task and i would like to come up with an utility for that. Please let me know, whether any specific utilities exist already for formatting hive queries. -- Thanks

Re: User accounts to execute hive queries

from” access to some and “add/modify/delete” options to some > >> > >> > >> > >> > >> > >> “What kind of security do you have on hdfs? “ > >> > >> I could not follow this question > >> > >> &g

Re: User accounts to execute hive queries

s, >> >> Shouvanik >> >> From: Nitin Pawar [mailto:nitinpawar...@gmail.com] >> Sent: Monday, September 16, 2013 6:50 PM >> To: Haldar, Shouvanik >> Cc: user@hive.apache.org >> Subject: Re: User accounts to execute hive queries >> >> >>

Re: User accounts to execute hive queries

in Pawar [mailto:nitinpawar...@gmail.com] > *Sent:* Monday, September 16, 2013 6:50 PM > *To:* Haldar, Shouvanik > *Cc:* user@hive.apache.org > *Subject:* Re: User accounts to execute hive queries > > ** ** > > You will need to tell few more things. > > Do you

RE: User accounts to execute hive queries

s, Shouvanik From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Monday, September 16, 2013 6:50 PM To: Haldar, Shouvanik Cc: user@hive.apache.org Subject: Re: User accounts to execute hive queries You will need to tell few more things. Do you want it secured? Do you distinguish users in different cat

Re: User accounts to execute hive queries

You will need to tell few more things. Do you want it secured? Do you distinguish users in different categories on what one particular user can do or not? What kind of security do you have on hdfs? It is definitely possible for users to run queries on their own username but then you have to take

RE: User accounts to execute hive queries

Hi Nitin, Users want to execute hive queries from their user name? Is it possible or they have to do it logged in as hive user? Thanks, Shouvanik -Original Message- From: Haldar, Shouvanik Sent: Monday, September 16, 2013 4:06 PM To: user@hive.apache.org Subject: User accounts to

User accounts to execute hive queries

Hi, Can you please tell me if its possible to execute hive queries as different users? Can we create read-only access for hive? Please help. Thanks Shouvanik Sent from my Windows Phone -Original Message- From: "Nitin Pawar" Sent: ‎16-‎09-‎2013 15:57 To: "user@hive.apach

Re: Hive Queries on S3 Data not working after moving to Hive metastore on CDH4

. - Himanish On Thu, May 2, 2013 at 8:54 AM, Himanish Kushary wrote: > Hi, > > We were running some hive queries off data on amazon S3.In the hive script > file we are including the access key and secret access key as below. > > set fs.s3.awsAccessKeyId=ABCD; > set fs.s3.awsSecre

Hive Queries on S3 Data not working after moving to Hive metastore on CDH4

Hi, We were running some hive queries off data on amazon S3.In the hive script file we are including the access key and secret access key as below. set fs.s3.awsAccessKeyId=ABCD; set fs.s3.awsSecretAccessKey=XYZ; set fs.s3n.awsAccessKeyId=ABCD; set fs.s3n.awsSecretAccessKey=XYZ; and then we run

Re: Optimizing hive queries

rsioned metadata feature of ORC ? , is it like handling varying >>> schemas in Hive? >>> >>> Regards, >>> >>> Jagat Singh >>> >>> >>> >>> On Fri, Mar 29, 2013 at 4:16 PM, Nitin Pawar wrote: >>> >>>> >>>> Hi, >>>> >>>> Here is is a nice presentation from Owen from Hortonworks on >>>> "Optimizing hive queries" >>>> >>>> http://www.slideshare.net/oom65/optimize-hivequeriespptx >>>> >>>> >>>> >>>> Thanks, >>>> Nitin Pawar >>>> >>> >>> >> >

Re: Optimizing hive queries

>> >> Regards, >> >> Jagat Singh >> >> >> >> On Fri, Mar 29, 2013 at 4:16 PM, Nitin Pawar wrote: >> >>> >>> Hi, >>> >>> Here is is a nice presentation from Owen from Hortonworks on "Optimizing >>> hive queries" >>> >>> http://www.slideshare.net/oom65/optimize-hivequeriespptx >>> >>> >>> >>> Thanks, >>> Nitin Pawar >>> >> >> >

Re: Optimizing hive queries

ioned metadata feature of ORC ? , is it like handling varying schemas > in Hive? > > Regards, > > Jagat Singh > > > > On Fri, Mar 29, 2013 at 4:16 PM, Nitin Pawar wrote: > >> >> Hi, >> >> Here is is a nice presentation from Owen from

Re: Optimizing hive queries

t; Here is is a nice presentation from Owen from Hortonworks on "Optimizing >> hive queries" >> >> http://www.slideshare.net/oom65/optimize-hivequeriespptx >> >> >> >> Thanks, >> Nitin Pawar >> > > -- Nitin Pawar

Re: Optimizing hive queries

rtonworks on "Optimizing > hive queries" > > http://www.slideshare.net/oom65/optimize-hivequeriespptx > > > > Thanks, > Nitin Pawar >

Optimizing hive queries

Hi, Here is is a nice presentation from Owen from Hortonworks on "Optimizing hive queries" http://www.slideshare.net/oom65/optimize-hivequeriespptx Thanks, Nitin Pawar

Re: Where is the location of hive queries

Or use a variant of the INSERT statement to write to a directory or a table. On Wed, Mar 6, 2013 at 10:05 AM, Nitin Pawar wrote: > the results are not stored to any file .. they are available on console > only > > if you want to save to the results then write execute your query like hive > -e "qu

Re: Where is the location of hive queries

the results are not stored to any file .. they are available on console only if you want to save to the results then write execute your query like hive -e "query" > file On Wed, Mar 6, 2013 at 9:32 PM, Sai Sai wrote: > After we run a query in hive shell as: > Select * from myTable; > > Are the

Re: Where is the location of hive queries

After we run a query in hive shell as: Select * from myTable; Are these results getting saved to any file apart from the console/terminal display. If so where is the location of the results. Thanks Sai

Re: Hive queries

e excuse typos > -- > *From: * Cyril Bogus > *Date: *Mon, 25 Feb 2013 10:34:29 -0500 > *To: * > *ReplyTo: * user@hive.apache.org > *Subject: *Re: Hive queries > > I do not get any errors. > It is only when I run hive and try to query the tables

Re: Hive queries

ote device, Please excuse typos -Original Message- From: Cyril Bogus Date: Mon, 25 Feb 2013 10:34:29 To: Reply-To: user@hive.apache.org Subject: Re: Hive queries I do not get any errors. It is only when I run hive and try to query the tables I imported. Let's say I want to only get num

Re: Hive queries

I do not get any errors. It is only when I run hive and try to query the tables I imported. Let's say I want to only get numeric tuples for a given table. I cannot find the table (show tables; is empty) unless I go in the hive home folder and run hive again. I would expect the state of hive to be t

Re: Hive queries

any errors you see ? On Mon, Feb 25, 2013 at 8:48 PM, Cyril Bogus wrote: > Hi everyone, > > My setup is Hadoop 1.0.4, Hive 0.9.0, Sqoop 1.4.2-hadoop 1.0.0 > Mahout 0.7 > > I have imported tables from a remote database directly into Hive using > Sqoop. > > Somehow when I try to run Sqoop from Ha

Hive queries

Hi everyone, My setup is Hadoop 1.0.4, Hive 0.9.0, Sqoop 1.4.2-hadoop 1.0.0 Mahout 0.7 I have imported tables from a remote database directly into Hive using Sqoop. Somehow when I try to run Sqoop from Hadoop, the content Hive is giving me trouble in bookkeeping of where the imported tables are

Re: Hive Queries

anish Bhoge > sent by HTC device. Excuse typo. > > ----- Reply message - > From: "Cyrille Djoko" > To: > Subject: Hive Queries > Date: Sat, Feb 16, 2013 1:50 AM > > > Hi Jarcec, > I did try Sqoop. I am running sqoop 1.4.2 --hadoop1.0

Re: Hive Queries

table can > be loaded using Load table command. > > Regards, > Manish Bhoge > sent by HTC device. Excuse typo. > > - Reply message - > From: "Cyrille Djoko" > To: > Subject: Hive Queries > Date: Sat, Feb 16, 2013 1:50 AM > > > Hi Jar

Re: Hive Queries

real time fashion try Flume. But end of the day the data movement first happens in HDFS and then hive table can be loaded using Load table command. Regards, Manish Bhoge sent by HTC device. Excuse typo. - Reply message - From: "Cyrille Djoko" To: Subject: Hive Queries Date: S

Re: Hive Queries

[-user@hive, +user@sqoop] Hi Cyrille, this seems to me more a Sqoop issue than Hive issue, so I've moved this email to user@sqoop mailing list. I'm keeping user@hive in Bcc so that the mailing list will get the memo. Please join the user@sqoop mailing list [1] to receive additional feedback. >

Re: Hive Queries

Hi Jarcec, I did try Sqoop. I am running sqoop 1.4.2 --hadoop1.0.0 along with hadoop 1.0.4 But I keep running on the following exception. Exception in thread "main" java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.JobContext, but interface was expected So I wrote a

Re: Hive Queries

Hi Cyrille, I'm not exactly sure what exactly you mean, so I'm more or less blindly shooting, but maybe Apache Sqoop [1] might help you? Jarcec Links: 1: http://sqoop.apache.org/ On Fri, Feb 15, 2013 at 01:44:45PM -0500, Cyrille Djoko wrote: > I am looking for a relatively efficient way of tran

  1   2   >