Re: Measuring the execution time of Hive queries through Ambari

ht Mannheim > Registernummer | Register No.: HRB 110579 > USt-ID | VAT ID: DE234663798 > > *Informationen zum Datenschutz | Information about privacy policy* > https://www.solute.de/ger/datenschutz/grundsaetze-der-datenverarbeitung.php > > > > --

AW: Measuring the execution time of Hive queries through Ambari

enverarbeitung.php Von: Mich Talebzadeh Gesendet: Montag, 22. Juni 2020 14:23:51 An: user Betreff: Re: Measuring the execution time of Hive queries through Ambari Hi Julien. It is as I see is standard Ambari. Has TEZ UI but when I run the query and check TEZ UI it says TEZ view is not deployed

Re: Measuring the execution time of Hive queries through Ambari

ze-der-datenverarbeitung.php *Von:* Mich Talebzadeh mailto:mich.talebza...@gmail.com>> *Gesendet:* Montag, 22. Juni 2020 12:57:27 *An:* user *Betreff:* Measuring the execution t

Re: Measuring the execution time of Hive queries through Ambari

USt-ID | VAT ID: DE234663798 > > *Informationen zum Datenschutz | Information about privacy policy* > https://www.solute.de/ger/datenschutz/grundsaetze-der-datenverarbeitung.php > > > > -- > *Von:* Mich Talebzadeh > *Gesendet:* Montag, 22. Juni 2020 12:

AW: Measuring the execution time of Hive queries through Ambari

Datenschutz | Information about privacy policy https://www.solute.de/ger/datenschutz/grundsaetze-der-datenverarbeitung.php Von: Mich Talebzadeh Gesendet: Montag, 22. Juni 2020 12:57:27 An: user Betreff: Measuring the execution time of Hive queries through Ambari Hi,

Measuring the execution time of Hive queries through Ambari

Hi, Using Ambari to connect to Hive, is there any way of measuring the query time? Please be aware that this is through Ambari not through beeline etc. The tool we have at the moment is Ambari to Prod. We do not have any other luxury! Thanks LinkedIn *

Re: Running Hive queries from Ambari or from edge node via beeline

T ID: DE234663798 > > *Informationen zum Datenschutz | Information about privacy policy* > https://www.solute.de/ger/datenschutz/grundsaetze-der-datenverarbeitung.php > > > > -- > *Von:* Mich Talebzadeh > *Gesendet:* Montag, 15. Juni 2020 21:26:20 > *An:

AW: Running Hive queries from Ambari or from edge node via beeline

__ Von: Mich Talebzadeh Gesendet: Montag, 15. Juni 2020 21:26:20 An: user Betreff: Running Hive queries from Ambari or from edge node via beeline Hi, I am not a user of Ambari but I believe it is a GUI interface to Hive. it can be run on your laptop and connect to Hive via ODBC or JDBC. There is

Running Hive queries from Ambari or from edge node via beeline

Hi, I am not a user of Ambari but I believe it is a GUI interface to Hive. it can be run on your laptop and connect to Hive via ODBC or JDBC. There is also another tool DB Visualizer Pro that uses JDBC to connect to Hive thrift server. My view is that if one is a developer the best best would

Re: Clustering and Large-scale analysis of Hive Queries

> I am interested in working on a project that takes a large number of Hive > queries (as well as their meta data like amount of resources used etc) and > find out common sub queries and expensive query groups etc. This was roughly the central research topic of one of the Hive

Re: Clustering and Large-scale analysis of Hive Queries

sted in hearing about good and bad about Dr Elephant w/ Hive. > > Sent from my iPhone > > On Jul 25, 2018, at 12:13 PM, Zheng Shao wrote: > > Hi, > > I am interested in working on a project that takes a large number of Hive > queries (as well as their meta data like amo

Re: Clustering and Large-scale analysis of Hive Queries

. Sent from my iPhone > On Jul 25, 2018, at 12:13 PM, Zheng Shao wrote: > > Hi, > > I am interested in working on a project that takes a large number of Hive > queries (as well as their meta data like amount of resources used etc) and > find out common sub queries and expen

Clustering and Large-scale analysis of Hive Queries

Hi, I am interested in working on a project that takes a large number of Hive queries (as well as their meta data like amount of resources used etc) and find out common sub queries and expensive query groups etc. Are there any existing work in this domain? Happy to collaborate as well

Any hooks to invoke the custom database's statistics for aggregate hive queries

queries instead of full table scan, storageHandler should be able to invoke our totalCount, max, min etc. methods So are there any hooks to invoke these statistics api's for aggregate hive queries which can do simple look up of these statistics? Thanks, Amey

Re: Maintaining big and complex Hive queries

I have been contemplating attaching meta data for the query lineage to each table such that I can know where the data came from and have a 1 click regenerate button. On Wed, Dec 21, 2016 at 3:02 PM, Stephen Sprague wrote: > my 2 cents. :) > > as soon as you say "complex

Re: Maintaining big and complex Hive queries

my 2 cents. :) as soon as you say "complex query" i would submit you've lost the upperhand and you're behind the eight-ball right off the bat. And you know this too otherwise you wouldn't have posted here. ha! i use cascading CTAS statements so that i can examine the intermediate tables.

Re: Maintaining big and complex Hive queries

Hi Elliot, Thanks for letting me know. HPL-SQL sounded particularly interesting. But in the documentation I could not see any way to pass output generated by one Hive query to the next one. The tool looks good as a homogeneous PL-SQL platform for multiple big-data systems

Re: Maintaining big and complex Hive queries

I notice that HPL/SQL is not mentioned on the page I referenced, however I expect that is another approach that you could use to modularise: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=59690156 http://www.hplsql.org/doc On 15 December 2016 at 17:17, Elliot West

Re: Maintaining big and complex Hive queries

Some options are covered here, although there is no definitive guidance as far as I know: https://cwiki.apache.org/confluence/display/Hive/Unit+Testing+Hive+SQL#UnitTestingHiveSQL-Modularisation On 15 December 2016 at 17:08, Saumitra Shahapure < saumitra.offic...@gmail.com> wrote: > Hello, > >

Maintaining big and complex Hive queries

Hello, We are running and maintaining quite big and complex Hive SELECT query right now. It's basically a single SELECT query which performs JOIN of about ten other SELECT query outputs. A simplest way to refactor that we can think of is to break this query down into multiple views and then join

Re: Hive queries rejected under heavy load

gotta start by looking at the logs and run the local client to eliminate HS2. perhaps running hive as such: $ hive -hiveconf hive.root.logger=DEBUG,console do you see any smoking gun? On Wed, Sep 28, 2016 at 7:34 AM, Jose Rozanec wrote: > Hi, > > We have a

Hive queries rejected under heavy load

Hi, We have a Hive cluster (Hive 2.1.0+Tez 0.8.4) which works well for most queries. Though for some heavy ones we observe that sometimes are able to execute and sometimes get rejected. We are not sure why we get a rejection instead of getting them enqueued and wait for execution until resources

Running multiple hive queries in the same jvm

Team, I want to know whether there is any way in which I can run 3 hive queries sequentially in a single jvm. From the docs, I found that setting " mapreduce.framework.name=local" might achieve what I am looking for. Can some one confirm? - Rahul

Re: How to run large Hive queries in PySpark 1.2.1

> wrote: > > Hi PySpark users, > > We need to be able to run large Hive queries in PySpark 1.2.1. Users are > running PySpark on an Edge Node, and submit jobs to a Cluster that > allocates YARN resources to the clients. > We are using MapR as the Hadoop Distribution on to

Re: How to run large Hive queries in PySpark 1.2.1

Both have outdated versions, usually one can support you better if you upgrade to the newest. Firewall could be an issue here. > On 26 May 2016, at 10:11, Nikolay Voronchikhin <nvoronchik...@gmail.com> > wrote: > > Hi PySpark users, > > We need to be able to run large

Fwd: How to run large Hive queries in PySpark 1.2.1

Hi PySpark users, We need to be able to run large Hive queries in PySpark 1.2.1. Users are running PySpark on an Edge Node, and submit jobs to a Cluster that allocates YARN resources to the clients. We are using MapR as the Hadoop Distribution on top of Hive 0.13 and Spark 1.2.1. Currently, our

Varying vcores/ram for hive queries running Tez engine

I was trying to benchmark some hive queries. I am using the tez execution engine. I varied the values of the following properties: 1. hive.tez.container.size 2. tez.task.resource.memory.mb 3. tez.task.resource.cpu.vcores Changes in values for property 1 is reflected properly

RE: Mappers spawning Hive queries

I'm not aware of any particular reason that this shouldn't "inherently" work, but for debugging purposes I'd be wondering about the nested environment variables related to the hadoop job.the bash shell where you are trying to launch subsequent hive queries already has pre-exist

Re: Mappers spawning Hive queries

-- a streaming MR job spawning multiple hive queries that in turn spawn mr jobs. Shirish On Mon, Apr 18, 2016 at 1:31 PM, Ryan Harris <ryan.har...@zionsbancorp.com> wrote: > My $0.02 > > > > If you are running multiple concurrent queries on the data, you are > probably doi

RE: Mappers spawning Hive queries

, April 18, 2016 2:00 PM To: user@hive.apache.org Subject: Re: Mappers spawning Hive queries Hi John, 2) The shell script is invoked in the mappers of a Hadoop streaming job. 1) The use case is that I have to process multiple entities in parallel. Each entity is associated with its own data set

Re: Mappers spawning Hive queries

> Each entity is associated with its own data set. The processing involves a > few hive queries to do joins and aggregations, which is followed by some > code in Python. My thought process is to put the hive queries and python > invocation in a shell script, and invoke the shell script on

Re: Mappers spawning Hive queries

Hi John, 2) The shell script is invoked in the mappers of a Hadoop streaming job. 1) The use case is that I have to process multiple entities in parallel. Each entity is associated with its own data set. The processing involves a few hive queries to do joins and aggregations, which is followed

Re: Mappers spawning Hive queries

Just out of curiosity, what is the use case behind this? How do you call the shell script? > On 16 Apr 2016, at 00:24, Shirish Tatikonda <shirish.tatiko...@gmail.com> > wrote: > > Hello, > > I am trying to run multiple hive queries in parallel by submitting them &g

Mappers spawning Hive queries

Hello, I am trying to run multiple hive queries in parallel by submitting them through a map-reduce job. More specifically, I have a map-only hadoop streaming job where each mapper runs a shell script that does two things -- 1) parses input lines obtained via streaming; and 2) submits a very

Re: Running hive queries in different queue

gt; Date: Friday, February 26, 2016 at 6:01 PM To: "user@hive.apache.org<mailto:user@hive.apache.org>" <user@hive.apache.org<mailto:user@hive.apache.org>> Subject: Re: Running hive queries in different queue I think in your hive script you can do set mapreduce.job.queuen

Re: Running hive queries in different queue

Hello. What Hive client are you using? beeline Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On 27

Re: Running hive queries in different queue

I think in your hive script you can do set mapreduce.job.queuename=; Thanks Sathi From: Rajit Saha Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" Date: Friday, February 26, 2016 at 5:34 PM To: "user@hive.apache.org<mailto:user@hive.apache.org>&quo

Running hive queries in different queue

Hi I want to run hive query in a queue others than "default" queue from hive client command line . Can anybody please suggest a way to do it. Regards Rajit On Feb 26, 2016, at 07:36, Patrick Duin > wrote: Hi Prasanth. Thanks for the quick reply!

Re: Is it ok to build an entire ETL/ELT data flow using HIVE queries?

Spark, Crunch, Scrunch, Scalding, > etc. > > Elliot. > > > On Tuesday, 16 February 2016, Ramasubramanian < > ramasubramanian.naraya...@gmail.com> wrote: > >> Hi, >> >> Is it ok to build an entire ETL/ELT data flow using HIVE queries? >> &

Re: Is it ok to build an entire ETL/ELT data flow using HIVE queries?

re ETL/ELT data flow using HIVE queries? > > Data is stored in HIVE. We have transactional and reference data. We need > to build a small warehouse. > > Need suggestion on alternatives too. > > Regards, > Rams

Re: Is it ok to build an entire ETL/ELT data flow using HIVE queries?

A combination of both normally See below https://www.linkedin.com/pulse/etl-elt-use-case-mich-talebzadeh-ph-d-?trk=pulse_spock-articles [1] HTH. Mich On 16/02/2016 06:19, Ramasubramanian wrote: > Hi, > > Is it ok to build an entire ETL/ELT data flow using HIVE queries?

Re: Is it ok to build an entire ETL/ELT data flow using HIVE queries?

My company do ETL data flow using HIVE + Pig, it is OK now. 2016-02-16 14:55 GMT+08:00 Jörn Franke <jornfra...@gmail.com>: > Why should it not be ok if you do not miss any functionality? You can use > oozie + hive queries to have more sophisticated logging and scheduling. Do

Re: Is it ok to build an entire ETL/ELT data flow using HIVE queries?

Why should it not be ok if you do not miss any functionality? You can use oozie + hive queries to have more sophisticated logging and scheduling. Do not forget to do proper capacity/queue management. > On 16 Feb 2016, at 07:19, Ramasubramanian > <ramasubramanian.naraya...@gmail.c

Is it ok to build an entire ETL/ELT data flow using HIVE queries?

Hi, Is it ok to build an entire ETL/ELT data flow using HIVE queries? Data is stored in HIVE. We have transactional and reference data. We need to build a small warehouse. Need suggestion on alternatives too. Regards, Rams

Re: how to set a job name for hive queries

Please see this, its possible with Tez in Hive 1.2.1 https://community.hortonworks.com/questions/9004/naming-tez-hive-session.html On Jan 19, 2016 11:06 AM, "Frank Luo" wrote: > We are in a multi-tenant environment wanting to add a client’s name into > each job name hence

how to set a job name for hive queries

We are in a multi-tenant environment wanting to add a client’s name into each job name hence they can be informed/involved when job fails. We can easily do that with M/R jobs, but I haven’t figure out a way to do so for hive job. I googled and found the answer below, but I couldn’t get it to

RE: python libraries to execute or call hive queries

Hi Gopal Have you tried pyhs2 libraryIt has many useful functions to retrieve the data thanksrakesh > Date: Fri, 28 Aug 2015 11:53:20 -0700 > Subject: Re: python libraries to execute or call hive queries > From: gop...@apache.org > To: user@hive.apache.org > > > > Can a

python libraries to execute or call hive queries

Hi All, Can anyone suggest any python libraries to call hive queries from python scripts ? what is the best practice to execute queries from python like using hive cli , beeline, jdbc etc.., Thanks Giri

Re: python libraries to execute or call hive queries

Can anyone suggest any python libraries to call hive queries from python scripts ? https://cwiki.apache.org/confluence/display/Hive/HiveClient#HiveClient-Pyth on Though I suspect that's out of date. https://github.com/t3rmin4t0r/amplab-benchmark/blob/master/runner/run_query .py#L604

Re: How to match three letter month name in Hive queries

Hi Thimut, I believe that the UDF unix_timestamp uses the java class SimpleDateFormat. http://docs.oracle.com/javase/6/docs/api/java/text/SimpleDateFormat.html From the doc, you can see that m denotes a minute while M denotes a month. For your problem, -MMM-dd should do the trick. Regards,

Re: How to match three letter month name in Hive queries

Thanks a lot Furcy. It works. Regards, Thimuth On Sun, Dec 21, 2014 at 4:34 PM, Furcy Pin furcy@flaminem.com wrote: Hi Thimut, I believe that the UDF unix_timestamp uses the java class SimpleDateFormat. http://docs.oracle.com/javase/6/docs/api/java/text/SimpleDateFormat.html From the

How to match three letter month name in Hive queries

Hi, How can we match a date value like *2014-Dec-20* in unix_timestamp()? The pattern *-MM-dd* matches 2014-12-20 format. But -mmm-dd or -m-dd is not doing the trick for matching the month name. Thanks and regards, Thimuth

Re: Hive queries returning all NULL values.

Raymond - you were the closest. Parquet field names contained '::' ex. bag1::user_name Hope it will help anyone in the future Thanks for all your help Tor On Sun, Aug 17, 2014 at 7:50 PM, Raymond Lau raymond.lau...@gmail.com wrote: Do your field names in your parquet files contain upper

Hive queries returning all NULL values.

Hi I have a hive (0.11) table with the following create syntax: CREATE EXTERNAL TABLE events( … ) PARTITIONED BY(dt string) ROW FORMAT SERDE 'parquet.hive.serde.ParquetHiveSerDe' STORED AS INPUTFORMAT parquet.hive.DeprecatedParquetInputFormat OUTPUTFORMAT

Hive queries returning all NULL values.

Hi I have a hive (0.11) table with the following create syntax: CREATE EXTERNAL TABLE events( … ) PARTITIONED BY(dt string) ROW FORMAT SERDE 'parquet.hive.serde.ParquetHiveSerDe' STORED AS INPUTFORMAT parquet.hive.DeprecatedParquetInputFormat OUTPUTFORMAT

Re: Hive queries returning all NULL values.

Hi, You check the data type you have provided while creating external table, it should match with data in files. Thanks Vikas Srivastava On Aug 17, 2014 7:07 PM, Tor Ivry tork...@gmail.com wrote: Hi I have a hive (0.11) table with the following create syntax: CREATE EXTERNAL TABLE

Re: Hive queries returning all NULL values.

Is there any way to debug this? We are talking about many fields here. How can I see which field has the mismatch? On Sun, Aug 17, 2014 at 4:30 PM, hadoop hive hadooph...@gmail.com wrote: Hi, You check the data type you have provided while creating external table, it should match with

Re: Hive queries returning all NULL values.

Take a small set of data like 2-5 line and insert it... After that you can try insert first 10 column and then next 10 till you fund your problematic column On Aug 17, 2014 8:37 PM, Tor Ivry tork...@gmail.com wrote: Is there any way to debug this? We are talking about many fields here. How

Re: Hive queries returning all NULL values.

Do your field names in your parquet files contain upper case letters by any chance ex. userName? Hive will not read the data of external tables if they are not completely lower case field names, it doesn't convert them properly in the case of external tables. On Aug 17, 2014 8:00 AM, hadoop hive

Re: Query execution time for Hive queries in Hue Web UI

in the result page click on the m/r job on the left , then click on metadata Stephane On Mon, Jun 23, 2014 at 3:42 AM, Ravi Prasad raviprasa...@gmail.com wrote: Hi all, I have created the Hive table ( million of records). I am using Hue Web UI to run the Hive queires I am running the

Query execution time for Hive queries in Hue Web UI

Hi all, I have created the Hive table ( million of records). I am using Hue Web UI to run the Hive queires I am running the same queries in both Hive UI ( Beeswax) and Cloudera Impala ( Web UI) in Hue to find our the performance. In the Hue, I am not able to find the query execution

Re: Executing Hive Queries in Parallel

hive_query1 Thanks Warm Regards Sanjay From: saurabh mpp.databa...@gmail.com Reply-To: user@hive.apache.org user@hive.apache.org Date: Monday, April 21, 2014 at 1:53 PM To: user@hive.apache.org user@hive.apache.org Subject: Executing Hive Queries in Parallel Hi, I need some

Re: Executing Hive Queries in Parallel

- screen -x hive_query1 Thanks Warm Regards Sanjay From: saurabh mpp.databa...@gmail.com Reply-To: user@hive.apache.org user@hive.apache.org Date: Monday, April 21, 2014 at 1:53 PM To: user@hive.apache.org user@hive.apache.org Subject: Executing Hive Queries in Parallel Hi

Executing Hive Queries in Parallel

Hi, I need some inputs to execute hive queries in parallel. I tried doing this using CLI (by opening multiple ssh connection) and executed 4 HQL's; it was observed that the queries are getting executed sequentially. All the FOUR queries got submitted however while the first one was in execution

Re: Executing Hive Queries in Parallel

@hive.apache.orgmailto:user@hive.apache.org Subject: Executing Hive Queries in Parallel Hi, I need some inputs to execute hive queries in parallel. I tried doing this using CLI (by opening multiple ssh connection) and executed 4 HQL's; it was observed that the queries are getting executed sequentially. All the FOUR

Tuning Hive queries that uses underlying HBase Table

I am querying Hive table ( mapped to HBase Table ) . What are the techniques to tune the Hive query and to avoid HBase scans. Query uses multiple SPLIT and SUBSTR functions and WHERE condition something like select col1, col2, ...,count(*) from hiveTable where split( col1)[0] timestamp1

Hive queries for disk usage analysis

Hello All, We are doing some analysis for which we need to determine things like size of the largest row or size of the largest column. By size, I am referring to disk space usage. Does HIVE provide any functions to run such queries? Thanks, Surbhi Mungre Software Engineer

Re: Formatting hive queries

. Because, formatting is one of the tedious task and i would like to come up with an utility for that. Please let me know, whether any specific utilities exist already for formatting hive queries. -- Thanks, Pandeeswaran

Formatting hive queries

Hi, I would like to come up with a code which automatically formats your hql files. Because, formatting is one of the tedious task and i would like to come up with an utility for that. Please let me know, whether any specific utilities exist already for formatting hive queries. -- Thanks

Re: User accounts to execute hive queries

this question Thanks, Shouvanik From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Monday, September 16, 2013 6:50 PM To: Haldar, Shouvanik Cc: user@hive.apache.org Subject: Re: User accounts to execute hive queries You will need to tell few more things. Do you

Re: User accounts to execute hive queries

, 2013 6:50 PM *To:* Haldar, Shouvanik *Cc:* user@hive.apache.org *Subject:* Re: User accounts to execute hive queries ** ** You will need to tell few more things. Do you want it secured? Do you distinguish users in different categories on what one particular user can do

Re: User accounts to execute hive queries

Subject: Re: User accounts to execute hive queries You will need to tell few more things. Do you want it secured? Do you distinguish users in different categories on what one particular user can do or not? What kind of security do you have on hdfs? It is definitely possible

User accounts to execute hive queries

Hi, Can you please tell me if its possible to execute hive queries as different users? Can we create read-only access for hive? Please help. Thanks Shouvanik Sent from my Windows Phone -Original Message- From: Nitin Pawar nitinpawar...@gmail.com Sent: ‎16-‎09-‎2013 15:57 To: user

RE: User accounts to execute hive queries

Hi Nitin, Users want to execute hive queries from their user name? Is it possible or they have to do it logged in as hive user? Thanks, Shouvanik -Original Message- From: Haldar, Shouvanik Sent: Monday, September 16, 2013 4:06 PM To: user@hive.apache.org Subject: User accounts

Re: User accounts to execute hive queries

You will need to tell few more things. Do you want it secured? Do you distinguish users in different categories on what one particular user can do or not? What kind of security do you have on hdfs? It is definitely possible for users to run queries on their own username but then you have to take

Re: Optimizing hive queries

: Hi, Here is is a nice presentation from Owen from Hortonworks on Optimizing hive queries http://www.slideshare.net/oom65/optimize-hivequeriespptx Thanks, Nitin Pawar

Re: Optimizing hive queries

on Versioned metadata feature of ORC ? , is it like handling varying schemas in Hive? Regards, Jagat Singh On Fri, Mar 29, 2013 at 4:16 PM, Nitin Pawar nitinpawar...@gmail.comwrote: Hi, Here is is a nice presentation from Owen from Hortonworks on Optimizing hive queries http

Optimizing hive queries

Hi, Here is is a nice presentation from Owen from Hortonworks on Optimizing hive queries http://www.slideshare.net/oom65/optimize-hivequeriespptx Thanks, Nitin Pawar

Re: Optimizing hive queries

from Hortonworks on Optimizing hive queries http://www.slideshare.net/oom65/optimize-hivequeriespptx Thanks, Nitin Pawar

Re: Optimizing hive queries

Hortonworks on Optimizing hive queries http://www.slideshare.net/oom65/optimize-hivequeriespptx Thanks, Nitin Pawar -- Nitin Pawar

Re: Optimizing hive queries

of ORC ? , is it like handling varying schemas in Hive? Regards, Jagat Singh On Fri, Mar 29, 2013 at 4:16 PM, Nitin Pawar nitinpawar...@gmail.comwrote: Hi, Here is is a nice presentation from Owen from Hortonworks on Optimizing hive queries http://www.slideshare.net/oom65/optimize

Re: Where is the location of hive queries

After we run a query in hive shell as: Select * from myTable; Are these results getting saved to any file apart from the console/terminal display. If so where is the location of the results. Thanks Sai

Re: Where is the location of hive queries

the results are not stored to any file .. they are available on console only if you want to save to the results then write execute your query like hive -e query file On Wed, Mar 6, 2013 at 9:32 PM, Sai Sai saigr...@yahoo.in wrote: After we run a query in hive shell as: Select * from

Re: Where is the location of hive queries

Or use a variant of the INSERT statement to write to a directory or a table. On Wed, Mar 6, 2013 at 10:05 AM, Nitin Pawar nitinpawar...@gmail.comwrote: the results are not stored to any file .. they are available on console only if you want to save to the results then write execute your

Hive queries

Hi everyone, My setup is Hadoop 1.0.4, Hive 0.9.0, Sqoop 1.4.2-hadoop 1.0.0 Mahout 0.7 I have imported tables from a remote database directly into Hive using Sqoop. Somehow when I try to run Sqoop from Hadoop, the content Hive is giving me trouble in bookkeeping of where the imported tables

Re: Hive queries

any errors you see ? On Mon, Feb 25, 2013 at 8:48 PM, Cyril Bogus cyrilbo...@gmail.com wrote: Hi everyone, My setup is Hadoop 1.0.4, Hive 0.9.0, Sqoop 1.4.2-hadoop 1.0.0 Mahout 0.7 I have imported tables from a remote database directly into Hive using Sqoop. Somehow when I try to run

Re: Hive queries

, Please excuse typos -Original Message- From: Cyril Bogus cyrilbo...@gmail.com Date: Mon, 25 Feb 2013 10:34:29 To: user@hive.apache.org Reply-To: user@hive.apache.org Subject: Re: Hive queries I do not get any errors. It is only when I run hive and try to query the tables I imported. Let's say

Re: Hive queries

cyrilbo...@gmail.com *Date: *Mon, 25 Feb 2013 10:34:29 -0500 *To: *user@hive.apache.org *ReplyTo: * user@hive.apache.org *Subject: *Re: Hive queries I do not get any errors. It is only when I run hive and try to query the tables I imported. Let's say I want to only get numeric tuples

Re: Hive Queries

table can be loaded using Load table command. Regards, Manish Bhoge sent by HTC device. Excuse typo. - Reply message - From: Cyrille Djoko c...@agnik.com To: user@hive.apache.org Subject: Hive Queries Date: Sat, Feb 16, 2013 1:50 AM Hi Jarcec, I did try Sqoop. I am running sqoop

Re: Hive Queries

: Hive Queries Date: Sat, Feb 16, 2013 1:50 AM Hi Jarcec, I did try Sqoop. I am running sqoop 1.4.2 --hadoop1.0.0 along with hadoop 1.0.4 But I keep running on the following exception. Exception in thread main java.lang.IncompatibleClassChangeError: Found class

Hive Queries

I am looking for a relatively efficient way of transferring data between a remote server and Hive without going through the hassle of storing the data first on memory before loading it to Hive. From what I have read so far there is no such command but it would not hurt to ask. Is it possible to

Re: Hive Queries

Hi Cyrille, I'm not exactly sure what exactly you mean, so I'm more or less blindly shooting, but maybe Apache Sqoop [1] might help you? Jarcec Links: 1: http://sqoop.apache.org/ On Fri, Feb 15, 2013 at 01:44:45PM -0500, Cyrille Djoko wrote: I am looking for a relatively efficient way of

Re: Hive Queries

Hi Jarcec, I did try Sqoop. I am running sqoop 1.4.2 --hadoop1.0.0 along with hadoop 1.0.4 But I keep running on the following exception. Exception in thread main java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.JobContext, but interface was expected So I wrote a

Re: Hive Queries

[-user@hive, +user@sqoop] Hi Cyrille, this seems to me more a Sqoop issue than Hive issue, so I've moved this email to user@sqoop mailing list. I'm keeping user@hive in Bcc so that the mailing list will get the memo. Please join the user@sqoop mailing list [1] to receive additional feedback.

Run hive queries, and collect job information

Hi folks, I would like to run a list of generated HIVE queries. For each, I would like to retrieve the MR job_id (or ids, in case of multiple stages). And then, with this job_id, collect statistics from job tracker (cumulative CPU, read bytes...) How can I send HIVE queries from a bash or python

Re: Run hive queries, and collect job information

folks, I would like to run a list of generated HIVE queries. For each, I would like to retrieve the MR job_id (or ids, in case of multiple stages). And then, with this job_id, collect statistics from job tracker (cumulative CPU, read bytes...) How can I send HIVE queries from a bash or python

Re: Run hive queries, and collect job information

, Qiang 2013/1/30 Mathieu Despriee mdespr...@octo.com Hi folks, I would like to run a list of generated HIVE queries. For each, I would like to retrieve the MR job_id (or ids, in case of multiple stages). And then, with this job_id, collect statistics from job tracker (cumulative CPU, read

Re: Run hive queries, and collect job information

Regard, Qiang 2013/1/30 Mathieu Despriee mdespr...@octo.com Hi folks, I would like to run a list of generated HIVE queries. For each, I would like to retrieve the MR job_id (or ids, in case of multiple stages). And then, with this job_id, collect statistics from job tracker (cumulative

Re: REST API for Hive queries?

Ideally, push the aggregated data to some RDBMS like MySQL and have REST API or some API to enable ui to build report or query out of it. If the use case is ad-hoc query then once that qry is submitted, and result is generated in batch mode, the REST API can be provided to get the results from

Re: REST API for Hive queries?

If your requirement is that queries are not going to be run on fly then i would suggest following. 1) Create Hive script 2) Combine it with Oozie workflow to run at scheduled time and push results to some DB say MySQL 3) Use some application to talk to MySQL and generate those reports. Thanks,

  1   2   >