Loop if table is not empty

2015-12-28 Thread Thomas Achache
Hi everyone, I am running a series of queries in a file named rgm.hql. At the end of the execution, if a specific table is not empty, I'd like to run rgm.hql all over again (and again if it the table is not empty). By design it won't be an infinite loop because the table will be empty

Re: troubleshooting: "unread block data' error

2015-12-28 Thread Sofia Panagiotidi
Just for others that might be having the same issue, I managed to fix this and get past it, I think this was something with the HBase jars at the executors’ side (it was only occurring when running queries that were touching HBase through hive, and only in spark cluster mode). My solution was

Avro table from multiple schemas

2015-12-28 Thread Milan Young
Hello, I'd like to create an avro-backed table with a field defined in an external schema.  For example: CREATE TABLE mytableROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe'STORED AS INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'OUTPUTFORMAT

RE: Loop if table is not empty

2015-12-28 Thread Ryan Harris
either use a multi table insert to write the results of the source table into another file/table: https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-MULTITABLEINSERT or use windowing and analytics functions to run a count over the entire table as a separate results

Re: Loop if table is not empty

2015-12-28 Thread Alan Gates
Have you looked at the new procedural HPL/SQL available in recent Hive? If you are using an older version of Hive you can check out hplsql.org, which allows you to install it separately. Alan. Thomas Achache December 28, 2015 at 2:30 Hi everyone, I am running

How to set hive.aux.jars.path in hive1.1.0?

2015-12-28 Thread Lee S
Hi all: I have a serde jar written by myself to deserialize some kind of data. I put the jar in the host of hiverserver and set the *hive.aux.jars.path* property in hive-site.xml. Then I use beeline connecting to hiveserver2, create a table with the serde class, but it said class not

Re: How to set hive.aux.jars.path in hive1.1.0?

2015-12-28 Thread Peyman Mohajerian
Maybe you need to also add: HIVE_AUX_JARS_PATH = /path/to/JAR e.g.: http://www.cloudera.com/content/www/en-us/documentation/archive/manager/4-x/4-8-0/Cloudera-Manager-Managing-Clusters/cmmc_hive_udf.html On Mon, Dec 28, 2015 at 11:52 PM, Lee S wrote: > Sorry, the is ,

Re: How to set hive.aux.jars.path in hive1.1.0?

2015-12-28 Thread Lee S
Sorry, the is , forgive my wrong typing. Anybody can help? On Tue, Dec 29, 2015 at 3:50 PM, Lee S wrote: > Hi all: >I have a serde jar written by myself to deserialize some kind of data. > >I put the jar in the host of hiverserver and set the > *hive.aux.jars.path*