troubleshooting: "unread block data' error

2015-11-17 Thread Sofia
Hello, I have configured Hive to work Spark. I have been trying to run a query on a Hive table managing an HBase table (created via HBaseStorageHandler) at the Hive CLI. When spark.master is “local" it works just fine, but when I set it to my spark master spark://spark-master:7077 I get the

Re: ORC tables loading

2015-11-17 Thread Alan Gates
The reads and writes both happen in parallel, so as more nodes are available for read and write, at least in this case, the time stays roughly the same. Alan. James Pirz November 16, 2015 at 21:23 Hi, I am using Hive 1.2 with ORC tables on Hadoop 2.6 on a

Hive/Tez bug -- escaping spaces in classpath

2015-11-17 Thread John Lilley
Greetings, We are seeing an issue that I summarize as "Tez doesn't like spaces in the classpath", but I wanted to check with the group before submitting a JIRA. This is showing when we try to access Hive on HDP 2.3 from a Windows client, where we've put the client jars in a classpath that

Re: Changelog table

2015-11-17 Thread Gopal Vijayaraghavan
> If I have a series of entries that look like ... > { "update", {"baz" : "bar" }} Due to the way the split distribution works, you need a global ordering key for each operation. 0, "ADD", "baz", "" 1, "SET", "baz", "bar" 2, "DEL", "baz", null If you do not have updates coming in within a

Re: Cross join/cartesian product explanation

2015-11-17 Thread Gopal Vijayaraghavan
>It¹s really a very simple query that I¹m trying to run: >select ... >bloom_contains(a_id, b_id_bloom) That's nearly impossible to optimize directly - there is no way to limit the number of table_b rows which may match table a. More than one bloom filter can successfully match a single row

Re: hive transaction strange behaviour

2015-11-17 Thread Sanjeev Verma
Thank Elliot, Eugene I am able to see the Base file created in one of the partition, seems the Compactor kicked in and created it but it has not created base files in rest of the partition where delta files still exists.why compactor has not picked the other partition, when and how these partition

full DDL for an index

2015-11-17 Thread Mich Talebzadeh
Hi, Is there an equivalent of "show create table " for index in hive? hive> show index on t; OK idx_object_id t object_id asehadoop__t_idx_object_id__compact Time taken: 0.035 seconds, Fetched: 1 row(s) hive> show create index idx_object_id; FAILED:

Re: hive transaction strange behaviour

2015-11-17 Thread Sanjeev Verma
Any help will be much appreciated.Thanks On Tue, Nov 17, 2015 at 2:39 PM, Sanjeev Verma wrote: > Thank Elliot, Eugene > I am able to see the Base file created in one of the partition, seems the > Compactor kicked in and created it but it has not created base files in

Re: override log4j level

2015-11-17 Thread Lefty Leverenz
This is documented in the wiki: Hive Logging . -- Lefty On Mon, Nov 16, 2015 at 11:49 PM, Amey Barve wrote: > Hi Patcharee, > > Use > *--hiveconf hive.root.logger=ERROR,console*