Re: How to do a calculation among 2 rows?
There's a new release candidate version of Hive that includes windowing functions that address this. RC1 is available at http://people.apache.org/~hashutosh/hive-0.11.0-rc1/. Also see https://issues.apache.org/jira/browse/HIVE-896 Without 0.11 the approach from Paul will work, but will be slow. On Wed, May 15, 2013 at 7:53 AM, Paul COURTOIS p...@pole-conseils.com wrote: Hi Bhathiya, what about cartesian product ? the idea would be something like that : select a, b, c from t1 join t1 as t2 on t2.a = t1.a where t2.b t1.b it's not very elegant, but should work ;-) Paul 2013/5/15 Bhathiya Jayasekara tobhathi...@gmail.com Hi all, Can someone please give an idea for this? I'm totally stuck. http://stackoverflow.com/questions/16558438/in-hive-how-to-do-a-calculation-among-2-rows Thanks. --Bhathiya
Re: Filtering
On Wed, May 15, 2013 at 3:38 AM, Peter Marron peter.mar...@trilliumsoftware.com wrote: Hi, ** ** I’m using Hive 0.10.0 and Hadoop 1.0.4. ** ** I would like to create a normal table but have some of my code run so that I can remove filtering parts of the query and limit the output in the splits of the InputFormat. I believe that this is “Filtering Pushdown” as described in https://cwiki.apache.org/Hive/filterpushdowndev.html I have tried various approaches and run into problems and I was wondering* *** if anyone had any suggestions as to how I might proceed. I've started doing similar work for the ORC reader. ** ** Firstly although that page mentions InputFormat there doesn’t seem to be any way (that I can find) to perform filter passing to InputFormats and so I gave up on that approach. There is. You just need to set hive.optimize.index.filter to true. See https://issues.apache.org/jira/browse/HIVE-4242. That said, we really need to create a better interface that allows inputformats to negotiate what parts of the predicate they can process. -- Owen **
Re: adding create or replace view documentation to the wiki
I also just realized that partitioned views have also been in Hive since 0.8 but it seems the only place they're mentioned on the main LanguageManual DDL page is in another offhand remark in the docs for ALTER VIEW AS SELECT. I was at least able to find a design dochttps://cwiki.apache.org/confluence/display/Hive/PartitionedViewsfor the feature, and it does seem like it does describe the feature pretty well, but there are parts of it that don't seem the most definitive (e.g. referring in future tense to CREATE OR REPLACE VIEW functionality). Could someone also update the wiki about this too? I'd love to update it myself with a couple stubs that at least point to the existence of these functionalities. Is this the right place to make such requests? Thanks again! --Darren On Mon, May 13, 2013 at 9:19 PM, Darren Yin darren@gmail.com wrote: I just realized that this has existed in Hive for a couple years now, but the only reference to it that exists on this page in the wiki https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL is an offhand remark in the documentation for ALTER VIEW AS SELECT. Looks like it was implemented as a response to HIVE-1078https://issues.apache.org/jira/browse/HIVE-1078. It even looks like there's a reminder to update the wiki, but it doesn't seem like the wiki was ever updated. Thanks! --Darren
Re: adding create or replace view documentation to the wiki
Glad to see someone paying attention to the docs. I can't tackle these tasks right now, so I'm adding d...@hive.apache.org to the mailing list. Hope springs eternal – Lefty On Wed, May 15, 2013 at 11:50 AM, Darren Yin darren@gmail.com wrote: I also just realized that partitioned views have also been in Hive since 0.8 but it seems the only place they're mentioned on the main LanguageManual DDL page is in another offhand remark in the docs for ALTER VIEW AS SELECT. I was at least able to find a design dochttps://cwiki.apache.org/confluence/display/Hive/PartitionedViewsfor the feature, and it does seem like it does describe the feature pretty well, but there are parts of it that don't seem the most definitive (e.g. referring in future tense to CREATE OR REPLACE VIEW functionality). Could someone also update the wiki about this too? I'd love to update it myself with a couple stubs that at least point to the existence of these functionalities. Is this the right place to make such requests? Thanks again! --Darren On Mon, May 13, 2013 at 9:19 PM, Darren Yin darren@gmail.com wrote: I just realized that this has existed in Hive for a couple years now, but the only reference to it that exists on this page in the wiki https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL is an offhand remark in the documentation for ALTER VIEW AS SELECT. Looks like it was implemented as a response to HIVE-1078https://issues.apache.org/jira/browse/HIVE-1078. It even looks like there's a reminder to update the wiki, but it doesn't seem like the wiki was ever updated. Thanks! --Darren
Partitioning an external hbase table
Is it possible to define partitions for a external table backed by Hbase? If so what is the proper syntax? I already have an external table backed by base and I'm finding that for even simple SELECT queries the load isn't getting evenly distributed a across the map tasks. Some tasks see as few as a few hundred map input records while others receive more than a million.
Hive Web Interface
I have installed Hive locally I am able to run Hive queries etc. Now I would like to try out Hive Web Interface, but when I try to start the webserver I run into this: ./hive --service hwi 13/05/15 22:18:33 INFO hwi.HWIServer: HWI is starting up 13/05/15 22:18:33 WARN conf.HiveConf: hive-site.xml not found on CLASSPATH 13/05/15 22:18:34 FATAL hwi.HWIServer: HWI WAR file not found at HIVEDIR/lib/hive-hwi-0.9.0.war
