Re: Hive metadata on Hbase

2016-10-24 Thread Mich Talebzadeh
Thanks Alan for detailed explanation. Please bear in mind that any tool that needs to work with some repository (Oracle TimesTen IMDB has its metastore on Oracle classic), SAP Replication Server has its repository RSSD on SAP ASE and others First thing they do, they go and cache those tables and

Re: Hive metadata on Hbase

2016-10-24 Thread Alan Gates
Some thoughts on this: First, there’s no plan to remove the option to use an RDBMS such as Oracle as your backend. Hive’s RawStore interface is built such that various implementations of the metadata storage can easily coexist. Obviously different users will make different choices about what

Re: hiveserver2 java heap space

2016-10-24 Thread Patcharee Thongtra
It works on Hive cli Patcharee On 10/24/2016 11:51 AM, Mich Talebzadeh wrote: does this work ok through Hive cli? Dr Mich Talebzadeh LinkedIn /https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw/ http://talebzadehmich.wordpress.com *Disclaimer:* Use it at

Re: hiveserver2 java heap space

2016-10-24 Thread Mich Talebzadeh
does this work ok through Hive cli? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com *Disclaimer:* Use it

hiveserver2 java heap space

2016-10-24 Thread Patcharee Thongtra
Hi, I tried to query orc file by beeline and java program using jdbc ("select * from orcfileTable limit 1"). Both failed with Caused by: java.lang.OutOfMemoryError: Java heap space. Hiveserver2 heap size is 1024m. I guess I need to increase this Hiveserver2 heap size? However I wonder why I

Rest API Apache Hive

2016-10-24 Thread Hardika Catur S
Hi, I try create Rest API Apache Hive, but but I find it difficult to make. My documentation from the link https://www.npmjs.com/package/jshs2. Has anyone tried making of these or other documentation based node js?? Please help me to find a solution. Thanks, Hardika CS.

Re: Hive metadata on Hbase

2016-10-24 Thread Mich Talebzadeh
Hi Furcy, Thanks for updates. transactional tables creates issue for us. When many updates are done they create many delta files that require compaction. This by itself is not an issue for Hive. However, Spark fails to read these delta files so the job crashes. Regards, Mich Dr Mich

Re: Hive metadata on Hbase

2016-10-24 Thread Furcy Pin
Hi Mich, the umbrella JIRA for this gives a few reason. https://issues.apache.org/jira/browse/HIVE-9452 (with even more details in the attached pdf https://issues.apache.org/jira/secure/attachment/12697601/HBaseMetastoreApproach.pdf ) In my experience, Hive tables with a lot of partitions (> 10

Re: Hive metadata on Hbase

2016-10-24 Thread Mich Talebzadeh
Hive 2.0.1 Subversion git://reznor-mbp-2.local/Users/sergey/git/hivegit -r e3cfeebcefe9a19c5055afdcbb00646908340694 Compiled by sergey on Tue May 3 21:03:11 PDT 2016 >From source with checksum 5a49522e4b572555dbbe5dd4773bc7c2 Dr Mich Talebzadeh LinkedIn *

Re: Hive metadata on Hbase

2016-10-24 Thread Per Ullberg
What version of hive are you running? /Pelle On Monday, October 24, 2016, Mich Talebzadeh wrote: > @Per > > We run full transactional enabled Hive metadb on an Oracle DB. > > I don't have statistics now but will collect from AWR reports no problem. > > @Jorn, > > The

Re: Hive metadata on Hbase

2016-10-24 Thread Mich Talebzadeh
@Per We run full transactional enabled Hive metadb on an Oracle DB. I don't have statistics now but will collect from AWR reports no problem. @Jorn, The primary reason Oracle was chosen is because the company has global licenses for Oracle + MSSQL + SAP and they are classified as Enterprise