javax.jdo.JDODataStoreException: Required table missing : "VERSION" in Catalog "" Schema "". DataNucleus requires this table to perform its persistence operations. Either your MetaData is incorrect, o

Hey, Could you please help me resolving this error? version= hive 2.1.0 ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console. 13:41:37.848 [main] ERROR hive.ql.metadata.Hive - Cannot initialize metastore due to autoCreate error jav

Re: javax.jdo.JDODataStoreException: Required table missing : "VERSION" in Catalog "" Schema "". DataNucleus requires this table to perform its persistence operations. Either your MetaData is incorrec

As the error message indicated, please use "schematool -initSchema -dbType.. " command to create the proper metadata schema in metastore. On Fri, Aug 19, 2016 at 4:53 AM, شجاع الرحمن بیگ wrote: > Hey, > > Could you please help me resolving this error? > version= hive 2.1.0 > > ERROR StatusLogge

Re: why need set hive.server2.enable.doAs=false in SQL-Standard Based Authorization

1 - if it set to true, you need to manager permissions in two places for users, using grant/revoke on tables, and file system permissions as well, and keep them in sync. That will be a headache. Moreover, the main intent for sql std auth is to be able to provide fine grained access control using vi

Inserting data in hive bucket

Hi , Is there a way to create the bucket with specific file name in hive. I see hive creates random names for the file starting with I want the file name to be in mmdd format since I am partitioning by month and bucketing by date Thank you Rahul

Re: Inserting data in hive bucket

Hi, You are partitioning by Month and bucketing by date or day? If that is the case you only have 30-31 hash partitioning (bucketing) for each Month? HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Inserting data in hive bucket

Hi Mich, We are bucketing by date so we wil have max 32 buckets On Friday, August 19, 2016, Mich Talebzadeh wrote: > Hi, > > You are partitioning by Month and bucketing by date or day? > > If that is the case you only have 30-31 hash partitioning (bucketing) for > each Month? > > HTH > > Dr Mic

Re: Optimizing limit 0 / null scan cases (HIVE-7203)

> CREATE TABLE T . AS The limit clause in the outermost query should prevent the entire query from executing. However, the CREATE TABLE expression and the UNION ALL are rather challenging in this matter. If you have queries which don't hit the NULL-scan fully, a BUG report would be hel

Re: Inserting data in hive bucket

> We are bucketing by date so we wil have max 32 buckets If you do want to lookup specifically by date, you could just create day partitions and never partition by month. FYI, in a modern version of Hive select count(1) from table where YEAR(dt) = 2016 and MONTH(dt) = 12 does prune it on the c

Re: Inserting data in hive bucket

Hash partitioning (Bucketing) does not make much sense for /MM/DD/32 as pointed out. So it is clear that with (mod 32), the maximum number of offsets is going to be 32, i.e. in the range between 0-31. With /MM/DD you have to account for hash collisions as well. The set of inputs is potenti

Re: why need set hive.server2.enable.doAs=false in SQL-Standard Based Authorization

One more addition to what Thejas mentioned - BitSetCheckAuthorizationProvider was the old legacy method of authorization in hive that was replaced in use-intent by SQLStandardAuthorization. I think we should look to deprecating and removing that now. In general, if you want conventional db-like gr