Re: hive metastore update from 0.12 to 1.0

Probably you started the new Hive version before upgrading the schema. This means manual fixing. > On 03 Nov 2015, at 11:56, Sanjeev Verma wrote: > > Hi > > I am trying to update the metastore using schematool but getting error > > schematool -dbType derby -upgradeSchemaFrom 0.12 > > Upg

Hive for registration process

Hi all, I have an e-commerce app which has a registration process(it is a 5 step registration process). On the submit button the data is pushed on the SQL db currently. I wanna know can Hive help me with 1000 or more user registrations at a time? If yes how can I go about it? and how fast will it

Hive for registration process

Hi all, I have an e-commerce app which has a registration process(it is a 5 step registration process). On the submit button the data is pushed on the SQL db currently. I wanna know can Hive help me with 1000 or more user registrations at a time? If yes how can I go about it? and how fast will it

Re: hive metastore update from 0.12 to 1.0

even after using schematool -dbType derby -upgradeSchema the upgrade failing. On Wed, Nov 4, 2015 at 1:23 AM, Sergey Shelukhin wrote: > Is your metastore schema version actually 0.12? The upgrade should be able > to determine the schema version, so there should be no need to force it to > use 0

Re: SemanticException Unable to fetch table t. null

Nice catch! Can you file a JIRA? From: Mich Talebzadeh mailto:m...@peridale.co.uk>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Tuesday, November 3, 2015 at 13:17 To: "user@hive.apache.org" mailto:user@hive.apache

Re: SemanticException Unable to fetch table t. null

https://issues.apache.org/jira/browse/HIVE-11123 However the point is, it’s not a real error, i.e. not the cause of this bug. From: Mich Talebzadeh mailto:m...@peridale.co.uk>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Tuesday, November 3,

RE: create table as ORC with SORTED BY fails

Yes thanks Something like below works with the selectivity of object_id column --> (select count(distinct(object_id))/count(object_id) ) = 1 create table t ( owner varchar(30) ,object_name varchar(30) ,subobject_name varchar(30) ,object_id

RE: SemanticException Unable to fetch table t. null

The cause of the problem was passing a null value in table creation attribute "orc.bloom.filter.columns"="", as blank create table t ( owner varchar(30) ,object_name varchar(30) ,subobject_name varchar(30) ,object_id bigint ,data_object

Re: create table as ORC with SORTED BY fails

Yes. SORTED BY can only be used with CLUSTERED BY .. into ’n’ buckets If you want to insert data in a sorted order on a specific column, you can add ORDER BY/SORT BY to the select query for the column that you want to sort. ORDER BY will use single reducer but you will get global ordering where

RE: SemanticException Unable to fetch table t. null

Thanks where is it fixed? Is there any patch available. Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908.pdf Author of the books "A

Re: create table as ORC with SORTED BY fails

IIRC sorted by is only supported on bucketed tables. From: Mich Talebzadeh mailto:m...@peridale.co.uk>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Tuesday, November 3, 2015 at 01:23 To: "user@hive.apache.org" mai

Re: hive metastore update from 0.12 to 1.0

Is your metastore schema version actually 0.12? The upgrade should be able to determine the schema version, so there should be no need to force it to use 0.12. From: Sanjeev Verma mailto:sanjeev.verm...@gmail.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.

Re: SemanticException Unable to fetch table t. null

This error is not related to the issue, it’s just an old DB type check that runs db-specific queries and sees which ones don’t fail. It has been fixed to not use db-specific queries lately. From: Mich Talebzadeh mailto:m...@peridale.co.uk>> Reply-To: "user@hive.apache.org

RE: SemanticException Unable to fetch table t. null

Ok I sorted this by hacking into hive metadata in Oracle. You need to delete the relevant records from hive metadata tables delete from table_params where tbl_id = 2641; delete from tbls where TBL_NAME = 't'; commit; then log in to hive CLI and drop the table as usual. It seems to

Re: hive metastore update from 0.12 to 1.0

Any help will be appreciated... On Tue, Nov 3, 2015 at 4:26 PM, Sanjeev Verma wrote: > Hi > > I am trying to update the metastore using schematool but getting error > > schematool -dbType derby -upgradeSchemaFrom 0.12 > > Upgrade script upgrade-0.12.0-to-0.13.0.derby.sql > Error: Table/View 'TXN

RE: SemanticException Unable to fetch table t. null

Correct. I am getting this error in hive.log 2015-11-03 11:20:28,470 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(319)) - Trying to connect to metastore with URI thrift://localhost:9083 2015-11-03 11:20:28,471 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(41

Re: Hive on Spark NPE at org.apache.hadoop.hive.ql.io.HiveInputFormat

Yeah. it seems that the NPE is a result of the warning msg, missing map.xml file. Not sure why, but I believe that Hortonworks doesn't support Hive on Spark. You can try get a build from the master branch or try other distributions. Thanks, Xuefu On Mon, Nov 2, 2015 at 10:18 PM, Jagat Singh wrot

Re: SemanticException Unable to fetch table t. null

Can you please check metastore log? *Thanks & Regards,* *Srinivas T* On Tue, Nov 3, 2015 at 4:40 PM, Rajkumar Singh wrote: > it seems that you are having a problem metastore. > > On Tue, Nov 3, 2015 at 1:46 PM, Mich Talebzadeh > wrote: > >> Hi, >> >> >> >> Has anyone got a quick fix for dropp

Re: SemanticException Unable to fetch table t. null

it seems that you are having a problem metastore. On Tue, Nov 3, 2015 at 1:46 PM, Mich Talebzadeh wrote: > Hi, > > > > Has anyone got a quick fix for dropping such table please? > > > > hive> drop table t; > > FAILED: SemanticException Unable to fetch table t. null > > hive> desc t; > > FAILED:

Re: Hive CLI not working

With the given stacktrace I can say that your metastore db (derby) is read only or the user with whom you are trying to connect has read only permission only. Thanks Rajkumar Singh On Tue, Nov 3, 2015 at 2:54 PM, Vishwakarma, Chhaya < chhaya.vishwaka...@thinkbiganalytics.com> wrote: > > > Hi all

hive metastore update from 0.12 to 1.0

Hi I am trying to update the metastore using schematool but getting error schematool -dbType derby -upgradeSchemaFrom 0.12 Upgrade script upgrade-0.12.0-to-0.13.0.derby.sql Error: Table/View 'TXNS' already exists in Schema 'APP'. (state=X0Y32,code=3) org.apache.hadoop.hive.metastore.HiveMeta

create table as ORC with SORTED BY fails

Hi, Any idea why this simple create table fails? hive> create table test ( > owner varchar(30) > ,object_name varchar(30) > ,object_id bigint > ) > SORTED BY (object_id) > STORED AS ORC > TBLPROPERTIES ("orc.co

Hive CLI not working

Hi all, When I type "hive" command it hangs without going to hive prompt, when I checked logs I found below error. ERROR [BoneCP-pool-watch-thread]: bonecp.PoolWatchThread (PoolWatchThread.java:fillConnections(118)) - Error in trying to obtain a connection. Retrying in 7000ms java.sql.SQLExcept

SemanticException Unable to fetch table t. null

Hi, Has anyone got a quick fix for dropping such table please? hive> drop table t; FAILED: SemanticException Unable to fetch table t. null hive> desc t; FAILED: SemanticException Unable to fetch table t. null Thanks, Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winn