mm tables with original files in hive 4

2021-01-08 Thread Gabriel Balan
n the managed warehouse root dir". Wouldn't that make it such that a non-transactional table cannot be converted into a mm table? If that's the case, then you can't create original files, right? what am I missing? Gabriel Balan P.S. I played around a bit in CDP7.0.3:

what does MM stand for

2020-11-06 Thread Gabriel Balan
his is set to false, however unless MAPREDUCE-7086 fix is present (hadoop 3.1.1+),\n" +     "queries that read non-orc *MM tables* with original files will fail. The default in\n" +     "Hive 3.0 is false."), thank you Gabriel Balan P.S. And since I'm alr

Re: Implementing a custom StorageHandler

2016-07-06 Thread Gabriel Balan
trol the number of splits by specifying the lower and upper bounds on the size of splits. Heads up #2. Most FileInputFormat implementations will give you 1 or more splits for each file in the input set. Hive will try to use a /Combine/ input format, which combines small files/splits into larger s

Re: Unable to pick data from subdirectories into hive table in CDH 5.3.3

2016-05-23 Thread Gabriel Balan
d * hive runs your queries locally (e.g. a fetch task instead of a remote MR job (see HIVE-2925)). You can see what hive's classpath ends up to be by running "set system:java.class.path;" in your hive cli to see the classpath. Grep for "mapreduce1", or "-mr1-".

Re: External table returns no result.

2016-02-19 Thread Gabriel Balan
Hi It's not enough to make dirs in hdfs. You need to let the metastore know you're adding partitions. Try to Recover Partitions (MSCK REPAIR TABLE) . hth Gabriel Balan The statements and opinions expressed here are my own and do not necessarily represent those of Oracle C

Re: Stored By

2016-01-28 Thread Gabriel Balan
Hi Why not write your own storage handler extending AccumuloStorageHandler and overriding getInputFormatClass() to return your HiveAccumuloTableInputFormat subclass. hth Gabriel Balan On 1/21/2016 10:46 AM, peter.mar...@baesystems.com wrote: Hi, So I am using the AccumuloStorageHandler

Re: Serde for all encoding standards.

2015-12-10 Thread Gabriel Balan
onstants.java#L59>). However, it also worked when I added "field.delim" to TBLPROPERTIES instead of SERDEPROPERTIES. So maybe you can try: create ... row format delimited fields terminated by '\t' ... TBLPROPERTIES("serialization.encoding"='GBK',.

Utilities.copyTableJobPropertiesToConf

2015-11-06 Thread Gabriel Balan
s. Why were the extra steps added? What are the use cases that require the extra properties in the (job)conf? What's the difference between the content of TableDesc.properties and TableDesc.jobProperties? I tried to do some digging on my on, but the only JIRA I found somewhat relevant

Re: binary column data consistency in hive table copy

2015-09-15 Thread Gabriel Balan

Re: getting mismatched input 'ROW' expecting error in hive creation

2015-08-04 Thread gabriel balan
Hi + "ROW FORMAT DELIMITED FIELDS TERMINATED BY '\b' LINES TERMINATED BY '\n'"); Shouldn't you escape the backslashes ('\\n' instead of '\n'), so they're not interpreted by java? hth GB On 8/4/2015 11:22 AM, Sateesh Karuturi wrote: i want create a hive table using java code. my code is pa

Re: Can't access file in Distributed Cache in Hive 1.1.0

2015-06-30 Thread gabriel balan
Hi Try "set hive.fetch.task.conversion=minimal;" in hive cli to get an MR job rather than a local fetch task. hth Gabriel Balan On 6/30/2015 5:22 AM, Zsolt Tóth wrote: Thank you for your answer. The plans are identical for Hive 1.0.0 and Hive 1.1.0. You're right, Hive-1.1.0

Re: Set variable in hive query

2015-06-08 Thread gabriel balan
Hi It seems (see here ) Hive substitutes the variables before parsing the query. So the query being parsed is actually: SELECT criticid AS criticid, sum(rating)

Re: Hive Query

2015-06-03 Thread gabriel balan
Hi If(ISNOTNULL(sum(columnname), sum(columnname),0) as sumVendor Or *coalesce( sum(columnname),0) as ...* As explained here , COALESCE(T v1, T v2, ...) Returns the first v that is not NULL, or NULL if all v's are NULL

Re: create statement is not working

2015-04-24 Thread gabriel balan
Hi What's the error message? if you get "FAILED: SemanticException [Error 10072]: Database does not exist: PROCESS" then run create schema if not exists process; After that the DDL is accepted just fine on my hive-0.13.1-cdh5.3.0. hth GB On 4/24/2015 12:25 PM, Bhagwan S. Soni wrote: Hi

programmatic filter

2015-02-26 Thread gabriel balan
redicate push down to optimize filtering data. I need to generate ExprNodeDesc objects for the HiveStoragePredicateHandler.decomposePredicate API, and optionally to make a ExprNodeEvaluator. Any advice, tips, or hints are most welcome thank you Gabriel Balan -- The statements and opinions