Re: operation log is missing when using hive.execution.engine=mr

ssible that you are effected by this? > https://issues.apache.org/jira/browse/HIVE-16061 > > Thanks, > Peter > > > > > > 2017. máj. 15. 19:44 ezt írta ("Jie Zhang" <jiezh2...@gmail.com>): > > Hi, > > My team just upgrade Hive from 0.14.0

operation log is missing when using hive.execution.engine=mr

Hi, My team just upgrade Hive from 0.14.0 to 2.1.1. The operation log is missing when running the query, no query progress is printed. The only log printed in operation log is "WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different

embedded hive metastore fail when upgrading from 0.14.0 to 2.1.0

We are working on upgrading hive from apache hive 0.14.0 to 2.1.0, however, hit the problem in a testcase which uses embedded metatore. here is the code snippet and stack trace. Does anyone encounter the similar problem and any suggestion to resolve it? Thanks for the help! Connection connection

does build-in UDF work with custom storage handler?

Hi, I have an external table with custom storage handler. Somehow, when I use build-in UDF (e.g. col >= unix_timestamp('2016-04-28 00:00:00') )in where clause, the predicate does not do any filtering. if I used constant literal, the predicate works fine. May I know whether build-in UDF can work

Re: SARG predicate is ignored when query ORC table

t; > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > http://talebzadehmich.wordpress.com > > > > On 28 February 2016 at 07:39, Jie Zhang <jiezh2...@g

Re: SARG predicate is ignored when query ORC table

ile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > > On 27 February 2016 at 18:59, Jie Zhang <jiezh2...@gmail.com> wrote: &

SARG predicate is ignored when query ORC table

Hi, We have an external ORC table which includes ~200 relatively small orc files (less than 256MB). When querying the table with selective SARG predicate (explain shows the predicate is qualified pushdown), we expects a few splits generated with pruning based on predicate condition and only a few

can OrcSerde work with custom input format

Hi, My application is using hive extenal tables with ORC and needs some special logic to filter out some input files. I was thinking to write a custom InputFormat extending OrcInputFormat. create external table test1 (...) ROW FORMAT SERDE 'org.apache.hadoop.hive.ql.io.orc.OrcSerde' STORED AS

Equal predicate on timestamp column

Hi, I have a table partitioned on every hour, the partitioning column ds is timestamp type. However, I could not locate one partition with the equal predicate on ds, only the range predicates works. Here are the ddl and queries: create table test (c1 int, c2 string) partitioned by (ds timestamp)

how ALTER statement affects reading the ORC files before table schema change

Hi, Experts, We have an application which creates a ORC table in hive to store the events. The table schema needs to be changed dynamically since new data adds more new columns (append only). We noticed the application needs to use alter table to change the table schema before loading the new

how to enable serde property hive.serialization.extend.nesting.levels for CTAS statment

Hi, experts, My application uses a CTAS query to create a result table in hive, the source table has deeply nested struct column (7 levels). CTAS query fails with the following exception. jdbc:hive2://localhost:1/default CREATE TABLE IF NOT EXISTS reporting.test1 AS select row_number()

NPE error during file sink stage when inserting into bucketed table

Hi, I have created a simple bucketed table and would like to insert some values into the table. However, hit the following NPE during file sink. Any clue what the problem can be? I am using hive 0.14.0, with hive.enforce.bucketing setting true. Thanks very much for any help! create table test4

create table fails with exception unable to rename tmp file

Hi, I hit the following error when running a CTAS statment. Looks like a hdfs permission issue since the temp file can not be renamed. Maybe I miss setting some property? my hive version is 0.14.0. Any help is appreciated! hive create table reporting.test2 as select count(uuid) from store.imr;

empty plan shows when explaining CTAS query

When explaining a CTAS query, no execution plan shows somehow. 0: jdbc:hive2://localhost:1/default explain create table if not exists test1 as select c1, count(distinct c2) as cnt from test group by c1 order by c1; +--+--+ | Explain|

how to access array type?

Hi, I am trying to use hive complex data type on hive0.14.0. However, could not access the array type as manual indicated. I have an array column, but hit SemanticException when access the individual item in the array. Any clue? Did I use the wrong syntax or miss some property setting? Thanks!

fail to drop table after upgrade to hive 0.14.0

Hi, I have an application using hive, and just upgraded from 0.13.1 to 0.14.0. However, a bunch of unit testcases, which are using embedded derby metastore, failing to drop table. Here are the exception stack trace. Does anyone have clue what the problem can be and how to resolve it? Feedback is