Re: Insert after typecast fails for Timestamp

Thanks Mich for replying. I got the cause of it. Version: Hive v0.14 Cause: Vectorization was enabled Regards, Dhaval Modi dhavalmod...@gmail.com On 18 April 2016 at 22:13, Mich Talebzadeh wrote: > this should work and should not crash > > > *hive> insert into dummy select cast("2016-06-08 0

Re: Hive footprint

> On Apr 18, 2016, at 15:34, Mich Talebzadeh wrote: > > Hi, > > > If Hive had the ability (organic) to have local variable and stored procedure > support then it would be top notch Data Warehouse. Given its metastore, I > don't see any technical reason why it cannot support these constructs.

Re: Hive Cli ORC table read error with limit option

Thanks Prasanth for the update. I will test it and update it here the outcome. Thanks Biswa On Tue, Apr 19, 2016 at 6:26 AM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > Hi Biswajit > > You might need patch from https://issues.apache.org/jira/browse/HIVE-11546 > > Can you appl

Re: Hive Cli ORC table read error with limit option

Hi Biswajit You might need patch from https://issues.apache.org/jira/browse/HIVE-11546 Can you apply this patch to your hive build and see if it solves the issue? (recommended) Alternatively, you can use “hive.exec.orc.split.strategy”=“BI” as workaround. Its highly not recommended to use this c

Re: Hive Cli ORC table read error with limit option

Hi All, I seriously need help on this aspect. Any reference or pointer to troubleshoot or fix this, could be helpful. Regards Biswa On Fri, Mar 25, 2016 at 11:24 PM, Biswajit Nayak wrote: > Prashanth, > > Apologies for the delay in response. > > Below is the orcfiledump of the empty orc file f

WebHCat - Pig job runs in local mode

Hello Experts, I am using WebHCat REST interface to launch Pig jobs. When I invoke Pig scripts using Curl, WebHCat launches a TempletonControllerJob which has one map task as expected. This job in turn is NOT launching the actual job from the REST API call. In the Resource Manager page, I only se

Re: Hive footprint

HBase can handle high read/write throughput, e.g. IOT use cases. It is not an analytic engine even though you can use Hive storage handler to read data from HBase the performance would be lower than reading from HDFS directly for analytic. But HBase has index, rowkey and you can add secondary inde

Re: Hive footprint

We use a hive with ORC setup now. Queries may take thousands of seconds with joins, and potentially tens of seconds with selects on very large tables. My understanding is that the goal of hbase is to provide much lower latency for queries. Obviously, this comes at the cost of not being able to per

Re: Hive footprint

Thanks Marcin. What is the definition of low latency here? Are you referring to the performance of SQL against HBase tables compared to Hive. As I understand HBase is a columnar database. Would it be possible to use Hive against ORC to achieve the same? Dr Mich Talebzadeh LinkedIn * https://w

Re: Hive footprint

HBase has a different use case - it's for low-latency querying of big tables. If you combined it with Hive, you might have something nice for certain queries, but I wouldn't think of them as direct competitors. On Mon, Apr 18, 2016 at 6:34 PM, Mich Talebzadeh wrote: > Hi, > > I notice that Impal

RE: Mappers spawning Hive queries

I'm not aware of any particular reason that this shouldn't "inherently" work, but for debugging purposes I'd be wondering about the nested environment variables related to the hadoop job.the bash shell where you are trying to launch subsequent hive queries already has pre-existing hadoop job

Hive footprint

Hi, I notice that Impala is rarely mentioned these days. I may be missing something. However, I gather it is coming to end now as I don't recall many use cases for it (or customers asking for it). In contrast, Hive has hold its ground with the new addition of Spark and Tez as execution engines, s

Re: Mappers spawning Hive queries

I am using Hive 1.2.1 with MR backend. Ryan, I hear you. I totally agree. This is not the best approach, and I am in fact restructuring the approach. However, I would like to understand what is going on. In my test run, each hive query is computing *distinct* on a toy table of 10 records -- so, w

RE: Mappers spawning Hive queries

My $0.02 If you are running multiple concurrent queries on the data, you are probably doing it wrong (or at least inefficiently)although this somewhat depends on what type of files are backing your hive warehouse... Let's assume that your data is NOT backed by ORC/parquet files, and tha

Re: Mappers spawning Hive queries

What is the version of Hive and the execution engine (MR, Tez, Spark)? HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmic

Re: Mappers spawning Hive queries

Hi John, 2) The shell script is invoked in the mappers of a Hadoop streaming job. 1) The use case is that I have to process multiple entities in parallel. Each entity is associated with its own data set. The processing involves a few hive queries to do joins and aggregations, which is followed by

Re: [VOTE] Bylaws change to allow some commits without review

?+1 From: Wei Zheng Sent: Monday, April 18, 2016 10:51 AM To: user@hive.apache.org Subject: Re: [VOTE] Bylaws change to allow some commits without review +1 Thanks, Wei From: Siddharth Seth mailto:ss...@apache.org>> Reply-To: "user@hive.apache.org

Re: [VOTE] Bylaws change to allow some commits without review

+1 Thanks, Wei From: Siddharth Seth mailto:ss...@apache.org>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Monday, April 18, 2016 at 10:29 To: "user@hive.apache.org" mailto:user@hive.apache.org>> Subject: Re: [VOT

Re: [VOTE] Bylaws change to allow some commits without review

+1 On Wed, Apr 13, 2016 at 3:58 PM, Lars Francke wrote: > Hi everyone, > > we had a discussion on the dev@ list about allowing some forms of > contributions to be committed without a review. > > The exact sentence I propose to add is: "Minor issues (e.g. typos, code > style issues, JavaDoc chang

Re: [VOTE] Bylaws change to allow some commits without review

+1 Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On 18 April 2016 at 18:24, Alan Gates wrote: > +1. >

Re: [VOTE] Bylaws change to allow some commits without review

+1. Alan. > On Apr 18, 2016, at 06:53, Lars Francke wrote: > > Thanks for the votes so far. Can I get some more people interested please? > > On Fri, Apr 15, 2016 at 7:35 PM, Jason Dere wrote: > ​+1 > From: Lefty Leverenz > Sent: Friday, April 15, 2016 1:36 AM > To: user@hive.apache.org > Su

Re: Insert after typecast fails for Timestamp

this should work and should not crash *hive> insert into dummy select cast("2016-06-08 00:00:00" as String) from t2 limit 5;*Query ID = hduser_20160418175620_4cebc5e9-10a0-422c-92ff-43f059b4c3a6 Total jobs = 1 Launching Job 1 out of 1 In order to change the average load for a reducer (in bytes):

Insert after typecast fails for Timestamp

Hi All, I am trying to convert typecast timestamp to string and add in table containing String column. But it is failing with = Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Error evaluating '2016-06-08 00:00:00'

Re: [VOTE] Bylaws change to allow some commits without review

Thanks for the votes so far. Can I get some more people interested please? On Fri, Apr 15, 2016 at 7:35 PM, Jason Dere wrote: > ​+1 > -- > *From:* Lefty Leverenz > *Sent:* Friday, April 15, 2016 1:36 AM > *To:* user@hive.apache.org > *Subject:* Re: [VOTE] Bylaws chan