Re: User accounts to execute hive queries

2013-09-17 Thread Nitin Pawar
The link I gave in previous mail explains how can you user level authorizations in hive. On Mon, Sep 16, 2013 at 7:57 PM, wrote: > Hi Nitin, > > ** ** > > I want it secured. > > ** ** > > Yes, I would like to give specific access to specific users. E.g. “select > * from” access to som

Outputting newlines from data

2013-09-17 Thread Andrew Mains
Hi all, I'm having some issues working with records containing new lines after deserialization. Some information: 1. The serialized records do not contain new lines (they are base64 encoded protobuf messages). 2. The deserialized records DO contain new lines (our SerDe base64 decodes them an

Fwd: Outputting newlines from data

2013-09-17 Thread Andrew Mains
Hi all, I'm having some issues working with records containing new lines after deserialization. Some information: 1. The serialized records do not contain new lines (they are base64 encoded protobuf messages). 2. The deserialized records DO contain new lines (our SerDe base64 decodes them and e

Export/Import Table in Hive NPE

2013-09-17 Thread Brad Ruderman
Hi All- I am trying to export a table in Hive 0.9, then import it into Hive 0.10 staging. Essentially moving data from a production import to staging. I used the EXPORT table command, however when I try to import the table back into staging I receive the following (pulled from the hive.log file).

Re: Interesting claims that seem untrue

2013-09-17 Thread Lefty Leverenz
> Whatever you count, you get more of :) Then let's count lines of documentation! ;) -- Lefty On Tue, Sep 17, 2013 at 12:15 PM, Edward Capriolo wrote: > Whatever you count, you get more of :) > > > On Tue, Sep 17, 2013 at 1:57 PM, Konstantin Boudnik wrote: > >> Carter, >> >> what you are doin

Re: Interesting claims that seem untrue

2013-09-17 Thread Edward Capriolo
Whatever you count, you get more of :) On Tue, Sep 17, 2013 at 1:57 PM, Konstantin Boudnik wrote: > Carter, > > what you are doing is essentially contradict ASF policy of "community over > code". > > Perhaps, your intentions are good. However, LOC calculations or other silly > contests are esse

Hiveserver2 Authentication (openLDAP) and Authorization (using Sentry)

2013-09-17 Thread Sanjay Subramanian
Hi guys DISCLAIMER == I have no affiliations to Cloudera and I am writing this mail of my own free will, with the hope to help fellow Hive users who will be

Re: Interesting claims that seem untrue

2013-09-17 Thread Konstantin Boudnik
Carter, what you are doing is essentially contradict ASF policy of "community over code". Perhaps, your intentions are good. However, LOC calculations or other silly contests are essentially driving a wedge between developers who happen to draw their paycheck from different commercial entities. H

Re: from_unix time problem

2013-09-17 Thread Robert Li
Thanks, that worked!! On Tue, Sep 17, 2013 at 12:56 PM, Mark Grover wrote: > Stephen is right. Here is some context: > Looking at the UDF source code ( > https://github.com/apache/hive/blob/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFFromUnixTime.java#L121), > it's using SimpleDateForma

subscribe

2013-09-17 Thread ados1...@gmail.com

Re: from_unix time problem

2013-09-17 Thread Mark Grover
Stephen is right. Here is some context: Looking at the UDF source code ( https://github.com/apache/hive/blob/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFFromUnixTime.java#L121), it's using SimpleDateFormat where the format string follows the convention at http://docs.oracle.com/javase/1.4.2

Re: from_unix time problem

2013-09-17 Thread Stephen Sprague
what happens if you use HH (instead of hh)? Any diff? On Tue, Sep 17, 2013 at 8:49 AM, Robert Li wrote: > Hi All > > I have a query where I want to convert the unix timestamp to an hour and > day bucket like so. > > *select case * > *when from_unixtime(cast(ts as bigint),'hh:mm') BETWEEN "00:0

from_unix time problem

2013-09-17 Thread Robert Li
Hi All I have a query where I want to convert the unix timestamp to an hour and day bucket like so. *select case * *when from_unixtime(cast(ts as bigint),'hh:mm') BETWEEN "00:01" and "00:15" then "00:15"* *when from_unixtime(cast(ts as bigint),'hh:mm') BETWEEN "00:16" and "00:30" then "00:30"* *.

Root user case for hive.

2013-09-17 Thread Rudra Tripathy
Hi Al, Hi All, I am trying to run hive command as *root *user-linux user. I am getting --001a11c2c08a47af4604e694f5f2 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi All,I am trying to run hive com= mand from root user-linux user. I am getting error

Re: Duplicate rows when using group by in subquery

2013-09-17 Thread Yin Huai
Hello Mikael, ReduceSinkDeduplication automatically kicked in because it is enabled by default. The original plan tries to shuffle your data twice. Then, ReduceSinkDeduplication finds that the original plan can be optimized to shuffle your data once. But, when picking the partitioning columns, thi

HBase Tables Join in Hive

2013-09-17 Thread Kiran Kumar.M.R
Hi, I am having 2 tables in HBase. Table1: data, userID ( This is very big table) Table2: userID, userDetails ( This is a smaller table) We need to join both the table on userID column and perform some queries. Our idea is to map both Table1 and Table2 in Hive using HBaseStorageHandler. Does Hi