Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations! -- Lefty On Wed, Mar 9, 2016 at 10:30 PM, Dmitry Tolpeko wrote: > Congratulations, Wei! > > On Thu, Mar 10, 2016 at 5:48 AM, Chao Sun wrote: > >> Congratulations! >> >> On Wed, Mar 9, 2016 at 6:44 PM, Prasanth Jayachandran < >> pjayachand...@hortonworks.com> wrote: >> >>> Cong

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations, Wei! On Thu, Mar 10, 2016 at 5:48 AM, Chao Sun wrote: > Congratulations! > > On Wed, Mar 9, 2016 at 6:44 PM, Prasanth Jayachandran < > pjayachand...@hortonworks.com> wrote: > >> Congratulations Wei! >> >> On Mar 9, 2016, at 8:43 PM, Sergey Shelukhin >

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations! On Wed, Mar 9, 2016 at 6:44 PM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > Congratulations Wei! > > On Mar 9, 2016, at 8:43 PM, Sergey Shelukhin > wrote: > > Congrats! > > From: Szehon Ho mailto:sze...@cloudera.com>> > Reply-To

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congrats! From: Szehon Ho mailto:sze...@cloudera.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Wednesday, March 9, 2016 at 17:40 To: "user@hive.apache.org" mailto:user@hive.apache.org>> Cc: "d...@hive.apache.o

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations Wei! On Mar 9, 2016, at 8:43 PM, Sergey Shelukhin mailto:ser...@hortonworks.com>> wrote: Congrats! From: Szehon Ho mailto:sze...@cloudera.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Wednesday, March 9, 2016 at 17:40 To

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations Wei for being part of one of the successful Apache project !! On 10 March 2016 at 09:40, Szehon Ho wrote: > Congratulations Wei! > > On Wed, Mar 9, 2016 at 5:26 PM, Vikram Dixit K wrote: > >> The Apache Hive PMC has voted to make Wei Zheng a committer on the Apache >> Hive Pro

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations Wei! On Wed, Mar 9, 2016 at 5:26 PM, Vikram Dixit K wrote: > The Apache Hive PMC has voted to make Wei Zheng a committer on the Apache > Hive Project. Please join me in congratulating Wei. > > Thanks > Vikram. >

[ANNOUNCE] New Hive Committer - Wei Zheng

The Apache Hive PMC has voted to make Wei Zheng a committer on the Apache Hive Project. Please join me in congratulating Wei. Thanks Vikram.

Re: read-only mode for hive

If this is all about a maintenance window, then why not shutdown Hive server2 which stops client access including beeline and use Hive CLI to do the maintenance work effectively in single user mode. Snapshot is another option. HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profil

Re: read-only mode for hive

Another option might be to lock using a zookeeper script. Andrew Sent using CloudMagic Email [https://cloudmagic.com/k/d/mailapp?ct=pa&cv=7.4.10&pv=5.1.1&source=email_footer_2] On Wed, Mar 09, 2016 at 7:05 PM, Andrew Sears < andrew.se...@analyticsdream.com [andrew.se...@analyticsdream.com] >

Re: read-only mode for hive

What about renaming the table? To another schema with limited rights? Not sure why just flipping access grant to select only wouldn't also work, provided auth is enabled and not external. An hdfs snapshot could also give you point -in-time copy. Set acls to restrict access if enabled. Cheers, An

Re: binary file deserialization

bq. there is a varying number of items for that record If the combination of items is very large, using case class would be tedious. On Wed, Mar 9, 2016 at 9:57 AM, Saurabh Bajaj wrote: > You can load that binary up as a String RDD, then map over that RDD and > convert each row to your case cla

RE: Simple UDFS and IN Operator

Thanks Edward, (and Gopal), This fits with what I was seeing. I have modified GenericIN to accept a list (by having it look at the listElementObjInspector), but it still fails to be accepted as a partitionkey expression. I traced that to IndexPredicateAnalyzer.analyzeExpr where it’s lookin

Re: read-only mode for hive

Thank you all for replies. My usecase is as follows: I want to put a table (or database) in read-only mode. Then do some operations such as taking table definition and hdfs snapshot. I want to put table in read only mode to maintain consistency. After all my operations are done, I will again put h

Re: Hive_CSV

The data is already in the csv so it is not matter for querying. It is recommend to convert it to ORC or Parquet for querying. > On 09 Mar 2016, at 19:09, Ajay Chander wrote: > > Daniel, thanks for your time. Is it like creating two tables, one is to get > all the data and the another one is t

Re: Hive_CSV

Daniel, thanks for your time. Is it like creating two tables, one is to get all the data and the another one is to fetch the required data out of it? If that is the case I was just concerned of redundant data. Please correct me if I am wrong. Thanks On Wednesday, March 9, 2016, Daniel Haviv wrote

Re: Hive_CSV

Jorn, thanks for your time. The reason I wanted to do so is, I don't want to bring the unnecessary data into the table. Each record is carrying a unnecessary value. On Wednesday, March 9, 2016, Jörn Franke wrote: > > Why Don't you load all data and use just two columns for querying? > Alternativ

Re: Hive_CSV

Hi Ajay, Use the CSV serde to read your file, map all three columns but only select the relevant ones when you insert: Create table csvtab ( irrelevant string, sportName string, sportType string) ... Insert into loaded_table select sportName, sportType from csvtab; Daniel > On 9 Mar 2016, at 1

Re: Hive_CSV

Why Don't you load all data and use just two columns for querying? Alternatively use regular expressions. > On 09 Mar 2016, at 18:43, Ajay Chander wrote: > > Hi Everyone, > > I am looking for a way, to ignore the first occurrence of the delimiter while > loading the data from csv file to h

Hive_CSV

Hi Everyone, I am looking for a way, to ignore the first occurrence of the delimiter while loading the data from csv file to hive external table. Csv file: Xyz, baseball, outdoor Hive table has two columns sport_name & sport_type and fields are separated by ',' Now I want to load by data into

Re: Hive Context: Hive Metastore Client

Thanks Alan for the info. I will have a look. Some tools like MongoDB (providing its own database) provide a layer of access by creating an admin database through which admin users are authenticated and new users can be added to the individual databases. When it comes to Hadoop and its ultimate s

Re: Hive Context: Hive Metastore Client

Apache Knox for authentication makes sense. For Hive authorization there are tools such as Apache ranger or Sentry, which themselves can connect via LDAP. > On 09 Mar 2016, at 16:58, Alan Gates wrote: > > One way people have gotten around the lack of LDAP connectivity in HS2 has > been to use

Re: Hive Context: Hive Metastore Client

One way people have gotten around the lack of LDAP connectivity in HS2 has been to use Apache Knox. That project’s goal is to provide a single login capability for Hadoop related projects so that users can tie their LDAP or Active Directory servers into Hadoop. Alan. > On Mar 8, 2016, at 16:0

Re: read-only mode for hive

Could always set the tables output format to be the null output format On Mar 8, 2016 11:01 PM, "Jörn Franke" wrote: > What is the use case? You can try security solutions such as Ranger or > Sentry. > > As already mentioned another alternative could be a view. > > > On 08 Mar 2016, at 21:09, PG

Re: SELECT without FROM

hm. Certainly it worked if I recall correctly on 0.14, 1.2.1 and now on 2 Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.

Re: SELECT without FROM

Not sure. It does not work in my Hive 0.13 version. On Wed, Mar 9, 2016 at 1:06 PM, Mich Talebzadeh wrote: > I believe it has always been there > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >

Re: SELECT without FROM

I believe it has always been there Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On 9 March 2016 at 09:

Re: SELECT without FROM

Mich, I now that. I just want to trace when it was added to Hive. Dmitry On Wed, Mar 9, 2016 at 12:56 PM, Mich Talebzadeh wrote: > ASAIK any database does that! > > 1> set nocount on > 2> select @@version > 3> select 1 + 1 > 4> go > > > > > ---

Re: SELECT without FROM

ASAIK any database does that! 1> set nocount on 2> select @@version 3> select 1 + 1 4> go

SELECT without FROM

I noticed that Hive allows you to execute SELECT without FROM clause (tested in Hive 0.14, Hive 1.2.1): SELECT 1+1; In which version was it added (is there a Jira)? I see that it is not mentioned in docs https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Select So the question wheth