Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2013-12-26 Thread Edward Capriolo
I like the changes. I believe rotating the PMC chair will keep the project fresh. Work and life events come in spurts, and it's hard to step down when your at the top ( http://disinfo.com/2013/02/ratzinger-resigns-first-pope-to-quit-since-1415/ :) . On Thu, Dec 26, 2013 at 10:08 PM, Carl Steinbac

Re: [ANNOUNCE] New Hive PMC Member - Gunther Hagleitner

2013-12-26 Thread hsubramaniyan
Congrats Gunther!! > On Dec 26, 2013, at 8:59 PM, Carl Steinbach wrote: > > I am pleased to announce that Gunther Hagleitner has been elected to the > Hive Project Management Committee. Please join me in congratulating Gunther! > > Thanks. > > Carl -- CONFIDENTIALITY NOTICE NOTICE: This mess

[ANNOUNCE] New Hive PMC Member - Gunther Hagleitner

2013-12-26 Thread Carl Steinbach
I am pleased to announce that Gunther Hagleitner has been elected to the Hive Project Management Committee. Please join me in congratulating Gunther! Thanks. Carl

[DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2013-12-26 Thread Carl Steinbach
I think we should make several changes to the Apache Hive Project Bylaws. The proposed changes are available for review here: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38568856 Most of the changes were directly inspired by provisions found in the Apache Hadoop Project Bylaw

Re: use custom MapReduce script to load data into table with partitions

2013-12-26 Thread zeekvfu
On Thu, Dec 26, 2013 at 7:03 PM, Satish Mittal wrote: > You could use HCatalog for reading/writing data into Hive metastore > tables. HCatalog provides HCatLoader/HCatStorer interface for Pig and > HCatInputFormat/HCatFormat interface for MR jobs to perform table > read/write, including support fo

skewed tables

2013-12-26 Thread Kireet
I tried to create a skewed table using the group lens 100k data set and setting the skew columns to the movie rating, but I only see one file get created. My understanding was that separate files would be created per value. Is there anything else that needs to be done? hive commands: CREATE TA

Re: hive hbase integration

2013-12-26 Thread Vikas Parashar
Hi buddy, have gone through with given link. But no luck.. Actually i am working on HDP. Might be, there is some issue with yarn and MR. On Thu, Dec 26, 2013 at 10:10 PM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > Seems like you are running hive on yarn instead of mr1. I

Re: hive hbase integration

2013-12-26 Thread kulkarni.swar...@gmail.com
Seems like you are running hive on yarn instead of mr1. I have had some issues in the past doing so. The post here[1] has some solutions on how to configure hive ot work with yarn. Hope that helps. [1] https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/gHVq9C5H6RE On Thu, Dec 26, 20

hive hbase integration

2013-12-26 Thread Vikas Parashar
Hi, I am integrating hive(0.12) with hbase(0.96). Everything is working fine there but get stuck between two quires. When i create table or select * from table then it's working fine . but in case of select count(*) from table it give me below error. 2013-12-26 13:25:01,864 ERROR ql.Driver (Ses

RE: Adding a table in HIVE does not create a table on mysql which is the metastore

2013-12-26 Thread shouvanik.haldar
After adding this, do we have to restart mysql / hive? From: Satish Mittal [mailto:satish.mit...@inmobi.com] Sent: Thursday, December 26, 2013 4:41 PM To: user@hive.apache.org Subject: Re: Adding a table in HIVE does not create a table on mysql which is the metastore Can you check the following

concat_ws() UDF

2013-12-26 Thread Alexey Zotov
Hello Guys, historically concat_ws() UDF was added in the scope of https://issues.apache.org/jira/browse/HIVE-682 ticket. I have a simple question about its implementation. According to above ticket's description it should have behavior like MySQL implementation ( http://dev.mysql.com/doc/refman/5

Re: Adding a table in HIVE does not create a table on mysql which is the metastore

2013-12-26 Thread Satish Mittal
Can you check the following element configured in hive-site.xml of your Hive client: javax.jdo.option.ConnectionURLjdbc:mysql://*hostname*/database_name?createDatabaseIfNotExist=true where *hostname* is the name of the machine you installed MySQL on and database_name is the name of database. On

Re: use custom MapReduce script to load data into table with partitions

2013-12-26 Thread Satish Mittal
Hi, You could use HCatalog for reading/writing data into Hive metastore tables. HCatalog provides HCatLoader/HCatStorer interface for Pig and HCatInputFormat/HCatFormat interface for MR jobs to perform table read/write, including support for static/dynamic partitions. Thanks, Satish On Thu, Dec

RE: Adding a table in HIVE does not create a table on mysql which is the metastore

2013-12-26 Thread shouvanik.haldar
Hi, Which database should I select in MYSQL? I have two databases presently mysql> show databases; ++ | Database | ++ | information_schema | | test | ++ 2 rows in set (0.00 sec) And once inside test database, I

RE: Adding a table in HIVE does not create a table on mysql which is the metastore

2013-12-26 Thread shouvanik.haldar
Hi, I will check and let you know. Thanks, Shouvanik From: zeekvfu [mailto:wzmind...@gmail.com] Sent: Thursday, December 26, 2013 12:46 PM To: user@hive.apache.org Subject: Re: Adding a table in HIVE does not create a table on mysql which is the metastore You can get the table name, using: sel

use custom MapReduce script to load data into table with partitions

2013-12-26 Thread zeekvfu
Hi all, I want to know that, whether Hive supports using a custom MapReduce script to load data into a table with static/hybrid/dynamic partitions? I'm working on a log analysis program, for instance, the Tomcat log. Firstly, I import the raw/original log file into Hive, then I need to do some an