use custom MapReduce script to load data into table with partitions

2013-12-26 Thread zeekvfu
Hi all, I want to know that, whether Hive supports using a custom MapReduce script to load data into a table with static/hybrid/dynamic partitions? I'm working on a log analysis program, for instance, the Tomcat log. Firstly, I import the raw/original log file into Hive, then I need to do some

RE: Adding a table in HIVE does not create a table on mysql which is the metastore

2013-12-26 Thread shouvanik.haldar
Hi, I will check and let you know. Thanks, Shouvanik From: zeekvfu [mailto:wzmind...@gmail.com] Sent: Thursday, December 26, 2013 12:46 PM To: user@hive.apache.org Subject: Re: Adding a table in HIVE does not create a table on mysql which is the metastore You can get the table name, using:

RE: Adding a table in HIVE does not create a table on mysql which is the metastore

2013-12-26 Thread shouvanik.haldar
Hi, Which database should I select in MYSQL? I have two databases presently mysql show databases; ++ | Database | ++ | information_schema | | test | ++ 2 rows in set (0.00 sec) And once inside test database, I

Re: Adding a table in HIVE does not create a table on mysql which is the metastore

2013-12-26 Thread Satish Mittal
Can you check the following element configured in hive-site.xml of your Hive client: javax.jdo.option.ConnectionURLjdbc:mysql://*hostname*/database_name?createDatabaseIfNotExist=true where *hostname* is the name of the machine you installed MySQL on and database_name is the name of database. On

concat_ws() UDF

2013-12-26 Thread Alexey Zotov
Hello Guys, historically concat_ws() UDF was added in the scope of https://issues.apache.org/jira/browse/HIVE-682 ticket. I have a simple question about its implementation. According to above ticket's description it should have behavior like MySQL implementation (

RE: Adding a table in HIVE does not create a table on mysql which is the metastore

2013-12-26 Thread shouvanik.haldar
After adding this, do we have to restart mysql / hive? From: Satish Mittal [mailto:satish.mit...@inmobi.com] Sent: Thursday, December 26, 2013 4:41 PM To: user@hive.apache.org Subject: Re: Adding a table in HIVE does not create a table on mysql which is the metastore Can you check the following

Re: hive hbase integration

2013-12-26 Thread kulkarni.swar...@gmail.com
Seems like you are running hive on yarn instead of mr1. I have had some issues in the past doing so. The post here[1] has some solutions on how to configure hive ot work with yarn. Hope that helps. [1] https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/gHVq9C5H6RE On Thu, Dec 26,

Re: hive hbase integration

2013-12-26 Thread Vikas Parashar
Hi buddy, have gone through with given link. But no luck.. Actually i am working on HDP. Might be, there is some issue with yarn and MR. On Thu, Dec 26, 2013 at 10:10 PM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: Seems like you are running hive on yarn instead of mr1. I

skewed tables

2013-12-26 Thread Kireet
I tried to create a skewed table using the group lens 100k data set and setting the skew columns to the movie rating, but I only see one file get created. My understanding was that separate files would be created per value. Is there anything else that needs to be done? hive commands: CREATE

[ANNOUNCE] New Hive PMC Member - Gunther Hagleitner

2013-12-26 Thread Carl Steinbach
I am pleased to announce that Gunther Hagleitner has been elected to the Hive Project Management Committee. Please join me in congratulating Gunther! Thanks. Carl

Re: [ANNOUNCE] New Hive PMC Member - Gunther Hagleitner

2013-12-26 Thread hsubramaniyan
Congrats Gunther!! On Dec 26, 2013, at 8:59 PM, Carl Steinbach c...@apache.org wrote: I am pleased to announce that Gunther Hagleitner has been elected to the Hive Project Management Committee. Please join me in congratulating Gunther! Thanks. Carl -- CONFIDENTIALITY NOTICE NOTICE:

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2013-12-26 Thread Edward Capriolo
I like the changes. I believe rotating the PMC chair will keep the project fresh. Work and life events come in spurts, and it's hard to step down when your at the top ( http://disinfo.com/2013/02/ratzinger-resigns-first-pope-to-quit-since-1415/ :) . On Thu, Dec 26, 2013 at 10:08 PM, Carl