Re: Automatic creation of Hive output table based on SELECT statement

I had the same problem sometime back and I found a dirty workaround that actually works. 1) create view foo as select statement # this automatically creates foo view with select output schema, this can contain joins, sel conditions, group/count operators etc. 2) create table bar like foo #

Re: Hive .012 works with CDH 4.2.0

bcc: user@hive.apache.org + cdh-u...@cloudera.org No, they aren't tested together and we suggested not replace the packages as there is chance that you might corrupt your hive metastore data and this makes existing hive unusable. You might want to upgrade to CDH 5 beta that includes many of the

Re: Is it possible to host hive server on port 80?

Ports below 1024 can only be used by superusers. Try doing a sudo! On Sun, Sep 22, 2013 at 11:55 AM, Gary Zhao garyz...@gmail.com wrote: On Sat, Sep 21, 2013 at 11:20 PM, Gary Zhao garyz...@gmail.com wrote: Hello It failed to start hiveserver if I specify 80 port and there is no other

Re: hive.metastore.warehouse.dir - Should it point to a physical directory

Hi, If by local physical directory you mean a directory in the underlying OS file system, then No. You just need to create a directory in HDFS and ad it to that xml config file. Thanks, On Tue, May 21, 2013 at 11:19 PM, Raj Hadoop hadoop...@yahoo.com wrote: Ok.I got it. My questions - 1)

Re: hive.metastore.warehouse.dir - Should it point to a physical directory

Yes ! On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop hadoop...@yahoo.com wrote: So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right? *From:* Dean Wampler deanwamp...@gmail.com

Re: Location of external table in hdfs

When you create an external table, original data ('/tmp/states' in this case) is NOT copied to the warehouse folder (or infact any other folder for that matter). So you can find it in '/tmp/states' ifself. On Tue, Mar 5, 2013 at 10:26 PM, Sai Sai saigr...@yahoo.in wrote: I have created an

Re: hive odbc driver

Hi, This looks like a CDH specific issue. You'd get a better response in their mailing lists. Thanks, On Wed, Jan 30, 2013 at 11:59 AM, Chhaya Vishwakarma chhaya.vishwaka...@lntinfotech.com wrote: Hi, ** ** I am using cloudera hive odbc driver made DSN but when I am trying to

Re: Hive configuration property

I'm no expert in hive, but here are my 2 cents. By default hive schedules a reducer per every 1 GB of data ( change that value by modifying *hive.exec.reducers.bytes.per.reducer ) *. If your input data is huge, there will be large number of reducers, which might be unnecessary.( Sometimes large

Re: Performance: hive+hbase integration query against the row_key

Hey, Hive does all kinds of parsing , metadata lookups, query tree building and stuff before executing the query. Not sure if this all was included in those 36 seconds ! Also what hive does is, it builds a scan object with ranges based on predicates (and mappers too ) on key column and not a

Re: Long running Join Query - Reduce task fails due to failing to report status

ham radio callsign: NW0W -- Bertrand Dechoux -- Bharath Vissapragada, 4th Year undergraduate, IIIT Hyderabad. w: http://researchweb.iiit.ac.in/~bharath.vhttp://research.iiit.ac.in/%7Ebharath.v

Re: How to turn off logging in hive

See https://cwiki.apache.org/Hive/languagemanual-cli.html#LanguageManualCli-Logging . modify conf/hive-*-log4j.properties and set the logging level there! On Tue, Aug 7, 2012 at 12:44 PM, Ravindra ravindra.baj...@gmail.com wrote: Hi , I used following property in the hive-site.xml and I

Re: Setting up stats database[SOLVED]

, wd w...@wdicc.com wrote: Maybe you should use 'hive.stats.jdbcdriver=org.apache.mysql.jdbc.EmbeddedDriver' settings? via http://mail-archives.apache.org/mod_mbox/hive-user/201103.mbox/%3c42360b00-72ec-437a-9d95-93f3ad9f1...@fb.com%3E On Fri, Aug 19, 2011 at 5:45 AM, bharath vissapragada

Re: multiple hive access

Hey, Embedded mode is used just for testing purposes and the only once process can connect to it at a time. Configure it as a local/remote metastore. Refer http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin for details . Hope this helps. Thanks and Regards. On Thu, May 19, 2011 at

Re: can I change the default field delimiter of the hive?

Hi , Please see http://wiki.apache.org/hadoop/Hive/LanguageManual/DDL http://wiki.apache.org/hadoop/Hive/LanguageManual/DDL http://wiki.apache.org/hadoop/Hive/LanguageManual/DML http://wiki.apache.org/hadoop/Hive/LanguageManual/DMLThese links are pretty good for starters ! Thanks On Sat, Apr

Re: skew join optimization

Hi Igor, See http://wiki.apache.org/hadoop/Hive/JoinOptimization and see the jira 1642 which automatically converts a normal join into map-join (Otherwise you can specify the mapjoin hints in the query itself.). Because your 'S' table is very small , it can be replicated across all the mappers

Re: Not able to run Hive

I am also getting this error .. any suggestions? hive : 0.6 had :0.20.2 = On Mon, Jun 7, 2010 at 1:03 AM, Shuja Rehman shujamug...@gmail.com wrote: Hi all Thanks for reply. I have changed the heap size to 1024, then 512 then even 100 in the specified file. But i am still getting this

mergeJoinTree ??

Hi all, Once the JoinTrees are created by the the semantic analyzer for a query block , a function mergeJoinTree(qb) is called . Can anyone tell me what it does ? Thanks in anticipation, Bharath.V

Re: mergeJoinTree ??

children (T1,T2,T3) On 12/23/10 4:24 AM, bharath vissapragada bharathvissapragada1...@gmail.com wrote: Hi all, Once the JoinTrees are created by the the semantic analyzer for a query block , a function mergeJoinTree(qb) is called . Can anyone tell me what it does ? Thanks in anticipation

Re: mergeJoinTree ??

Thanks for the help namit ! :) On Fri, Dec 24, 2010 at 12:00 PM, Namit Jain nj...@fb.com wrote: Yes Sent from my iPhone On Dec 23, 2010, at 8:02 PM, bharath vissapragada bharathvissapragada1...@gmail.com   wrote: Hi, Thanks for the reply . This is the optimization of converting 2

Functionality of RowResolver

Hi all, I am going through the src code of the hive trunk and Iam not clear about the usage of org.apache.hadoop.hive.ql.parse.RowResolver . Can anyone help me with this ? Thanks Bharath.V 4th Year UnderGraduate, IIIT Hyderabad