Hi Gordon,
Thanks a lot for reply.
We have installed CDH4.2.0 and hive-0.10.0-cdh4.2.0. Both are working as
desired.
We need to set hive configuration parameter from Java while making JDBC
connection.
We have written a java program to execute queries on hive server with some
configurations properties setting dynamically . We are doing it as below
CONNECTION_URL=jdbc:hive://master149:10000/default
Next, we are doing following method to set properties through java
props.setProperty(mapreduce.map.memory.mb,50);
props.setProperty(mapreduce.reduce.memory.mb,500);
and a hive connection is made as given below
hiveConnection = DriverManager.getConnection(connectionURL,props);
by above steps when a hive connection is made using hive-jdbc and we are
getting hive query results as desired.
QUERY:
1. Are we doing rightly for setting up the hive properties, if yes then
how can we verify that?
2. If the above is not the right way, then how can we achieve setting
hive configuration parameters from Java using JDBC?
Please reply
Thanks
Rinku Garg
From: Gordon Wang [mailto:gw...@gopivotal.com]
Sent: Friday, March 07, 2014 2:45 PM
To: user
Subject: Re: Setting | Verifying | Hive Query Parameters from Java
Hi Rinku,
I think yarn.nodemanager.resource.memory-mb is a static configuration prop.
You can not change this dynamically.
The other MR props looks OK to me.
On Fri, Mar 7, 2014 at 2:58 PM, Garg, Rinku
<rinku.g...@fisglobal.com<mailto:rinku.g...@fisglobal.com>> wrote:
Hi Gordon,
Thanks a lot for your reply.
The properties mentioned in mail trail are just an example. Actual properties
that we want to set are as given below:
set yarn.nodemanager.resource.memory-mb=16384;
set mapreduce.map.memory.mb=2048;
set mapreduce.reduce.memory.mb=2048;
set mapreduce.map.java.opts=-Xmx2048M;
set yarn.app.mapreduce.am.command-opts=-Xmx2048m;
Please suggest.
Thanks
Rinku Garg
From: Gordon Wang [mailto:gw...@gopivotal.com<mailto:gw...@gopivotal.com>]
Sent: Friday, March 07, 2014 11:49 AM
To: user@hive.apache.org<mailto:user@hive.apache.org>
Subject: Re: Setting | Verifying | Hive Query Parameters from Java
The 2 following props are for hive server2. I don't think you can change it in
your jdbc session. I am wondering why you need to change them in your jdbc
connection.
props.setProperty(hive.server2.async.exec.threads,50);
props.setProperty(hive.server2.thrift.max.worker.threads,500);
You can set props in your jdbc connetion with HQL like "propA=valueA;"
More, your connection url is for hive server, it does not work for hive server2.
If you need to use hive server2, you have to use
jdbc:hive2://master149:10000/default
On Tue, Mar 4, 2014 at 7:43 PM, Garg, Rinku
<rinku.g...@fisglobal.com<mailto:rinku.g...@fisglobal.com>> wrote:
Hi All,
We have installed CDH4.2.0 and hive-0.10.0-cdh4.2.0. Both are working as
desired.
We need to set hive configuration parameter from Java while making JDBC
connection.
We have written a java program to execute queries on hive server with some
configurations properties setting dynamically . We are doing it as below
CONNECTION_URL=jdbc:hive://master149:10000/default
Next, we are doing following method to set properties through java
props.setProperty(hive.server2.async.exec.threads,50);
props.setProperty(hive.server2.thrift.max.worker.threads,500);
props.setProperty(hive.groupby.orderby.position.alias,false);
and a hive connection is made as given below
hiveConnection = DriverManager.getConnection(connectionURL,props);
by above steps when a hive connection is made using hive-jdbc and we are
getting hive query results as desired.
QUERY:
1. Are we doing rightly for setting up the hive properties, if yes then
how can we verify that?
2. If the above is not the right way, then how can we achieve setting
hive configuration parameters from Java using JDBC?
Thanks
Rinku Garg
_____________
The information contained in this message is proprietary and/or confidential.
If you are not the intended recipient, please: (i) delete the message and all
copies; (ii) do not disclose, distribute or use the message in any manner; and
(iii) notify the sender immediately. In addition, please be aware that any
message addressed to our domain is subject to archiving and review by persons
other than the intended recipient. Thank you.
--
Regards
Gordon Wang
_____________
The information contained in this message is proprietary and/or confidential.
If you are not the intended recipient, please: (i) delete the message and all
copies; (ii) do not disclose, distribute or use the message in any manner; and
(iii) notify the sender immediately. In addition, please be aware that any
message addressed to our domain is subject to archiving and review by persons
other than the intended recipient. Thank you.
--
Regards
Gordon Wang
_____________
The information contained in this message is proprietary and/or confidential.
If you are not the intended recipient, please: (i) delete the message and all
copies; (ii) do not disclose, distribute or use the message in any manner; and
(iii) notify the sender immediately. In addition, please be aware that any
message addressed to our domain is subject to archiving and review by persons
other than the intended recipient. Thank you.
