Re: How to obtain concurrent query executions

2016-09-29 Thread Jose Rozanec
. > > > > *From:* Jose Rozanec [mailto:jose.roza...@mercadolibre.com] > *Sent:* Tuesday, September 27, 2016 5:54 PM > *To:* user@hive.apache.org > *Subject:* How to obtain concurrent query executions > > > > Hi, > > > > We have a Hive cluster. We no

Hive queries rejected under heavy load

2016-09-28 Thread Jose Rozanec
Hi, We have a Hive cluster (Hive 2.1.0+Tez 0.8.4) which works well for most queries. Though for some heavy ones we observe that sometimes are able to execute and sometimes get rejected. We are not sure why we get a rejection instead of getting them enqueued and wait for execution until resources i

How to obtain concurrent query executions

2016-09-27 Thread Jose Rozanec
Hi, We have a Hive cluster. We notice that some queries consume all resources, which is not desirable to us, since we want to grant some degree of parallelism to incoming ones: any incoming query should be able to do at least some progress, not just wait the big one finish. Is there way to do so?

Query consuming all resources

2016-09-27 Thread Jose Rozanec
Hi, We have a Hive cluster. We notice that some queries consume all resources, which is not desirable to us, since we want to grant some degree of parallelism to incoming ones: any incoming query should be able to do at least some progress, not just wait the big one finish. Is there way to do so?

Upgrading Metastore schema 2.0.0->2.1.0

2016-06-29 Thread Jose Rozanec
Hi all, Upgrading DB schema from 2.0.0 to 2.1.0 is causing an error. Did anyone experience similar issues? Below we leave the command and stacktrace. Thanks, *./schematool -dbType mysql -upgradeSchemaFrom 2.0.0* Starting upgrade metastore schema from version 2.0.0 to 2.1.0 Upgrade script upgrad

LDAPS jdbc connection string

2016-06-22 Thread Jose Rozanec
Hi, We set up a Hive cluster with LDAP and we are able to authenticate and use if from beeline without issues: beeline> !connect jdbc:hive2://localhost:1/default Connecting to jdbc:hive2://localhost:1/default Enter username for jdbc:hive2://localhost:1/default: uid=,ou=People

Re: LDAPS (Secure LDAP) Hive configuration

2016-06-16 Thread Jose Rozanec
rent port like 636 or something. Default port does not > work as far as I remember. > > Could you check if something on these lines ? > > Thanks, > Anurag Tangri > > Sent from my iPhone > > On Jun 15, 2016, at 3:01 PM, Jose Rozanec > wrote: > > Hi, > > We

Re: LDAPS (Secure LDAP) Hive configuration

2016-06-15 Thread Jose Rozanec
in the one LDAPS is configured. May that cause some trouble? We would value any insight or guidance from those who already worked on this. Thanks! Joze. 2016-06-13 9:45 GMT-03:00 Jose Rozanec : > Thank you for the quick response. Will try upgrading to version 2.1.0 > > Thanks! > >

Re: LDAPS (Secure LDAP) Hive configuration

2016-06-13 Thread Jose Rozanec
>> ldaps://ip:port >> >> >> hive.server2.authentication.ldap.baseDN >> dc=net,dc=com >> >> >> Thanks! >> >> Joze. >> > > > This issue is fixed here https://issues.apache.org/jira/browse/HIVE-1

LDAPS (Secure LDAP) Hive configuration

2016-06-10 Thread Jose Rozanec
Hello, We are working on a Hive 2.0.0 cluster, to configure LDAPS authentication, but I get some errors preventing a successful authentication. Does anyone have some insight on how to solve this? *The problem* The errors we get are (first is most frequent): - sun.security.provider.certpath.SunCer

Re: Query fails if condition placed on Parquet struct field

2016-05-03 Thread Jose Rozanec
**-Xmx1500m* > > In HUE, this is the settings tab and you enter them manually. I’m unsure > about command line. > > > From: Jose Rozanec > Reply-To: "user@hive.apache.org" > Date: Tuesday, May 3, 2016 at 12:45 PM > To: "user@hive.apache.org" > Sub

Query fails if condition placed on Parquet struct field

2016-05-03 Thread Jose Rozanec
Hello, We are running queries on Hive against parquet files. In the schema definition, we have a parquet struct called device with a string field user_agent. If we run query from Example 1, it returns results as expected. If we run query from Example 2, execution fails and exits with error. Did

Re: Hue 3.7.1 issue at EMR 4.3.0: fails to install Hive Editor

2016-04-04 Thread Jose Rozanec
=true and restarting the process, we got it running as expected. 2016-04-04 13:00 GMT-03:00 Jose Rozanec : > Hello, > > Today morning we started getting an issue at Hue instance, when creating > an EMR cluster with Hive/Hue. At this link we provide the trace we get, > when attempting

Hue 3.7.1 issue at EMR 4.3.0: fails to install Hive Editor

2016-04-04 Thread Jose Rozanec
Hello, Today morning we started getting an issue at Hue instance, when creating an EMR cluster with Hive/Hue. At this link we provide the trace we get, when attempting to setup Hue's Hive Editor: http://pastebin.com/LTN15k7r Did anyone face this? A few days ago we had no issues creating a cluster

Re: Hive parquet on EMR

2016-04-01 Thread Jose Rozanec
for this in Hive, but it only fixed querying with mixed > case in top level column names, not columns nested in structs. > > Hope this helps, > > Nick > > Nicholas Szandor Hakobian > Data Scientist > Rally Health > nicholas.hakob...@rallyhealth.com > >

Hive parquet on EMR

2016-04-01 Thread Jose Rozanec
Hello, We have a Hive (v 1.0.0) cluster at EMR and data stored in parquet files. When querying data, it fails to return result, causing a NPE. We think the error may be related with Hive deserialization, since can query data without problems when using other technologies (ex.: Presto). Here we pr