Re: Does it has a way to config limit in query on STS by default?

I tried both of the following with STS but neither works for me. Starting STS with --hiveconf hive.limit.optimize.fetch.max=50 and Setting common.max_count in Zeppelin Without setting such limits, a query that outputs lots of rows could cause the driver to OOM and makes TS unusable. Any

Re: Does it has a way to config limit in query on STS by default?

I don't think it really works and it is vague. Is it rows, blocks, network? [image: Inline images 1] Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Does it has a way to config limit in query on STS by default?

Hi Ayan, You mean common.max_count = 1000 Max number of SQL result to display to prevent the browser overload. This is common properties for all connections It already set default in Zeppelin but I think it doesn’t work with Hive. DOC:

Re: Does it has a way to config limit in query on STS by default?

Zeppelin already has a param for jdbc On 2 Aug 2016 19:50, "Mich Talebzadeh" wrote: > Ok I have already set up mine > > > hive.limit.optimize.fetch.max > 5 > > Maximum number of rows allowed for a smaller subset of data for > simple LIMIT,

Re: Does it has a way to config limit in query on STS by default?

I just added to spark thrift server as it starts a param —hiveconf hive.limit.optimize.fetch.max=1000 > On Aug 2, 2016, at 4:50 PM, Mich Talebzadeh wrote: > > Ok I have already set up mine > > > hive.limit.optimize.fetch.max > 5 > >

Re: Does it has a way to config limit in query on STS by default?

Ok I have already set up mine hive.limit.optimize.fetch.max 5 Maximum number of rows allowed for a smaller subset of data for simple LIMIT, if it is a fetch query. Insert queries are not restricted by this limit. I am surprised that yours was missing.

Re: Does it has a way to config limit in query on STS by default?

I tried and it works perfectly. Regards, Chanh > On Aug 2, 2016, at 3:33 PM, Mich Talebzadeh wrote: > > OK > > Try that > > Another tedious way is to create views in Hive based on tables and use limit > on those views. > > But try that parameter first if it does

Re: Does it has a way to config limit in query on STS by default?

OK Try that Another tedious way is to create views in Hive based on tables and use limit on those views. But try that parameter first if it does anything. HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Does it has a way to config limit in query on STS by default?

Hi Mich, I use Spark Thrift Server basically it acts like Hive. I see that there is property in Hive. > hive.limit.optimize.fetch.max > Default Value: 5 > Added In: Hive 0.8.0 > Maximum number of rows allowed for a smaller subset of data for simple LIMIT, > if it is a fetch query. Insert

Re: Does it has a way to config limit in query on STS by default?

This is a classic problem on any RDBMS Set the limit on the number of rows returned like maximum of 50K rows through JDBC What is your JDBC connection going to? Meaning which RDBMS if any? HTH Dr Mich Talebzadeh LinkedIn *

Does it has a way to config limit in query on STS by default?

Hi everyone, I setup STS and use Zeppelin to query data through JDBC connection. A problem we are facing is users usually forget to put limit in the query so it causes hang the cluster. SELECT * FROM tableA; Is there anyway to config the limit by default ? Regards, Chanh