Re: Init weirdness

2016-02-24 Thread Radar Da lei
When doing 'hawq init', we will check the segments number and dynamic to decide some property values, for example 'default_segment_num', 'hawq_rm_nvseg_perquery_perseg_limit'. These properties will be write back to hawq-site.xml by 'hawq config' command. Another situation you mentioned is when we

Re: Init weirdness

2016-02-24 Thread Konstantin Boudnik
Thanks for the explanation, Radar. But I am talking about hawq-site.xml, which is being re-written and the original content is copied under hawq-site.xml.org I guess I pointed to a wrong function, as I see that _write_config() is doing exactly what you said. Generating of the new files might be fi

Re: Init weirdness

2016-02-24 Thread Radar Da lei
Hi Konstantin, Do you mean the step we read properties in hawq-site.xml, and then re-write them to the file '_mgmt_config' ? This is to read some parameters easier when doing hawq init. The file will be generate during each 'hawq init', then it's useless. In the plan, it will be generated into '

Init weirdness

2016-02-24 Thread Konstantin Boudnik
Guys, I've been slowly working my way towards running the hawq out of the package (BIGTOP-2320) and have stepped on something that I can not quite explain. During the initial cluster init, there's an attempt to rewrite the configuration file hawq-site.xml Because of the standard location of the

[GitHub] incubator-hawq pull request: HAWQ-455. Disable creating partition ...

2016-02-24 Thread hsyuan
GitHub user hsyuan opened a pull request: https://github.com/apache/incubator-hawq/pull/387 HAWQ-455. Disable creating partition tables with non uniform bucket schema HAWQ user should not be able to create partition tables with non uniform bucket schema so that don't make orca trip

[GitHub] incubator-hawq pull request: HAWQ-454. 'hawq stop' should return t...

2016-02-24 Thread yaoj2
Github user yaoj2 commented on the pull request: https://github.com/apache/incubator-hawq/pull/386#issuecomment-188570149 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] incubator-hawq pull request: HAWQ-454. 'hawq stop' should return t...

2016-02-24 Thread radarwave
GitHub user radarwave opened a pull request: https://github.com/apache/incubator-hawq/pull/386 HAWQ-454. 'hawq stop' should return true if master/standby already stopped Currently if we do 'hawq stop master/standby' while master/standby already in stop stage, we will recognize the s

[GitHub] incubator-hawq pull request: HAWQ-454. 'hawq stop' should return t...

2016-02-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-hawq/pull/386 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-hawq pull request: HAWQ-447. YARN mode resource manager ...

2016-02-24 Thread jiny2
Github user jiny2 closed the pull request at: https://github.com/apache/incubator-hawq/pull/381 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-hawq pull request: HAWQ-448. hawq_global_rm_type is case...

2016-02-24 Thread jiny2
Github user jiny2 closed the pull request at: https://github.com/apache/incubator-hawq/pull/382 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-hawq pull request: HAWQ-449. Should not adjust FTS resou...

2016-02-24 Thread jiny2
Github user jiny2 closed the pull request at: https://github.com/apache/incubator-hawq/pull/383 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-hawq pull request: HAWQ-451. Remove dead code in utiliti...

2016-02-24 Thread jiny2
Github user jiny2 closed the pull request at: https://github.com/apache/incubator-hawq/pull/384 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-hawq pull request: HAWQ-454. 'hawq stop' should return t...

2016-02-24 Thread linwen
Github user linwen commented on the pull request: https://github.com/apache/incubator-hawq/pull/386#issuecomment-188569751 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] incubator-hawq pull request: HAWQ-449. Should not adjust FTS resou...

2016-02-24 Thread yaoj2
Github user yaoj2 commented on the pull request: https://github.com/apache/incubator-hawq/pull/383#issuecomment-188557251 LGTM +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] incubator-hawq pull request: HAWQ-451. Remove dead code in utiliti...

2016-02-24 Thread yaoj2
Github user yaoj2 commented on the pull request: https://github.com/apache/incubator-hawq/pull/384#issuecomment-188557140 LGTM +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] incubator-hawq pull request: HAWQ-447. YARN mode resource manager ...

2016-02-24 Thread yaoj2
Github user yaoj2 commented on the pull request: https://github.com/apache/incubator-hawq/pull/381#issuecomment-188556895 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] incubator-hawq pull request: HAWQ-451. Remove dead code in utiliti...

2016-02-24 Thread huor
Github user huor commented on the pull request: https://github.com/apache/incubator-hawq/pull/384#issuecomment-188552764 LTGM. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] incubator-hawq pull request: HAWQ-449. Should not adjust FTS resou...

2016-02-24 Thread huor
Github user huor commented on the pull request: https://github.com/apache/incubator-hawq/pull/383#issuecomment-188552638 LGTM. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] incubator-hawq pull request: HAWQ-448. hawq_global_rm_type is case...

2016-02-24 Thread huor
Github user huor commented on the pull request: https://github.com/apache/incubator-hawq/pull/382#issuecomment-188552566 LGTM. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] incubator-hawq pull request: HAWQ-447. YARN mode resource manager ...

2016-02-24 Thread huor
Github user huor commented on the pull request: https://github.com/apache/incubator-hawq/pull/381#issuecomment-188552288 LGTM. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

Re: build hawq on ubuntu

2016-02-24 Thread Clay Baenziger (BLOOMBERG/ 731 LEX)
Hi Yongzhu, While HAWQ-307 will give you the right code to build. You are hitting a Bison issue. Bison 2.5.1 is absolutely necessary. (There is a bison bug in newer versions as such as is packaged by Ubuntu.) I build bison via the Chef script at: https://github.com/cbaenziger/incubator-hawq/bl

Re: build hawq on ubuntu

2016-02-24 Thread Konstantin Boudnik
Check HAWQ-307 where the work for this is done. Cos On Sun, Feb 21, 2016 at 03:29PM, Yongzhu Li wrote: > Hello, > > Any one had good experience building hawq on ubuntu. I tried that on a > 15.10 ubuntu desktop version. > > I managed to resolve all dependencies and now the configure script is >

[GitHub] incubator-hawq pull request: HAWQ-452. Remove the workfile views f...

2016-02-24 Thread gcaragea
GitHub user gcaragea opened a pull request: https://github.com/apache/incubator-hawq/pull/385 HAWQ-452. Remove the workfile views from hawq_toolkit In the hawq_toolkit schema we have a few views with live information about disk space used for workfiles (or spillfiles). Generatin

[GitHub] incubator-hawq pull request: HAWQ-451. Remove dead code in utiliti...

2016-02-24 Thread jiny2
GitHub user jiny2 opened a pull request: https://github.com/apache/incubator-hawq/pull/384 HAWQ-451. Remove dead code in utilities of resource manager You can merge this pull request into a Git repository by running: $ git pull https://github.com/jiny2/incubator-hawq HAWQ-451

[GitHub] incubator-hawq pull request: HAWQ-444. The counter for increasing ...

2016-02-24 Thread jiny2
Github user jiny2 closed the pull request at: https://github.com/apache/incubator-hawq/pull/379 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-hawq pull request: HAWQ-445. Support large strings (up t...

2016-02-24 Thread foyzur
Github user foyzur commented on the pull request: https://github.com/apache/incubator-hawq/pull/378#issuecomment-188453389 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] incubator-hawq pull request: HAWQ-368. Fix runawqy query cancellat...

2016-02-24 Thread foyzur
Github user foyzur commented on the pull request: https://github.com/apache/incubator-hawq/pull/377#issuecomment-188423900 It definitely LGTM as we worked together on this one :-p So, I guess you need two more LGTM from other people. --- If your project is set up for it, you can repl

[GitHub] incubator-hawq pull request: HAWQ-445. Support large strings (up t...

2016-02-24 Thread karthijrk
Github user karthijrk commented on the pull request: https://github.com/apache/incubator-hawq/pull/378#issuecomment-188423548 LGTM :+1: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] incubator-hawq pull request: Hawq 317

2016-02-24 Thread GodenYao
Github user GodenYao commented on the pull request: https://github.com/apache/incubator-hawq/pull/279#issuecomment-188397037 Jemish is on paternity leave until Mar 1st. He will pick up the verification and update us. --- If your project is set up for it, you can reply to this email a

[GitHub] incubator-hawq pull request: HAWQ-449. Should not adjust FTS resou...

2016-02-24 Thread jiny2
GitHub user jiny2 opened a pull request: https://github.com/apache/incubator-hawq/pull/383 HAWQ-449. Should not adjust FTS resource capacity in YARN mode You can merge this pull request into a Git repository by running: $ git pull https://github.com/jiny2/incubator-hawq HAWQ-4

[GitHub] incubator-hawq pull request: HAWQ-448. hawq_global_rm_type is case...

2016-02-24 Thread yaoj2
Github user yaoj2 commented on the pull request: https://github.com/apache/incubator-hawq/pull/382#issuecomment-188164309 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] incubator-hawq pull request: HAWQ-448. hawq_global_rm_type is case...

2016-02-24 Thread jiny2
GitHub user jiny2 opened a pull request: https://github.com/apache/incubator-hawq/pull/382 HAWQ-448. hawq_global_rm_type is case sensitive This makes HAWQ RM able to recognize string of hawq_global_rm_type in a case insensitive way. You can merge this pull request into a Git reposi

[GitHub] incubator-hawq pull request: HAWQ-447. YARN mode resource manager ...

2016-02-24 Thread jiny2
GitHub user jiny2 opened a pull request: https://github.com/apache/incubator-hawq/pull/381 HAWQ-447. YARN mode resource manager does not count available segment back in to available segment counter The fix is to add available segment counter when segment is FTS available again but