Re: Review Request 28011: AMBARI-8015: Dashboard: add a widget for YARN links (similar to the HDFS Links)

2014-11-13 Thread Mingjiang Shi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28011/#review61366 --- Ship it! Ship It! - Mingjiang Shi On Nov. 13, 2014, 11:07 p.m

[jira] [Created] (AMBARI-8303) Write another copy of the config files.

2014-11-12 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-8303: - Summary: Write another copy of the config files. Key: AMBARI-8303 URL: https://issues.apache.org/jira/browse/AMBARI-8303 Project: Ambari Issue Type

Cannot run ambari-agent unittests

2014-11-11 Thread Mingjiang Shi
Hi There, I am running the ambari-agent unit tests using the following command under ambari-agent folder: mvn clean test ​ I got the following error message: Traceback (most recent call last): File “unitTests.py”, line 119, in main() File “unitTests.py”, line 86, in main suite = all *tests

Re: questions about service starting dependencies ...

2014-11-10 Thread Mingjiang Shi
Hi Thomas, I think this can be achieved by modifying the file role_command_order.json under the stack definition folder (e.g. BIGTOP/0.8). Here is an example that defines the namenode should be started before starting the secondary namenode "SECONDARY_NAMENODE-START": ["NAMENODE-START"] ​ Hope t

[jira] [Commented] (AMBARI-8015) Dashboard: add a widget for YARN links (similar to the HDFS Links)

2014-10-29 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188103#comment-14188103 ] Mingjiang Shi commented on AMBARI-8015: --- I am working on this right

[jira] [Commented] (AMBARI-8015) Dashboard: add a widget for YARN links (similar to the HDFS Links)

2014-10-29 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188102#comment-14188102 ] Mingjiang Shi commented on AMBARI-8015: --- Added a screenshot for the prop

[jira] [Updated] (AMBARI-8015) Dashboard: add a widget for YARN links (similar to the HDFS Links)

2014-10-29 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-8015: -- Attachment: yarn_links.png > Dashboard: add a widget for YARN links (similar to the HDFS Li

[jira] [Created] (AMBARI-8015) Dashboard: add a widget for YARN links (similar to the HDFS Links)

2014-10-29 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-8015: - Summary: Dashboard: add a widget for YARN links (similar to the HDFS Links) Key: AMBARI-8015 URL: https://issues.apache.org/jira/browse/AMBARI-8015 Project: Ambari

[jira] [Updated] (AMBARI-7552) Create Pivotal HD stack definition

2014-10-21 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-7552: -- Fix Version/s: 2.0.0 1.7.0 > Create Pivotal HD stack definit

[jira] [Updated] (AMBARI-7684) Bigtop: use reload command to make the postgresql changes be effective

2014-10-21 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-7684: -- Fix Version/s: 2.0.0 1.7.0 > Bigtop: use reload command to make

[jira] [Updated] (AMBARI-7688) Bigtop: HDFS configuration misses dfs.datanode.data.dir.mount.file configuration item.

2014-10-21 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-7688: -- Fix Version/s: 2.0.0 > Bigtop: HDFS configuration misses dfs.datanode.data.dir.mount.f

[jira] [Updated] (AMBARI-7688) Bigtop: HDFS configuration misses dfs.datanode.data.dir.mount.file configuration item.

2014-10-21 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-7688: -- Fix Version/s: 1.7.0 > Bigtop: HDFS configuration misses dfs.datanode.data.dir.mount.f

[jira] [Updated] (AMBARI-7686) Pulling AMBARI-7296 into BT stack definition: HCatalog and WebHCat services should not be managed as separate service (should be part of Hive service)

2014-10-21 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-7686: -- Fix Version/s: 1.7.0 > Pulling AMBARI-7296 into BT stack definition: HCatalog and WebH

[jira] [Updated] (AMBARI-7686) Pulling AMBARI-7296 into BT stack definition: HCatalog and WebHCat services should not be managed as separate service (should be part of Hive service)

2014-10-21 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-7686: -- Fix Version/s: 2.0.0 > Pulling AMBARI-7296 into BT stack definition: HCatalog and WebH

Re: No Cluster Load, Memory, CPU and network information for HDPNamenode in Ganglia

2014-10-21 Thread Mingjiang Shi
r the HDP_GRID to be incorrect. Would you please confirm on this? Thanks! On Tue, Oct 21, 2014 at 2:35 PM, Mingjiang Shi wrote: > Hi Sid, Yusaku > I have observed 2 things on the namenode which also runs datanode: > *1. ps out only has HDPSlaves:* > ps -ef | grep gmond > nobody

Re: No Cluster Load, Memory, CPU and network information for HDPNamenode in Ganglia

2014-10-20 Thread Mingjiang Shi
metrics to gmond running on the *Ganglia server* host. > > Ambari, configures the /etc/ganglia/hdp/ automatically, can you > restart Ganglia service and check if there are errors in the agent log. > > Check, ps aux | grep gmond, on ganglia host, also check the debug log after > resta

Re: No Cluster Load, Memory, CPU and network information for HDPNamenode in Ganglia

2014-10-20 Thread Mingjiang Shi
s metrics to that gmond process. > > 2. Edit /etc/ganglia/hdp/HDPNamenode/gmond.core.conf, set debug = 10. > > Restart gmond on ganglia server host, #] service hdp-gmond restart. > > This will start the proc in foreground and print logs to stdout. > > -Sid > > >

Re: No Cluster Load, Memory, CPU and network information for HDPNamenode in Ganglia

2014-10-20 Thread Mingjiang Shi
in the following way: > > > Something like: > 192.168.64.101 c6401.ambari.apache.org c6401 > 192.168.64.102 c6402.ambari.apache.org c6402 > > On Mon, Oct 20, 2014 at 3:05 AM, Mingjiang Shi wrote: > >> Hi There, >> I deployed an HDP-2.1 cluster with Ganglia install

No Cluster Load, Memory, CPU and network information for HDPNamenode in Ganglia

2014-10-20 Thread Mingjiang Shi
Hi There, I deployed an HDP-2.1 cluster with Ganglia installed, but I don't see any Load, Memory, CPU and network information for HDPNamenode. Is this as designed? Thanks! ​ -- Cheers -MJ

[jira] [Created] (AMBARI-7811) Integrate ElasticSearch, LogStash and Kibana with Ambari

2014-10-15 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-7811: - Summary: Integrate ElasticSearch, LogStash and Kibana with Ambari Key: AMBARI-7811 URL: https://issues.apache.org/jira/browse/AMBARI-7811 Project: Ambari

[jira] [Updated] (AMBARI-7352) Support create new PostgreSQL database for hive metastore when deploy hive.

2014-10-15 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-7352: -- Fix Version/s: 2.0.0 > Support create new PostgreSQL database for hive metastore when dep

Re: Review Request 26780: AMBARI-7352 - JavaScript support for using "New PostgreSQL" option for HIVE database for BIGTOP stack

2014-10-15 Thread Mingjiang Shi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26780/#review56856 --- Ship it! Ship It! - Mingjiang Shi On Oct. 15, 2014, 9:32 p.m

[jira] [Commented] (AMBARI-7354) Allow different stack have different predefined site properties

2014-10-14 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171936#comment-14171936 ] Mingjiang Shi commented on AMBARI-7354: --- Hi [~jaimin], +1 to what you said

Re: Review Request 26659: Allow different stack have different predefined site properties

2014-10-14 Thread Mingjiang Shi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26659/#review56641 --- Ship it! Ship It! - Mingjiang Shi On Oct. 13, 2014, 8:47 p.m

[jira] [Updated] (AMBARI-7770) Bigtop: Mahout service version is not shown in the admin tab.

2014-10-14 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-7770: -- Fix Version/s: 2.0.0 > Bigtop: Mahout service version is not shown in the admin

[jira] [Updated] (AMBARI-7770) Bigtop: Mahout service version is not shown in the admin tab.

2014-10-14 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-7770: -- Fix Version/s: 1.7.0 > Bigtop: Mahout service version is not shown in the admin

[jira] [Updated] (AMBARI-7770) Bigtop: Mahout service version is not shown in the admin tab.

2014-10-14 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-7770: -- Description: Install bigtop stack using Ambari, the mahout service version is not shown in the

[jira] [Updated] (AMBARI-7770) Bigtop: Mahout service version is not shown in the admin tab.

2014-10-14 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-7770: -- Summary: Bigtop: Mahout service version is not shown in the admin tab. (was: Allow update the

[jira] [Created] (AMBARI-7770) Allow update the App.defaultStackVersion in config. js to a stack-specific value at build time

2014-10-14 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-7770: - Summary: Allow update the App.defaultStackVersion in config. js to a stack-specific value at build time Key: AMBARI-7770 URL: https://issues.apache.org/jira/browse/AMBARI-7770

[jira] [Updated] (AMBARI-7770) Allow update the App.defaultStackVersion in config.js to a stack-specific value at build time

2014-10-14 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-7770: -- Summary: Allow update the App.defaultStackVersion in config.js to a stack-specific value at

[jira] [Updated] (AMBARI-7688) Bigtop: HDFS configuration misses dfs.datanode.data.dir.mount.file configuration item.

2014-10-08 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi updated AMBARI-7688: -- Description: Installing bigtop stack using Ambari, the hdfs configuration tab shows a red box

[jira] [Created] (AMBARI-7688) Bigtop: HDFS configuration misses dfs.datanode.data.dir.mount.file configuration item.

2014-10-08 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-7688: - Summary: Bigtop: HDFS configuration misses dfs.datanode.data.dir.mount.file configuration item. Key: AMBARI-7688 URL: https://issues.apache.org/jira/browse/AMBARI-7688

[jira] [Created] (AMBARI-7686) Pulling AMBARI-7296 into BT stack definition: HCatalog and WebHCat services should not be managed as separate service (should be part of Hive service)

2014-10-07 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-7686: - Summary: Pulling AMBARI-7296 into BT stack definition: HCatalog and WebHCat services should not be managed as separate service (should be part of Hive service) Key: AMBARI-7686

[jira] [Created] (AMBARI-7684) Bigtop: use reload command to make the postgresql changes be effective

2014-10-07 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-7684: - Summary: Bigtop: use reload command to make the postgresql changes be effective Key: AMBARI-7684 URL: https://issues.apache.org/jira/browse/AMBARI-7684 Project

[jira] [Created] (AMBARI-7552) Create Pivotal HD stack definition

2014-09-29 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-7552: - Summary: Create Pivotal HD stack definition Key: AMBARI-7552 URL: https://issues.apache.org/jira/browse/AMBARI-7552 Project: Ambari Issue Type: Bug

[jira] [Created] (AMBARI-7551) Create mahout definition for bigtop

2014-09-29 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-7551: - Summary: Create mahout definition for bigtop Key: AMBARI-7551 URL: https://issues.apache.org/jira/browse/AMBARI-7551 Project: Ambari Issue Type: Bug

[jira] [Commented] (AMBARI-7292) Create stack definitions for Bigtop 0.8

2014-09-27 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150997#comment-14150997 ] Mingjiang Shi commented on AMBARI-7292: --- [~vgog...@gopivotal.com], those files

[jira] [Created] (AMBARI-7442) ServiceCheck cannot be run if there is only one stack definition

2014-09-22 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-7442: - Summary: ServiceCheck cannot be run if there is only one stack definition Key: AMBARI-7442 URL: https://issues.apache.org/jira/browse/AMBARI-7442 Project: Ambari

Unabled to build ambari due to unable to find suitable version for angular

2014-09-18 Thread Mingjiang Shi
Hi There, Ambari build failed when building ambari-admin, with the following error: [INFO] --- exec-maven-plugin:1.3.2:exec (Bower install) @ ambari-admin --- > bower angular-animate#~1.2.23 cached git:// > github.com/angular/bower-angular-animate.git#1.2.25 > bower angular-animate#~1.2.23 valid

[jira] [Commented] (AMBARI-7291) Create different Maven profiles to build Bigtop, HDP and PHD stacks

2014-09-17 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138420#comment-14138420 ] Mingjiang Shi commented on AMBARI-7291: --- [~mahadev], did you mean to see

[jira] [Commented] (AMBARI-7146) non-HDP stack definitions are not included in the ambari-server rpm package.

2014-09-17 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14136927#comment-14136927 ] Mingjiang Shi commented on AMBARI-7146: --- Duplicated to AMBARI-7291 >

[jira] [Resolved] (AMBARI-7146) non-HDP stack definitions are not included in the ambari-server rpm package.

2014-09-17 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingjiang Shi resolved AMBARI-7146. --- Resolution: Duplicate > non-HDP stack definitions are not included in the ambari-server

[jira] [Created] (AMBARI-7354) Allow different stack have different predefined site properties

2014-09-17 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-7354: - Summary: Allow different stack have different predefined site properties Key: AMBARI-7354 URL: https://issues.apache.org/jira/browse/AMBARI-7354 Project: Ambari

[jira] [Created] (AMBARI-7352) Support create new PostgreSQL database for hive metastore when deploy hive.

2014-09-17 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-7352: - Summary: Support create new PostgreSQL database for hive metastore when deploy hive. Key: AMBARI-7352 URL: https://issues.apache.org/jira/browse/AMBARI-7352

[jira] [Commented] (AMBARI-7146) non-HDP stack definitions are not included in the ambari-server rpm package.

2014-09-04 Thread Mingjiang Shi (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122297#comment-14122297 ] Mingjiang Shi commented on AMBARI-7146: --- I am working on a fix for this. &

[jira] [Created] (AMBARI-7146) non-HDP stack definitions are not included in the ambari-server rpm package.

2014-09-04 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-7146: - Summary: non-HDP stack definitions are not included in the ambari-server rpm package. Key: AMBARI-7146 URL: https://issues.apache.org/jira/browse/AMBARI-7146

[jira] [Created] (AMBARI-7145) 3 unit test cases failure in the ambari-web project on trunk

2014-09-03 Thread Mingjiang Shi (JIRA)
Mingjiang Shi created AMBARI-7145: - Summary: 3 unit test cases failure in the ambari-web project on trunk Key: AMBARI-7145 URL: https://issues.apache.org/jira/browse/AMBARI-7145 Project: Ambari