[
https://issues.apache.org/jira/browse/AMBARI-3548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dmitry Lysnichenko updated AMBARI-3548:
---------------------------------------
Attachment: AMBARI-3548_preview3.patch
Attached a fixed patch. It has been end to end tested and works with new-style
HBase scripts. This patch is not final as it has to be merged with AMBARI-3731
and lacks few changes/unit tests. But it may be used for testing another custom
services.
Performed a simple benchmark with puppet HBase scripts and python HBase
scripts. Configuration:
The same vmware VM (4 cores, 3.5gb ram, stored at ssd drive), using local
caching proxy
Installing 2.0.6/2.0._ stack (HDFS+HBase+Zookeeper)
2.0.6 stack (with puppet manifests) took 7 minutes and 32 seconds/7 minutes and
23 seconds (tried twice)
2.0._ stack (HBase installation scripts are python-based and do the same things
as puppet) 6 minutes 10 seconds
So puppet overhead is really great.
> Changes to stacks definitions to allow custom services support (needed by an
> ambari-agent)
> ------------------------------------------------------------------------------------------
>
> Key: AMBARI-3548
> URL: https://issues.apache.org/jira/browse/AMBARI-3548
> Project: Ambari
> Issue Type: Bug
> Components: controller
> Affects Versions: 1.5.0
> Reporter: Dmitry Lysnichenko
> Assignee: Dmitry Lysnichenko
> Fix For: 1.5.0
>
> Attachments: AMBARI-3548_preview.patch, AMBARI-3548_preview2.patch,
> AMBARI-3548_preview3.patch, hbase_new_metainfo.json, hbase_new_metainfo.xml,
> hbase_old_metainfo.xml, new-style-command-dump.txt,
> service_metainfo_changes.patch
>
>
> Stack definitions for custom services should contain fields:
> - service metadata
> -- list of repositories
> - component metadata should contain fields:
> -- scriptType (possible values: "python", "puppet")
> -- taskTimeout (per-component value)
> Except metadata files, custom service directory should contain:
> - script directory that contains separate python files for components (e.g.
> namenode.py, datanode.py etc.) and service.py file.
> - a separate directory for templates
> Patch is so large because I've created a separate stack dir with modified
> HBase metadata.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
