Re: Docker-based app: defining application.def

2015-06-10 Thread Yu Liu
Hi, Olivier: Sorry about the delay of the response. For some reason, I didn't receive your original email in my mailbox. 'application.def' is not required for launching Docker based application through Slider. I just re-verified with the tip of develop branch of Slider and it seems to work fin

Re: Docker-based app: defining application.def

2015-06-10 Thread Gour Saha
Fwd-ing to the DL again, as it seems our docker dev was not receiving these emails. -Gour On 6/8/15, 4:43 AM, "Olivier Armand" wrote: >Hi, > >Rephrasing the initial question: should users consider Slider's Docker >support usable starting from 0.80, as there doesn't seem to be any public >sample

Re: component restart by making config changes.

2015-06-10 Thread Chackravarthy Esakkimuthu
Yeah understood now, thanks for the clarification. On 11 Jun 2015 02:27, "Gour Saha" wrote: > You are right that upgrade cmd supersedes the update cmd. upgrade is a > formal way to do a zero-downtime upgrade of your application in production > env and requires you to tag your app config with an a

Re: component restart by making config changes.

2015-06-10 Thread Gour Saha
You are right that upgrade cmd supersedes the update cmd. upgrade is a formal way to do a zero-downtime upgrade of your application in production env and requires you to tag your app config with an appropriate app_version. update cmd on the other hand requires a stop/start of your application. It

Re: component restart by making config changes.

2015-06-10 Thread Chackravarthy Esakkimuthu
Thanks for the detailed explanation, yes Agreed that it would create confusion when different components of same application runs with different versions. Since I had tried 'slider update' command to update the configs and then to do complete app restart, thought there would be an option to do at

Re: component restart by making config changes.

2015-06-10 Thread Gour Saha
Upgrade of an application package should be visualized holistically. It could be as minor as a single config of a single component, OR as major as changes to all the binaries and 10s/100s of additional new configs. If the original version was 1.0.0, then a single config update version might be ca

Re: component restart by making config changes.

2015-06-10 Thread Steve Loughran
> On 10 Jun 2015, at 20:58, Chackravarthy Esakkimuthu > wrote: > > Thanks for the response Gour, > > Since I was facing issue with packaging storm, I tried with hbase > app-package and then identified that app_version reflects that. I tried > reconfiguration using upgrade command as per the do

Re: component restart by making config changes.

2015-06-10 Thread Chackravarthy Esakkimuthu
Thanks for the response Gour, Since I was facing issue with packaging storm, I tried with hbase app-package and then identified that app_version reflects that. I tried reconfiguration using upgrade command as per the doc and it resulted in success. I understand that this upgrade will be really he

Re: NIMBUS Component not starting while running apache storm on slider

2015-06-10 Thread Chackravarthy Esakkimuthu
Thanks steve, I applied the patch and tried again. Now ended up in some other error preventing NIMBUS to start, Error opening zip file or JAR manifest missing : /grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1433776215383_0025/container_1433776215383_0025_01_02/app/install/apach

Re: component restart by making config changes.

2015-06-10 Thread Gour Saha
I think you are missing the app_version entry in your app_config file, like this - "site.global.app_version": "1.0", Please refer to this file as an example - https://github.com/apache/incubator-slider/blob/develop/app-packages/hbase/appConfig-default.json If that does not work, can you

[jira] [Commented] (SLIDER-902) AMClientCertStoreRetrievalIT#testRetrieveCertificateStores failing on Windows

2015-06-10 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580893#comment-14580893 ] ASF subversion and git services commented on SLIDER-902: Commit 80

[jira] [Updated] (SLIDER-902) AMClientCertStoreRetrievalIT#testRetrieveCertificateStores failing on Windows

2015-06-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated SLIDER-902: - Summary: AMClientCertStoreRetrievalIT#testRetrieveCertificateStores failing on Windows (was: AMClientCert

[jira] [Commented] (SLIDER-901) AgentClientInstallIT#testAgentClientInstall last validation statement is failing on Windows

2015-06-10 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580884#comment-14580884 ] ASF subversion and git services commented on SLIDER-901: Commit 07

[jira] [Updated] (SLIDER-901) AgentClientInstallIT#testAgentClientInstall last validation statement is failing on Windows

2015-06-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated SLIDER-901: - Summary: AgentClientInstallIT#testAgentClientInstall last validation statement is failing on Windows (was

Re: Use variables in "components" property in app config JSON file

2015-06-10 Thread Steve Loughran
right now we've steered clear of doing any form of variable, or x-ref in the config files, though I do have my eye on the @{variable} pattern in future. One of the reasons is the big question "when and where to evaluate these things", as well as "do you ever need to re-evaluate them as things c

[jira] [Updated] (SLIDER-902) AMClientCertStoreRetrievalIT failing on Windows

2015-06-10 Thread thomas liu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] thomas liu updated SLIDER-902: -- Attachment: SLIDER-902-001.patch Attaching the first fix > AMClientCertStoreRetrievalIT failing on Wind

[jira] [Updated] (SLIDER-902) AMClientCertStoreRetrievalIT failing on Windows

2015-06-10 Thread thomas liu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] thomas liu updated SLIDER-902: -- Attachment: (was: slider-902-001.patch) > AMClientCertStoreRetrievalIT failing on Windows >

[jira] [Issue Comment Deleted] (SLIDER-902) AMClientCertStoreRetrievalIT failing on Windows

2015-06-10 Thread thomas liu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] thomas liu updated SLIDER-902: -- Comment: was deleted (was: Attaching the first fix) > AMClientCertStoreRetrievalIT failing on Windows >

[jira] [Updated] (SLIDER-902) AMClientCertStoreRetrievalIT failing on Windows

2015-06-10 Thread thomas liu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] thomas liu updated SLIDER-902: -- Attachment: slider-902-001.patch Attaching the first fix > AMClientCertStoreRetrievalIT failing on Wind

[jira] [Updated] (SLIDER-901) AgentClientInstallIT last validation statement is failing on Windows

2015-06-10 Thread thomas liu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] thomas liu updated SLIDER-901: -- Attachment: SLIDER-901-001.patch Attaching first fix > AgentClientInstallIT last validation statement i

[jira] [Updated] (SLIDER-901) AgentClientInstallIT last validation statement is failing on Windows

2015-06-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated SLIDER-901: - Fix Version/s: (was: Slider 0.81) > AgentClientInstallIT last validation statement is failing on Windo

[jira] [Updated] (SLIDER-902) AMClientCertStoreRetrievalIT failing on Windows

2015-06-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated SLIDER-902: - Assignee: thomas liu > AMClientCertStoreRetrievalIT failing on Windows > -

[jira] [Updated] (SLIDER-902) AMClientCertStoreRetrievalIT failing on Windows

2015-06-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated SLIDER-902: - Affects Version/s: Slider 0.80 > AMClientCertStoreRetrievalIT failing on Windows > ---

[jira] [Updated] (SLIDER-902) AMClientCertStoreRetrievalIT failing on Windows

2015-06-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated SLIDER-902: - Description: The test case is passing on Linux It uses some Linux specific path so fails on Windows Fixing

[jira] [Updated] (SLIDER-902) AMClientCertStoreRetrievalIT failing on Windows

2015-06-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated SLIDER-902: - Description: The test case is passing on Linux It uses some Linux specific path so fails on Windows Fixing

[jira] [Updated] (SLIDER-901) AgentClientInstallIT last validation statement is failing on Windows

2015-06-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated SLIDER-901: - Assignee: thomas liu > AgentClientInstallIT last validation statement is failing on Windows >

[jira] [Updated] (SLIDER-901) AgentClientInstallIT last validation statement is failing on Windows

2015-06-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated SLIDER-901: - Fix Version/s: Slider 0.81 > AgentClientInstallIT last validation statement is failing on Windows > --

[jira] [Updated] (SLIDER-901) AgentClientInstallIT last validation statement is failing on Windows

2015-06-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated SLIDER-901: - Affects Version/s: Slider 0.80 > AgentClientInstallIT last validation statement is failing on Windows > --

[jira] [Updated] (SLIDER-901) AgentClientInstallIT last validation statement is failing on Windows

2015-06-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated SLIDER-901: - Description: AgentClientInstallIT passes on Linux. However, on Windows, the second validation statement in

[jira] [Created] (SLIDER-902) AMClientCertStoreRetrievalIT failing on Windows

2015-06-10 Thread thomas liu (JIRA)
thomas liu created SLIDER-902: - Summary: AMClientCertStoreRetrievalIT failing on Windows Key: SLIDER-902 URL: https://issues.apache.org/jira/browse/SLIDER-902 Project: Slider Issue Type: Bug

[jira] [Updated] (SLIDER-901) AgentClientInstallIT last validation statement is failing on Windows

2015-06-10 Thread thomas liu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] thomas liu updated SLIDER-901: -- Description: AgentClientInstallIT passes on Linux. However, on Windows, the second validation statement

[jira] [Created] (SLIDER-901) AgentClientInstallIT last validation statement is failing on Windows

2015-06-10 Thread thomas liu (JIRA)
thomas liu created SLIDER-901: - Summary: AgentClientInstallIT last validation statement is failing on Windows Key: SLIDER-901 URL: https://issues.apache.org/jira/browse/SLIDER-901 Project: Slider

[jira] [Resolved] (SLIDER-896) TestClientBasicArgs.testListUnknownRM fails on Windows

2015-06-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SLIDER-896. --- Resolution: Fixed Fix Version/s: Slider 0.80 > TestClientBasicArgs.testListUnknownRM fa

Use variables in "components" property in app config JSON file

2015-06-10 Thread Nathaniel Braun
Hi, In order to determine the principal name to use in my Kerberized AM, I need the hostname of the machine the AM executes on. Here is the part of the appConfig.json I'm interested in: "components": { "slider-appmaster": { "jvm.heapsize": "256M", "slider.hdfs.keytab.dir": ".s

Re: NIMBUS Component not starting while running apache storm on slider

2015-06-10 Thread Steve Loughran
> On 9 Jun 2015, at 13:10, Chackravarthy Esakkimuthu > wrote: > > I created slider-storm package (with apache storm 0.9.3) following > instructions at README.txt, and then did install using slider. > > NIMBUS component failed to start with following error : > > /usr/bin/python: can't open fil