>>>This is not possible when the app is running. Yarn does have a support for that. You need to stop the application and then modify the values. After topping the application you need to edit the "resources.json" file in HDFS to modify the value (e.g. ./user/USER1/slider/cluster/CLUSTER1/resources.json).
This is fine. I don't need to change this at run time, but I don't want to recreate either. Can I just stop, edit and start the application again with new properties been picked up? >>>If you stop and then start (probably it is "freeze" and "thaw" in 0.40) the application then it will use the hostnames that it remembered. What if I use *yarn application -kill* to stop the application? On Fri, Nov 14, 2014 at 5:09 PM, hsy...@gmail.com <hsy...@gmail.com> wrote: > The only problem is I have to upgrade to hadoop 2.6? > > On Fri, Nov 14, 2014 at 5:08 PM, Sumit Mohanty <smoha...@hortonworks.com> > wrote: > >> Is it possible for you to pick up the latest RC (0.60)? I can help you >> update the existing application package, if needed. >> >> >> Meanwhile, for 0.40, the log4j.properties file in >> slider-client-install-dir/conf can be modified to up the log level and the >> "create" call will push the file as a localized file for the AppMaster. >> >> >>> Another question is actually I'm asking how to change the >> configuration without >> recreate the cluster. Sometime I just want to increase the memory/add more >> instances for example and I want the application recover from last >> snapshot(run >> on same machines it allocated before) >> >> >>> increase the memory >> This is not possible when the app is running. Yarn does have a support for >> that. You need to stop the application and then modify the values. After >> topping the application you need to edit the "resources.json" file in HDFS >> to modify the value >> (e.g. ./user/USER1/slider/cluster/CLUSTER1/resources.json). >> >> >>> add more instances for example >> >> Flex command can be used while the application is running. >> >> >>> want the application recover from last snapshot >> If you stop and then start (probably it is "freeze" and "thaw" in 0.40) >> the >> application then it will use the hostnames that it remembered. >> >> -Sumit >> >> >> On Fri, Nov 14, 2014 at 4:35 PM, hsy...@gmail.com <hsy...@gmail.com> >> wrote: >> >> > I'm actually using 0.40 >> > >> > On Fri, Nov 14, 2014 at 4:21 PM, Sumit Mohanty < >> smoha...@hortonworks.com> >> > wrote: >> > >> > > >>> I'm getting confused. After you edit your appConfig.json and >> > > resources.json. >> > > You don't put it back in your package zip file? So the >> > > appConfig-default.json >> > > and resource-default.json is outdated? >> > > >> > > The file in the .zip package is not used by the running application. >> The >> > > files that are used are the ones that are provided by command line >> when >> > > "create" is called. *We suggest adding sample defaults to the .zip >> file >> > as >> > > reference so that there are only one file to download for the users.* >> > > >> > > Which branch are you using? (for me to answer the next questions) >> > > >> > > On Fri, Nov 14, 2014 at 3:47 PM, hsy...@gmail.com <hsy...@gmail.com> >> > > wrote: >> > > >> > > > I'm getting confused. After you edit your appConfig.json and >> > > > resources.json. You don't put it back in your package zip file? So >> the >> > > > appConfig-default.json and resource-default.json is outdated? >> > > > >> > > > >> > > > Another question is actually I'm asking how to change the >> configuration >> > > > without recreate the cluster. Sometime I just want to increase the >> > > memory/ >> > > > add more instances for example and I want the application recover >> from >> > > last >> > > > snapshot(run on same machines it allocated before) >> > > > >> > > > Thank you! >> > > > >> > > > >> > > > >> > > > >> > > > On Fri, Nov 14, 2014 at 2:14 PM, Sumit Mohanty < >> > smoha...@hortonworks.com >> > > > >> > > > wrote: >> > > > >> > > > > Nope. This is what I do typically. >> > > > > >> > > > > * Get an application package zip file >> > > > > * Extract the appConfig-default.json and resources-default.json >> from >> > > the >> > > > > package >> > > > > * Rename the files to appConfig.json and resources.json >> respectively >> > > and >> > > > > edit as needed >> > > > > * Use install-package to upload the application package zip file >> > > > > * Call create with .... --template appConfig.json --resources >> > > > > resources.json ... >> > > > > >> > > > > -Sumit >> > > > > >> > > > > On Fri, Nov 14, 2014 at 2:08 PM, hsy...@gmail.com < >> hsy...@gmail.com> >> > > > > wrote: >> > > > > >> > > > > > So actually you don't need appConfig.json and resources.json in >> the >> > > ZIP >> > > > > > package? >> > > > > > >> > > > > > On Fri, Nov 14, 2014 at 12:05 PM, Jon Maron < >> > jma...@hortonworks.com> >> > > > > > wrote: >> > > > > > >> > > > > > > Perhaps I’m misunderstanding your question, but in general, if >> > > making >> > > > > > > modifications to those files, you can simply create a new >> > > application >> > > > > > > instance referencing the new versions of the file from the >> > command >> > > > > line: >> > > > > > > >> > > > > > > ./slider create <app name> —template <appConfig path> >> —resources >> > > > > > > <resources file path> >> > > > > > > >> > > > > > > the app config references the application package in HDFS, >> which >> > > can >> > > > be >> > > > > > > pre-seeded using “slider install-package” >> > > > > > > >> > > > > > > — Jon >> > > > > > > >> > > > > > > On Nov 14, 2014, at 2:54 PM, hsy...@gmail.com wrote: >> > > > > > > >> > > > > > > > Everytime I change appConfig.json and resources.json. Do I >> have >> > > to >> > > > > > > > repackage the zip file and redeploy the file to hdfs? >> > > > > > > > >> > > > > > > > Thanks! >> > > > > > > >> > > > > > > >> > > > > > > -- >> > > > > > > CONFIDENTIALITY NOTICE >> > > > > > > NOTICE: This message is intended for the use of the >> individual or >> > > > > entity >> > > > > > to >> > > > > > > which it is addressed and may contain information that is >> > > > confidential, >> > > > > > > privileged and exempt from disclosure under applicable law. If >> > the >> > > > > reader >> > > > > > > of this message is not the intended recipient, you are hereby >> > > > notified >> > > > > > that >> > > > > > > any printing, copying, dissemination, distribution, >> disclosure or >> > > > > > > forwarding of this communication is strictly prohibited. If >> you >> > > have >> > > > > > > received this communication in error, please contact the >> sender >> > > > > > immediately >> > > > > > > and delete it from your system. Thank You. >> > > > > > > >> > > > > > >> > > > > >> > > > > -- >> > > > > CONFIDENTIALITY NOTICE >> > > > > NOTICE: This message is intended for the use of the individual or >> > > entity >> > > > to >> > > > > which it is addressed and may contain information that is >> > confidential, >> > > > > privileged and exempt from disclosure under applicable law. If the >> > > reader >> > > > > of this message is not the intended recipient, you are hereby >> > notified >> > > > that >> > > > > any printing, copying, dissemination, distribution, disclosure or >> > > > > forwarding of this communication is strictly prohibited. If you >> have >> > > > > received this communication in error, please contact the sender >> > > > immediately >> > > > > and delete it from your system. Thank You. >> > > > > >> > > > >> > > >> > > -- >> > > CONFIDENTIALITY NOTICE >> > > NOTICE: This message is intended for the use of the individual or >> entity >> > to >> > > which it is addressed and may contain information that is >> confidential, >> > > privileged and exempt from disclosure under applicable law. If the >> reader >> > > of this message is not the intended recipient, you are hereby notified >> > that >> > > any printing, copying, dissemination, distribution, disclosure or >> > > forwarding of this communication is strictly prohibited. If you have >> > > received this communication in error, please contact the sender >> > immediately >> > > and delete it from your system. Thank You. >> > > >> > >> >> -- >> CONFIDENTIALITY NOTICE >> NOTICE: This message is intended for the use of the individual or entity >> to >> which it is addressed and may contain information that is confidential, >> privileged and exempt from disclosure under applicable law. If the reader >> of this message is not the intended recipient, you are hereby notified >> that >> any printing, copying, dissemination, distribution, disclosure or >> forwarding of this communication is strictly prohibited. If you have >> received this communication in error, please contact the sender >> immediately >> and delete it from your system. Thank You. >> > >
