[jira] [Resolved] (SLIDER-534) Create a standalone HA page in apache slider doc
[ https://issues.apache.org/jira/browse/SLIDER-534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha resolved SLIDER-534. -- Resolution: Fixed Fix Version/s: (was: Slider 0.70) Slider 0.60 > Create a standalone HA page in apache slider doc > > > Key: SLIDER-534 > URL: https://issues.apache.org/jira/browse/SLIDER-534 > Project: Slider > Issue Type: Documentation >Affects Versions: Slider 0.50 >Reporter: Gour Saha >Assignee: Gour Saha > Fix For: Slider 0.60 > > > Provide details on the properties that needs to be set for RM HA and NN HA. > Also provide details on work preserving RM and work preserving NM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Q: How to define component configuration?
components": { "COMPONENT1": { *"mykey": "myvalue"* }, This is not wired up in the AgentProviderService to send to the agents. So as a work-around you may have to use something like "global": { "COMPONENT1.mykey": "myvaluep", Can you file a JIRA to add support for reading component specific configs from appConfig.json and make them available at the container? This seems to be a good feature to support. -Sumit On Tue, Nov 11, 2014 at 2:42 PM, hsy...@gmail.com wrote: > Thanks Steve, but I logged all the properties in params.py, I couldn't > find any key named *mykey* > > > *config = Script.get_config()* > for key in config.keys(): > print "key: " + key > for key in config['global'].keys(): > print "key: " + key > > Best > > On Tue, Nov 11, 2014 at 5:04 AM, Steve Loughran > wrote: > > > that should be it. What happens each component gets the properties of > > > > component-level union global-level > > > > that is, everything that is global, extended with anything that is at the > > component level. If a component overrides the global value, that override > > is picked up > > > > It's essentially a form of prototype-based programming, except only of > > properties, not methods: > > http://en.wikipedia.org/wiki/Prototype-based_programming > > > > On 11 November 2014 01:30, hsy...@gmail.com wrote: > > > > > Thanks Ted, but back to my first question, how can you define component > > > level property? in appConfig.json? > > > > > > I tried to define like this : > > > > > > > > > { > > > "schema": "http://example.org/specification/v2.0.0";, > > > "metadata": { > > > }, > > > "global": { > > > "application.def": "app-package-0.1.zip", > > > "java_home": "/usr/lib/jvm/java-7-oracle/", > > > "package_list": "files/app.tgz", > > > "agent.conf": "/user/siyuan/agent/conf/agent.ini", > > > > > > "site.global.app_user": "siyuan", > > > "site.global.app_root": > > > "${AGENT_WORK_ROOT}/app/install/kafka_2.10-0.8.1.1", > > > "site.global.app_install_dir": "${AGENT_WORK_ROOT}/app/install", > > > "site.global.pid_file": "${AGENT_WORK_ROOT}/app/run/app.pid", > > > > > > }, > > > "components": { > > > "COMPONENT1": { > > > *"mykey": "myvalue"* > > > }, > > > "slider-appmaster": { > > > "jvm.heapsize": "256M" > > > } > > > } > > > } > > > > > > Is it able to make the component1 read the value for *mykey* ? > > > > > > > > > Best, > > > Siyuan > > > > > > On Mon, Nov 10, 2014 at 4:15 PM, Ted Yu wrote: > > > > > > > To my knowledge, there is no direct support for this. > > > > > > > > You can create different components, each with corresponding > > properties. > > > > > > > > Cheers > > > > > > > > On Mon, Nov 10, 2014 at 4:13 PM, hsy...@gmail.com > > > > wrote: > > > > > > > > > If I want to have several instances of some component. But I want > to > > > set > > > > > some of the properties to different value for different instances. > > How > > > > can > > > > > I do it? > > > > > > > > > > Thanks! > > > > > > > > > > Best, > > > > > Siyuan > > > > > > > > > > On Mon, Nov 10, 2014 at 1:26 PM, hsy...@gmail.com < > hsy...@gmail.com> > > > > > wrote: > > > > > > > > > > > Hi guys, > > > > > > > > > > > > Is there an example of component configuration? Is there a way to > > > give > > > > > > different value to same property for different instances? > > > > > > > > > > > > Siyuan > > > > > > > > > > > > > > > > > > > > > > -- > > CONFIDENTIALITY NOTICE > > NOTICE: This message is intended for the use of the individual or entity > to > > which it is addressed and may contain information that is confidential, > > privileged and exempt from disclosure under applicable law. If the reader > > of this message is not the intended recipient, you are hereby notified > that > > any printing, copying, dissemination, distribution, disclosure or > > forwarding of this communication is strictly prohibited. If you have > > received this communication in error, please contact the sender > immediately > > and delete it from your system. Thank You. > > > -- thanks Sumit
[jira] [Updated] (SLIDER-617) review conf/ directories in slider-assembly
[ https://issues.apache.org/jira/browse/SLIDER-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Mohanty updated SLIDER-617: - Sprint: (was: Slider November #1) > review conf/ directories in slider-assembly > --- > > Key: SLIDER-617 > URL: https://issues.apache.org/jira/browse/SLIDER-617 > Project: Slider > Issue Type: Test >Reporter: Steve Loughran > Fix For: Slider 0.70 > > > have a look at the assembly/src/conf dirs and make sure we are happy with them -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (SLIDER-631) Slider should provide auto replacement of ganglia properties
[ https://issues.apache.org/jira/browse/SLIDER-631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Mohanty resolved SLIDER-631. -- Resolution: Won't Fix > Slider should provide auto replacement of ganglia properties > > > Key: SLIDER-631 > URL: https://issues.apache.org/jira/browse/SLIDER-631 > Project: Slider > Issue Type: Bug > Components: agent-provider, client >Affects Versions: Slider 0.50 >Reporter: Sumit Mohanty >Assignee: Jonathan Maron > Fix For: Slider 0.70 > > > Noticed an issue where if ganglia is not enabled then the ganglia patterns > are left as is. For example: > "site.storm-site.worker.childopts": "-Xmx768m > -javaagent:${AGENT_WORK_ROOT}/app/install/apache-storm-0.9.3.2.2.0.0-1876/external/storm-jmxetric/lib/jmxetric-1.0.4.jar\u003dhost\u003d${@//site/global/ganglia_server_host},port\u003d${@//site/global/ganglia_server_port},wireformat31x\u003dtrue,mode\u003dmulticast,config\u003d${AGENT_WORK_ROOT}/app/install/apache-storm-0.9.3.2.2.0.0-1876/external/storm-jmxetric/conf/jmxetric-conf.xml,process\u003dWorker_%ID%_JVM" > * ${@//site/global/ganglia_server_host} > * ${@//site/global/ganglia_server_port} > There is probably more elegant way of handling it but setting them to > "localhost" and "0" might be an option. > Any recommendations? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-631) Slider should provide auto replacement of ganglia properties
[ https://issues.apache.org/jira/browse/SLIDER-631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207467#comment-14207467 ] Sumit Mohanty commented on SLIDER-631: -- setting them to "localhost" and "0" is not an option. These should be changes by the application package itself to read a flag and not populate the ganglia properties so that overall generated config is clean. This is fairly easy as through resource_management scripts. Slider should not provide any support for custom configs such as for ganglia. > Slider should provide auto replacement of ganglia properties > > > Key: SLIDER-631 > URL: https://issues.apache.org/jira/browse/SLIDER-631 > Project: Slider > Issue Type: Bug > Components: agent-provider, client >Affects Versions: Slider 0.50 >Reporter: Sumit Mohanty >Assignee: Jonathan Maron > Fix For: Slider 0.70 > > > Noticed an issue where if ganglia is not enabled then the ganglia patterns > are left as is. For example: > "site.storm-site.worker.childopts": "-Xmx768m > -javaagent:${AGENT_WORK_ROOT}/app/install/apache-storm-0.9.3.2.2.0.0-1876/external/storm-jmxetric/lib/jmxetric-1.0.4.jar\u003dhost\u003d${@//site/global/ganglia_server_host},port\u003d${@//site/global/ganglia_server_port},wireformat31x\u003dtrue,mode\u003dmulticast,config\u003d${AGENT_WORK_ROOT}/app/install/apache-storm-0.9.3.2.2.0.0-1876/external/storm-jmxetric/conf/jmxetric-conf.xml,process\u003dWorker_%ID%_JVM" > * ${@//site/global/ganglia_server_host} > * ${@//site/global/ganglia_server_port} > There is probably more elegant way of handling it but setting them to > "localhost" and "0" might be an option. > Any recommendations? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (SLIDER-575) Slider fun-test stabilization
[ https://issues.apache.org/jira/browse/SLIDER-575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Mohanty resolved SLIDER-575. -- Resolution: Fixed Fix Version/s: (was: Slider 0.70) Slider 0.60 They are stable on CentOS6 and Windows. Tested manually. > Slider fun-test stabilization > - > > Key: SLIDER-575 > URL: https://issues.apache.org/jira/browse/SLIDER-575 > Project: Slider > Issue Type: Bug > Components: test >Affects Versions: Slider 0.50 >Reporter: Sumit Mohanty >Assignee: Sumit Mohanty > Fix For: Slider 0.60 > > Attachments: SLIDER-575.HBasePackage.patch > > > Run and stabilize the fun-tests prior to the next release. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-629) Slider's count of failure threshold may not be accurate or it could be a logging issue
[ https://issues.apache.org/jira/browse/SLIDER-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Mohanty updated SLIDER-629: - Sprint: (was: Slider November #1) > Slider's count of failure threshold may not be accurate or it could be a > logging issue > -- > > Key: SLIDER-629 > URL: https://issues.apache.org/jira/browse/SLIDER-629 > Project: Slider > Issue Type: Bug > Components: appmaster >Affects Versions: Slider 0.50 >Reporter: Sumit Mohanty >Assignee: Jonathan Maron > Fix For: Slider 0.70 > > > One of the long running HBase tests failed with the following error: > {noformat} > 2014-11-08 01:07:26,407 [AmExecutor-008] ERROR appmaster.SliderAppMaster - > Cluster teardown triggered > org.apache.slider.core.exceptions.TriggerClusterTeardownException: Unstable > Application Instance : - failed with component H BASE_REGIONSERVER > failing 8 times (0 in startup); threshold is 5 - last failure: Failure > container_1415341585168_0005_01_08 on host onprem-slider23: > http://onprem-slider21:19888/jobhistory/logs/onprem-slider23:45454/contai > ner_1415341585168_0005_01_08/ctx/hadoop^M > {noformat} > However, there were total of "9" REGION_SERVERs created. > {noformat} > 2014-11-07 16:00:35,346 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_02, on onprem-slider25:45454, > 2014-11-07 16:00:35,347 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_05, on onprem-slider24:45454, > 2014-11-07 16:00:35,347 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_07, on onprem-slider22:45454, > 2014-11-07 16:00:35,347 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_08, on onprem-slider23:45454, > 2014-11-07 23:51:20,040 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_09, on onprem-slider22:45454, > 2014-11-07 23:58:44,810 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_13, on onprem-slider24:45454, > 2014-11-08 00:12:17,804 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_15, on onprem-slider22:45454, > 2014-11-08 00:15:57,373 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_18, on onprem-slider25:45454, > 2014-11-08 01:06:36,771 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_20, on onprem-slider25:45454, > {noformat} > As the ask was for 4 but 9 were created, obviously there are 5 failures. > Perhaps its a logging issue. Can we also print the Window - e.g. 5 failures > in X minutes or hours. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (SLIDER-630) slider-agent unit tests fail on debian and suse and windows
[ https://issues.apache.org/jira/browse/SLIDER-630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Mohanty resolved SLIDER-630. -- Resolution: Fixed Fix Version/s: (was: Slider 0.70) Slider 0.60 > slider-agent unit tests fail on debian and suse and windows > --- > > Key: SLIDER-630 > URL: https://issues.apache.org/jira/browse/SLIDER-630 > Project: Slider > Issue Type: Bug > Components: agent, test >Affects Versions: Slider 0.50 >Reporter: Sumit Mohanty >Assignee: Sumit Mohanty >Priority: Critical > Fix For: Slider 0.60 > > > The tests fail because they do not find correct python on certain OSes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Q: How to define component configuration?
Thanks Steve, but I logged all the properties in params.py, I couldn't find any key named *mykey* *config = Script.get_config()* for key in config.keys(): print "key: " + key for key in config['global'].keys(): print "key: " + key Best On Tue, Nov 11, 2014 at 5:04 AM, Steve Loughran wrote: > that should be it. What happens each component gets the properties of > > component-level union global-level > > that is, everything that is global, extended with anything that is at the > component level. If a component overrides the global value, that override > is picked up > > It's essentially a form of prototype-based programming, except only of > properties, not methods: > http://en.wikipedia.org/wiki/Prototype-based_programming > > On 11 November 2014 01:30, hsy...@gmail.com wrote: > > > Thanks Ted, but back to my first question, how can you define component > > level property? in appConfig.json? > > > > I tried to define like this : > > > > > > { > > "schema": "http://example.org/specification/v2.0.0";, > > "metadata": { > > }, > > "global": { > > "application.def": "app-package-0.1.zip", > > "java_home": "/usr/lib/jvm/java-7-oracle/", > > "package_list": "files/app.tgz", > > "agent.conf": "/user/siyuan/agent/conf/agent.ini", > > > > "site.global.app_user": "siyuan", > > "site.global.app_root": > > "${AGENT_WORK_ROOT}/app/install/kafka_2.10-0.8.1.1", > > "site.global.app_install_dir": "${AGENT_WORK_ROOT}/app/install", > > "site.global.pid_file": "${AGENT_WORK_ROOT}/app/run/app.pid", > > > > }, > > "components": { > > "COMPONENT1": { > > *"mykey": "myvalue"* > > }, > > "slider-appmaster": { > > "jvm.heapsize": "256M" > > } > > } > > } > > > > Is it able to make the component1 read the value for *mykey* ? > > > > > > Best, > > Siyuan > > > > On Mon, Nov 10, 2014 at 4:15 PM, Ted Yu wrote: > > > > > To my knowledge, there is no direct support for this. > > > > > > You can create different components, each with corresponding > properties. > > > > > > Cheers > > > > > > On Mon, Nov 10, 2014 at 4:13 PM, hsy...@gmail.com > > > wrote: > > > > > > > If I want to have several instances of some component. But I want to > > set > > > > some of the properties to different value for different instances. > How > > > can > > > > I do it? > > > > > > > > Thanks! > > > > > > > > Best, > > > > Siyuan > > > > > > > > On Mon, Nov 10, 2014 at 1:26 PM, hsy...@gmail.com > > > > wrote: > > > > > > > > > Hi guys, > > > > > > > > > > Is there an example of component configuration? Is there a way to > > give > > > > > different value to same property for different instances? > > > > > > > > > > Siyuan > > > > > > > > > > > > > > > > -- > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity to > which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You. >
VOTE: release Apache Slider 0.60.0
Hi This is a call for a vote on Apache Slider 0.60.0-incubating release. This is the big one: it is fully in sync with hadoop 2.6.0 which is being voted on on the hadoop lists; now that there are up to date hadoop artifacts we can build and release against it. This release is intended to be the first one people can use without the IDE to hand; a lot of work has been done (by others, I must add) to make it a lot easier to work with, along with support for new Hadoop 2.6 features: labelled nodes, log aggregation, yarn registry, ... In fact, if you look at a lot of the changes in Hadoop 2.6, you can say "done for slider and other YARN services" Git source tag: https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;a=shortlog;h=refs/tags/release-0.60.0-incubating-rc0 Staging site: http://people.apache.org/~stevel/slider/slider-release-0.60.0-incubating-rc0 PGP release keys http://pgp.mit.edu:11371/pks/lookup?op=vindex&search=ste...@apache.org The issues fixed in this release are listed at at: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315422&version=12327198 Note that this is a source only release and we are voting on the source. Build instructions at: http://slider.incubator.apache.org/developing/building.html Voting will be open for 72 hours [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove (and reason why) -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] [Updated] (SLIDER-208) Ongoing: keep Jenkins builds working
[ https://issues.apache.org/jira/browse/SLIDER-208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-208: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > Ongoing: keep Jenkins builds working > > > Key: SLIDER-208 > URL: https://issues.apache.org/jira/browse/SLIDER-208 > Project: Slider > Issue Type: Task > Components: build >Affects Versions: Slider 0.40 >Reporter: Steve Loughran > Fix For: Slider 0.70 > > > Uber-JIRA that never gets finished: keep Jenkins working. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-193) Improve site documentation
[ https://issues.apache.org/jira/browse/SLIDER-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-193: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > Improve site documentation > -- > > Key: SLIDER-193 > URL: https://issues.apache.org/jira/browse/SLIDER-193 > Project: Slider > Issue Type: Improvement > Components: site >Affects Versions: Slider 0.30 >Reporter: Steve Loughran > Labels: feedback > Fix For: Slider 0.70 > > > Based on feedback, improve site docs where appropriate. Note that this is > reported against the 0.30 bundled docs, not the forthcoming CMS site -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-617) review conf/ directories in slider-assembly
[ https://issues.apache.org/jira/browse/SLIDER-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-617: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > review conf/ directories in slider-assembly > --- > > Key: SLIDER-617 > URL: https://issues.apache.org/jira/browse/SLIDER-617 > Project: Slider > Issue Type: Test >Reporter: Steve Loughran > Fix For: Slider 0.70 > > > have a look at the assembly/src/conf dirs and make sure we are happy with them -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-534) Create a standalone HA page in apache slider doc
[ https://issues.apache.org/jira/browse/SLIDER-534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-534: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > Create a standalone HA page in apache slider doc > > > Key: SLIDER-534 > URL: https://issues.apache.org/jira/browse/SLIDER-534 > Project: Slider > Issue Type: Documentation >Affects Versions: Slider 0.50 >Reporter: Gour Saha >Assignee: Gour Saha > Fix For: Slider 0.70 > > > Provide details on the properties that needs to be set for RM HA and NN HA. > Also provide details on work preserving RM and work preserving NM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-552) remove root registry path setup in AM
[ https://issues.apache.org/jira/browse/SLIDER-552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-552: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > remove root registry path setup in AM > - > > Key: SLIDER-552 > URL: https://issues.apache.org/jira/browse/SLIDER-552 > Project: Slider > Issue Type: Sub-task > Components: registry >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Critical > Fix For: Slider 0.70 > > > once YARN-2571 is in, downgrade the {{RegistryOperations}} instance > instantied in the slider AM from a {{RegistryRMOperationsService}} —which > creates the root paths on startup— to a normal client. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-575) Slider fun-test stabilization
[ https://issues.apache.org/jira/browse/SLIDER-575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-575: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > Slider fun-test stabilization > - > > Key: SLIDER-575 > URL: https://issues.apache.org/jira/browse/SLIDER-575 > Project: Slider > Issue Type: Bug > Components: test >Affects Versions: Slider 0.50 >Reporter: Sumit Mohanty >Assignee: Sumit Mohanty > Fix For: Slider 0.70 > > Attachments: SLIDER-575.HBasePackage.patch > > > Run and stabilize the fun-tests prior to the next release. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-623) jenkins failing on cento5; python exec failing
[ https://issues.apache.org/jira/browse/SLIDER-623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-623: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > jenkins failing on cento5; python exec failing > -- > > Key: SLIDER-623 > URL: https://issues.apache.org/jira/browse/SLIDER-623 > Project: Slider > Issue Type: Sub-task > Components: test >Affects Versions: Slider 0.60 > Environment: centos5 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.70 > > > unit tests failing with exit code 2 when execing python -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-629) Slider's count of failure threshold may not be accurate or it could be a logging issue
[ https://issues.apache.org/jira/browse/SLIDER-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-629: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > Slider's count of failure threshold may not be accurate or it could be a > logging issue > -- > > Key: SLIDER-629 > URL: https://issues.apache.org/jira/browse/SLIDER-629 > Project: Slider > Issue Type: Bug > Components: appmaster >Affects Versions: Slider 0.50 >Reporter: Sumit Mohanty >Assignee: Jonathan Maron > Fix For: Slider 0.70 > > > One of the long running HBase tests failed with the following error: > {noformat} > 2014-11-08 01:07:26,407 [AmExecutor-008] ERROR appmaster.SliderAppMaster - > Cluster teardown triggered > org.apache.slider.core.exceptions.TriggerClusterTeardownException: Unstable > Application Instance : - failed with component H BASE_REGIONSERVER > failing 8 times (0 in startup); threshold is 5 - last failure: Failure > container_1415341585168_0005_01_08 on host onprem-slider23: > http://onprem-slider21:19888/jobhistory/logs/onprem-slider23:45454/contai > ner_1415341585168_0005_01_08/ctx/hadoop^M > {noformat} > However, there were total of "9" REGION_SERVERs created. > {noformat} > 2014-11-07 16:00:35,346 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_02, on onprem-slider25:45454, > 2014-11-07 16:00:35,347 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_05, on onprem-slider24:45454, > 2014-11-07 16:00:35,347 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_07, on onprem-slider22:45454, > 2014-11-07 16:00:35,347 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_08, on onprem-slider23:45454, > 2014-11-07 23:51:20,040 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_09, on onprem-slider22:45454, > 2014-11-07 23:58:44,810 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_13, on onprem-slider24:45454, > 2014-11-08 00:12:17,804 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_15, on onprem-slider22:45454, > 2014-11-08 00:15:57,373 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_18, on onprem-slider25:45454, > 2014-11-08 01:06:36,771 [AMRM Callback Handler Thread] INFO state.AppState - > Assigning role HBASE_REGIONSERVER to container > container_1415341585168_0005_01_20, on onprem-slider25:45454, > {noformat} > As the ask was for 4 but 9 were created, obviously there are 5 failures. > Perhaps its a logging issue. Can we also print the Window - e.g. 5 failures > in X minutes or hours. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-631) Slider should provide auto replacement of ganglia properties
[ https://issues.apache.org/jira/browse/SLIDER-631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-631: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > Slider should provide auto replacement of ganglia properties > > > Key: SLIDER-631 > URL: https://issues.apache.org/jira/browse/SLIDER-631 > Project: Slider > Issue Type: Bug > Components: agent-provider, client >Affects Versions: Slider 0.50 >Reporter: Sumit Mohanty >Assignee: Jonathan Maron > Fix For: Slider 0.70 > > > Noticed an issue where if ganglia is not enabled then the ganglia patterns > are left as is. For example: > "site.storm-site.worker.childopts": "-Xmx768m > -javaagent:${AGENT_WORK_ROOT}/app/install/apache-storm-0.9.3.2.2.0.0-1876/external/storm-jmxetric/lib/jmxetric-1.0.4.jar\u003dhost\u003d${@//site/global/ganglia_server_host},port\u003d${@//site/global/ganglia_server_port},wireformat31x\u003dtrue,mode\u003dmulticast,config\u003d${AGENT_WORK_ROOT}/app/install/apache-storm-0.9.3.2.2.0.0-1876/external/storm-jmxetric/conf/jmxetric-conf.xml,process\u003dWorker_%ID%_JVM" > * ${@//site/global/ganglia_server_host} > * ${@//site/global/ganglia_server_port} > There is probably more elegant way of handling it but setting them to > "localhost" and "0" might be an option. > Any recommendations? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-149) Support a YARN service registry
[ https://issues.apache.org/jira/browse/SLIDER-149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-149: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > Support a YARN service registry > --- > > Key: SLIDER-149 > URL: https://issues.apache.org/jira/browse/SLIDER-149 > Project: Slider > Issue Type: New Feature >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.70 > > Time Spent: 96h > Remaining Estimate: 0h > > YARN-913 proposes a YARN-wide service registry; we must integrate with this > as it is implemented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-630) slider-agent unit tests fail on debian and suse and windows
[ https://issues.apache.org/jira/browse/SLIDER-630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-630: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > slider-agent unit tests fail on debian and suse and windows > --- > > Key: SLIDER-630 > URL: https://issues.apache.org/jira/browse/SLIDER-630 > Project: Slider > Issue Type: Bug > Components: agent, test >Affects Versions: Slider 0.50 >Reporter: Sumit Mohanty >Assignee: Sumit Mohanty >Priority: Critical > Fix For: Slider 0.70 > > > The tests fail because they do not find correct python on certain OSes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-632) intermittent assertion failure of TestHeartbeatMonitor.testRegularHeartbeat
[ https://issues.apache.org/jira/browse/SLIDER-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-632: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > intermittent assertion failure of TestHeartbeatMonitor.testRegularHeartbeat > --- > > Key: SLIDER-632 > URL: https://issues.apache.org/jira/browse/SLIDER-632 > Project: Slider > Issue Type: Sub-task > Components: build > Environment: mac with a VM doing lots of work in the background >Reporter: Steve Loughran >Assignee: Gour Saha >Priority: Minor > Fix For: Slider 0.70 > > > I got a failure of {{TestHeartbeatMonitortestRegularHeartbeat}} while doing a > full core test. I did not see it when I ran the single test. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-544) Release Slider 0.6.0
[ https://issues.apache.org/jira/browse/SLIDER-544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-544: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > Release Slider 0.6.0 > > > Key: SLIDER-544 > URL: https://issues.apache.org/jira/browse/SLIDER-544 > Project: Slider > Issue Type: Task > Components: build >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.70 > > Original Estimate: 4h > Remaining Estimate: 4h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-622: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.70 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-527) add slider demo script/tuning
[ https://issues.apache.org/jira/browse/SLIDER-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-527: -- Fix Version/s: (was: Slider 0.60) Slider 0.70 > add slider demo script/tuning > - > > Key: SLIDER-527 > URL: https://issues.apache.org/jira/browse/SLIDER-527 > Project: Slider > Issue Type: Improvement >Affects Versions: Slider 0.70 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.70 > > > prepare slider demo for presentation; tune any usability issues that crop up, > including logging. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Documenting key configuration properties (appConfig, mostly)
Hi, I’ve started adding some documentation about key configuration properties to the incubator site’s core.md file (the core configuration spec). Perhaps these need to be pulled out as a separate document, but for the time being I thought I’d let it be known in case you are looking for a mechanism to document new configuration options. — Jon -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] [Created] (SLIDER-642) apache rat not found in mvn repos
Steve Loughran created SLIDER-642: - Summary: apache rat not found in mvn repos Key: SLIDER-642 URL: https://issues.apache.org/jira/browse/SLIDER-642 Project: Slider Issue Type: Bug Components: build Affects Versions: Slider 0.60 Reporter: Steve Loughran Priority: Minor {code} $ mvn apache-rat:check {code} leads to {code} [ERROR] No plugin found for prefix 'apache-rat' in the current project and in the plugin groups [org.apache.maven.plugins, org.codehaus.mojo] available from the repositories [local (/Users/stevel/.m2/repository), ASF Staging (https://repository.apache.org/content/groups/staging/), central (http://repo.maven.apache.org/maven2)] -> [Help 1] {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-544) Release Slider 0.6.0
[ https://issues.apache.org/jira/browse/SLIDER-544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207010#comment-14207010 ] ASF subversion and git services commented on SLIDER-544: Commit 50158dc91e6d6ddc70a898631f0530425fcce125 in incubator-slider's branch refs/heads/releases/slider-0.60 from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=50158dc ] SLIDER-544 updating release POMs for 0.60.0-incubating > Release Slider 0.6.0 > > > Key: SLIDER-544 > URL: https://issues.apache.org/jira/browse/SLIDER-544 > Project: Slider > Issue Type: Task > Components: build >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > Original Estimate: 4h > Remaining Estimate: 4h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (SLIDER-634) slider wrapper should look for and use python version >= 2.6
[ https://issues.apache.org/jira/browse/SLIDER-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Mohanty resolved SLIDER-634. -- Resolution: Fixed Fix Version/s: Slider 0.60 > slider wrapper should look for and use python version >= 2.6 > > > Key: SLIDER-634 > URL: https://issues.apache.org/jira/browse/SLIDER-634 > Project: Slider > Issue Type: Bug >Reporter: thomas liu >Assignee: thomas liu > Fix For: Slider 0.60 > > Attachments: slider634.patch > > > Need to have slider script pick up appropriate version of python to run -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-641) two slider-agent tarballs in lib dir
[ https://issues.apache.org/jira/browse/SLIDER-641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207002#comment-14207002 ] Steve Loughran commented on SLIDER-641: --- {code} -rw-r--r-- 1 stevel staff 698976 11 Nov 20:10 slider-agent-0.60-incubating.tar.gz -rw-r--r-- 1 stevel staff 698976 11 Nov 20:10 slider-agent.tar.gz {code} > two slider-agent tarballs in lib dir > > > Key: SLIDER-641 > URL: https://issues.apache.org/jira/browse/SLIDER-641 > Project: Slider > Issue Type: Bug > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran > > full builds create two versions of the agent tarball, one with a version > number, one without -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (SLIDER-641) two slider-agent tarballs in lib dir
Steve Loughran created SLIDER-641: - Summary: two slider-agent tarballs in lib dir Key: SLIDER-641 URL: https://issues.apache.org/jira/browse/SLIDER-641 Project: Slider Issue Type: Bug Components: build Affects Versions: Slider 0.60 Reporter: Steve Loughran full builds create two versions of the agent tarball, one with a version number, one without -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-544) Release Slider 0.6.0
[ https://issues.apache.org/jira/browse/SLIDER-544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206998#comment-14206998 ] ASF subversion and git services commented on SLIDER-544: Commit 4bb804a2e4bcdad73015fd5c9e1d9f4dc2499d7c in incubator-slider's branch refs/heads/releases/slider-0.60 from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=4bb804a ] SLIDER-544 Release Slider 0.6.0 - fix versions so that site command builds > Release Slider 0.6.0 > > > Key: SLIDER-544 > URL: https://issues.apache.org/jira/browse/SLIDER-544 > Project: Slider > Issue Type: Task > Components: build >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > Original Estimate: 4h > Remaining Estimate: 4h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0
[ https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SLIDER-640. --- Resolution: Fixed > Slider to build and test against Hadoop 2.6RC0 > -- > > Key: SLIDER-640 > URL: https://issues.apache.org/jira/browse/SLIDER-640 > Project: Slider > Issue Type: New Feature >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Blocker > Fix For: Slider 0.60 > > > switch the build to Hadoop 2.6 RC0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0
[ https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206909#comment-14206909 ] ASF subversion and git services commented on SLIDER-640: Commit d1441e391360ed59b5e80edd393a3450aa02be68 in incubator-slider's branch refs/heads/releases/slider-0.60 from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=d1441e3 ] SLIDER-640: switch build to hadoop-2.6.0 > Slider to build and test against Hadoop 2.6RC0 > -- > > Key: SLIDER-640 > URL: https://issues.apache.org/jira/browse/SLIDER-640 > Project: Slider > Issue Type: New Feature >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Blocker > Fix For: Slider 0.60 > > > switch the build to Hadoop 2.6 RC0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0
[ https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206905#comment-14206905 ] ASF subversion and git services commented on SLIDER-640: Commit 7c6e0ffc642f77a6f8abfb5f9e574cd2cc1b3462 in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=7c6e0ff ] SLIDER-640: switch build to hadoop-2.6.0 > Slider to build and test against Hadoop 2.6RC0 > -- > > Key: SLIDER-640 > URL: https://issues.apache.org/jira/browse/SLIDER-640 > Project: Slider > Issue Type: New Feature >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Blocker > Fix For: Slider 0.60 > > > switch the build to Hadoop 2.6 RC0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0
[ https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206907#comment-14206907 ] ASF subversion and git services commented on SLIDER-640: Commit 33eb8d656d7ea040328da364d38953f18200bed0 in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=33eb8d6 ] SLIDER-640 add PDB debug images > Slider to build and test against Hadoop 2.6RC0 > -- > > Key: SLIDER-640 > URL: https://issues.apache.org/jira/browse/SLIDER-640 > Project: Slider > Issue Type: New Feature >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Blocker > Fix For: Slider 0.60 > > > switch the build to Hadoop 2.6 RC0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0
[ https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206908#comment-14206908 ] ASF subversion and git services commented on SLIDER-640: Commit a0372d6c4cca5d6da9397fadd85e7e73b55f4aab in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=a0372d6 ] Merge branch 'feature/SLIDER-640-hadoop-2.6' into develop > Slider to build and test against Hadoop 2.6RC0 > -- > > Key: SLIDER-640 > URL: https://issues.apache.org/jira/browse/SLIDER-640 > Project: Slider > Issue Type: New Feature >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Blocker > Fix For: Slider 0.60 > > > switch the build to Hadoop 2.6 RC0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0
[ https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206906#comment-14206906 ] ASF subversion and git services commented on SLIDER-640: Commit d536e33f3ea3fdf183d74239800063779b7f5619 in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=d536e33 ] SLIDER-640 add hadoop locally built hadoop 2.6.0 binaries to the path > Slider to build and test against Hadoop 2.6RC0 > -- > > Key: SLIDER-640 > URL: https://issues.apache.org/jira/browse/SLIDER-640 > Project: Slider > Issue Type: New Feature >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Blocker > Fix For: Slider 0.60 > > > switch the build to Hadoop 2.6 RC0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0
[ https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206897#comment-14206897 ] ASF subversion and git services commented on SLIDER-640: Commit 33eb8d656d7ea040328da364d38953f18200bed0 in incubator-slider's branch refs/heads/feature/SLIDER-640-hadoop-2.6 from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=33eb8d6 ] SLIDER-640 add PDB debug images > Slider to build and test against Hadoop 2.6RC0 > -- > > Key: SLIDER-640 > URL: https://issues.apache.org/jira/browse/SLIDER-640 > Project: Slider > Issue Type: New Feature >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Blocker > Fix For: Slider 0.60 > > > switch the build to Hadoop 2.6 RC0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-534) Create a standalone HA page in apache slider doc
[ https://issues.apache.org/jira/browse/SLIDER-534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206886#comment-14206886 ] Gour Saha commented on SLIDER-534: -- Adding and polishing a new standalone page http://slider.incubator.apache.org/docs/high_availability.html > Create a standalone HA page in apache slider doc > > > Key: SLIDER-534 > URL: https://issues.apache.org/jira/browse/SLIDER-534 > Project: Slider > Issue Type: Documentation >Affects Versions: Slider 0.50 >Reporter: Gour Saha >Assignee: Gour Saha > Fix For: Slider 0.60 > > > Provide details on the properties that needs to be set for RM HA and NN HA. > Also provide details on work preserving RM and work preserving NM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0
[ https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206756#comment-14206756 ] ASF subversion and git services commented on SLIDER-640: Commit d536e33f3ea3fdf183d74239800063779b7f5619 in incubator-slider's branch refs/heads/feature/SLIDER-640-hadoop-2.6 from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=d536e33 ] SLIDER-640 add hadoop locally built hadoop 2.6.0 binaries to the path > Slider to build and test against Hadoop 2.6RC0 > -- > > Key: SLIDER-640 > URL: https://issues.apache.org/jira/browse/SLIDER-640 > Project: Slider > Issue Type: New Feature >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Blocker > Fix For: Slider 0.60 > > > switch the build to Hadoop 2.6 RC0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it
[ https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-637: -- Sprint: (was: Slider November #1) > Review ZKIntegration use and purge it -ideally, all of it > - > > Key: SLIDER-637 > URL: https://issues.apache.org/jira/browse/SLIDER-637 > Project: Slider > Issue Type: Improvement > Components: client >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 2.0.0 > > Original Estimate: 1h > Remaining Estimate: 1h > > The ZK Integration class predates the YARN registry, uses an out of date path > setup logic, and doesn't handle security. There should be no place for it in > the Slider Client. If we can pull it there, we can remove the class and the > tests that are causing trouble in Windows. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-623) jenkins failing on cento5; python exec failing
[ https://issues.apache.org/jira/browse/SLIDER-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206673#comment-14206673 ] ASF subversion and git services commented on SLIDER-623: Commit 4039ec56fafbb1869d7aad6fa1179cb51d7bde56 in incubator-slider's branch refs/heads/releases/slider-0.60 from [~jmaron] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=4039ec5 ] SLIDER-623 wrapping 2.4 incompatible print statment in try except > jenkins failing on cento5; python exec failing > -- > > Key: SLIDER-623 > URL: https://issues.apache.org/jira/browse/SLIDER-623 > Project: Slider > Issue Type: Sub-task > Components: test >Affects Versions: Slider 0.60 > Environment: centos5 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > unit tests failing with exit code 2 when execing python -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-623) jenkins failing on cento5; python exec failing
[ https://issues.apache.org/jira/browse/SLIDER-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206669#comment-14206669 ] ASF subversion and git services commented on SLIDER-623: Commit 65c33e787dae82187be095a618dfbf71a896f4fb in incubator-slider's branch refs/heads/develop from [~jmaron] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=65c33e7 ] SLIDER-623 wrapping 2.4 incompatible print statment in try except > jenkins failing on cento5; python exec failing > -- > > Key: SLIDER-623 > URL: https://issues.apache.org/jira/browse/SLIDER-623 > Project: Slider > Issue Type: Sub-task > Components: test >Affects Versions: Slider 0.60 > Environment: centos5 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > unit tests failing with exit code 2 when execing python -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-634) slider wrapper should look for and use python version >= 2.6
[ https://issues.apache.org/jira/browse/SLIDER-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Mohanty updated SLIDER-634: - Assignee: thomas liu > slider wrapper should look for and use python version >= 2.6 > > > Key: SLIDER-634 > URL: https://issues.apache.org/jira/browse/SLIDER-634 > Project: Slider > Issue Type: Bug >Reporter: thomas liu >Assignee: thomas liu > Attachments: slider634.patch > > > Need to have slider script pick up appropriate version of python to run -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0
[ https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206647#comment-14206647 ] ASF subversion and git services commented on SLIDER-640: Commit 7c6e0ffc642f77a6f8abfb5f9e574cd2cc1b3462 in incubator-slider's branch refs/heads/feature/SLIDER-640 from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=7c6e0ff ] SLIDER-640: switch build to hadoop-2.6.0 > Slider to build and test against Hadoop 2.6RC0 > -- > > Key: SLIDER-640 > URL: https://issues.apache.org/jira/browse/SLIDER-640 > Project: Slider > Issue Type: New Feature >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Blocker > Fix For: Slider 0.60 > > > switch the build to Hadoop 2.6 RC0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206551#comment-14206551 ] ASF subversion and git services commented on SLIDER-622: Commit 44c4bb996e428b5265ad351c2035f05bf2e614d8 in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=44c4bb9 ] Merge branch 'feature/SLIDER-622-windows' into develop > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM
[ https://issues.apache.org/jira/browse/SLIDER-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206550#comment-14206550 ] ASF subversion and git services commented on SLIDER-639: Commit 76f3e72df7210d9fb6f4981ebbb60a08f6a66d5a in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=76f3e72 ] SLIDER-639 workarounds for windows > SliderClient.buildInstanceDefinition() creates a directory that can't be > deleted in the same JVM > > > Key: SLIDER-639 > URL: https://issues.apache.org/jira/browse/SLIDER-639 > Project: Slider > Issue Type: Bug > Components: client, core >Affects Versions: Slider 0.60 > Environment: Windows >Reporter: Steve Loughran >Priority: Minor > Fix For: Slider 0.70 > > > In {{SliderClient.buildInstanceDefinition() }} some file handle or something > is kept open to the extent that if the definition is being saved to NTFS, it > can't be deleted. > This condition holds for the duration of the JVM, hence the conclusion that > this is a file handle. > As production instances have to use HDFS for their instance definitions, this > is only a test problem -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM
[ https://issues.apache.org/jira/browse/SLIDER-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206552#comment-14206552 ] ASF subversion and git services commented on SLIDER-639: Commit 010127abf16c630331e86ae68f4219a92565ad4e in incubator-slider's branch refs/heads/releases/slider-0.60 from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=010127a ] SLIDER-639 workarounds for windows > SliderClient.buildInstanceDefinition() creates a directory that can't be > deleted in the same JVM > > > Key: SLIDER-639 > URL: https://issues.apache.org/jira/browse/SLIDER-639 > Project: Slider > Issue Type: Bug > Components: client, core >Affects Versions: Slider 0.60 > Environment: Windows >Reporter: Steve Loughran >Priority: Minor > Fix For: Slider 0.70 > > > In {{SliderClient.buildInstanceDefinition() }} some file handle or something > is kept open to the extent that if the definition is being saved to NTFS, it > can't be deleted. > This condition holds for the duration of the JVM, hence the conclusion that > this is a file handle. > As production instances have to use HDFS for their instance definitions, this > is only a test problem -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0
Steve Loughran created SLIDER-640: - Summary: Slider to build and test against Hadoop 2.6RC0 Key: SLIDER-640 URL: https://issues.apache.org/jira/browse/SLIDER-640 Project: Slider Issue Type: New Feature Affects Versions: Slider 0.60 Reporter: Steve Loughran Assignee: Steve Loughran Priority: Blocker Fix For: Slider 0.60 switch the build to Hadoop 2.6 RC0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0
[ https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-640: -- Sprint: Slider November #1 > Slider to build and test against Hadoop 2.6RC0 > -- > > Key: SLIDER-640 > URL: https://issues.apache.org/jira/browse/SLIDER-640 > Project: Slider > Issue Type: New Feature >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Blocker > Fix For: Slider 0.60 > > > switch the build to Hadoop 2.6 RC0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM
[ https://issues.apache.org/jira/browse/SLIDER-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206546#comment-14206546 ] ASF subversion and git services commented on SLIDER-639: Commit 76f3e72df7210d9fb6f4981ebbb60a08f6a66d5a in incubator-slider's branch refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=76f3e72 ] SLIDER-639 workarounds for windows > SliderClient.buildInstanceDefinition() creates a directory that can't be > deleted in the same JVM > > > Key: SLIDER-639 > URL: https://issues.apache.org/jira/browse/SLIDER-639 > Project: Slider > Issue Type: Bug > Components: client, core >Affects Versions: Slider 0.60 > Environment: Windows >Reporter: Steve Loughran >Priority: Minor > Fix For: Slider 0.70 > > > In {{SliderClient.buildInstanceDefinition() }} some file handle or something > is kept open to the extent that if the definition is being saved to NTFS, it > can't be deleted. > This condition holds for the duration of the JVM, hence the conclusion that > this is a file handle. > As production instances have to use HDFS for their instance definitions, this > is only a test problem -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206510#comment-14206510 ] ASF subversion and git services commented on SLIDER-622: Commit 89073b13444728eded65d93373058bac227585ec in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=89073b1 ] SLIDER-622 bypass Haddop APIs and go to commons IO directory delete if the path is file:// > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206513#comment-14206513 ] ASF subversion and git services commented on SLIDER-622: Commit 36e5d435196fb6068bf00acb01fd52d1dd7c0fa5 in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=36e5d43 ] Merge branch 'feature/SLIDER-622-windows' into develop > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206515#comment-14206515 ] ASF subversion and git services commented on SLIDER-622: Commit 7596387040446aa8bac157f09fc028fe4b699981 in incubator-slider's branch refs/heads/releases/slider-0.60 from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=7596387 ] SLIDER-622 spin for deletion > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206517#comment-14206517 ] ASF subversion and git services commented on SLIDER-622: Commit f5324897d1649f79db9775b2f917282edfb9c810 in incubator-slider's branch refs/heads/releases/slider-0.60 from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=f532489 ] SLIDER-622 bypass Haddop APIs and go to commons IO directory delete if the path is file:// > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it
[ https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206514#comment-14206514 ] ASF subversion and git services commented on SLIDER-637: Commit 632346e540e1cac1ae6bac6b8ce1ed5bc5ba9772 in incubator-slider's branch refs/heads/releases/slider-0.60 from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=632346e ] SLIDER-637 rm unneeded test in TestZKIntegration > Review ZKIntegration use and purge it -ideally, all of it > - > > Key: SLIDER-637 > URL: https://issues.apache.org/jira/browse/SLIDER-637 > Project: Slider > Issue Type: Improvement > Components: client >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 2.0.0 > > Original Estimate: 1h > Remaining Estimate: 1h > > The ZK Integration class predates the YARN registry, uses an out of date path > setup logic, and doesn't handle security. There should be no place for it in > the Slider Client. If we can pull it there, we can remove the class and the > tests that are causing trouble in Windows. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206516#comment-14206516 ] ASF subversion and git services commented on SLIDER-622: Commit 5afa9b39d21d396052d82b5472b344e7903a13db in incubator-slider's branch refs/heads/releases/slider-0.60 from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=5afa9b3 ] SLIDER-622 add spin-checks for cluster dir deletion...deals with NTFS problems > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206512#comment-14206512 ] ASF subversion and git services commented on SLIDER-622: Commit eba57bb508fc26ee96affcc79a5374af900d05d8 in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=eba57bb ] SLIDER-622 ensuring unique names for instances in a test > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206509#comment-14206509 ] ASF subversion and git services commented on SLIDER-622: Commit 3dd6ac495ea2b87ced7069f19ce04cf8d52559f2 in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=3dd6ac4 ] SLIDER-622 add spin-checks for cluster dir deletion...deals with NTFS problems > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206518#comment-14206518 ] ASF subversion and git services commented on SLIDER-622: Commit 56e16c391524f8799a6f5d56beaafaf968a5c5c8 in incubator-slider's branch refs/heads/releases/slider-0.60 from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=56e16c3 ] SLIDER-622 ensuring unique names for instances in a test > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206508#comment-14206508 ] ASF subversion and git services commented on SLIDER-622: Commit 749484c2df3e170f30bba71afa9c5a242238af3b in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=749484c ] SLIDER-622 spin for deletion > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM
[ https://issues.apache.org/jira/browse/SLIDER-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206503#comment-14206503 ] Steve Loughran commented on SLIDER-639: --- {code}Tests run: 9, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 103.125 sec <<< FAILURE! - in org.apache.slider.provider s.agent.TestBuildBasicAgent testBuildMultipleRoles(org.apache.slider.providers.agent.TestBuildBasicAgent) Time elapsed: 63.985 sec <<< ERROR! java.io.IOException: Unable to delete file: C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2279) at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653) at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535) at org.apache.commons.io.FileUtils$deleteDirectory$0.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116) at org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:615) at org.apache.slider.test.YarnMiniClusterTestBase$rigorousDelete$2.callCurrent(Unknown Source) at org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:579) at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrap.invoke(PogoMetaMethodSit e.java:187) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:56) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:149) at org.apache.slider.test.YarnMiniClusterTestBase.createOrBuildCluster(YarnMiniClusterTestBase.groovy:520) at org.apache.slider.providers.agent.AgentTestBase.buildAgentCluster(AgentTestBase.groovy:151) at org.apache.slider.providers.agent.TestBuildBasicAgent.testBuildMultipleRoles(TestBuildBasicAgent.groovy:178) {code} > SliderClient.buildInstanceDefinition() creates a directory that can't be > deleted in the same JVM > > > Key: SLIDER-639 > URL: https://issues.apache.org/jira/browse/SLIDER-639 > Project: Slider > Issue Type: Bug > Components: client, core >Affects Versions: Slider 0.60 > Environment: Windows >Reporter: Steve Loughran >Priority: Minor > Fix For: Slider 0.70 > > > In {{SliderClient.buildInstanceDefinition() }} some file handle or something > is kept open to the extent that if the definition is being saved to NTFS, it > can't be deleted. > This condition holds for the duration of the JVM, hence the conclusion that > this is a file handle. > As production instances have to use HDFS for their instance definitions, this > is only a test problem -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Issue Comment Deleted] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM
[ https://issues.apache.org/jira/browse/SLIDER-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-639: -- Comment: was deleted (was: {code} C:\Work\slider\slider-core\target\zookeeper-testBuildMultipleRoles\data\version-2\log.7]: it still exists.Tests run: 9, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 103.125 sec <<< FAILURE! - in org.apache.slider.providers.agent.TestBuildBasicAgenttestBuildMultipleRoles(org.apache.slider.providers.agent.TestBuildBasicAgent) Time elapsed: 63.985 sec <<< ERROR!java.io.IOException: Unable to delete file: C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2279) at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653) at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535) at org.apache.commons.io.FileUtils$deleteDirectory$0.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116) at org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:615) at org.apache.slider.test.YarnMiniClusterTestBase$rigorousDelete$2.callCurrent(Unknown Source) at org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:579) at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrap.invoke(PogoMetaMethodSite.java:187) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:56) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:149) at org.apache.slider.test.YarnMiniClusterTestBase.createOrBuildCluster(YarnMiniClusterTestBase.groovy:520) at org.apache.slider.providers.agent.AgentTestBase.buildAgentCluster(AgentTestBase.groovy:151) at org.apache.slider.providers.agent.TestBuildBasicAgent.testBuildMultipleRoles(TestBuildBasicAgent.groovy:178)Results :Tests in error: TestBuildBasicAgent.testBuildMultipleRoles:178->AgentTestBase.buildAgentCluster:151->YarnMiniClusterTestBase.createOrBuildCluster:520->YarnMiniClusterTestBase.rigorousDelete:579->YarnMiniClusterTestBase.rigorousDelete:615 ╗ IOTests run: 9, Failures: 0, Errors: 1, Skipped: 0 {code}) > SliderClient.buildInstanceDefinition() creates a directory that can't be > deleted in the same JVM > > > Key: SLIDER-639 > URL: https://issues.apache.org/jira/browse/SLIDER-639 > Project: Slider > Issue Type: Bug > Components: client, core >Affects Versions: Slider 0.60 > Environment: Windows >Reporter: Steve Loughran >Priority: Minor > Fix For: Slider 0.70 > > > In {{SliderClient.buildInstanceDefinition() }} some file handle or something > is kept open to the extent that if the definition is being saved to NTFS, it > can't be deleted. > This condition holds for the duration of the JVM, hence the conclusion that > this is a file handle. > As production instances have to use HDFS for their instance definitions, this > is only a test problem -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM
[ https://issues.apache.org/jira/browse/SLIDER-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206501#comment-14206501 ] Steve Loughran commented on SLIDER-639: --- {code} C:\Work\slider\slider-core\target\zookeeper-testBuildMultipleRoles\data\version-2\log.7]: it still exists.Tests run: 9, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 103.125 sec <<< FAILURE! - in org.apache.slider.providers.agent.TestBuildBasicAgenttestBuildMultipleRoles(org.apache.slider.providers.agent.TestBuildBasicAgent) Time elapsed: 63.985 sec <<< ERROR!java.io.IOException: Unable to delete file: C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2279) at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653) at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535) at org.apache.commons.io.FileUtils$deleteDirectory$0.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116) at org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:615) at org.apache.slider.test.YarnMiniClusterTestBase$rigorousDelete$2.callCurrent(Unknown Source) at org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:579) at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrap.invoke(PogoMetaMethodSite.java:187) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:56) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:149) at org.apache.slider.test.YarnMiniClusterTestBase.createOrBuildCluster(YarnMiniClusterTestBase.groovy:520) at org.apache.slider.providers.agent.AgentTestBase.buildAgentCluster(AgentTestBase.groovy:151) at org.apache.slider.providers.agent.TestBuildBasicAgent.testBuildMultipleRoles(TestBuildBasicAgent.groovy:178)Results :Tests in error: TestBuildBasicAgent.testBuildMultipleRoles:178->AgentTestBase.buildAgentCluster:151->YarnMiniClusterTestBase.createOrBuildCluster:520->YarnMiniClusterTestBase.rigorousDelete:579->YarnMiniClusterTestBase.rigorousDelete:615 ╗ IOTests run: 9, Failures: 0, Errors: 1, Skipped: 0 {code} > SliderClient.buildInstanceDefinition() creates a directory that can't be > deleted in the same JVM > > > Key: SLIDER-639 > URL: https://issues.apache.org/jira/browse/SLIDER-639 > Project: Slider > Issue Type: Bug > Components: client, core >Affects Versions: Slider 0.60 > Environment: Windows >Reporter: Steve Loughran >Priority: Minor > Fix For: Slider 0.70 > > > In {{SliderClient.buildInstanceDefinition() }} some file handle or something > is kept open to the extent that if the definition is being saved to NTFS, it > can't be deleted. > This condition holds for the duration of the JVM, hence the conclusion that > this is a file handle. > As production instances have to use HDFS for their instance definitions, this > is only a test problem -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206498#comment-14206498 ] ASF subversion and git services commented on SLIDER-622: Commit eba57bb508fc26ee96affcc79a5374af900d05d8 in incubator-slider's branch refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=eba57bb ] SLIDER-622 ensuring unique names for instances in a test > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM
Steve Loughran created SLIDER-639: - Summary: SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM Key: SLIDER-639 URL: https://issues.apache.org/jira/browse/SLIDER-639 Project: Slider Issue Type: Bug Components: client, core Affects Versions: Slider 0.60 Environment: Windows Reporter: Steve Loughran Priority: Minor Fix For: Slider 0.70 In {{SliderClient.buildInstanceDefinition() }} some file handle or something is kept open to the extent that if the definition is being saved to NTFS, it can't be deleted. This condition holds for the duration of the JVM, hence the conclusion that this is a file handle. As production instances have to use HDFS for their instance definitions, this is only a test problem -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206491#comment-14206491 ] Steve Loughran commented on SLIDER-622: --- Moving to native IO operations does not fix this problem; the directory cannot be deleted on windows {code} C:\Work\slider\slider-core\target\zookeeper-testBuildMultipleRoles\data\version-2\log.7]: it still exists. Tests run: 9, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 103.125 sec <<< FAILURE! - in org.apache.slider.provider s.agent.TestBuildBasicAgent testBuildMultipleRoles(org.apache.slider.providers.agent.TestBuildBasicAgent) Time elapsed: 63.985 sec <<< ERROR! java.io.IOException: Unable to delete file: C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2279) at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653) at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535) at org.apache.commons.io.FileUtils$deleteDirectory$0.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116) at org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:615) at org.apache.slider.test.YarnMiniClusterTestBase$rigorousDelete$2.callCurrent(Unknown Source) at org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:579) at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrap.invoke(PogoMetaMethodSit e.java:187) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:56) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:149) at org.apache.slider.test.YarnMiniClusterTestBase.createOrBuildCluster(YarnMiniClusterTestBase.groovy:520) at org.apache.slider.providers.agent.AgentTestBase.buildAgentCluster(AgentTestBase.groovy:151) at org.apache.slider.providers.agent.TestBuildBasicAgent.testBuildMultipleRoles(TestBuildBasicAgent.groovy:178) Results : Tests in error: TestBuildBasicAgent.testBuildMultipleRoles:178->AgentTestBase.buildAgentCluster:151->YarnMiniClusterTestBase.createOrB uildCluster:520->YarnMiniClusterTestBase.rigorousDelete:579->YarnMiniClusterTestBase.rigorousDelete:615 ╗ IO Tests run: 9, Failures: 0, Errors: 1, Skipped: 0 {code} > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it
[ https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206481#comment-14206481 ] ASF subversion and git services commented on SLIDER-637: Commit 56bc48dc4fd1c34bc4f5115242081ed8adb57277 in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=56bc48d ] SLIDER-637 purge ZKInstance uses in the accumulo and hbase providers > Review ZKIntegration use and purge it -ideally, all of it > - > > Key: SLIDER-637 > URL: https://issues.apache.org/jira/browse/SLIDER-637 > Project: Slider > Issue Type: Improvement > Components: client >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 2.0.0 > > Original Estimate: 1h > Remaining Estimate: 1h > > The ZK Integration class predates the YARN registry, uses an out of date path > setup logic, and doesn't handle security. There should be no place for it in > the Slider Client. If we can pull it there, we can remove the class and the > tests that are causing trouble in Windows. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206480#comment-14206480 ] ASF subversion and git services commented on SLIDER-622: Commit 89073b13444728eded65d93373058bac227585ec in incubator-slider's branch refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=89073b1 ] SLIDER-622 bypass Haddop APIs and go to commons IO directory delete if the path is file:// > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206454#comment-14206454 ] Steve Loughran commented on SLIDER-622: --- file-in-use/delete problems on NTFS, even if no process other than the test JVM itself is running: {code} C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\app_config.json]: it still exists. 2014-11-11 14:15:36,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\internal.json]: it still exists. 2014-11-11 14:15:36,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json]: it still exists. 2014-11-11 14:15:37,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\.app_config.json.crc]: it still exists. 2014-11-11 14:15:37,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\.internal.json.crc]: it still exists. 2014-11-11 14:15:37,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\.resources.json.crc]: it still exists. 2014-11-11 14:15:37,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\app_config.json]: it still exists. 2014-11-11 14:15:37,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\internal.json]: it still exists. 2014-11-11 14:15:37,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json]: it still exists. 2014-11-11 14:15:38,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\.app_config.json.crc]: it still exists. 2014-11-11 14:15:38,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\.internal.json.crc]: it still exists. 2014-11-11 14:15:38,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\.resources.json.crc]: it still exists. 2014-11-11 14:15:38,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\app_config.json]: it still exists. 2014-11-11 14:15:38,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\internal.json]: it still exists. 2014-11-11 14:15:38,660 [Thread-1905] WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [ C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json]: it still exists. 2014-11-11 14:15:39,660 [Thread-1905] ERROR tools.CoreFileSystem (CoreFileSystem.java:verifyDirectoryNonexistent(291)) - Dir file:/C:/Users/Administrator/.slider/cluster/testbuildmultipleroles exists: file:/C:/Users/Administrator/.slider/cl uster/testbuildmultipleroles/app_config.json1196 file:/C:/Users/Administrator/.slider/cluster/testbuildmultipleroles/internal.json 1439 file:/C:/Users/Administrator/.slider/cluster/testbuildmultipleroles/resources.json 915 {code} > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206450#comment-14206450 ] ASF subversion and git services commented on SLIDER-622: Commit 3dd6ac495ea2b87ced7069f19ce04cf8d52559f2 in incubator-slider's branch refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=3dd6ac4 ] SLIDER-622 add spin-checks for cluster dir deletion...deals with NTFS problems > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it
[ https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206446#comment-14206446 ] ASF subversion and git services commented on SLIDER-637: Commit 56bc48dc4fd1c34bc4f5115242081ed8adb57277 in incubator-slider's branch refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=56bc48d ] SLIDER-637 purge ZKInstance uses in the accumulo and hbase providers > Review ZKIntegration use and purge it -ideally, all of it > - > > Key: SLIDER-637 > URL: https://issues.apache.org/jira/browse/SLIDER-637 > Project: Slider > Issue Type: Improvement > Components: client >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 2.0.0 > > Original Estimate: 1h > Remaining Estimate: 1h > > The ZK Integration class predates the YARN registry, uses an out of date path > setup logic, and doesn't handle security. There should be no place for it in > the Slider Client. If we can pull it there, we can remove the class and the > tests that are causing trouble in Windows. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it
[ https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206448#comment-14206448 ] ASF subversion and git services commented on SLIDER-637: Commit 2bb2323ccd0921da56bfdc502ece5d5b96ee8237 in incubator-slider's branch refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=2bb2323 ] SLIDER-637 rm unneeded test in TestZKIntegration > Review ZKIntegration use and purge it -ideally, all of it > - > > Key: SLIDER-637 > URL: https://issues.apache.org/jira/browse/SLIDER-637 > Project: Slider > Issue Type: Improvement > Components: client >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 2.0.0 > > Original Estimate: 1h > Remaining Estimate: 1h > > The ZK Integration class predates the YARN registry, uses an out of date path > setup logic, and doesn't handle security. There should be no place for it in > the Slider Client. If we can pull it there, we can remove the class and the > tests that are causing trouble in Windows. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206449#comment-14206449 ] ASF subversion and git services commented on SLIDER-622: Commit 749484c2df3e170f30bba71afa9c5a242238af3b in incubator-slider's branch refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=749484c ] SLIDER-622 spin for deletion > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206447#comment-14206447 ] ASF subversion and git services commented on SLIDER-622: Commit f9d7d4503491fbdcbb462d828996157d3b5d462d in incubator-slider's branch refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=f9d7d45 ] Merge branch 'develop' into feature/SLIDER-622-windows > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (SLIDER-638) Allow python executable to be specified per component (role)
Jonathan Maron created SLIDER-638: - Summary: Allow python executable to be specified per component (role) Key: SLIDER-638 URL: https://issues.apache.org/jira/browse/SLIDER-638 Project: Slider Issue Type: Bug Components: agent, appmaster Reporter: Jonathan Maron Fix For: Slider 2.0.0 The "agent.python.exec.path" option is currently specified as a global option and read as such in AgentProviderService. It may be a good idea to allow for a per-role python command, accounting for heterogeneous environments (where labeling can ensure that a component is mapped to a specific set of hosts with a specific OS). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-636) Slider destroy does not delete the keytabs folder
[ https://issues.apache.org/jira/browse/SLIDER-636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206427#comment-14206427 ] Jonathan Maron commented on SLIDER-636: --- I think that would make sense. Another possibility is "purge-slider-resources" to clean up both. > Slider destroy does not delete the keytabs folder > - > > Key: SLIDER-636 > URL: https://issues.apache.org/jira/browse/SLIDER-636 > Project: Slider > Issue Type: Bug > Components: client >Affects Versions: Slider 0.50 >Reporter: Sumit Mohanty >Assignee: Jonathan Maron >Priority: Critical > Fix For: Slider 2.0.0 > > > Slider destroy does not delete keytabs folder for the app. This forces the > users to use force to overwrite the keytabs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it
[ https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-637: -- Priority: Major (was: Critical) Fix Version/s: (was: Slider 0.60) Slider 2.0.0 too complex to remove easily; leaving code as is —for now. Purged use in a lot of tests > Review ZKIntegration use and purge it -ideally, all of it > - > > Key: SLIDER-637 > URL: https://issues.apache.org/jira/browse/SLIDER-637 > Project: Slider > Issue Type: Improvement > Components: client >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 2.0.0 > > Original Estimate: 1h > Remaining Estimate: 1h > > The ZK Integration class predates the YARN registry, uses an out of date path > setup logic, and doesn't handle security. There should be no place for it in > the Slider Client. If we can pull it there, we can remove the class and the > tests that are causing trouble in Windows. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it
[ https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206420#comment-14206420 ] Steve Loughran commented on SLIDER-637: --- SLIDER-634 shows how it is currently used, even though it doesn't work properly in a secure cluster. proposed: # purge from all the tests # build paths up from {{RegistryUtils}} to match yarn registry logic. # include a (configurable) base path. Not the YARN registry, as the app-specific path is for things like Accumulo and HBase. In slider 2 we can/should switch to the {{CuratorService}} to get security > Review ZKIntegration use and purge it -ideally, all of it > - > > Key: SLIDER-637 > URL: https://issues.apache.org/jira/browse/SLIDER-637 > Project: Slider > Issue Type: Improvement > Components: client >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Critical > Fix For: Slider 0.60 > > Original Estimate: 1h > Remaining Estimate: 1h > > The ZK Integration class predates the YARN registry, uses an out of date path > setup logic, and doesn't handle security. There should be no place for it in > the Slider Client. If we can pull it there, we can remove the class and the > tests that are causing trouble in Windows. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Q: How to define component configuration?
that should be it. What happens each component gets the properties of component-level union global-level that is, everything that is global, extended with anything that is at the component level. If a component overrides the global value, that override is picked up It's essentially a form of prototype-based programming, except only of properties, not methods: http://en.wikipedia.org/wiki/Prototype-based_programming On 11 November 2014 01:30, hsy...@gmail.com wrote: > Thanks Ted, but back to my first question, how can you define component > level property? in appConfig.json? > > I tried to define like this : > > > { > "schema": "http://example.org/specification/v2.0.0";, > "metadata": { > }, > "global": { > "application.def": "app-package-0.1.zip", > "java_home": "/usr/lib/jvm/java-7-oracle/", > "package_list": "files/app.tgz", > "agent.conf": "/user/siyuan/agent/conf/agent.ini", > > "site.global.app_user": "siyuan", > "site.global.app_root": > "${AGENT_WORK_ROOT}/app/install/kafka_2.10-0.8.1.1", > "site.global.app_install_dir": "${AGENT_WORK_ROOT}/app/install", > "site.global.pid_file": "${AGENT_WORK_ROOT}/app/run/app.pid", > > }, > "components": { > "COMPONENT1": { > *"mykey": "myvalue"* > }, > "slider-appmaster": { > "jvm.heapsize": "256M" > } > } > } > > Is it able to make the component1 read the value for *mykey* ? > > > Best, > Siyuan > > On Mon, Nov 10, 2014 at 4:15 PM, Ted Yu wrote: > > > To my knowledge, there is no direct support for this. > > > > You can create different components, each with corresponding properties. > > > > Cheers > > > > On Mon, Nov 10, 2014 at 4:13 PM, hsy...@gmail.com > > wrote: > > > > > If I want to have several instances of some component. But I want to > set > > > some of the properties to different value for different instances. How > > can > > > I do it? > > > > > > Thanks! > > > > > > Best, > > > Siyuan > > > > > > On Mon, Nov 10, 2014 at 1:26 PM, hsy...@gmail.com > > > wrote: > > > > > > > Hi guys, > > > > > > > > Is there an example of component configuration? Is there a way to > give > > > > different value to same property for different instances? > > > > > > > > Siyuan > > > > > > > > > > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] [Updated] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it
[ https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-637: -- Sprint: Slider November #1 > Review ZKIntegration use and purge it -ideally, all of it > - > > Key: SLIDER-637 > URL: https://issues.apache.org/jira/browse/SLIDER-637 > Project: Slider > Issue Type: Improvement > Components: client >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Critical > Fix For: Slider 0.60 > > Original Estimate: 1h > Remaining Estimate: 1h > > The ZK Integration class predates the YARN registry, uses an out of date path > setup logic, and doesn't handle security. There should be no place for it in > the Slider Client. If we can pull it there, we can remove the class and the > tests that are causing trouble in Windows. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it
Steve Loughran created SLIDER-637: - Summary: Review ZKIntegration use and purge it -ideally, all of it Key: SLIDER-637 URL: https://issues.apache.org/jira/browse/SLIDER-637 Project: Slider Issue Type: Improvement Components: client Affects Versions: Slider 0.60 Reporter: Steve Loughran Assignee: Steve Loughran Priority: Critical Fix For: Slider 0.60 The ZK Integration class predates the YARN registry, uses an out of date path setup logic, and doesn't handle security. There should be no place for it in the Slider Client. If we can pull it there, we can remove the class and the tests that are causing trouble in Windows. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206332#comment-14206332 ] ASF subversion and git services commented on SLIDER-622: Commit 8a3258ee73e723d4b583493c6a993e3fe762998c in incubator-slider's branch refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=8a3258e ] SLIDER-622: fix ZK Integration tests to be more independent and better @ cleaning up > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-630) slider-agent unit tests fail on debian and suse and windows
[ https://issues.apache.org/jira/browse/SLIDER-630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206331#comment-14206331 ] ASF subversion and git services commented on SLIDER-630: Commit e04c51b0e1539c0dd1f66ba79536a7ab68f62ab7 in incubator-slider's branch refs/heads/releases/slider-0.60 from [~jmaron] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=e04c51b ] SLIDER-630 python path specified via slider-client.xml or app config global prop > slider-agent unit tests fail on debian and suse and windows > --- > > Key: SLIDER-630 > URL: https://issues.apache.org/jira/browse/SLIDER-630 > Project: Slider > Issue Type: Bug > Components: agent, test >Affects Versions: Slider 0.50 >Reporter: Sumit Mohanty >Assignee: Sumit Mohanty >Priority: Critical > Fix For: Slider 0.60 > > > The tests fail because they do not find correct python on certain OSes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206299#comment-14206299 ] Steve Loughran commented on SLIDER-622: --- {code} org.codehaus.groovy.runtime.powerassert.PowerAssertionError: assert clusters.size() == 2 || | |4 false [cluster-02, cluster-01, cluster-03, cluster-00] at org.codehaus.groovy.runtime.InvokerHelper.assertFailed(InvokerHelper.java:398) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.assertFailed(ScriptBytecodeAdapter.java:646) at org.apache.slider.common.tools.TestZKIntegration.testListUserClustersWithTwoCluster(TestZKIntegration.groovy:96) {code} > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206294#comment-14206294 ] Steve Loughran commented on SLIDER-622: --- YARN-2845 covers change needed in {{MicroZKCluster}} for the duplicate registration problem. Until then: make sure all tests use unique service names, to derive unique paths > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206282#comment-14206282 ] Steve Loughran commented on SLIDER-622: --- ...looks like MicroZKService in the YARN registry (and presumably it's twill parent) doesn't do the shutdown > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-622) jenkins on windows failing
[ https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206274#comment-14206274 ] Steve Loughran commented on SLIDER-622: --- HBASE-6820 highlights how their ZK mini cluster doesn't close down properly. As the Slider one is based on it, we need the same patch for windows > jenkins on windows failing > -- > > Key: SLIDER-622 > URL: https://issues.apache.org/jira/browse/SLIDER-622 > Project: Slider > Issue Type: Sub-task > Components: build >Affects Versions: Slider 0.60 >Reporter: Steve Loughran >Assignee: Steve Loughran > Fix For: Slider 0.60 > > > Jenkins windows builds are failing: > [[https://builds.apache.org/job/slider-develop-windows/]] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-630) slider-agent unit tests fail on debian and suse and windows
[ https://issues.apache.org/jira/browse/SLIDER-630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206269#comment-14206269 ] ASF subversion and git services commented on SLIDER-630: Commit 1da0c8d35ba8ba854f2858bdad697c103853b740 in incubator-slider's branch refs/heads/feature/SLIDER-622-windows from [~jmaron] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=1da0c8d ] SLIDER-630 python path specified via slider-client.xml or app config global prop > slider-agent unit tests fail on debian and suse and windows > --- > > Key: SLIDER-630 > URL: https://issues.apache.org/jira/browse/SLIDER-630 > Project: Slider > Issue Type: Bug > Components: agent, test >Affects Versions: Slider 0.50 >Reporter: Sumit Mohanty >Assignee: Sumit Mohanty >Priority: Critical > Fix For: Slider 0.60 > > > The tests fail because they do not find correct python on certain OSes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-634) slider wrapper should look for and use python version >= 2.6
[ https://issues.apache.org/jira/browse/SLIDER-634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206270#comment-14206270 ] ASF subversion and git services commented on SLIDER-634: Commit 68263b4edccc635ec30b1d3aa6ba3f66e17e4c60 in incubator-slider's branch refs/heads/feature/SLIDER-622-windows from [~sumitmohanty] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=68263b4 ] SLIDER-634. slider wrapper should look for and use python version greater than or equal to 2.6 (Yu Liu via smohanty) > slider wrapper should look for and use python version >= 2.6 > > > Key: SLIDER-634 > URL: https://issues.apache.org/jira/browse/SLIDER-634 > Project: Slider > Issue Type: Bug >Reporter: thomas liu > Attachments: slider634.patch > > > Need to have slider script pick up appropriate version of python to run -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Fwd: [VOTE] Release Apache Hadoop 2.6.0
FYI, 2.6 RC0 is up I'm going to set up a profile for this and do the test runs, to qualify that the RC works for slider. Then we can +1 the RC and use it as the basis for our 0.60 release -- Forwarded message -- From: Arun C Murthy Date: 11 November 2014 02:52 Subject: [VOTE] Release Apache Hadoop 2.6.0 To: "common-...@hadoop.apache.org" , " hdfs-...@hadoop.apache.org" , " yarn-...@hadoop.apache.org" , " mapreduce-...@hadoop.apache.org" Folks, I've created a release candidate (rc0) for hadoop-2.6.0 that I would like to see released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0 The RC tag in git is: release-2.6.0-rc0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1012. Please try the release and vote; the vote will run for the usual 5 days. thanks, Arun -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.