Re: Is it able to make AM to restart from previous state?

On 5 November 2014 21:44, hsy...@gmail.com wrote: > Thanks Steve, > > Is No 1 a new feature in YARN (Not released yet)? > Came out in Hadoop 2.4; only got working in Hadoop 2.5. We were the first users. > > And you mentioned slider saves the location in history files. What are the > history f

Re: Is it able to make AM to restart from previous state?

On 6 November 2014 00:31, hsy...@gmail.com wrote: > Steve, > > I found out from the code that everything is kept in history folder in > hdfs. > > You mentioned that if I add new component, the history layout would be > discarded. What if I add more component instances in configuration? Do you > t

Re: Maven repository?

we haven't published to maven yet; I'll see about what it will take to do that with the 0.60 release against the forthcoming hadoop-2.6-RC0. You don't want publishing things to maven that depend on -SNAPSHOT stuff as it is too brittle (every morning you end up getting a different version of the bin

Specify a certain host for the Accumulo monitor

Is it possible in slider to configure the Accumulo Monitor to run on a particular node? Roshan

[jira] [Commented] (SLIDER-616) re-enable AMFailuresIT

[ https://issues.apache.org/jira/browse/SLIDER-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200235#comment-14200235 ] ASF subversion and git services commented on SLIDER-616: Commit 61

[jira] [Commented] (SLIDER-616) re-enable AMFailuresIT

[ https://issues.apache.org/jira/browse/SLIDER-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200236#comment-14200236 ] ASF subversion and git services commented on SLIDER-616: Commit d6

[jira] [Commented] (SLIDER-616) re-enable AMFailuresIT

[ https://issues.apache.org/jira/browse/SLIDER-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200237#comment-14200237 ] ASF subversion and git services commented on SLIDER-616: Commit 2b

[jira] [Commented] (SLIDER-555) AM needs to get log aggregation friendly log4j

[ https://issues.apache.org/jira/browse/SLIDER-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200234#comment-14200234 ] ASF subversion and git services commented on SLIDER-555: Commit 81

[jira] [Commented] (SLIDER-616) re-enable AMFailuresIT

[ https://issues.apache.org/jira/browse/SLIDER-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200244#comment-14200244 ] ASF subversion and git services commented on SLIDER-616: Commit 61

[jira] [Commented] (SLIDER-616) re-enable AMFailuresIT

[ https://issues.apache.org/jira/browse/SLIDER-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200246#comment-14200246 ] ASF subversion and git services commented on SLIDER-616: Commit 2b

[jira] [Commented] (SLIDER-616) re-enable AMFailuresIT

[ https://issues.apache.org/jira/browse/SLIDER-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200245#comment-14200245 ] ASF subversion and git services commented on SLIDER-616: Commit d6

[jira] [Commented] (SLIDER-616) re-enable AMFailuresIT

[ https://issues.apache.org/jira/browse/SLIDER-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200247#comment-14200247 ] ASF subversion and git services commented on SLIDER-616: Commit b3

Re: Maven repository?

Here's some info on publishing maven artifacts: http://www.apache.org/dev/publishing-maven-artifacts.html Although I think hadoop doesn't inherit from the ASF pom and just copies the stuff it needs into its own pom. We may already have some of the things we need in the distribution management sect

Re: Specify a certain host for the Accumulo monitor

In Hadoop 2.6.0, you will be able to label nodes, and then when you submit the Accumulo resources you need to Slider, you will be able to request that a component uses a specific label (corresponding to a specific node or nodes). On Thu, Nov 6, 2014 at 6:28 AM, Roshan Punnoose wrote: > Is it pos

[jira] [Commented] (SLIDER-616) re-enable AMFailuresIT

[ https://issues.apache.org/jira/browse/SLIDER-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200263#comment-14200263 ] ASF subversion and git services commented on SLIDER-616: Commit 92

[jira] [Commented] (SLIDER-616) re-enable AMFailuresIT

[ https://issues.apache.org/jira/browse/SLIDER-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200262#comment-14200262 ] ASF subversion and git services commented on SLIDER-616: Commit 5f

[jira] [Commented] (SLIDER-616) re-enable AMFailuresIT

[ https://issues.apache.org/jira/browse/SLIDER-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200261#comment-14200261 ] ASF subversion and git services commented on SLIDER-616: Commit dc

[jira] [Created] (SLIDER-621) increase timeouts of integration tests

Steve Loughran created SLIDER-621: - Summary: increase timeouts of integration tests Key: SLIDER-621 URL: https://issues.apache.org/jira/browse/SLIDER-621 Project: Slider Issue Type: Sub-task

Re: Maven repository?

Until then, you should be able to get away by checking out the git repo and run mvn install -DskipTests (to get it into your .m2) and then use this (for develop) - org.apache.slider slider-core 0.61-incubating -Gour On Thu, Nov 6, 2014 at 6:51 AM, Billie Rin

Re: Specify a certain host for the Accumulo monitor

I am running Hadoop 2.6.0 right now using Ambari 1.7.0 nightly. Is there some documentation around labeling nodes? Through the Resourcemanager UI? On Thu, Nov 6, 2014 at 9:54 AM, Billie Rinaldi wrote: > In Hadoop 2.6.0, you will be able to label nodes, and then when you submit > the Accumulo res

[jira] [Commented] (SLIDER-621) increase timeouts of integration tests

[ https://issues.apache.org/jira/browse/SLIDER-621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200350#comment-14200350 ] ASF subversion and git services commented on SLIDER-621: Commit 3f

[jira] [Updated] (SLIDER-621) increase timeouts of integration tests to 30m

[ https://issues.apache.org/jira/browse/SLIDER-621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-621: -- Summary: increase timeouts of integration tests to 30m (was: increase timeouts of integration t

[jira] [Resolved] (SLIDER-621) increase timeouts of integration tests to 30m

[ https://issues.apache.org/jira/browse/SLIDER-621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SLIDER-621. --- Resolution: Fixed > increase timeouts of integration tests to 30m > --

[jira] [Commented] (SLIDER-621) increase timeouts of integration tests

[ https://issues.apache.org/jira/browse/SLIDER-621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200349#comment-14200349 ] ASF subversion and git services commented on SLIDER-621: Commit b7

[jira] [Reopened] (SLIDER-555) AM needs to get log aggregation friendly log4j

[ https://issues.apache.org/jira/browse/SLIDER-555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened SLIDER-555: --- Assignee: Steve Loughran (was: Gour Saha) putting the logic in {{copyDirectory()}} isn't th

[jira] [Resolved] (SLIDER-574) document managing port ranges for slider containers

[ https://issues.apache.org/jira/browse/SLIDER-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Maron resolved SLIDER-574. --- Resolution: Fixed added configuration items section to bottom of core.md file in site document

[jira] [Commented] (SLIDER-555) AM needs to get log aggregation friendly log4j

[ https://issues.apache.org/jira/browse/SLIDER-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200446#comment-14200446 ] ASF subversion and git services commented on SLIDER-555: Commit 35

[jira] [Commented] (SLIDER-555) AM needs to get log aggregation friendly log4j

[ https://issues.apache.org/jira/browse/SLIDER-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200447#comment-14200447 ] ASF subversion and git services commented on SLIDER-555: Commit b0

Re: Specify a certain host for the Accumulo monitor

There are "yarn rmadmin" and "yarn cluster" commands to manage labels. -Sumit On Thu, Nov 6, 2014 at 7:49 AM, Roshan Punnoose wrote: > I am running Hadoop 2.6.0 right now using Ambari 1.7.0 nightly. Is there > some documentation around labeling nodes? Through the Resourcemanager UI? > > On Thu,

Re: Specify a certain host for the Accumulo monitor

I have not actually done this myself, but I can try to give you a general idea. Roughly the steps are to modify the capacity-scheduler.xml file, run yarn rmadmin -refreshQueues (not sure if you also have to start the RM or not -- maybe depends on what kinds of things you change). Then run yarn rm

Re: Specify a certain host for the Accumulo monitor

Thanks! That is perfect. On Thu, Nov 6, 2014 at 1:05 PM, Billie Rinaldi wrote: > I have not actually done this myself, but I can try to give you a general > idea. Roughly the steps are to modify the capacity-scheduler.xml file, run > yarn rmadmin -refreshQueues (not sure if you also have to sta

[jira] [Resolved] (SLIDER-616) re-enable AMFailuresIT

[ https://issues.apache.org/jira/browse/SLIDER-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SLIDER-616. --- Resolution: Fixed > re-enable AMFailuresIT > -- > > Key: S

[jira] [Updated] (SLIDER-555) AM needs to get log aggregation friendly log4j

[ https://issues.apache.org/jira/browse/SLIDER-555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SLIDER-555: -- Assignee: Gour Saha (was: Steve Loughran) > AM needs to get log aggregation friendly log4j > --

[jira] [Created] (SLIDER-622) jenkins on windows failing

Steve Loughran created SLIDER-622: - Summary: jenkins on windows failing Key: SLIDER-622 URL: https://issues.apache.org/jira/browse/SLIDER-622 Project: Slider Issue Type: Sub-task Affects

Re: Specify a certain host for the Accumulo monitor

We'll be interested to hear if you get it working, and what you did. I see also we have this on the slider website, though there's some hand-waving about the yarn reconfiguration: http://slider.incubator.apache.org/docs/slider_specs/resource_specification.html#labels On Thu, Nov 6, 2014 at 10:24

[jira] [Updated] (SLIDER-129) Evaluate footprint for the agent process and scale it to multiple instances

[ https://issues.apache.org/jira/browse/SLIDER-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Mohanty updated SLIDER-129: - Fix Version/s: (was: Slider 0.60) Slider 2.0.0 > Evaluate footprint for the

[jira] [Updated] (SLIDER-555) AM needs to get log aggregation friendly log4j

[ https://issues.apache.org/jira/browse/SLIDER-555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated SLIDER-555: - Assignee: thomas liu (was: Gour Saha) > AM needs to get log aggregation friendly log4j >

[jira] [Assigned] (SLIDER-555) AM needs to get log aggregation friendly log4j

[ https://issues.apache.org/jira/browse/SLIDER-555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha reassigned SLIDER-555: Assignee: Gour Saha (was: thomas liu) > AM needs to get log aggregation friendly log4j > -

[jira] [Updated] (SLIDER-129) Evaluate footprint for the agent process and scale it to multiple instances

[ https://issues.apache.org/jira/browse/SLIDER-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated SLIDER-129: - Assignee: thomas liu (was: Gour Saha) > Evaluate footprint for the agent process and scale it to multiple

[jira] [Updated] (SLIDER-129) Evaluate footprint for the agent process and scale it to multiple instances

[ https://issues.apache.org/jira/browse/SLIDER-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Mohanty updated SLIDER-129: - Sprint: Slider July #1, Slider October #2 (was: Slider July #1, Slider October #2, Slider Novembe

[jira] [Commented] (SLIDER-620) Execute command should allow polling for daemons that may stop within seconds

[ https://issues.apache.org/jira/browse/SLIDER-620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201465#comment-14201465 ] ASF subversion and git services commented on SLIDER-620: Commit d7

[jira] [Commented] (SLIDER-620) Execute command should allow polling for daemons that may stop within seconds

[ https://issues.apache.org/jira/browse/SLIDER-620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201467#comment-14201467 ] ASF subversion and git services commented on SLIDER-620: Commit 96