Re: Planning a Slider 0.90.0 release with anti-affinity

2015-12-10 Thread Yong Feng
Hi Gour and Steve Just curious who is currently using Slider. Do we have a wiki page or something else keeping track of existing Slider customer? Thanks, Yong On Wed, Dec 9, 2015 at 2:51 PM, Gour Saha wrote: > Steve, > > +1 for the release and for moving to 2.7.1. But it would be good to hear

[jira] [Commented] (SLIDER-663) Make it easy to develop and deploy application packages that are essentially shell commands

2015-10-04 Thread YONG FENG (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942863#comment-14942863 ] YONG FENG commented on SLIDER-663: -- Any suggestion? Tnanks > Make it easy to

[jira] [Commented] (SLIDER-663) Make it easy to develop and deploy application packages that are essentially shell commands

2015-09-28 Thread YONG FENG (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933519#comment-14933519 ] YONG FENG commented on SLIDER-663: -- Hi Gour, The design doc mentioned use c

[jira] [Commented] (SLIDER-663) Make it easy to develop and deploy application packages that are essentially shell commands

2015-09-28 Thread YONG FENG (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933501#comment-14933501 ] YONG FENG commented on SLIDER-663: -- Thanks Gour. I don't know why I

[jira] [Commented] (SLIDER-663) Make it easy to develop and deploy application packages that are essentially shell commands

2015-09-28 Thread YONG FENG (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1492#comment-1492 ] YONG FENG commented on SLIDER-663: -- Hi Sumit, Is there a user doc for SLIDER-663

[jira] [Commented] (SLIDER-877) Move SLIDER_HOME assignment to slider.py

2015-09-13 Thread YONG FENG (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742788#comment-14742788 ] YONG FENG commented on SLIDER-877: -- Never mind. It will not bring any issue, just re

[jira] [Commented] (SLIDER-877) Move SLIDER_HOME assignment to slider.py

2015-09-13 Thread YONG FENG (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742783#comment-14742783 ] YONG FENG commented on SLIDER-877: -- The patch is partially committed into branc

[jira] [Commented] (SLIDER-868) Ability to put a Slider application on cruise control

2015-08-18 Thread YONG FENG (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701282#comment-14701282 ] YONG FENG commented on SLIDER-868: -- We are on the same page. Do you have a JIRA lo

[jira] [Commented] (SLIDER-868) Ability to put a Slider application on cruise control

2015-08-17 Thread YONG FENG (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700680#comment-14700680 ] YONG FENG commented on SLIDER-868: -- Thanks Gour for the reply. The Slider always

[jira] [Commented] (SLIDER-868) Ability to put a Slider application on cruise control

2015-08-06 Thread YONG FENG (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660661#comment-14660661 ] YONG FENG commented on SLIDER-868: -- Hi Gour Saha, Please correct me if I am wrong

Re: Support YARN ContainerID as Environment Variable for Slider Application Instance

2015-08-05 Thread Yong Feng
e to use this to configure your metrics2 properties > template. > > Let me know if it does not solve your problem. > > -Gour > > On 8/4/15, 2:41 PM, "Yong Feng" wrote: > > >Hi Slider Team, > > > >We are using Slider to manage long running service and

[jira] [Created] (SLIDER-924) Support YARN ContainerID as Environment Variable for Slider Application Instance

2015-08-05 Thread YONG FENG (JIRA)
YONG FENG created SLIDER-924: Summary: Support YARN ContainerID as Environment Variable for Slider Application Instance Key: SLIDER-924 URL: https://issues.apache.org/jira/browse/SLIDER-924 Project

Support YARN ContainerID as Environment Variable for Slider Application Instance

2015-08-04 Thread Yong Feng
Hi Slider Team, We are using Slider to manage long running service and ElasticSearch to maintain the collected metrics of those long running service. We also develop an elasticSearch sink of Hadoop Metric2. The collected metric includes AppName, ComponentName and HostName which are prepared by Sli

Re: A quick question on dynamic resizing in Slider

2015-07-25 Thread Yong Feng
for an application to > request more machines -- or memory/cpus from Slider). > > Does Slider have such interface (API)? > > Thanks! > > -Jiwon > > > On Fri, Jul 24, 2015 at 1:51 PM, Yong Feng wrote: > > > Hi Jiwon, > > > > Slider supports horizontally

Re: A quick question on dynamic resizing in Slider

2015-07-24 Thread Yong Feng
Hi Jiwon, Slider supports horizontally scale out/in your application. Please refer to following link for the user doc of slider commands which describes "slider flex ..." http://slider.incubator.apache.org/docs/manpage.html Besides, YARN 1197 plans to support resizing YARN container. By leveragi

Re: Is it similar to mesos

2015-03-26 Thread Yong Feng
> > Thanks for your sharing, and I will try it after Mesos needed. > > > > 2015-03-01 20:37 GMT+08:00 Yong Feng : > > > >> A typo > >> > >> >>While Yarn and Tez are meta-framework in Yarn > >> While Slider and Tez are meta-

Re: Is it similar to mesos

2015-03-01 Thread Yong Feng
A typo >>While Yarn and Tez are meta-framework in Yarn While Slider and Tez are meta-framework in Yarn. Yong On Sun, Mar 1, 2015 at 7:36 AM, Yong Feng wrote: > Both Mesos and Yarn are resource manager or resource scheduler. They use > the different resource allocaiton proto

Re: Is it similar to mesos

2015-03-01 Thread Yong Feng
Both Mesos and Yarn are resource manager or resource scheduler. They use the different resource allocaiton protocol, push or request. Google "Mesos Vs Yarn“, you could find more material to compare Mesos and Yarn. Mesos argues that Yarn is "BigData Application" and is able to run on top of Yarn. We

Re: Spark on Slider

2015-01-13 Thread Yong Feng
gt; Anyway: the source for that patch is available —why not have a play with it > and see what you think? > > > On 13 January 2015 at 00:58, Yong Feng wrote: > > > Hi Slider team > > > > I also played with "Spark/SparkR on Yarn" recently, and think

Spark on Slider

2015-01-12 Thread Yong Feng
Hi Slider team I also played with "Spark/SparkR on Yarn" recently, and think we even could run Spark on Slider. After that we could enhance Slider to have API scale out/in Spark cluster horizontally or vertically. It is a little bit overlapped with the enhancement on YarnClusterScheduler of Spark.

Re: The utility exported by resource management of slider agent

2015-01-10 Thread Yong Feng
t > > On Sat, Jan 10, 2015 at 9:23 PM, Ted Yu wrote: > > > We have wiki but it is very out of date: > > https://cwiki.apache.org/confluence/collector/pages.action?key=SLIDER > > > > Cheers > > > > On Sat, Jan 10, 2015 at 9:00 PM, Yong Feng > wrote: &

The utility exported by resource management of slider agent

2015-01-10 Thread Yong Feng
Hi Ted and Team I have written a slider package for a HPC cluster by taking hbase slider package as example. It runs well. During the development, I used some resource types provided by resource management of slider agent such as package, Tarball, Execute, Account, File, Diectory ... They are qui

Re: how to get get the port of memcached

2015-01-09 Thread Yong Feng
> }2015-01-09 01:41:44,830 [main] INFO util.ExitUtil - Exiting with status 0 > > In this case, you see the logs on the console along with the output as > well. You can also have the command output to a text file. > > slider registry --name cl1 --getexp servers --dest memcached_servers

Re: How Sliders configure configuration file of regionserver of HBase

2015-01-03 Thread Yong Feng
> We can consider to add a method label-to-nodes mapping in future release > > if necessary. > > > > Thanks, > > Wangda > > > > On Fri, Jan 2, 2015 at 9:11 AM, Ted Yu wrote: > > > >> Thanks for the background information. > &

Re: How Sliders configure configuration file of regionserver of HBase

2015-01-02 Thread Yong Feng
Yarn team. Thanks, Yong On Thu, Jan 1, 2015 at 10:31 PM, Ted Yu wrote: > Yong: > Let me discuss with slider / YARN developers and get back to you. > > Happy new year. > > On Thu, Jan 1, 2015 at 7:13 PM, Yong Feng wrote: > > > Jon, Ted > > > > Hap

Re: How Sliders configure configuration file of regionserver of HBase

2015-01-01 Thread Yong Feng
? Thanks, Yong On Wed, Dec 31, 2014 at 5:18 PM, Yong Feng wrote: > Hi John > > I do expect the hosts allocated to master role of my slider application > are labeled as appname_rolename, but the question is who will add such > label and how? and how to get the hosts

Re: How Sliders configure configuration file of regionserver of HBase

2014-12-31 Thread Yong Feng
if certain hosts were labeled as MASTER, wouldn’t you know > a priori the list of master hosts? > > > On Dec 31, 2014, at 12:31 PM, Yong Feng wrote: > > > Thanks Ted. > > > >>> knowing the host list of master role in Slider script or template is > not >

Re: How Sliders configure configuration file of regionserver of HBase

2014-12-31 Thread Yong Feng
ters active master > under a well known zookeeper znode. > > This is much more flexible than the way you described. > > Again, knowing the host list of master role in Slider script or template is > not supported by either Slider or YARN. > > Cheers > > On Tue, Dec 3

Re: How Sliders configure configuration file of regionserver of HBase

2014-12-30 Thread Yong Feng
at 9:08 PM, Ted Yu wrote: > bq. host list of all the instances of a component > > Are you using node labels feature of YARN ? > If not, the list would comprise of all the nodes in your YARN cluster. > > Cheers > > On Tue, Dec 30, 2014 at 4:43 PM, Yong Feng wrote: > >

How Sliders configure configuration file of regionserver of HBase

2014-12-30 Thread Yong Feng
Hi Team, The template of regionserver of HBase application uses following scripts to configure configuraiton file of regionserver of HBase. I did not find where the rs_hosts is defined in any file in Slider HBase package. How a template is designed is mentioned a little at the end of http://slider

Re: how to get get the port of memcached

2014-12-29 Thread Yong Feng
uot;Mon Dec 29 20:49:01 UTC 2014"}],"org.apache.slider.hbase.thrift2":[{"value":" http://node6:57160","level":"application","updatedTime":"Mon Dec 29 20:48:45 UTC 2014"}]},"empty":false}[root@node2 bin] Yong On Mon, Dec

Re: how to get get the port of memcached

2014-12-29 Thread Yong Feng
ot;:true},"container_log_dirs":{"description":"container_log_dirs","updated":1419886151773,"updatedTime":"Mon Dec 29 20:49:11 UTC 2014","entries":{},"empty":true},"container_work_dirs":{"description&q

Re: how to get get the port of memcached

2014-12-29 Thread Yong Feng
BTW, I saw http://slider.incubator.apache.org/docs/slider_specs/specifying_exports.html and tried something like "curl http://.../proxy/application_.../ws/v1/slider /publisher/exports/", but no luck. Thanks, Yong On Mon, Dec 29, 2014 at 4:43 PM, Yong Feng wrote: > Thanks Ted,

Re: how to get get the port of memcached

2014-12-29 Thread Yong Feng
api":"classpath:org.apache.slider.agents.oneway","addressType":"uri","protocolType":"REST","addresses":[{"uri":" https://node6:37466/ws/v1/slider/agents "}]}],"yarn:persistence":"application","

Re: how to get get the port of memcached

2014-12-27 Thread Yong Feng
Hi Team, Could anyone shed some light on it? Thanks, Yong On Wed, Dec 24, 2014 at 3:09 PM, Yong Feng wrote: > Happy Christmas, slider team. > > I use this mail thread for a similar question on querying exported port of > slider sample cluster jmemcached. After I deployed jmemcach

Re: how to get get the port of memcached

2014-12-24 Thread Yong Feng
Happy Christmas, slider team. I use this mail thread for a similar question on querying exported port of slider sample cluster jmemcached. After I deployed jmemcached on slider, I did not find the entry point of the cluster by command "slider status". I have to go to the host on which the jmemcach

Re: Fail to build Slider 0.60.0

2014-12-22 Thread Yong Feng
w-r--r-- 1 tyu staff 4711 Jun 30 2013 > /Users/tyu/.m2/repository/net/java/jvnet-parent/1/jvnet-parent-1.pom > > Can you clean local maven repo and try again ? > > Cheers > > On Sun, Dec 21, 2014 at 5:56 PM, Yong Feng wrote: > >> Hi Hao, >> >> Thanks

Re: Fail to build Slider 0.60.0

2014-12-21 Thread Yong Feng
-Prelease-2.6 > > > 2014-12-22 8:06 GMT+08:00 Yong Feng : > >> Forward to dev mail group. >> >> Thanks, >> >> Yong >> >> -- Forwarded message -- >> From: Yong Feng >> Date: Sun, Dec 21, 2014 at 7:05 PM >>

Fwd: Fail to build Slider 0.60.0

2014-12-21 Thread Yong Feng
Forward to dev mail group. Thanks, Yong -- Forwarded message -- From: Yong Feng Date: Sun, Dec 21, 2014 at 7:05 PM Subject: Fail to build Slider 0.60.0 To: dev-ow...@slider.incubator.apache.org Hi Slider owner, I failed to subscribe and send the mail to the dev mail group