Happy Christmas, slider team. I use this mail thread for a similar question on querying exported port of slider sample cluster jmemcached. After I deployed jmemcached on slider, I did not find the entry point of the cluster by command "slider status". I have to go to the host on which the jmemcached is running and execute "ps" command to get the allocated port.
Generally speaking, how slider user knows the entry point of deployed cluster? OpenStack Heat and K8S of Google allows user to query entry point of their stack/service. As similar app orchestrator, I would like to know how slider resolve the issue of "service discovery". Thanks, Yong On Tue, Dec 23, 2014 at 9:06 AM, 杨浩 <[email protected]> wrote: > I think it would be a convient way. The source idea is that to get some > result of slider shell command by REST API. We just don't want to get the > result by executing shell command in Java. > > 2014-12-23 19:39 GMT+08:00 Jon Maron <[email protected]>: > > > Are you suggesting that the client interact with the REST API to retrieve > > results (instead of the current rpc mechanism)? That is part of the > plan. > > > > > On Dec 23, 2014, at 1:45 AM, 杨浩 <[email protected]> wrote: > > > > > > I think a way to do so is that exposing the REST API to get the result > > of > > > slider shell command > > > > > > 2014-12-23 14:22 GMT+08:00 Gour Saha <[email protected]>: > > > > > >> Do you mean REST API? > > >> > > >> Significant work is going on in exposing REST API in slider for the > next > > >> major release. We still don't know the best way to expose a REST API > to > > >> retrieve the AM host:port (via YARN REST API maybe) as the REST > endpoint > > >> itself will be served by the Slider AM host:port, but will surely come > > up > > >> with an elegant solution. Suggestions are welcome!! > > >> > > >> Check the uber jira for more details - > > >> https://issues.apache.org/jira/browse/SLIDER-151 > > >> > > >> -Gour > > >> > > >>> On Mon, Dec 22, 2014 at 1:50 AM, 杨浩 <[email protected]> wrote: > > >>> > > >>> Hi ,I've get the am port through shell command "slider list > > >>> "+applicationName+" --state RUNNING",but arguing with my boss, we > think > > >>> it's an ugly way to be used in production env. > > >>> > > >>> Can we get the am host:port through Java API > > >>> > > >>> 2014-12-16 9:07 GMT+08:00 Gour Saha <[email protected]>: > > >>> > > >>>> Once the app is up and running can you hit the following url and > copy > > >>> paste > > >>>> what you see? > > >>>> > > >>>> http://yang:8088/proxy/ > <application_id>/ws/v1/slider/publisher/slider > > >>>> > > >>>> where the <application_id> will be the value from the property "* > > >>>> info.am.app.id > > >>>> <http://info.am.app.id>*" in the status output above. > > >>>> > > >>>> -Gour > > >>>> > > >>>>> On Thu, Dec 11, 2014 at 8:23 PM, 杨浩 <[email protected]> wrote: > > >>>>> > > >>>>> yang@yang:/usr/local/slider$ slider status memcached1 > > >>>>> 2014-12-12 12:22:58,305 [main] INFO client.RMProxy - Connecting to > > >>>>> ResourceManager at yang/127.0.0.1:8032 > > >>>>> 2014-12-12 12:22:58,597 [main] INFO client.SliderClient - { > > >>>>> "version" : "1.0", > > >>>>> "name" : "memcached1", > > >>>>> "type" : "agent", > > >>>>> "state" : 3, > > >>>>> "createTime" : 1418357615354, > > >>>>> "updateTime" : 1418357615603, > > >>>>> "originConfigurationPath" : > > >>>>> "hdfs://yang:8020/user/yang/.slider/cluster/memcached1/snapshot", > > >>>>> "generatedConfigurationPath" : > > >>>>> "hdfs://yang:8020/user/yang/.slider/cluster/memcached1/generated", > > >>>>> "dataPath" : > > >>>>> "hdfs://yang:8020/user/yang/.slider/cluster/memcached1/database", > > >>>>> "options" : { > > >>>>> "slider.am.restart.supported" : "true", > > >>>>> "site.global.security_enabled" : "false", > > >>>>> "internal.application.home" : null, > > >>>>> "internal.queue" : "default", > > >>>>> "application.name" : "memcached1", > > >>>>> "slider.cluster.directory.permissions" : "0770", > > >>>>> "site.global.slider.allowed.ports" : "48000, 49000, > 50001-50010", > > >>>>> "internal.tmp.dir" : > > >>>>> "hdfs://yang:8020/user/yang/.slider/cluster/memcached1/tmp", > > >>>>> "java_home" : "/opt/soft/jdk", > > >>>>> "internal.snapshot.conf.path" : > > >>>>> "hdfs://yang:8020/user/yang/.slider/cluster/memcached1/snapshot", > > >>>>> "env.MALLOC_ARENA_MAX" : "4", > > >>>>> "zookeeper.path" : "/services/slider/users/yang/memcached1", > > >>>>> "internal.container.failure.shortlife" : "60000", > > >>>>> "internal.application.image.path" : null, > > >>>>> "internal.generated.conf.path" : > > >>>>> "hdfs://yang:8020/user/yang/.slider/cluster/memcached1/generated", > > >>>>> "site.fs.default.name" : "hdfs://yang:8020", > > >>>>> "site.global.additional_cp" : "/usr/lib/hadoop/lib/*", > > >>>>> "zookeeper.hosts" : "127.0.0.1", > > >>>>> "internal.provider.name" : "agent", > > >>>>> "internal.data.dir.path" : > > >>>>> "hdfs://yang:8020/user/yang/.slider/cluster/memcached1/database", > > >>>>> "site.fs.defaultFS" : "hdfs://yang:8020", > > >>>>> "site.global.memory_val" : "200M", > > >>>>> "slider.data.directory.permissions" : "0770", > > >>>>> "site.global.listen_port" : > > >>>>> "${MEMCACHED.ALLOCATED_PORT}{PER_CONTAINER}", > > >>>>> "zookeeper.quorum" : "127.0.0.1:2181", > > >>>>> "site.global.xmx_val" : "256m", > > >>>>> "internal.am.tmp.dir" : > > >> "hdfs://yang:8020/user/yang/.slider/cluster/memcached1/tmp/appmaster", > > >>>>> "application.def" : > > >>> ".slider/package/MEMCACHED/jmemcached-1.0.0.zip", > > >>>>> "internal.container.failure.threshold" : "5", > > >>>>> "site.global.xms_val" : "128m" > > >>>>> }, > > >>>>> "info" : { > > >>>>> "info.am.agent.status.url" : "https://yang:60422/", > > >>>>> "yarn.memory" : "2048", > > >>>>> "info.am.app.id" : "application_1418350976699_0004", > > >>>>> "info.am.agent.status.port" : "60422", > > >>>>> "info.am.agent.ops.url" : "https://yang:47879/", > > >>>>> "yarn.vcores" : "32", > > >>>>> "info.am.container.id" : > > >> "container_1418350976699_0004_03_000001", > > >>>>> "info.am.attempt.id" : "appattempt_1418350976699_0004_000003", > > >>>>> "info.am.rpc.port" : "48000", > > >>>>> "info.am.web.port" : "49000", > > >>>>> "info.am.web.url" : "http://yang:49000/", > > >>>>> "info.am.hostname" : "yang", > > >>>>> "info.am.agent.ops.port" : "47879", > > >>>>> "status.application.build.info" : "Slider > Core-0.60.0-incubating > > >>>> Built > > >>>>> against commit# 9e03554f99 on Java 1.6.0_31 by yang", > > >>>>> "status.hadoop.build.info" : "2.6.0", > > >>>>> "status.hadoop.deployed.info" : "branch-2.6.0 > > >>>>> @18e43357c8f927c0695f1e9522859d6a", > > >>>>> "live.time" : "12 Dec 2014 04:13:35 GMT", > > >>>>> "live.time.millis" : "1418357615354", > > >>>>> "create.time" : "12 Dec 2014 04:13:35 GMT", > > >>>>> "create.time.millis" : "1418357615354", > > >>>>> "containers.at.am-restart" : "0", > > >>>>> "status.time" : "12 Dec 2014 04:22:58 GMT", > > >>>>> "status.time.millis" : "1418358178437" > > >>>>> }, > > >>>>> "statistics" : { > > >>>>> "MEMCACHED" : { > > >>>>> "containers.start.started" : 1, > > >>>>> "containers.live" : 1, > > >>>>> "containers.start.failed" : 0, > > >>>>> "containers.active.requests" : 0, > > >>>>> "containers.failed" : 0, > > >>>>> "containers.completed" : 0, > > >>>>> "containers.desired" : 1, > > >>>>> "containers.requested" : 1 > > >>>>> }, > > >>>>> "slider-appmaster" : { > > >>>>> "containers.unknown.completed" : 1, > > >>>>> "containers.start.started" : 1, > > >>>>> "containers.live" : 2, > > >>>>> "containers.start.failed" : 0, > > >>>>> "containers.failed" : 0, > > >>>>> "containers.completed" : 0, > > >>>>> "containers.surplus" : 0 > > >>>>> } > > >>>>> }, > > >>>>> "instances" : { > > >>>>> "MEMCACHED" : [ "container_1418350976699_0004_03_000002" ], > > >>>>> "slider-appmaster" : [ "container_1418350976699_0004_03_000001" > ] > > >>>>> }, > > >>>>> "roles" : { > > >>>>> "MEMCACHED" : { > > >>>>> "yarn.memory" : "256", > > >>>>> "yarn.role.priority" : "1", > > >>>>> "role.requested.instances" : "0", > > >>>>> "role.failed.starting.instances" : "0", > > >>>>> "role.actual.instances" : "1", > > >>>>> "yarn.component.instances" : "1", > > >>>>> "role.releasing.instances" : "0", > > >>>>> "role.failed.instances" : "0" > > >>>>> }, > > >>>>> "slider-appmaster" : { > > >>>>> "yarn.memory" : "1024", > > >>>>> "role.requested.instances" : "0", > > >>>>> "role.failed.starting.instances" : "0", > > >>>>> "role.actual.instances" : "1", > > >>>>> "yarn.vcores" : "1", > > >>>>> "yarn.component.instances" : "1", > > >>>>> "role.releasing.instances" : "0", > > >>>>> "role.failed.instances" : "0" > > >>>>> } > > >>>>> }, > > >>>>> "clientProperties" : { }, > > >>>>> "status" : { > > >>>>> "live" : { > > >>>>> "MEMCACHED" : { > > >>>>> "container_1418350976699_0004_03_000002" : { > > >>>>> "name" : "container_1418350976699_0004_03_000002", > > >>>>> "role" : "MEMCACHED", > > >>>>> "roleId" : 1, > > >>>>> "createTime" : 1418357617294, > > >>>>> "startTime" : 1418357617328, > > >>>>> "released" : false, > > >>>>> "host" : "localhost", > > >>>>> "state" : 3, > > >>>>> "exitCode" : 0, > > >>>>> "command" : "python > > >> ./infra/agent/slider-agent/agent/main.py > > >>>>> --label container_1418350976699_0004_03_000002___MEMCACHED > > >> --zk-quorum > > >>>>> 127.0.0.1:2181 --zk-reg-path > > >>>>> /registry/users/yang/services/org-apache-slider/memcached1 > > > >>>>> <LOG_DIR>/slider-agent.out 2>&1 ; ", > > >>>>> "diagnostics" : "", > > >>>>> "environment" : [ "AGENT_WORK_ROOT=\"$PWD\"", > > >>>>> "HADOOP_USER_NAME=\"yang\"", "AGENT_LOG_ROOT=\"<LOG_DIR>\"", > > >>>>> "PYTHONPATH=\"./infra/agent/slider-agent/\"", > > >> > > > "SLIDER_PASSPHRASE=\"aa178fGHttfGC7Cnss3DPbLzYDEmqJuDcCUNwAW2YUfyPNQMZN\"" > > >>>>> ] > > >>>>> } > > >>>>> }, > > >>>>> "slider-appmaster" : { > > >>>>> "container_1418350976699_0004_03_000001" : { > > >>>>> "name" : "container_1418350976699_0004_03_000001", > > >>>>> "role" : "slider-appmaster", > > >>>>> "roleId" : 0, > > >>>>> "createTime" : 0, > > >>>>> "startTime" : 0, > > >>>>> "released" : false, > > >>>>> "host" : "yang", > > >>>>> "state" : 3, > > >>>>> "exitCode" : 0, > > >>>>> "command" : "", > > >>>>> "diagnostics" : "" > > >>>>> } > > >>>>> } > > >>>>> } > > >>>>> } > > >>>>> } > > >>>>> 2014-12-12 12:22:58,598 [main] INFO util.ExitUtil - Exiting with > > >>> status > > >>>> 0 > > >>>>> > > >>>>> > > >>>>> 2014-12-11 1:01 GMT+08:00 Gour Saha <[email protected]>: > > >>>>>> > > >>>>>> What do you get when you call "slider status <application>"? > > >>>>>> > > >>>>>> -Gour > > >>>>>> > > >>>>>>> On Wed, Dec 10, 2014 at 1:02 AM, 杨浩 <[email protected]> wrote: > > >>>>>>> > > >>>>>>> Hi, I have installed the jmemcached successfully, but how can I > > >> use > > >>>> it, > > >>>>>> or > > >>>>>>> how to get the port of memcached > > >>>>>> > > >>>>>> -- > > >>>>>> CONFIDENTIALITY NOTICE > > >>>>>> NOTICE: This message is intended for the use of the individual or > > >>>> entity > > >>>>> to > > >>>>>> which it is addressed and may contain information that is > > >>> confidential, > > >>>>>> privileged and exempt from disclosure under applicable law. If the > > >>>> reader > > >>>>>> of this message is not the intended recipient, you are hereby > > >>> notified > > >>>>> that > > >>>>>> any printing, copying, dissemination, distribution, disclosure or > > >>>>>> forwarding of this communication is strictly prohibited. If you > > >> have > > >>>>>> received this communication in error, please contact the sender > > >>>>> immediately > > >>>>>> and delete it from your system. Thank You. > > >>>> > > >>>> -- > > >>>> CONFIDENTIALITY NOTICE > > >>>> NOTICE: This message is intended for the use of the individual or > > >> entity > > >>> to > > >>>> which it is addressed and may contain information that is > > confidential, > > >>>> privileged and exempt from disclosure under applicable law. If the > > >> reader > > >>>> of this message is not the intended recipient, you are hereby > notified > > >>> that > > >>>> any printing, copying, dissemination, distribution, disclosure or > > >>>> forwarding of this communication is strictly prohibited. If you have > > >>>> received this communication in error, please contact the sender > > >>> immediately > > >>>> and delete it from your system. Thank You. > > >> > > >> -- > > >> CONFIDENTIALITY NOTICE > > >> NOTICE: This message is intended for the use of the individual or > > entity to > > >> which it is addressed and may contain information that is > confidential, > > >> privileged and exempt from disclosure under applicable law. If the > > reader > > >> of this message is not the intended recipient, you are hereby notified > > that > > >> any printing, copying, dissemination, distribution, disclosure or > > >> forwarding of this communication is strictly prohibited. If you have > > >> received this communication in error, please contact the sender > > immediately > > >> and delete it from your system. Thank You. > > >> > > > > -- > > CONFIDENTIALITY NOTICE > > NOTICE: This message is intended for the use of the individual or entity > to > > which it is addressed and may contain information that is confidential, > > privileged and exempt from disclosure under applicable law. If the reader > > of this message is not the intended recipient, you are hereby notified > that > > any printing, copying, dissemination, distribution, disclosure or > > forwarding of this communication is strictly prohibited. If you have > > received this communication in error, please contact the sender > immediately > > and delete it from your system. Thank You. > > >
