[jira] [Commented] (SLIDER-1064) Component level export host:port info does not appears in ZK
[
https://issues.apache.org/jira/browse/SLIDER-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105736#comment-15105736
]
Manoj Samel commented on SLIDER-1064:
-
Attached is a simplified use case I built using the out of box jmemcached. I
have attached the 3 configuration files I used and also have attached the
output summary in outputs.txt. Hope this helps
> Component level export host:port info does not appears in ZK
>
>
> Key: SLIDER-1064
> URL: https://issues.apache.org/jira/browse/SLIDER-1064
> Project: Slider
> Issue Type: Bug
> Components: core, registry
>Affects Versions: Slider 0.80
>Reporter: Manoj Samel
>
> Slider 0.80 with secured cluster. Registry is enabled *** without *** security
> Export is configured as follows
> 1. No application level export
> 2. Component level port allocated per container. In appConfig.json, ***
> "global" *** section
> "site.global.user1.http_port": "${user1.ALLOCATED_PORT}{PER_CONTAINER}",
> 3. Each component exports its own host/port (slider allocated). metainfo.xml
> {code:xml}
>
>
> user1
> MASTER
>
>
>my_info
>${THIS_HOST}:${user1.http_port}
>
>
>
> scripts/memcached.py
> PYTHON
>
>
> {code}
> At runtime,
> in http://am-host:1025/ws/v1/slider/publisher/slider/componentinstancedata,
> the host:port info can be seen as expected
> {"description":"ComponentInstanceData","updated":0,"entries":{"container_1452045276360_0005_01_04.my_info":"host1:33786",
>
> However, when I look at ZK data,
> get
> /registry/users/foo/services/org-apache-slider//components/container-1452045276360-0005-01-04,
> I don't see the host:port info. It only shows
> {
> "type" : "JSONServiceRecord",
> "description" : "user1",
> "external" : [ ],
> "internal" : [ ],
> "yarn:id" : "container-1452045276360-0005-01-04",
> "yarn:persistence" : "container"
> }
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (SLIDER-1064) Component level export host:port info does not appears in ZK
[
https://issues.apache.org/jira/browse/SLIDER-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106160#comment-15106160
]
Gour Saha commented on SLIDER-1064:
---
Absolutely. I was just trying to say why we did not do it and some of the
things we have to keep in mind to design it right. Maybe this bug deserves to
be changed to an improvement right away.
> Component level export host:port info does not appears in ZK
>
>
> Key: SLIDER-1064
> URL: https://issues.apache.org/jira/browse/SLIDER-1064
> Project: Slider
> Issue Type: Bug
> Components: core, registry
>Affects Versions: Slider 0.80
>Reporter: Manoj Samel
> Attachments: manoj_appConfig.json, manoj_metainfo.xml,
> manoj_outputs.txt, manoj_resources.json
>
>
> Slider 0.80 with secured cluster. Registry is enabled *** without *** security
> Export is configured as follows
> 1. No application level export
> 2. Component level port allocated per container. In appConfig.json, ***
> "global" *** section
> "site.global.user1.http_port": "${user1.ALLOCATED_PORT}{PER_CONTAINER}",
> 3. Each component exports its own host/port (slider allocated). metainfo.xml
> {code:xml}
>
>
> user1
> MASTER
>
>
>my_info
>${THIS_HOST}:${user1.http_port}
>
>
>
> scripts/memcached.py
> PYTHON
>
>
> {code}
> At runtime,
> in http://am-host:1025/ws/v1/slider/publisher/slider/componentinstancedata,
> the host:port info can be seen as expected
> {"description":"ComponentInstanceData","updated":0,"entries":{"container_1452045276360_0005_01_04.my_info":"host1:33786",
>
> However, when I look at ZK data,
> get
> /registry/users/foo/services/org-apache-slider//components/container-1452045276360-0005-01-04,
> I don't see the host:port info. It only shows
> {
> "type" : "JSONServiceRecord",
> "description" : "user1",
> "external" : [ ],
> "internal" : [ ],
> "yarn:id" : "container-1452045276360-0005-01-04",
> "yarn:persistence" : "container"
> }
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (SLIDER-1064) Component level export host:port info does not appears in ZK
[
https://issues.apache.org/jira/browse/SLIDER-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105878#comment-15105878
]
Gour Saha commented on SLIDER-1064:
---
As far as I remember it was internally not added to ZK to keep the amount of
data minimal. This would have to be converted to an improvement to get this
done. But we have to be careful because components can choose to store large
amounts of data and if there are 100s or 1000s of component instances for an
app, we might be in trouble.
> Component level export host:port info does not appears in ZK
>
>
> Key: SLIDER-1064
> URL: https://issues.apache.org/jira/browse/SLIDER-1064
> Project: Slider
> Issue Type: Bug
> Components: core, registry
>Affects Versions: Slider 0.80
>Reporter: Manoj Samel
> Attachments: manoj_appConfig.json, manoj_metainfo.xml,
> manoj_outputs.txt, manoj_resources.json
>
>
> Slider 0.80 with secured cluster. Registry is enabled *** without *** security
> Export is configured as follows
> 1. No application level export
> 2. Component level port allocated per container. In appConfig.json, ***
> "global" *** section
> "site.global.user1.http_port": "${user1.ALLOCATED_PORT}{PER_CONTAINER}",
> 3. Each component exports its own host/port (slider allocated). metainfo.xml
> {code:xml}
>
>
> user1
> MASTER
>
>
>my_info
>${THIS_HOST}:${user1.http_port}
>
>
>
> scripts/memcached.py
> PYTHON
>
>
> {code}
> At runtime,
> in http://am-host:1025/ws/v1/slider/publisher/slider/componentinstancedata,
> the host:port info can be seen as expected
> {"description":"ComponentInstanceData","updated":0,"entries":{"container_1452045276360_0005_01_04.my_info":"host1:33786",
>
> However, when I look at ZK data,
> get
> /registry/users/foo/services/org-apache-slider//components/container-1452045276360-0005-01-04,
> I don't see the host:port info. It only shows
> {
> "type" : "JSONServiceRecord",
> "description" : "user1",
> "external" : [ ],
> "internal" : [ ],
> "yarn:id" : "container-1452045276360-0005-01-04",
> "yarn:persistence" : "container"
> }
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
