Re: [alto] ALTO Draft ReCharter WG review - extensible set of policy attributes(Internet mail)

2021-03-12 Thread Randriamasy, Sabine (Nokia - FR/Paris-Saclay)
Hello Chunchan,

Thanks for the clarification. If I understand well:
- the cloud gaming server (CGS) needs notifications on QoS CHANGE information. 
This change would be conveyed by an ALTO Server that abstracts NEF information 
to the ALTO Client in the CGS.
- only QoS CHANGES upon e.g. exceeding some hysteresis threshold are useful 
because Continuous QoS information is needless and causes signaling overhead. 
These changes should be reported to the CGS immediately. To this end, ALTO 
extended pub/sub is needed.
- regarding the pace of the notification, I would have a question: Your e-mail 
says “the cloud gaming server does need the real-time QUICK QOS CHANGE 
information” and later specifies “Quick QoS Change notification should not be 
too frequent, the QUICK QoS change notification should be minutes level”.
So what frequency does the term “real-time” in the 1rst sentence cover? Maybe I 
missed something. Definitely minute-level notification is achievable, given the 
limited size of the topology covered by ALTO in this case.

Another question:
- the number of possible QoS values Qi are quite limited and this “volatile” 
and light information would be conveyed with a given channel, say the channel 
“Ve” mentioned earlier by Richard.
- The longer term costs and properties reflecting QoS impacting KPIs such as 
latency L and throughput T would then be conveyed via ALTO channel “Vs” in an 
asynchronous way
-  would the values of these costs and properties be made dependent on the 
values of Qi?

Thanks,
Sabine



From: chunshxiong(熊春山) 
Sent: Friday, March 12, 2021 7:38 AM
To: Y. Richard Yang ; Randriamasy, Sabine (Nokia - 
FR/Paris-Saclay) 
Cc: alto-cha...@ietf.org; alto-...@ietf.org; Qin Wu ; IETF 
ALTO 
Subject: RE: [alto] ALTO Draft ReCharter WG review - extensible set of policy 
attributes(Internet mail)

Hello all,

@Randriamasy, Sabine (Nokia - 
FR/Paris-Saclay)<mailto:sabine.randriam...@nokia-bell-labs.com>,  You say “An 
ALTO Server cannot provide real-time information".
I almost agree with your point.

But I want the ALTO Server to support very quick notification information to 
the ALTO Client, if there is a quick change as provided in my other email.

I think one goal of ALTO Server is not to  provide very frequent notification 
to the ALTO Client, but If there is some quick or big change, the ALTO Server 
needs very quickly notify the ALTO Client, just this, not repeated and 
continuous notify. I think this quick notification is very helpful for the 
cloud gaming server to adaptive change the coding scheme. But the cloud gaming 
does not need the ALTO server to repeated notify the current network bitrates. 
Cloud gaming server needs the change information not the status information. 
For the cloud gaming sever can “intelligently” detect the slow change 
information, but it is very hard for the gaming server to detect the quick 
change in short time (because there is buffer in the client and Server), in 
such case, if the ALTO server can provide such quick (QoS) change information 
to the cloud gaming server, the cloud gaming server can quickly change its 
coding scheme.

So, Yes, the cloud gaming server does NOT need the real-time QoS information, 
but the cloud gaming server does need the real-time QUICK QOS CHANGE 
information.

But, this Quick QoS change (e.g. Alternative QoS profile) is defined to trigger 
the cloud server to make some changes(e.g. encoding scheme change).  It should 
be avoid to define a  QUICK QOS change that does not trigger the cloud server 
to make any changes. So the real-time frequently reporting the current QOS to 
the cloud server is really not needed,  this repeated and continuous 
reporting/notification only creates a lot of message loads and no help for the 
cloud gaming server.

Also this Quick QoS Change notification should not be too frequent, the QUICK 
QoS change notification should be minutes level, i.e. one notification per one 
minute. In some cases, it is possible that the notification can be several 
notifications per one minutes, but the average rate should be less than one 
notification per one minute.


BRs,
Chunshan Xiong

From: alto mailto:alto-boun...@ietf.org>> On Behalf Of 
Y. Richard Yang
Sent: Friday, March 12, 2021 5:29 AM
To: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 
mailto:sabine.randriam...@nokia-bell-labs.com>>
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>; Qin Wu 
mailto:bill...@huawei.com>>; IETF ALTO 
mailto:alto@ietf.org>>
Subject: Re: [alto] ALTO Draft ReCharter WG review - extensible set of policy 
attributes(Internet mail)

Hi Sabine, Qin,

Good discussions.

I support the use cases of the design direction. One suggestion is to look at 
the design in a slightly abstract, general framework. In particular, the 
abstract framework looks like this to me:

- Ve: A set of "volatile" (ephemeral) variables; Ve tends to be

Re: [alto] ALTO Draft ReCharter WG review - extensible set of policy attributes

2021-03-12 Thread Randriamasy, Sabine (Nokia - FR/Paris-Saclay)
Hi Richard,

Thanks for your thoughts. This is definitely the path we want to take together 
with a flexible design to encode and represent information carried by Ve.
Meet you virtually at the ALTO session
Cheers,
Sabine

From: Y. Richard Yang 
Sent: Thursday, March 11, 2021 10:29 PM
To: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 

Cc: Qin Wu ; IETF ALTO ; 
alto-cha...@ietf.org; alto-...@ietf.org
Subject: Re: [alto] ALTO Draft ReCharter WG review - extensible set of policy 
attributes

Hi Sabine, Qin,

Good discussions.

I support the use cases of the design direction. One suggestion is to look at 
the design in a slightly abstract, general framework. In particular, the 
abstract framework looks like this to me:

- Ve: A set of "volatile" (ephemeral) variables; Ve tends to be small, 
fast-changing data;
- Vs: Another set of records that are stable and indexed by the ephemeral 
variables; Vs can be large, but stable data.

There are two channels from the network to the application:
- Channel 1 for Ve
- Channel 2 for Vs

This definitely is a generic framework supported by some existing use cases 
including what you presented.

In the general framework, Channel 1 can be ALTO or protocol specific. Since it 
is short and needs low latency, it is more likely to be protocol specific and 
embedded in some other protocol such as even data path protocols (5G, ECN bits 
in IP); channel 2 is ALTO.

A couple of points to be considered when conducting further design:
- One thing we learned from SSE is the consistency between these two channels 
(or more, as Ve can be carried by multiple channels, etc), and
- Document additional use cases beyond the demonstrated use cases.

Looking forward to talking to you (virtually) f2f tomorrow.

Richard

On Thu, Mar 11, 2021 at 5:01 AM Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 
mailto:sabine.randriam...@nokia-bell-labs.com>>
 wrote:
Hi Qin,

Please see inline,
Thanks
Sabine

From: Qin Wu mailto:bill...@huawei.com>>
Sent: Thursday, March 11, 2021 9:32 AM
To: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 
mailto:sabine.randriam...@nokia-bell-labs.com>>;
 IETF ALTO mailto:alto@ietf.org>>
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>
Subject: RE: ALTO Draft ReCharter WG review - extensible set of policy 
attributes

Hi, Sabine:
发件人: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 
[mailto:sabine.randriam...@nokia-bell-labs.com]
发送时间: 2021年3月11日 1:55
收件人: Qin Wu mailto:bill...@huawei.com>>; IETF ALTO 
mailto:alto@ietf.org>>
抄送: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>
主题: RE: ALTO Draft ReCharter WG review - extensible set of policy attributes

Hello ALTO WG,

Regarding the proposed work item on “Protocol extensions to support a richer 
and extensible set of policy attributes in ALTO information update request and 
response” (GPE for short) , I would like to add the following:

This work item can be useful, among others, to allow a UE getting cellular 
network KPIs from an ALTO Server, to figure out for example whether the cell is 
congested, or which cell to choose.

An ALTO Server cannot provide real-time information. With the proposed 
extensions, it can indicate a number of real-time network parameters against 
which ALTO cost values can be modulated.

[Qin]: Yes, the current ALTO server can only provide non-real time or near real 
time information, performance metrics work allows ALTO server expose 
performance data. If ALTO protocol is extended to support pub sub mechanism,
Providing real time information will not be an issue.

But I agree in many cases, providing real time information is not necessary, 
e.g., cloud gaming use case provided Tencent and china mobile, their case is 
different from your proposed case, they will use cloud gaming server as ALTO 
client to get needed information.
[ [SR] ] indeed, an ALTO client (AOC for short) can be beneficially integrated 
with a cloud gaming server (CGS for short) . In that case, the ALTO information 
provided by the ALTO Server (AOS for short) can be made aware of given specific 
parameters captured by the CGS at a different pace. This may speed up the 
process as well.

These parameters are received by UEs directly from the network and not from 
ALTO. The UE receives an array of ALTO cell KPI values that each depend on the 
value of a parameter. The UE can pick the  ALTO value corresponding to the 
value of the real-time parameter received from the network. Thus, the UE 
modulates the received ALTO values in real-time.

[Qin]: your case is UE centric solution, UE gets network KPI from ALTO server 
and get real time parameter from another data source in the Network, what is 
not clear is how real time parameter is correlated with Network KPI information 
within UE.
Also the interface between UE and RAN is not in the scope of ALTO work, I think.

Re: [alto] ALTO Draft ReCharter WG review - extensible set of policy attributes(Internet mail)

2021-03-11 Thread 熊春山
Hello all,

@Randriamasy, Sabine (Nokia - 
FR/Paris-Saclay)<mailto:sabine.randriam...@nokia-bell-labs.com>,  You say “An 
ALTO Server cannot provide real-time information".
I almost agree with your point.

But I want the ALTO Server to support very quick notification information to 
the ALTO Client, if there is a quick change as provided in my other email.

I think one goal of ALTO Server is not to  provide very frequent notification 
to the ALTO Client, but If there is some quick or big change, the ALTO Server 
needs very quickly notify the ALTO Client, just this, not repeated and 
continuous notify. I think this quick notification is very helpful for the 
cloud gaming server to adaptive change the coding scheme. But the cloud gaming 
does not need the ALTO server to repeated notify the current network bitrates. 
Cloud gaming server needs the change information not the status information. 
For the cloud gaming sever can “intelligently” detect the slow change 
information, but it is very hard for the gaming server to detect the quick 
change in short time (because there is buffer in the client and Server), in 
such case, if the ALTO server can provide such quick (QoS) change information 
to the cloud gaming server, the cloud gaming server can quickly change its 
coding scheme.

So, Yes, the cloud gaming server does NOT need the real-time QoS information, 
but the cloud gaming server does need the real-time QUICK QOS CHANGE 
information.

But, this Quick QoS change (e.g. Alternative QoS profile) is defined to trigger 
the cloud server to make some changes(e.g. encoding scheme change).  It should 
be avoid to define a  QUICK QOS change that does not trigger the cloud server 
to make any changes. So the real-time frequently reporting the current QOS to 
the cloud server is really not needed,  this repeated and continuous 
reporting/notification only creates a lot of message loads and no help for the 
cloud gaming server.

Also this Quick QoS Change notification should not be too frequent, the QUICK 
QoS change notification should be minutes level, i.e. one notification per one 
minute. In some cases, it is possible that the notification can be several 
notifications per one minutes, but the average rate should be less than one 
notification per one minute.


BRs,
Chunshan Xiong

From: alto  On Behalf Of Y. Richard Yang
Sent: Friday, March 12, 2021 5:29 AM
To: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 

Cc: alto-cha...@ietf.org; alto-...@ietf.org; Qin Wu ; IETF 
ALTO 
Subject: Re: [alto] ALTO Draft ReCharter WG review - extensible set of policy 
attributes(Internet mail)

Hi Sabine, Qin,

Good discussions.

I support the use cases of the design direction. One suggestion is to look at 
the design in a slightly abstract, general framework. In particular, the 
abstract framework looks like this to me:

- Ve: A set of "volatile" (ephemeral) variables; Ve tends to be small, 
fast-changing data;
- Vs: Another set of records that are stable and indexed by the ephemeral 
variables; Vs can be large, but stable data.

There are two channels from the network to the application:
- Channel 1 for Ve
- Channel 2 for Vs

This definitely is a generic framework supported by some existing use cases 
including what you presented.

In the general framework, Channel 1 can be ALTO or protocol specific. Since it 
is short and needs low latency, it is more likely to be protocol specific and 
embedded in some other protocol such as even data path protocols (5G, ECN bits 
in IP); channel 2 is ALTO.

A couple of points to be considered when conducting further design:
- One thing we learned from SSE is the consistency between these two channels 
(or more, as Ve can be carried by multiple channels, etc), and
- Document additional use cases beyond the demonstrated use cases.

Looking forward to talking to you (virtually) f2f tomorrow.

Richard

On Thu, Mar 11, 2021 at 5:01 AM Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 
mailto:sabine.randriam...@nokia-bell-labs.com>>
 wrote:
Hi Qin,

Please see inline,
Thanks
Sabine

From: Qin Wu mailto:bill...@huawei.com>>
Sent: Thursday, March 11, 2021 9:32 AM
To: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 
mailto:sabine.randriam...@nokia-bell-labs.com>>;
 IETF ALTO mailto:alto@ietf.org>>
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>
Subject: RE: ALTO Draft ReCharter WG review - extensible set of policy 
attributes

Hi, Sabine:
发件人: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 
[mailto:sabine.randriam...@nokia-bell-labs.com]
发送时间: 2021年3月11日 1:55
收件人: Qin Wu mailto:bill...@huawei.com>>; IETF ALTO 
mailto:alto@ietf.org>>
抄送: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>
主题: RE: ALTO Draft ReCharter WG review - extensible set of policy attributes

Hello ALTO WG,

Regarding the proposed work item on “Protoco

Re: [alto] ALTO Draft ReCharter WG review

2021-03-11 Thread 刘鹏


Hi Richard,




Thanks for sharing your idea! I think it's necessary to considering the 
security and privacy issues.




The framework of differential privacy can be a potential choice to protect 
individual or detail privacy of network without encryption which might influent 
the efficiency of information exchange, while it need to consider the data 
availability.




Regards,

Peng








Peng Liu | 刘鹏

China Mobile | 移动研究院

mobile phone:13810146105

email:  liupeng...@chinamobile.com

 



发件人: Y. Richard Yang

时间: 2021/03/10(星期三)10:32

收件人: Qiao Xiang;

抄送人: 刘鹏;IETF ALTO;Qin Wu;

主题: Re: [alto] ALTO Draft ReCharter WG review



Hi Peng, all,




Thanks a lot for the excellent discussions. It is clear that multi-domain is a 
major issue to resolve, as multidomain is the general deployment setting where 
resource consumers and providers are in the general case deployed in multiple 
networks. 




To proceed with the recharter discussion, I suggest that we conduct basic 
security and privacy analysis to see if we are ready for recharter; that is, we 
have a basic understanding of related issues so that it is ready for design, 
not still in the early research stage. For security, we can start with focusing 
on the basic requirements including authenticity, integrity, and 
confidentiality. For privacy, we can start with a framework such as 
differential privacy analysis.




To me, a basic model of a multi-domain alto information service is the 
following:

- a set of (potential) resource providers s1, s2, ..., 


- a set of (potential) resource consumers c1, c2, c3, ...






The foundation of the alto service is to provide the costs of the paths {si -> 
cj}; I always think of alto as an extension of DNS, which is mainly for 
endpoints in a graph and alto is paths. In a single domain setting, all 
entities, {si}, {cj}, {si->cj} are within a single domain and hence the main 
security/privacy issue is the security/privacy issue of between the single alto 
server representing the single domain and the alto client. For security, the 
domain can leverage any one of the security systems (e.g., using public keys to 
bootstrap the system); for privacy, the application (client) and the network 
(server) are two parties, and they can agree on an acceptable privacy model.




Now, in a multi-domain setting, each entity may have a different domain (or a 
sequence of domains for a path). Now, both ALTO client and ALTO server will 
have additional security and privacy issues. 

- For the ALTO client, the information can now come from multiple networks; 
assume the information info(n1, n2, ...)  is computed from those from multiple 
networks n1, n2, ... Then the basic security issue is how the client can verify 
the authenticity of the information. 

- For an ALTO server, the server may not have a direct trust relationship with 
the client; for example, when the ALTO server is only in the chain of a path, 
not the client-facing server. Hence, the server may not have a relationship to 
specify the privacy requirement.




The preceding are challenging issues. It is clear that security and privacy 
issues depend on the specific design. Hence, we target a "lower-bound" 
analysis, by considering a base design that can address main security and 
privacy issues. The WG can decide on the specific design which is better than 
the basic design.








During the design meetings, we have considered the following "base-line" design 
for a "lower-bound":

-  We provide a basic path discovery service to discover the path segments. We 
can use BGP security to bootstrap the security of the discovered paths. 

- We build verifiable aggregation (i.e., the preceding info function) so that 
the information can then be individually verified. 

- The remaining issue is how each server can control the privacy of its 
information, as it may not have a direct relationship with the client. For 
this, we suggest to start with basic public information, and gradually build 
trust.




The preceding is high level. A first task, if multidomain is charted, is to 
write down the details, beyond the existing drafts. I do agree that this 
analysis and requirements is a good starting, based on the specified use cases.




We can go over the details in our design meeting in the next few following 
weeks.




Richard




 













On Tue, Mar 2, 2021 at 11:18 AM Qiao Xiang  wrote:




Hi Peng, Qin and Richard,




Very good discussion! Richard and I have been working with folks from CMS and 
ESNet (a large global multi-domain science network) to design network 
information exposure abstractions and mechanisms in multi-domain networks, with 
privacy requirements considered. The basic idea stems from the ALTO path-vector 
extension but goes beyond to take privacy into consideration. The following are 
some pointers.


[1] "Toward Fine-Grained, Privacy-Preserving, Efficient Multi-Domain Network 
Reso

Re: [alto] ALTO Draft ReCharter WG review - extensible set of policy attributes

2021-03-11 Thread Y. Richard Yang
rated in the slides presented at the previous IETF
> 109 ALTO WG meeting, see (1), slide 4. A preliminary design with example
> IRD and ALTO request and response can be found in slides 7 and 8.
>
>
>
> Any feedback is more than welcome,
>
> (1)
> https://datatracker.ietf.org/meeting/109/materials/slides-109-alto-proposed-recharter-item-general-alto-protocol-extensions-00
>
> Thanks,
>
> Sabine
>
>
>
>
>
>
>
> *From:* alto  *On Behalf Of *Qin Wu
> *Sent:* Monday, February 22, 2021 2:51 PM
> *To:* IETF ALTO 
> *Cc:* alto-cha...@ietf.org; alto-...@ietf.org
> *Subject:* [alto] ALTO Draft ReCharter WG review
>
>
>
> Hi, :
>
> We have requested one hour session for ALTO WG meeting in the upcoming
> IETF 110, which is arranged on Friday, March 12, 14:30-15:30(UTC).
>
> The goal is to boil down ALTO recharter and have consensus on charter
> contents in IETF 110.
>
> To get this goal, an updated inline draft charter text for ALTO has just
> been posted to this list,
>
> This charter has received a couple of rounds of informal review from WG 
> members, chairs and our Ads from brief to deep thorough, 5 new chartered 
> items have been listed.
>
> We would like to solicit feedback on these new chartered items and your
> use case, deployment, idea corresponding to these new chartered items.
>
> Sharing your past deployment story will also be appreciated.
>
>
>
>
> 
>
> The ALTO working group was established in 2008 to devise a
> request/response protocol to allow a host to benefit from a server that is
> more cognizant of the network infrastructure than the host is.
>
>
>
> The working group has developed an HTTP-based protocol and recent work has
> reported large-scale deployment of ALTO based solutions supporting
> applications such as content distribution networks (CDN).
>
>
>
> ALTO is now proposed as a component for cloud-based interactive
> applications, large-scale data analytics, multi-cloud SD-WAN deployment,
> and distributed
>
> computing. In all these cases, exposing network information such as
> abstract topologies and network function deployment location helps
> applications.
>
>
>
> To support these emerging uses, extensions are needed, and additional
> functional and architectural features need to be considered as follows:
>
>
>
> o Protocol extensions to support a richer and extensible set of policy
> attributes in ALTO information update request and response. Such policy
> attributes may indicate information dependency (e.g., ALTO path-cost/QoS
> properties with dependency on real-time network  indications), optimization
> criteria (e.g., lowest latency/throughput network performance objective),
> and constraints (e.g., relaxation bound of optimization criteria, domain or
> network node to be traversed, diversity and redundancy of paths).
>
>
>
> o Protocol extensions for facilitating operational automation tasks and
> improving transport efficiency. In particular, extensions to provide
> "pub/sub" mechanisms to allow the client to request and receive a diverse
> types (such as event-triggered/sporadic, continuous), continuous,
> customized feed of publisher-generated information. Efforts developed in
> other working groups such as MQTT Publish / Subscribe Architecture, WebSub,
> Subscription to YANG Notifications will be considered, and issues such as
> scalability (e.g., using unicast or broadcast/multicast, and periodicity of
> object updates) should be considered.
>
>
>
> o The working group will investigate the configuration, management, and
> operation of ALTO systems and may develop suitable data models.
>
>
>
> o Extensions to ALTO services to support multi-domain settings. ALTO is
> currently specified for a single ALTO server in a single administrative
> domain, but a network may consist of
>
> multiple domains and the potential information sources may not be limited
> to a certain domain. The working group will investigate extending the ALTO
> framework to (1) specify multi-ALTO-server protocol flow and usage
> guidelines when an ALTO service involves network paths spanning multiple
> domains with multiple ALTO servers, and (2) extend or introduce ALTO
>
> services allowing east-west interfaces for multiple ALTO server
> integration and collaboration. The specifications and extensions should use
> existing services whenever possible. The specifications and extensions
> should consider realistic complexities including incremental deployment,
> dynamicity, and security issues such as access control, authorization
> (e.g., an ALTO s

Re: [alto] ALTO Draft ReCharter WG review - extensible set of policy attributes

2021-03-11 Thread Randriamasy, Sabine (Nokia - FR/Paris-Saclay)
TO information and passes the relevant costs to the 
application client. Again this agent is out of scope of ALTO.

This use-case is illustrated in the slides presented at the previous IETF 109 
ALTO WG meeting, see (1), slide 4. A preliminary design with example IRD and 
ALTO request and response can be found in slides 7 and 8.

Any feedback is more than welcome,
(1)  
https://datatracker.ietf.org/meeting/109/materials/slides-109-alto-proposed-recharter-item-general-alto-protocol-extensions-00
Thanks,
Sabine



From: alto mailto:alto-boun...@ietf.org>> On Behalf Of 
Qin Wu
Sent: Monday, February 22, 2021 2:51 PM
To: IETF ALTO mailto:alto@ietf.org>>
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>
Subject: [alto] ALTO Draft ReCharter WG review

Hi, :
We have requested one hour session for ALTO WG meeting in the upcoming IETF 
110, which is arranged on Friday, March 12, 14:30-15:30(UTC).
The goal is to boil down ALTO recharter and have consensus on charter contents 
in IETF 110.
To get this goal, an updated inline draft charter text for ALTO has just been 
posted to this list,

This charter has received a couple of rounds of informal review from WG 
members, chairs and our Ads from brief to deep thorough, 5 new chartered items 
have been listed.
We would like to solicit feedback on these new chartered items and your use 
case, deployment, idea corresponding to these new chartered items.
Sharing your past deployment story will also be appreciated.


The ALTO working group was established in 2008 to devise a request/response 
protocol to allow a host to benefit from a server that is more cognizant of the 
network infrastructure than the host is.

The working group has developed an HTTP-based protocol and recent work has 
reported large-scale deployment of ALTO based solutions supporting applications 
such as content distribution networks (CDN).

ALTO is now proposed as a component for cloud-based interactive applications, 
large-scale data analytics, multi-cloud SD-WAN deployment, and distributed
computing. In all these cases, exposing network information such as abstract 
topologies and network function deployment location helps applications.

To support these emerging uses, extensions are needed, and additional 
functional and architectural features need to be considered as follows:

o Protocol extensions to support a richer and extensible set of policy 
attributes in ALTO information update request and response. Such policy 
attributes may indicate information dependency (e.g., ALTO path-cost/QoS 
properties with dependency on real-time network  indications), optimization 
criteria (e.g., lowest latency/throughput network performance objective), and 
constraints (e.g., relaxation bound of optimization criteria, domain or network 
node to be traversed, diversity and redundancy of paths).

o Protocol extensions for facilitating operational automation tasks and 
improving transport efficiency. In particular, extensions to provide "pub/sub" 
mechanisms to allow the client to request and receive a diverse types (such as 
event-triggered/sporadic, continuous), continuous, customized feed of 
publisher-generated information. Efforts developed in other working groups such 
as MQTT Publish / Subscribe Architecture, WebSub, Subscription to YANG 
Notifications will be considered, and issues such as scalability (e.g., using 
unicast or broadcast/multicast, and periodicity of object updates) should be 
considered.

o The working group will investigate the configuration, management, and 
operation of ALTO systems and may develop suitable data models.

o Extensions to ALTO services to support multi-domain settings. ALTO is 
currently specified for a single ALTO server in a single administrative domain, 
but a network may consist of
multiple domains and the potential information sources may not be limited to a 
certain domain. The working group will investigate extending the ALTO framework 
to (1) specify multi-ALTO-server protocol flow and usage guidelines when an 
ALTO service involves network paths spanning multiple domains with multiple 
ALTO servers, and (2) extend or introduce ALTO
services allowing east-west interfaces for multiple ALTO server integration and 
collaboration. The specifications and extensions should use existing services 
whenever possible. The specifications and extensions should consider realistic 
complexities including incremental deployment, dynamicity, and security issues 
such as access control, authorization (e.g., an ALTO server provides 
information for a network that the server has no authorization), and privacy 
protection in multi-domain settings.

o The working group will update RFC 7971 to provide operational considerations 
for recent protocol extensions (e.g., cost calendar, unified properties, and

Re: [alto] ALTO Draft ReCharter WG review - extensible set of policy attributes

2021-03-11 Thread Qin Wu
Sabine:
Thanks for your clarification, I want to make sure the ALTO clients can express 
to the ALTO sever that they want real time data or not real time data. Also 
Alto server can express that the returned  information is real time or not real 
time in the response message to the ALTO clients.
Are these covered by your case as well?

_Qin
发件人: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 
[mailto:sabine.randriam...@nokia-bell-labs.com]
发送时间: 2021年3月11日 18:01
收件人: Qin Wu ; IETF ALTO 
抄送: alto-cha...@ietf.org; alto-...@ietf.org
主题: RE: ALTO Draft ReCharter WG review - extensible set of policy attributes

Hi Qin,

Please see inline,
Thanks
Sabine

From: Qin Wu mailto:bill...@huawei.com>>
Sent: Thursday, March 11, 2021 9:32 AM
To: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 
mailto:sabine.randriam...@nokia-bell-labs.com>>;
 IETF ALTO mailto:alto@ietf.org>>
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>
Subject: RE: ALTO Draft ReCharter WG review - extensible set of policy 
attributes

Hi, Sabine:
发件人: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 
[mailto:sabine.randriam...@nokia-bell-labs.com]
发送时间: 2021年3月11日 1:55
收件人: Qin Wu mailto:bill...@huawei.com>>; IETF ALTO 
mailto:alto@ietf.org>>
抄送: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>
主题: RE: ALTO Draft ReCharter WG review - extensible set of policy attributes

Hello ALTO WG,

Regarding the proposed work item on “Protocol extensions to support a richer 
and extensible set of policy attributes in ALTO information update request and 
response” (GPE for short) , I would like to add the following:

This work item can be useful, among others, to allow a UE getting cellular 
network KPIs from an ALTO Server, to figure out for example whether the cell is 
congested, or which cell to choose.

An ALTO Server cannot provide real-time information. With the proposed 
extensions, it can indicate a number of real-time network parameters against 
which ALTO cost values can be modulated.

[Qin]: Yes, the current ALTO server can only provide non-real time or near real 
time information, performance metrics work allows ALTO server expose 
performance data. If ALTO protocol is extended to support pub sub mechanism,
Providing real time information will not be an issue.

But I agree in many cases, providing real time information is not necessary, 
e.g., cloud gaming use case provided Tencent and china mobile, their case is 
different from your proposed case, they will use cloud gaming server as ALTO 
client to get needed information.
[ [SR] ] indeed, an ALTO client (AOC for short) can be beneficially integrated 
with a cloud gaming server (CGS for short) . In that case, the ALTO information 
provided by the ALTO Server (AOS for short) can be made aware of given specific 
parameters captured by the CGS at a different pace. This may speed up the 
process as well.

These parameters are received by UEs directly from the network and not from 
ALTO. The UE receives an array of ALTO cell KPI values that each depend on the 
value of a parameter. The UE can pick the  ALTO value corresponding to the 
value of the real-time parameter received from the network. Thus, the UE 
modulates the received ALTO values in real-time.

[Qin]: your case is UE centric solution, UE gets network KPI from ALTO server 
and get real time parameter from another data source in the Network, what is 
not clear is how real time parameter is correlated with Network KPI information 
within UE.
Also the interface between UE and RAN is not in the scope of ALTO work, I think.
[ [SR] ] definitely, the scope of the extension restricts to exchanges between 
AOS and AOC. The UE may have some agent that gathers and relates the RAN 
indicators and the ALTO information and passes the relevant costs to the 
application client. Again this agent is out of scope of ALTO.

This use-case is illustrated in the slides presented at the previous IETF 109 
ALTO WG meeting, see (1), slide 4. A preliminary design with example IRD and 
ALTO request and response can be found in slides 7 and 8.

Any feedback is more than welcome,
(1)  
https://datatracker.ietf.org/meeting/109/materials/slides-109-alto-proposed-recharter-item-general-alto-protocol-extensions-00
Thanks,
Sabine



From: alto mailto:alto-boun...@ietf.org>> On Behalf Of 
Qin Wu
Sent: Monday, February 22, 2021 2:51 PM
To: IETF ALTO mailto:alto@ietf.org>>
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>
Subject: [alto] ALTO Draft ReCharter WG review

Hi, :
We have requested one hour session for ALTO WG meeting in the upcoming IETF 
110, which is arranged on Friday, March 12, 14:30-15:30(UTC).
The goal is to boil down ALTO recharter and have consensus on charter contents 
in IETF 110.
To get this goal, an updated inline draft charter text fo

Re: [alto] ALTO Draft ReCharter WG review - extensible set of policy attributes

2021-03-11 Thread Randriamasy, Sabine (Nokia - FR/Paris-Saclay)
Hi Qin,

Please see inline,
Thanks
Sabine

From: Qin Wu 
Sent: Thursday, March 11, 2021 9:32 AM
To: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 
; IETF ALTO 
Cc: alto-cha...@ietf.org; alto-...@ietf.org
Subject: RE: ALTO Draft ReCharter WG review - extensible set of policy 
attributes

Hi, Sabine:
发件人: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 
[mailto:sabine.randriam...@nokia-bell-labs.com]
发送时间: 2021年3月11日 1:55
收件人: Qin Wu mailto:bill...@huawei.com>>; IETF ALTO 
mailto:alto@ietf.org>>
抄送: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>
主题: RE: ALTO Draft ReCharter WG review - extensible set of policy attributes

Hello ALTO WG,

Regarding the proposed work item on “Protocol extensions to support a richer 
and extensible set of policy attributes in ALTO information update request and 
response” (GPE for short) , I would like to add the following:

This work item can be useful, among others, to allow a UE getting cellular 
network KPIs from an ALTO Server, to figure out for example whether the cell is 
congested, or which cell to choose.

An ALTO Server cannot provide real-time information. With the proposed 
extensions, it can indicate a number of real-time network parameters against 
which ALTO cost values can be modulated.

[Qin]: Yes, the current ALTO server can only provide non-real time or near real 
time information, performance metrics work allows ALTO server expose 
performance data. If ALTO protocol is extended to support pub sub mechanism,
Providing real time information will not be an issue.

But I agree in many cases, providing real time information is not necessary, 
e.g., cloud gaming use case provided Tencent and china mobile, their case is 
different from your proposed case, they will use cloud gaming server as ALTO 
client to get needed information.
[ [SR] ] indeed, an ALTO client (AOC for short) can be beneficially integrated 
with a cloud gaming server (CGS for short) . In that case, the ALTO information 
provided by the ALTO Server (AOS for short) can be made aware of given specific 
parameters captured by the CGS at a different pace. This may speed up the 
process as well.

These parameters are received by UEs directly from the network and not from 
ALTO. The UE receives an array of ALTO cell KPI values that each depend on the 
value of a parameter. The UE can pick the  ALTO value corresponding to the 
value of the real-time parameter received from the network. Thus, the UE 
modulates the received ALTO values in real-time.

[Qin]: your case is UE centric solution, UE gets network KPI from ALTO server 
and get real time parameter from another data source in the Network, what is 
not clear is how real time parameter is correlated with Network KPI information 
within UE.
Also the interface between UE and RAN is not in the scope of ALTO work, I think.
[ [SR] ] definitely, the scope of the extension restricts to exchanges between 
AOS and AOC. The UE may have some agent that gathers and relates the RAN 
indicators and the ALTO information and passes the relevant costs to the 
application client. Again this agent is out of scope of ALTO.

This use-case is illustrated in the slides presented at the previous IETF 109 
ALTO WG meeting, see (1), slide 4. A preliminary design with example IRD and 
ALTO request and response can be found in slides 7 and 8.

Any feedback is more than welcome,
(1)  
https://datatracker.ietf.org/meeting/109/materials/slides-109-alto-proposed-recharter-item-general-alto-protocol-extensions-00
Thanks,
Sabine



From: alto mailto:alto-boun...@ietf.org>> On Behalf Of 
Qin Wu
Sent: Monday, February 22, 2021 2:51 PM
To: IETF ALTO mailto:alto@ietf.org>>
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>
Subject: [alto] ALTO Draft ReCharter WG review

Hi, :
We have requested one hour session for ALTO WG meeting in the upcoming IETF 
110, which is arranged on Friday, March 12, 14:30-15:30(UTC).
The goal is to boil down ALTO recharter and have consensus on charter contents 
in IETF 110.
To get this goal, an updated inline draft charter text for ALTO has just been 
posted to this list,

This charter has received a couple of rounds of informal review from WG 
members, chairs and our Ads from brief to deep thorough, 5 new chartered items 
have been listed.
We would like to solicit feedback on these new chartered items and your use 
case, deployment, idea corresponding to these new chartered items.
Sharing your past deployment story will also be appreciated.


The ALTO working group was established in 2008 to devise a request/response 
protocol to allow a host to benefit from a server that is more cognizant of the 
network infrastructure than the host is.

The working group has developed an HTTP-based protocol and recent work has 
reporte

Re: [alto] ALTO Draft ReCharter WG review - extensible set of policy attributes

2021-03-11 Thread Qin Wu
Hi, Sabine:
发件人: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) 
[mailto:sabine.randriam...@nokia-bell-labs.com]
发送时间: 2021年3月11日 1:55
收件人: Qin Wu ; IETF ALTO 
抄送: alto-cha...@ietf.org; alto-...@ietf.org
主题: RE: ALTO Draft ReCharter WG review - extensible set of policy attributes

Hello ALTO WG,

Regarding the proposed work item on “Protocol extensions to support a richer 
and extensible set of policy attributes in ALTO information update request and 
response” (GPE for short) , I would like to add the following:

This work item can be useful, among others, to allow a UE getting cellular 
network KPIs from an ALTO Server, to figure out for example whether the cell is 
congested, or which cell to choose.

An ALTO Server cannot provide real-time information. With the proposed 
extensions, it can indicate a number of real-time network parameters against 
which ALTO cost values can be modulated.

[Qin]: Yes, the current ALTO server can only provide non-real time or near real 
time information, performance metrics work allows ALTO server expose 
performance data. If ALTO protocol is extended to support pub sub mechanism,
Providing real time information will not be an issue.

But I agree in many cases, providing real time information is not necessary, 
e.g., cloud gaming use case provided Tencent and china mobile, their case is 
different from your proposed case, they will use cloud gaming server as ALTO 
client to get needed information.

These parameters are received by UEs directly from the network and not from 
ALTO. The UE receives an array of ALTO cell KPI values that each depend on the 
value of a parameter. The UE can pick the  ALTO value corresponding to the 
value of the real-time parameter received from the network. Thus, the UE 
modulates the received ALTO values in real-time.

[Qin]: your case is UE centric solution, UE gets network KPI from ALTO server 
and get real time parameter from another data source in the Network, what is 
not clear is how real time parameter is correlated with Network KPI information 
within UE.
Also the interface between UE and RAN is not in the scope of ALTO work, I think.

This use-case is illustrated in the slides presented at the previous IETF 109 
ALTO WG meeting, see (1), slide 4. A preliminary design with example IRD and 
ALTO request and response can be found in slides 7 and 8.

Any feedback is more than welcome,
(1)  
https://datatracker.ietf.org/meeting/109/materials/slides-109-alto-proposed-recharter-item-general-alto-protocol-extensions-00
Thanks,
Sabine



From: alto mailto:alto-boun...@ietf.org>> On Behalf Of 
Qin Wu
Sent: Monday, February 22, 2021 2:51 PM
To: IETF ALTO mailto:alto@ietf.org>>
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>
Subject: [alto] ALTO Draft ReCharter WG review

Hi, :
We have requested one hour session for ALTO WG meeting in the upcoming IETF 
110, which is arranged on Friday, March 12, 14:30-15:30(UTC).
The goal is to boil down ALTO recharter and have consensus on charter contents 
in IETF 110.
To get this goal, an updated inline draft charter text for ALTO has just been 
posted to this list,

This charter has received a couple of rounds of informal review from WG 
members, chairs and our Ads from brief to deep thorough, 5 new chartered items 
have been listed.
We would like to solicit feedback on these new chartered items and your use 
case, deployment, idea corresponding to these new chartered items.
Sharing your past deployment story will also be appreciated.


The ALTO working group was established in 2008 to devise a request/response 
protocol to allow a host to benefit from a server that is more cognizant of the 
network infrastructure than the host is.

The working group has developed an HTTP-based protocol and recent work has 
reported large-scale deployment of ALTO based solutions supporting applications 
such as content distribution networks (CDN).

ALTO is now proposed as a component for cloud-based interactive applications, 
large-scale data analytics, multi-cloud SD-WAN deployment, and distributed
computing. In all these cases, exposing network information such as abstract 
topologies and network function deployment location helps applications.

To support these emerging uses, extensions are needed, and additional 
functional and architectural features need to be considered as follows:

o Protocol extensions to support a richer and extensible set of policy 
attributes in ALTO information update request and response. Such policy 
attributes may indicate information dependency (e.g., ALTO path-cost/QoS 
properties with dependency on real-time network  indications), optimization 
criteria (e.g., lowest latency/throughput network performance objective), and 
constraints (e.g., relaxation bound of optimization criteria, domain or network 
node to be traversed, 

Re: [alto] ALTO Draft ReCharter WG review - extensible set of policy attributes

2021-03-10 Thread Randriamasy, Sabine (Nokia - FR/Paris-Saclay)
Hello ALTO WG,

Regarding the proposed work item on "Protocol extensions to support a richer 
and extensible set of policy attributes in ALTO information update request and 
response" (GPE for short) , I would like to add the following:

This work item can be useful, among others, to allow a UE getting cellular 
network KPIs from an ALTO Server, to figure out for example whether the cell is 
congested, or which cell to choose.

An ALTO Server cannot provide real-time information. With the proposed 
extensions, it can indicate a number of real-time network parameters against 
which ALTO cost values can be modulated.

These parameters are received by UEs directly from the network and not from 
ALTO. The UE receives an array of ALTO cell KPI values that each depend on the 
value of a parameter. The UE can pick the  ALTO value corresponding to the 
value of the real-time parameter received from the network. Thus, the UE 
modulates the received ALTO values in real-time.

This use-case is illustrated in the slides presented at the previous IETF 109 
ALTO WG meeting, see (1), slide 4. A preliminary design with example IRD and 
ALTO request and response can be found in slides 7 and 8.

Any feedback is more than welcome,
(1)  
https://datatracker.ietf.org/meeting/109/materials/slides-109-alto-proposed-recharter-item-general-alto-protocol-extensions-00
Thanks,
Sabine



From: alto  On Behalf Of Qin Wu
Sent: Monday, February 22, 2021 2:51 PM
To: IETF ALTO 
Cc: alto-cha...@ietf.org; alto-...@ietf.org
Subject: [alto] ALTO Draft ReCharter WG review

Hi, :
We have requested one hour session for ALTO WG meeting in the upcoming IETF 
110, which is arranged on Friday, March 12, 14:30-15:30(UTC).
The goal is to boil down ALTO recharter and have consensus on charter contents 
in IETF 110.
To get this goal, an updated inline draft charter text for ALTO has just been 
posted to this list,

This charter has received a couple of rounds of informal review from WG 
members, chairs and our Ads from brief to deep thorough, 5 new chartered items 
have been listed.
We would like to solicit feedback on these new chartered items and your use 
case, deployment, idea corresponding to these new chartered items.
Sharing your past deployment story will also be appreciated.


The ALTO working group was established in 2008 to devise a request/response 
protocol to allow a host to benefit from a server that is more cognizant of the 
network infrastructure than the host is.

The working group has developed an HTTP-based protocol and recent work has 
reported large-scale deployment of ALTO based solutions supporting applications 
such as content distribution networks (CDN).

ALTO is now proposed as a component for cloud-based interactive applications, 
large-scale data analytics, multi-cloud SD-WAN deployment, and distributed
computing. In all these cases, exposing network information such as abstract 
topologies and network function deployment location helps applications.

To support these emerging uses, extensions are needed, and additional 
functional and architectural features need to be considered as follows:

o Protocol extensions to support a richer and extensible set of policy 
attributes in ALTO information update request and response. Such policy 
attributes may indicate information dependency (e.g., ALTO path-cost/QoS 
properties with dependency on real-time network  indications), optimization 
criteria (e.g., lowest latency/throughput network performance objective), and 
constraints (e.g., relaxation bound of optimization criteria, domain or network 
node to be traversed, diversity and redundancy of paths).

o Protocol extensions for facilitating operational automation tasks and 
improving transport efficiency. In particular, extensions to provide "pub/sub" 
mechanisms to allow the client to request and receive a diverse types (such as 
event-triggered/sporadic, continuous), continuous, customized feed of 
publisher-generated information. Efforts developed in other working groups such 
as MQTT Publish / Subscribe Architecture, WebSub, Subscription to YANG 
Notifications will be considered, and issues such as scalability (e.g., using 
unicast or broadcast/multicast, and periodicity of object updates) should be 
considered.

o The working group will investigate the configuration, management, and 
operation of ALTO systems and may develop suitable data models.

o Extensions to ALTO services to support multi-domain settings. ALTO is 
currently specified for a single ALTO server in a single administrative domain, 
but a network may consist of
multiple domains and the potential information sources may not be limited to a 
certain domain. The working group will investigate extending the ALTO framework 
to (1) specify multi-ALTO-server protocol flow and usage guidelines when an 
ALTO service involves network paths spann

Re: [alto] ALTO Draft ReCharter WG review

2021-03-10 Thread Qiao Xiang
eeexplore.ieee.org/abstract/document/8756056)
>> [2] "Resource Orchestration for Multi-Domain, Exascale, Geo-Distributed
>> Data Analytics", (
>> https://datatracker.ietf.org/doc/draft-xiang-alto-multidomain-analytics/)
>>
>> For the pointers above, the privacy requirement considered in this work
>> is that the network information of multiple domains should be exposed to
>> applications as a complete, unified aggregation, appearing as much as
>> possible as from a single (virtual) network. We design a network
>> information obfuscation mechanism so that the application is not able to
>> associate any network resource bottleneck information to any domain,
>> reducing the risk of exposing network vulnerability.
>>
>> In addition, we also studied how to control the routing across multiple
>> domains to achieve more flexible end-to-end interdomain routing.
>> Essentially, we propose a mechanism that allows networks to expose their
>> available interdomain routes, just as BGP looking glasses, so that
>> applications can control them. In this setting, we consider the privacy
>> setting where each network's BGP export policies are private, and design
>> interesting algorithms for applications to select the best policy-compliant
>> routes without knowing the export policies. The following is the pointer
>> for this study:
>>
>> [3] "Toward Optimal Software-Defined Interdomain Routing". INFOCOM 2020 (
>> https://ieeexplore.ieee.org/abstract/document/9155486)
>>
>> Above are our current efforts on extending ALTO to multi-domain settings.
>> It would be great if we can know more about the industry efforts on network
>> information exposure in multi-domain settings, and the privacy requirements
>> of operators. This would be extremely helpful to push this extension
>> forward! :-)
>>
>>
>>
>> Best
>> Qiao
>>
>> On Tue, Mar 2, 2021 at 1:14 PM 刘鹏  wrote:
>>
>>> Hi Richard,
>>>
>>> Thank you. please see my reply inline below.
>>>
>>>
>>> Peng Liu | 刘鹏
>>> China Mobile | 移动研究院
>>> mobile phone:13810146105
>>> email: * liupeng...@chinamobile.com *
>>>
>>>
>>> 发件人: Y. Richard Yang 
>>> 时间: 2021/03/02(星期二)07:36
>>> 收件人: 刘鹏 ;
>>> 抄送人: IETF ALTO ;Qin Wu ;
>>> 主题: Re: [alto] ALTO Draft ReCharter WG review
>>>
>>> Dear Peng,
>>>
>>> Thank you so much for the feedback. Please see below.
>>>
>>> On Fri, Feb 26, 2021 at 9:23 PM 刘鹏  wrote:
>>>
>>>> Hi WG,
>>>>
>>>>
>>>> Here are some considerations of recharter:
>>>>
>>>> I believe that the multi domain problem is worthy of attention.
>>>>
>>>
>>> It is good info.
>>>
>>>
>>>> At present, operators also research in it, which may involve
>>>> guaranteeing end-to-end network service in the future, such as delay,
>>>> bandwidth, etc. There are some researches on cross domain deterministic
>>>> network in the industry, which need some support from management and
>>>> control plane.
>>>>
>>>
>>>  Do you want to share some pointers?
>>>
>>> [Peng] As Qin said, it is hard to collect information across network
>>> borders.
>>>
>>> Just taking deterministic network as an example, it is hard to applying
>>> synchronization, unified forwarding strategy in multi domain, so there
>>> are some works need to be done with management plane. Due to the large
>>> scale and multi domains or operators, the management system may be
>>> distributed.
>>>
>>> A potential way is to consider negotiating the forwarding time of each
>>> domain in advance and carrying time stamp in the message to control the
>>> forwarding path of each domain. While it needs some agreements like
>>> contracts to prevent one party from tampering with and denying the
>>> management content.
>>>
>>> Beside this, there may be others use case. I'm not sure if Alto servers
>>> are willing to do those work, but it may be helpful to collect or configure
>>> some key information.
>>>
>>> Who is the provider of Alto service is related to the deployment and
>>>> cooperation mode. It may be difficult for operators to give too much
>>>> detailed network information now. If the Alto service belongs to the
>>>> operator, it may be used to help manage its own network. If Alt

Re: [alto] ALTO Draft ReCharter WG review(Internet mail)

2021-03-10 Thread 熊春山
Hello Qin,

Normally, the 1080p/720p indicates the bitrates.

The cloud gaming server only provides the bitrate span to the ALTO server( to 
the 5G network), it does not need to provide the encoding scheme information to 
the 5G network.

Normally we/Tencent use H.264 encoding scheme because there are a lot of open 
source available,  but some vide streaming service are testing to use VP8 
encoding scheme to compare the performance between different encoding scheme. 
But H.264 is used in most video streaming.

BRs,
Chunshan Xiong

From: alto  On Behalf Of Qin Wu
Sent: Monday, March 8, 2021 3:03 PM
To: Li Gang ; kai...@scu.edu.cn
Cc: alto-cha...@ietf.org; alto-...@ietf.org; 'IETF ALTO' 
Subject: Re: [alto] ALTO Draft ReCharter WG review(Internet mail)

Thanks for your clarification, I think 1080p and 720p are resolution, 
corresponding to HD, SD video, or 4.5Mbit/s, 2.5 Mbit/s bit rate if you are 
using H.264 encoding scheme.
Have you considered to use VP8 encoding scheme?

-Qin
发件人: Li Gang [mailto:ligan...@chinamobile.com]
发送时间: 2021年3月8日 11:42
收件人: Qin Wu mailto:bill...@huawei.com>>; 
kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>
抄送: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>; 'IETF ALTO' 
mailto:alto@ietf.org>>
主题: RE: [alto] ALTO Draft ReCharter WG review

Hi, Qin,
Please see my reply inline.

Li Gang

From: Qin Wu [mailto:bill...@huawei.com]
Sent: Monday, March 8, 2021 10:52 AM
To: Li Gang; kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>; 'IETF ALTO'
Subject: RE: [alto] ALTO Draft ReCharter WG review

Hi, Gang:
Thanks for sharing your use case, let me rephrase what you envision for your 
use case,
You want to express QoS requirement in the subscription request, the network 
exposes the network information via notification in response to subscription 
request,
application operators can tune adaptive rate to improve user QoE based on the 
network information change.

[Gang]: yes

Can you clarify a little bit about specific application traffic patterns?

[Gang]: let me take video streaming as an example, normally the downlink 
streaming content would be segmented into pieces for `10 seconds. For each 
piece, multiple video encoding rates, for example 1080p, 720p …, can be 
provided and adjusted by server. For each encoding rate, the QoS requirement 
(e.g. throughput, latency) is different. The network can provide such 
information change  (e.g. whether QoS requirement for 1080p, 720p is fulfilled 
or not) via pub/sub, which help application operator tune encoding rate.

Secondly, I agree fine granularity pub sub can consider one time subscription 
and configure wait time as subscription policy to alleviate the signaling load 
on the network.

-Qin
发件人: Li Gang [mailto:ligan...@chinamobile.com]
发送时间: 2021年3月7日 16:30
收件人: kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>; Qin Wu 
mailto:bill...@huawei.com>>
抄送: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>; 'IETF ALTO' 
mailto:alto@ietf.org>>
主题: RE: [alto] ALTO Draft ReCharter WG review

Hi, Kai and Qin,

Thanks for triggering the discussion on  the 2nd item of the recharter text.
I agree that it would be better to define a generic pub/sub framework 
irrespective of specific transport protocol.
We can start with a simple pub/sub mechanism, which is driven by concrete use 
cases and then consider to extend as needed.

Some of my thoughts are inline.

Li Gang

From: alto [mailto:alto-boun...@ietf.org] On Behalf Of 
kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>
Sent: Friday, March 5, 2021 11:03 AM
To: Qin Wu
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>; IETF ALTO
Subject: Re: [alto] ALTO Draft ReCharter WG review


Hi Qin,



Thanks for the comments. A quick summary of my response is



1. "Pub/sub" means different things in different contexts and I think we must 
clarify what it means in the context of distributing ALTO information.

2. There are two ways of realizing complex "pub/sub" of ALTO information but I 
think they are fundamentally different deployment settings for one generic 
framework (whose details are, unfortunately, not thought through yet).



Please see the details inline.



Best,

Kai

-Original Messages-
From:"Qin Wu" mailto:bill...@huawei.com>>
Sent Time:2021-03-04 22:21:06 (Thursday)
To: "kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>" 
mailto:kai...@scu.edu.cn>>
Cc: "alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>" 
mailto:alto-cha...@ietf.org>>, 
"alto-...@ietf.org<mailto:alto-...@ietf.org>" 
mailto:alto-...@ietf.org>>, "IETF ALTO" 
mailto:alto@ietf.org>>
Subject: Re: [

Re: [alto] ALTO Draft ReCharter WG review

2021-03-09 Thread Y. Richard Yang
tleneck information to any domain,
> reducing the risk of exposing network vulnerability.
>
> In addition, we also studied how to control the routing across multiple
> domains to achieve more flexible end-to-end interdomain routing.
> Essentially, we propose a mechanism that allows networks to expose their
> available interdomain routes, just as BGP looking glasses, so that
> applications can control them. In this setting, we consider the privacy
> setting where each network's BGP export policies are private, and design
> interesting algorithms for applications to select the best policy-compliant
> routes without knowing the export policies. The following is the pointer
> for this study:
>
> [3] "Toward Optimal Software-Defined Interdomain Routing". INFOCOM 2020 (
> https://ieeexplore.ieee.org/abstract/document/9155486)
>
> Above are our current efforts on extending ALTO to multi-domain settings.
> It would be great if we can know more about the industry efforts on network
> information exposure in multi-domain settings, and the privacy requirements
> of operators. This would be extremely helpful to push this extension
> forward! :-)
>
>
>
> Best
> Qiao
>
> On Tue, Mar 2, 2021 at 1:14 PM 刘鹏  wrote:
>
>> Hi Richard,
>>
>> Thank you. please see my reply inline below.
>>
>>
>> Peng Liu | 刘鹏
>> China Mobile | 移动研究院
>> mobile phone:13810146105
>> email: * liupeng...@chinamobile.com *
>>
>>
>> 发件人: Y. Richard Yang 
>> 时间: 2021/03/02(星期二)07:36
>> 收件人: 刘鹏 ;
>> 抄送人: IETF ALTO ;Qin Wu ;
>> 主题: Re: [alto] ALTO Draft ReCharter WG review
>>
>> Dear Peng,
>>
>> Thank you so much for the feedback. Please see below.
>>
>> On Fri, Feb 26, 2021 at 9:23 PM 刘鹏  wrote:
>>
>>> Hi WG,
>>>
>>>
>>> Here are some considerations of recharter:
>>>
>>> I believe that the multi domain problem is worthy of attention.
>>>
>>
>> It is good info.
>>
>>
>>> At present, operators also research in it, which may involve
>>> guaranteeing end-to-end network service in the future, such as delay,
>>> bandwidth, etc. There are some researches on cross domain deterministic
>>> network in the industry, which need some support from management and
>>> control plane.
>>>
>>
>>  Do you want to share some pointers?
>>
>> [Peng] As Qin said, it is hard to collect information across network
>> borders.
>>
>> Just taking deterministic network as an example, it is hard to applying
>> synchronization, unified forwarding strategy in multi domain, so there
>> are some works need to be done with management plane. Due to the large
>> scale and multi domains or operators, the management system may be
>> distributed.
>>
>> A potential way is to consider negotiating the forwarding time of each
>> domain in advance and carrying time stamp in the message to control the
>> forwarding path of each domain. While it needs some agreements like
>> contracts to prevent one party from tampering with and denying the
>> management content.
>>
>> Beside this, there may be others use case. I'm not sure if Alto servers
>> are willing to do those work, but it may be helpful to collect or configure
>> some key information.
>>
>> Who is the provider of Alto service is related to the deployment and
>>> cooperation mode. It may be difficult for operators to give too much
>>> detailed network information now. If the Alto service belongs to the
>>> operator, it may be used to help manage its own network. If Alto service
>>> belong to non operators, I think the issue of how to cooperate needs
>>> further discussion.
>>>
>>>
>>> It looks that you want to consider both modes: multidomains but single
>> operator (i.e., intra-cooperation) and multidomains and multiple operators.
>> Regardless, I agree that it is important for the work to clarify on the
>> privacy requirements.
>>
>> [Peng] Yes, agree.
>>
>> Richard
>>
>>
>>
>>
>>> Regards,
>>>
>>> Peng
>>>
>>> Peng Liu | 刘鹏
>>> China Mobile | 移动研究院
>>> mobile phone:13810146105
>>> email: * liupeng...@chinamobile.com *
>>>
>>>
>>> 发件人: Qin Wu 
>>> 时间: 2021/02/22(星期一)21:45
>>> 收件人: IETF ALTO ;
>>> 抄送人: alto-chairs ;alto-ads ;
>>> 主题: [alto] ALTO Draft ReCharter WG review
>>>
>>> Hi, :
>>>
>>> We have requested one hour session for ALTO WG meet

Re: [alto] ALTO Draft ReCharter WG review

2021-03-08 Thread Qin Wu
Hi, Kai:
发件人: alto [mailto:alto-boun...@ietf.org] 代表 kai...@scu.edu.cn
发送时间: 2021年3月8日 17:44
收件人: Qin Wu 
抄送: alto-cha...@ietf.org; alto-...@ietf.org; 'IETF ALTO' 
主题: Re: [alto] ALTO Draft ReCharter WG review


Hi Gang and Qin,



I am also interested in the details of the use case. Like I mentioned, ALTO 
already has an extension (RFC 8895) that allows one-to-one pub/sub, it would be 
useful if the use case can show that the current design, despite that it is 
built on top of SSE, is not enough to support similar common use cases. My 
guess is that there are some synchronization requirements that the subscribers 
are intended to make decisions based on the same ALTO information? So aside 
from Qin's question on the traffic pattern, it would be wonderful if the use 
case can illustrate the distribution of ALTO information.

[Qin]: Good point, When NETCONF WG is talking about their next step or new work 
last night, NETCONF over HTTP 2/ HTTP 3 had been brought up and got a lot of 
attention. Therefore I think it will be valuable for us to investigate how ALTO 
can migrate transport from HTTP 1.0 to HTTP 2/HTTP3 and leverage underlying 
capability as well.

One question come up from NETCONF discussion, is whether NETCONF should 
allocate new port for new transport. I am not sure this issue applies to ALTO 
protocol as well.

I am also a bit confused about what one-time subscription means here. Is it 
one-time for a single subscriber or multiple subscribers? If for a single 
subscriber, I do not see why the subscriber would make the same subscription 
many times. It would wonderful if we can clarify this in the use case.

[Qin]:I believe it is terminology issue, I think we can have on demand 
subscription, and periodical subscription. One time subscription is similar to 
on demand subscription. Refer to gNMI for the similar term 
(https://github.com/openconfig/reference/blob/master/rpc/gnmi/gnmi-specification.md#35-subscribing-to-telemetry-updates):

" A client may create a subscription which has a dedicated stream to return 
one-off data (ONCE); a subscription that utilizes a stream to periodically 
request a set of data (POLL); or a long-lived subscription that streams data 
according to the triggers specified within the individual subscription's mode 
(STREAM).

"

Best,

Kai



-Original Messages-
From:"Qin Wu" mailto:bill...@huawei.com>>
Sent Time:2021-03-08 10:51:31 (Monday)
To: "Li Gang" mailto:ligan...@chinamobile.com>>, 
"kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>" 
mailto:kai...@scu.edu.cn>>
Cc: "alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>" 
mailto:alto-cha...@ietf.org>>, 
"alto-...@ietf.org<mailto:alto-...@ietf.org>" 
mailto:alto-...@ietf.org>>, "'IETF ALTO'" 
mailto:alto@ietf.org>>
Subject: Re: [alto] ALTO Draft ReCharter WG review
Hi, Gang:
Thanks for sharing your use case, let me rephrase what you envision for your 
use case,
You want to express QoS requirement in the subscription request, the network 
exposes the network information via notification in response to subscription 
request,
application operators can tune adaptive rate to improve user QoE based on the 
network information change.

Can you clarify a little bit about specific application traffic patterns?

Secondly, I agree fine granularity pub sub can consider one time subscription 
and configure wait time as subscription policy to alleviate the signaling load 
on the network.

-Qin
发件人: Li Gang [mailto:ligan...@chinamobile.com]
发送时间: 2021年3月7日 16:30
收件人: kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>; Qin Wu 
mailto:bill...@huawei.com>>
抄送: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>; 'IETF ALTO' 
mailto:alto@ietf.org>>
主题: RE: [alto] ALTO Draft ReCharter WG review

Hi, Kai and Qin,

Thanks for triggering the discussion on  the 2nd item of the recharter text.
I agree that it would be better to define a generic pub/sub framework 
irrespective of specific transport protocol.
We can start with a simple pub/sub mechanism, which is driven by concrete use 
cases and then consider to extend as needed.

Some of my thoughts are inline.

Li Gang

From: alto [mailto:alto-boun...@ietf.org] On Behalf Of 
kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>
Sent: Friday, March 5, 2021 11:03 AM
To: Qin Wu
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>; IETF ALTO
Subject: Re: [alto] ALTO Draft ReCharter WG review


Hi Qin,



Thanks for the comments. A quick summary of my response is



1. "Pub/sub" means different things in different contexts and I think we must 
clarify what it means in the context of distributing ALTO information.

2. There are two ways of realizing complex "pub/sub" of ALTO information but I 
think they are fundamentally differe

Re: [alto] ALTO Draft ReCharter WG review

2021-03-08 Thread kaigao
Hi Gang and Qin,




I am also interested in the details of the use case. Like I mentioned, ALTO 
already has an extension (RFC 8895) that allows one-to-one pub/sub, it would be 
useful if the use case can show that the current design, despite that it is 
built on top of SSE, is not enough to support similar common use cases. My 
guess is that there are some synchronization requirements that the subscribers 
are intended to make decisions based on the same ALTO information? So aside 
from Qin's question on the traffic pattern, it would be wonderful if the use 
case can illustrate the distribution of ALTO information.




I am also a bit confused about what one-time subscription means here. Is it 
one-time for a single subscriber or multiple subscribers? If for a single 
subscriber, I do not see why the subscriber would make the same subscription 
many times. It would wonderful if we can clarify this in the use case.




Best,

Kai



-Original Messages-
From:"Qin Wu" 
Sent Time:2021-03-08 10:51:31 (Monday)
To: "Li Gang" , "kai...@scu.edu.cn" 

Cc: "alto-cha...@ietf.org" , "alto-...@ietf.org" 
, "'IETF ALTO'" 
Subject: Re: [alto] ALTO Draft ReCharter WG review



Hi, Gang:

Thanks for sharing your use case, let me rephrase what you envision for your 
use case,

You want to express QoS requirement in the subscription request, the network 
exposes the network information via notification in response to subscription 
request,

application operators can tune adaptive rate to improve user QoE based on the 
network information change.

 

Can you clarify a little bit about specific application traffic patterns?

 

Secondly, I agree fine granularity pub sub can consider one time subscription 
and configure wait time as subscription policy to alleviate the signaling load 
on the network.

 

-Qin

发件人: Li Gang [mailto:ligan...@chinamobile.com]
发送时间: 2021年3月7日 16:30
收件人: kai...@scu.edu.cn; Qin Wu 
抄送: alto-cha...@ietf.org; alto-...@ietf.org; 'IETF ALTO' 
主题: RE: [alto] ALTO Draft ReCharter WG review

 

Hi, Kai and Qin,

 

Thanks for triggering the discussion on  the 2nd item of the recharter text.

I agree that it would be better to define a generic pub/sub framework 
irrespective of specific transport protocol.

We can start with a simple pub/sub mechanism, which is driven by concrete use 
cases and then consider to extend as needed.

 

Some of my thoughts are inline.

 

Li Gang

 

From: alto [mailto:alto-boun...@ietf.org] On Behalf Of kai...@scu.edu.cn
Sent: Friday, March 5, 2021 11:03 AM
To: Qin Wu
Cc:alto-cha...@ietf.org; alto-...@ietf.org; IETF ALTO
Subject: Re: [alto] ALTO Draft ReCharter WG review

 

Hi Qin,

 

Thanks for the comments. A quick summary of my response is

 

1. "Pub/sub" means different things in different contexts and I think we must 
clarify what it means in the context of distributing ALTO information.

2. There are two ways of realizing complex "pub/sub" of ALTO information but I 
think they are fundamentally different deployment settings for one generic 
framework (whose details are, unfortunately, not thought through yet).

 

Please see the details inline.

 

Best,

Kai





-Original Messages-
From:"Qin Wu" 
Sent Time:2021-03-04 22:21:06 (Thursday)
To: "kai...@scu.edu.cn" 
Cc: "alto-cha...@ietf.org" , "alto-...@ietf.org" 
, "IETF ALTO" 
Subject: Re: [alto] ALTO Draft ReCharter WG review

Kai:

发件人:kai...@scu.edu.cn [mailto:kai...@scu.edu.cn]
发送时间: 2021年3月3日 21:40
收件人: Qin Wu 
抄送: IETF ALTO ; alto-cha...@ietf.org; alto-...@ietf.org
主题: Re: [alto] ALTO Draft ReCharter WG review

 

Dear all,

 

Below are some comments on the 2nd item in the recharter text.

 

As far as I know, the ALTO incremental update extension (RFC 8895) already 
provides a mechanism to enable the "pub-sub" of ALTO information, using 
Server-Sent Events (SSE). I see there are multiple directions indicated by the 
new charter item:

[Qin]: Thanks for clarifying the difference between SSE and pub sub proposed in 
the new proposed charter item.

1. Decouple the "pub-sub" protocol with the underlying mechanism.

Besides SSE, other mechanisms can also be used to realize the "pub-sub" of ALTO 
information, such as HTTP/2, HTTP/3 or the methods mentioned in the charter 
text. Thus, a direct extension is to define the abstract format of control 
messages and data messages (i.e., WHAT information should be provided but not 
HOW), and allow different underlying protocols to use protocol-specific 
encodings.

For example, SSE encodes the metadata (e.g., content-type and stream id) and 
the content of an event using "event:" and "data:" prefixes at the beginning of 
each line, and uses empty lines to indicate the end of a message, while HTTP/2 
(RFC 7540) may encode the metadata and the content of an event using 
PUSH_PROMIS

Re: [alto] ALTO Draft ReCharter WG review

2021-03-07 Thread Qin Wu
Thanks for your clarification, I think 1080p and 720p are resolution, 
corresponding to HD, SD video, or 4.5Mbit/s, 2.5 Mbit/s bit rate if you are 
using H.264 encoding scheme.
Have you considered to use VP8 encoding scheme?

-Qin
发件人: Li Gang [mailto:ligan...@chinamobile.com]
发送时间: 2021年3月8日 11:42
收件人: Qin Wu ; kai...@scu.edu.cn
抄送: alto-cha...@ietf.org; alto-...@ietf.org; 'IETF ALTO' 
主题: RE: [alto] ALTO Draft ReCharter WG review

Hi, Qin,
Please see my reply inline.

Li Gang

From: Qin Wu [mailto:bill...@huawei.com]
Sent: Monday, March 8, 2021 10:52 AM
To: Li Gang; kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>; 'IETF ALTO'
Subject: RE: [alto] ALTO Draft ReCharter WG review

Hi, Gang:
Thanks for sharing your use case, let me rephrase what you envision for your 
use case,
You want to express QoS requirement in the subscription request, the network 
exposes the network information via notification in response to subscription 
request,
application operators can tune adaptive rate to improve user QoE based on the 
network information change.

[Gang]: yes

Can you clarify a little bit about specific application traffic patterns?

[Gang]: let me take video streaming as an example, normally the downlink 
streaming content would be segmented into pieces for `10 seconds. For each 
piece, multiple video encoding rates, for example 1080p, 720p …, can be 
provided and adjusted by server. For each encoding rate, the QoS requirement 
(e.g. throughput, latency) is different. The network can provide such 
information change  (e.g. whether QoS requirement for 1080p, 720p is fulfilled 
or not) via pub/sub, which help application operator tune encoding rate.

Secondly, I agree fine granularity pub sub can consider one time subscription 
and configure wait time as subscription policy to alleviate the signaling load 
on the network.

-Qin
发件人: Li Gang [mailto:ligan...@chinamobile.com]
发送时间: 2021年3月7日 16:30
收件人: kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>; Qin Wu 
mailto:bill...@huawei.com>>
抄送: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>; 'IETF ALTO' 
mailto:alto@ietf.org>>
主题: RE: [alto] ALTO Draft ReCharter WG review

Hi, Kai and Qin,

Thanks for triggering the discussion on  the 2nd item of the recharter text.
I agree that it would be better to define a generic pub/sub framework 
irrespective of specific transport protocol.
We can start with a simple pub/sub mechanism, which is driven by concrete use 
cases and then consider to extend as needed.

Some of my thoughts are inline.

Li Gang

From: alto [mailto:alto-boun...@ietf.org] On Behalf Of 
kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>
Sent: Friday, March 5, 2021 11:03 AM
To: Qin Wu
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>; IETF ALTO
Subject: Re: [alto] ALTO Draft ReCharter WG review


Hi Qin,



Thanks for the comments. A quick summary of my response is



1. "Pub/sub" means different things in different contexts and I think we must 
clarify what it means in the context of distributing ALTO information.

2. There are two ways of realizing complex "pub/sub" of ALTO information but I 
think they are fundamentally different deployment settings for one generic 
framework (whose details are, unfortunately, not thought through yet).



Please see the details inline.



Best,

Kai

-Original Messages-
From:"Qin Wu" mailto:bill...@huawei.com>>
Sent Time:2021-03-04 22:21:06 (Thursday)
To: "kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>" 
mailto:kai...@scu.edu.cn>>
Cc: "alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>" 
mailto:alto-cha...@ietf.org>>, 
"alto-...@ietf.org<mailto:alto-...@ietf.org>" 
mailto:alto-...@ietf.org>>, "IETF ALTO" 
mailto:alto@ietf.org>>
Subject: Re: [alto] ALTO Draft ReCharter WG review
Kai:
发件人: kai...@scu.edu.cn<mailto:kai...@scu.edu.cn> [mailto:kai...@scu.edu.cn]
发送时间: 2021年3月3日 21:40
收件人: Qin Wu mailto:bill...@huawei.com>>
抄送: IETF ALTO mailto:alto@ietf.org>>; 
alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>
主题: Re: [alto] ALTO Draft ReCharter WG review


Dear all,



Below are some comments on the 2nd item in the recharter text.



As far as I know, the ALTO incremental update extension (RFC 8895) already 
provides a mechanism to enable the "pub-sub" of ALTO information, using 
Server-Sent Events (SSE). I see there are multiple directions indicated by the 
new charter item:
[Qin]: Thanks for clarifying the difference between SSE and pub sub proposed in 
the new proposed charter item.

1. Decouple the "pub-sub" protocol with the underlying mechanism.

Besides 

Re: [alto] ALTO Draft ReCharter WG review

2021-03-07 Thread Jensen Zhang
Hi Qin,

See my comments inline.

On Mon, Mar 8, 2021 at 11:21 AM Qin Wu  wrote:

> Hi, Jensen and Qian:
>
> Thanks for your clarification, , the interesting paper [2] you share,
>
> I am wondering how ALTO server in your implementation get network info
> from BGP in each domain?
>

In our implementation, the ALTO server doesn't get network info from the
BGP/SFP speaker. Each domain runs OpenFlow to do the intra-domain routing.
And the ALTO server gets intra-domain network info from the OpenFlow
controller in each domain. The SFP speaker in each domain provides another
service to allow the application to request the inter-domain routing. We
also inject a delegation service into the ALTO server to delegate such
requests to the SFP speaker. But it doesn't follow any existing ALTO
specification.


> Do you configure ALTO server in each domain for consistent Cost Metric
> reporting? What if each ALTO server report different Cost metric in the
> multi-domain setting?
>

Yes, we enforce each domain to deploy the same ALTO server implementation
and configure the consistent cost metric reporting. The inconsistent cost
metric reporting was not in the scope of our previous work. But personally,
if ALTO servers report different cost metrics, I think one potential
solution is to design a negotiation mechanism similar to the ethernet link
connection negotiation before the client does any ALTO queries.

Thanks,
Jensen


>
>
> -Qin
>
> *发件人:* Jensen Zhang [mailto:jingxuan.n.zh...@gmail.com]
> *发送时间:* 2021年3月5日 10:26
> *收件人:* Qiao Xiang 
> *抄送:* Qin Wu ; 刘鹏 ; IETF
> ALTO 
> *主题:* Re: [alto] ALTO Draft ReCharter WG review
>
>
>
> Hi Qin and Qiao,
>
> Please see my comments inline.
>
>
>
> On Thu, Mar 4, 2021 at 11:57 PM Qiao Xiang  wrote:
>
> Hi Qin,
>
>
>
> Thank you so much for the feedback. Please see my responses inline.
>
>
>
> On Thu, Mar 4, 2021 at 9:22 PM Qin Wu  wrote:
>
> Thanks Qiao for sharing your project on Unicorn and thought on
> multi-domain setting.
>
> My impression in your implementation is each domain name and first ingress
> node in such domain will be carried in the ALTO response message.
>
> First, for domain name, I do not believe we need that in the ALTO response
> message. Our setting here is each domain has an ALTO server, and the ALTO
> clients at the aggregator have separate connections to different ALTO
> servers. In this way, by maintaining a (domain, ALTO  server) mapping, the
> aggregator can differentiate responses from different domains.
>
>
>
> Right, our implementation didn't carry each domain name in the ALTO
> message. The current ALTO protocol cannot carry on this info. And we also
> didn't do such an extension to ALTO. We just use a centralized aggregator
> (which can be considered as an ALTO client) to coordinate with the ALTO
> server of each domain. There is no communication between any two ALTO
> servers. The domain name may appear in the configuration message.
>
>
>
> Second, for ingress node, the client needs to specify the ingress and the
> (srcIP, dstIP) pair in the query first so that the ALTO server knows what
> information to return. And I should also clarify that although we use
> ODL-ALTO for our system, but the path vector extension is not implemented
> exactly following the specification since it was not fully stabilized then.
>
>
>
> Yes, and the ingress info only appears in the request message, not in the
> response message. We use the early design of the FCS extension [1] to do
> this. The request message should specify the flow-id of each flow.
>
>
>
> [1] https://tools.ietf.org/html/draft-gao-alto-fcs-04
>
>
>
>
>
> @Jensen is the core developer and can comment further on this, as well as
> the ODL implementation.
>
>
>
> One thing I want to highlight is
>
> Unicorn has already been deployed in several cities of USA in 2018 and
> implemented in the ODL open source.
>
> I should clarify that this deployment is pre-production, and the
> demonstration scenario is at SC18 and SC19, where we are at the conference
> cities (Dallas and Denver), and orchestrate traffic from there back to a
> Caltech LHC site (we manually separate this site into two domains to create
> a 3-domain scenario for demonstration purpose.)
>
>
>
> Quote from
> https://datatracker.ietf.org/doc/draft-xiang-alto-multidomain-analytics/
>
> “
>
>The authors build an ALTO server on top of the OpenDaylight Software
>
>Defined Network controller.  The ALTO server collects the network
>
>state information from the OpenDaylight controller, e.g., topology,
>
>policy and traffic statistics, processes the collected information
>
>into resourc

Re: [alto] ALTO Draft ReCharter WG review

2021-03-07 Thread Li Gang
Hi, Qin, 

Please see my reply inline.

 

Li Gang

 

From: Qin Wu [mailto:bill...@huawei.com] 
Sent: Monday, March 8, 2021 10:52 AM
To: Li Gang; kai...@scu.edu.cn
Cc: alto-cha...@ietf.org; alto-...@ietf.org; 'IETF ALTO'
Subject: RE: [alto] ALTO Draft ReCharter WG review

 

Hi, Gang:

Thanks for sharing your use case, let me rephrase what you envision for your 
use case,

You want to express QoS requirement in the subscription request, the network 
exposes the network information via notification in response to subscription 
request,

application operators can tune adaptive rate to improve user QoE based on the 
network information change.

 

[Gang]: yes 

 

Can you clarify a little bit about specific application traffic patterns?

 

[Gang]: let me take video streaming as an example, normally the downlink 
streaming content would be segmented into pieces for `10 seconds. For each 
piece, multiple video encoding rates, for example 1080p, 720p …, can be 
provided and adjusted by server. For each encoding rate, the QoS requirement 
(e.g. throughput, latency) is different. The network can provide such 
information change  (e.g. whether QoS requirement for 1080p, 720p is fulfilled 
or not) via pub/sub, which help application operator tune encoding rate.

 

Secondly, I agree fine granularity pub sub can consider one time subscription 
and configure wait time as subscription policy to alleviate the signaling load 
on the network.

 

-Qin

发件人: Li Gang [mailto:ligan...@chinamobile.com] 
发送时间: 2021年3月7日 16:30
收件人: kai...@scu.edu.cn; Qin Wu 
抄送: alto-cha...@ietf.org; alto-...@ietf.org; 'IETF ALTO' 
主题: RE: [alto] ALTO Draft ReCharter WG review

 

Hi, Kai and Qin,

 

Thanks for triggering the discussion on  the 2nd item of the recharter text.

I agree that it would be better to define a generic pub/sub framework 
irrespective of specific transport protocol.

We can start with a simple pub/sub mechanism, which is driven by concrete use 
cases and then consider to extend as needed.

 

Some of my thoughts are inline.

 

Li Gang

 

From: alto [mailto:alto-boun...@ietf.org] On Behalf Of kai...@scu.edu.cn
Sent: Friday, March 5, 2021 11:03 AM
To: Qin Wu
Cc: alto-cha...@ietf.org; alto-...@ietf.org; IETF ALTO
Subject: Re: [alto] ALTO Draft ReCharter WG review

 

Hi Qin, 

 

Thanks for the comments. A quick summary of my response is 

 

1. "Pub/sub" means different things in different contexts and I think we must 
clarify what it means in the context of distributing ALTO information. 

2. There are two ways of realizing complex "pub/sub" of ALTO information but I 
think they are fundamentally different deployment settings for one generic 
framework (whose details are, unfortunately, not thought through yet). 

 

Please see the details inline. 

 

Best, 

Kai 

 

-Original Messages-
From:"Qin Wu" 
Sent Time:2021-03-04 22:21:06 (Thursday)
To: "kai...@scu.edu.cn" 
Cc: "alto-cha...@ietf.org" , "alto-...@ietf.org" 
, "IETF ALTO" 
Subject: Re: [alto] ALTO Draft ReCharter WG review

Kai: 

发件人: kai...@scu.edu.cn [mailto:kai...@scu.edu.cn] 
发送时间: 2021年3月3日 21:40
收件人: Qin Wu 
抄送: IETF ALTO ; alto-cha...@ietf.org; alto-...@ietf.org
主题: Re: [alto] ALTO Draft ReCharter WG review 

  

Dear all, 

  

Below are some comments on the 2nd item in the recharter text. 

  

As far as I know, the ALTO incremental update extension (RFC 8895) already 
provides a mechanism to enable the "pub-sub" of ALTO information, using 
Server-Sent Events (SSE). I see there are multiple directions indicated by the 
new charter item: 

[Qin]: Thanks for clarifying the difference between SSE and pub sub proposed in 
the new proposed charter item. 

1. Decouple the "pub-sub" protocol with the underlying mechanism. 

Besides SSE, other mechanisms can also be used to realize the "pub-sub" of ALTO 
information, such as HTTP/2, HTTP/3 or the methods mentioned in the charter 
text. Thus, a direct extension is to define the abstract format of control 
messages and data messages (i.e., WHAT information should be provided but not 
HOW), and allow different underlying protocols to use protocol-specific 
encodings. 

For example, SSE encodes the metadata (e.g., content-type and stream id) and 
the content of an event using "event:" and "data:" prefixes at the beginning of 
each line, and uses empty lines to indicate the end of a message, while HTTP/2 
(RFC 7540) may encode the metadata and the content of an event using 
PUSH_PROMISE/HEADERS and DATA frame . 

[Qin]: Good analysis, I think we need to decide whether we should define 
generic pub sub mechanism or transport specific pub sub mechanism. Do you have 
any suggestion on this? 

[KAI]: I think the generic pub-sub mechanism (or maybe the term framework is 
more appropriate) is more important at this point, which should also cover the 
direction of providing more fine-

Re: [alto] ALTO Draft ReCharter WG review

2021-03-07 Thread Qin Wu
Hi, Jensen and Qian:
Thanks for your clarification, , the interesting paper [2] you share,
I am wondering how ALTO server in your implementation get network info from BGP 
in each domain?
Do you configure ALTO server in each domain for consistent Cost Metric 
reporting? What if each ALTO server report different Cost metric in the 
multi-domain setting?

-Qin
发件人: Jensen Zhang [mailto:jingxuan.n.zh...@gmail.com]
发送时间: 2021年3月5日 10:26
收件人: Qiao Xiang 
抄送: Qin Wu ; 刘鹏 ; IETF ALTO 

主题: Re: [alto] ALTO Draft ReCharter WG review

Hi Qin and Qiao,
Please see my comments inline.

On Thu, Mar 4, 2021 at 11:57 PM Qiao Xiang 
mailto:xiang...@gmail.com>> wrote:
Hi Qin,

Thank you so much for the feedback. Please see my responses inline.

On Thu, Mar 4, 2021 at 9:22 PM Qin Wu 
mailto:bill...@huawei.com>> wrote:
Thanks Qiao for sharing your project on Unicorn and thought on multi-domain 
setting.
My impression in your implementation is each domain name and first ingress node 
in such domain will be carried in the ALTO response message.
First, for domain name, I do not believe we need that in the ALTO response 
message. Our setting here is each domain has an ALTO server, and the ALTO 
clients at the aggregator have separate connections to different ALTO servers. 
In this way, by maintaining a (domain, ALTO  server) mapping, the aggregator 
can differentiate responses from different domains.

Right, our implementation didn't carry each domain name in the ALTO message. 
The current ALTO protocol cannot carry on this info. And we also didn't do such 
an extension to ALTO. We just use a centralized aggregator (which can be 
considered as an ALTO client) to coordinate with the ALTO server of each 
domain. There is no communication between any two ALTO servers. The domain name 
may appear in the configuration message.

Second, for ingress node, the client needs to specify the ingress and the 
(srcIP, dstIP) pair in the query first so that the ALTO server knows what 
information to return. And I should also clarify that although we use ODL-ALTO 
for our system, but the path vector extension is not implemented exactly 
following the specification since it was not fully stabilized then.

Yes, and the ingress info only appears in the request message, not in the 
response message. We use the early design of the FCS extension [1] to do this. 
The request message should specify the flow-id of each flow.

[1] https://tools.ietf.org/html/draft-gao-alto-fcs-04


@Jensen is the core developer and can comment further on this, as well as the 
ODL implementation.

One thing I want to highlight is
Unicorn has already been deployed in several cities of USA in 2018 and 
implemented in the ODL open source.
I should clarify that this deployment is pre-production, and the demonstration 
scenario is at SC18 and SC19, where we are at the conference cities (Dallas and 
Denver), and orchestrate traffic from there back to a Caltech LHC site (we 
manually separate this site into two domains to create a 3-domain scenario for 
demonstration purpose.)

Quote from 
https://datatracker.ietf.org/doc/draft-xiang-alto-multidomain-analytics/
“
   The authors build an ALTO server on top of the OpenDaylight Software
   Defined Network controller.  The ALTO server collects the network
   state information from the OpenDaylight controller, e.g., topology,
   policy and traffic statistics, processes the collected information
   into resource abstraction, and sends the abstraction back to the ALTO
   client at the resource orchestrator.

The Unicorn framework has been deployed and
   demonstrated in small federation networks connecting Dallas, Texas,
   Los Angles, California, and Denver, Colorado at different
   conventions.  For example, in 2018, the federation in the
   demonstration is composed of three member networks.  Network 1 is in
   Dallas, Texas, and Network 2 and network 3 are in Los Angeles,
   California.  Network 1 is connected to network 2 through a layer-2
   WAN circuit with a 100 Gbps bandwidth, provisioned by several
   providers such as SCinet, CenturyLink and CENIC.  Network 1 is a
   temporal science network in the CMS experiment, while network 2 and 3
   are long-running CMS Tier-2 sites.
”
I believe your case require server to server communication for end-to-end 
interdomain routing.

Yes, the server-to-server communication for the e2e interdomain routing is 
helpful. However, we didn't use/extend ALTO to do this in our deployment. We 
used SFP (a BGP extension) [2] to do this. So any ALTO servers didn't 
communicate with each other. The limitation is that we must assume the ALTO 
server of each domain can provide consistent cost metrics.

[2] "SFP: Toward Interdomain Routing for SDN Networks", SIGCOMM 2018 Poster 
(https://dl.acm.org/doi/10.1145/3234200.3234207)

Thanks,
Jensen


Secondly, as for network information exposure in multi-domain setting, I think
1. 3GPP Network Exposure Function is a good example f

Re: [alto] ALTO Draft ReCharter WG review

2021-03-07 Thread Qin Wu
Hi, Gang:
Thanks for sharing your use case, let me rephrase what you envision for your 
use case,
You want to express QoS requirement in the subscription request, the network 
exposes the network information via notification in response to subscription 
request,
application operators can tune adaptive rate to improve user QoE based on the 
network information change.

Can you clarify a little bit about specific application traffic patterns?

Secondly, I agree fine granularity pub sub can consider one time subscription 
and configure wait time as subscription policy to alleviate the signaling load 
on the network.

-Qin
发件人: Li Gang [mailto:ligan...@chinamobile.com]
发送时间: 2021年3月7日 16:30
收件人: kai...@scu.edu.cn; Qin Wu 
抄送: alto-cha...@ietf.org; alto-...@ietf.org; 'IETF ALTO' 
主题: RE: [alto] ALTO Draft ReCharter WG review

Hi, Kai and Qin,

Thanks for triggering the discussion on  the 2nd item of the recharter text.
I agree that it would be better to define a generic pub/sub framework 
irrespective of specific transport protocol.
We can start with a simple pub/sub mechanism, which is driven by concrete use 
cases and then consider to extend as needed.

Some of my thoughts are inline.

Li Gang

From: alto [mailto:alto-boun...@ietf.org] On Behalf Of 
kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>
Sent: Friday, March 5, 2021 11:03 AM
To: Qin Wu
Cc: alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>; IETF ALTO
Subject: Re: [alto] ALTO Draft ReCharter WG review


Hi Qin,



Thanks for the comments. A quick summary of my response is



1. "Pub/sub" means different things in different contexts and I think we must 
clarify what it means in the context of distributing ALTO information.

2. There are two ways of realizing complex "pub/sub" of ALTO information but I 
think they are fundamentally different deployment settings for one generic 
framework (whose details are, unfortunately, not thought through yet).



Please see the details inline.



Best,

Kai


-Original Messages-
From:"Qin Wu" mailto:bill...@huawei.com>>
Sent Time:2021-03-04 22:21:06 (Thursday)
To: "kai...@scu.edu.cn<mailto:kai...@scu.edu.cn>" 
mailto:kai...@scu.edu.cn>>
Cc: "alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>" 
mailto:alto-cha...@ietf.org>>, 
"alto-...@ietf.org<mailto:alto-...@ietf.org>" 
mailto:alto-...@ietf.org>>, "IETF ALTO" 
mailto:alto@ietf.org>>
Subject: Re: [alto] ALTO Draft ReCharter WG review
Kai:
发件人: kai...@scu.edu.cn<mailto:kai...@scu.edu.cn> [mailto:kai...@scu.edu.cn]
发送时间: 2021年3月3日 21:40
收件人: Qin Wu mailto:bill...@huawei.com>>
抄送: IETF ALTO mailto:alto@ietf.org>>; 
alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>; 
alto-...@ietf.org<mailto:alto-...@ietf.org>
主题: Re: [alto] ALTO Draft ReCharter WG review


Dear all,



Below are some comments on the 2nd item in the recharter text.



As far as I know, the ALTO incremental update extension (RFC 8895) already 
provides a mechanism to enable the "pub-sub" of ALTO information, using 
Server-Sent Events (SSE). I see there are multiple directions indicated by the 
new charter item:
[Qin]: Thanks for clarifying the difference between SSE and pub sub proposed in 
the new proposed charter item.

1. Decouple the "pub-sub" protocol with the underlying mechanism.

Besides SSE, other mechanisms can also be used to realize the "pub-sub" of ALTO 
information, such as HTTP/2, HTTP/3 or the methods mentioned in the charter 
text. Thus, a direct extension is to define the abstract format of control 
messages and data messages (i.e., WHAT information should be provided but not 
HOW), and allow different underlying protocols to use protocol-specific 
encodings.

For example, SSE encodes the metadata (e.g., content-type and stream id) and 
the content of an event using "event:" and "data:" prefixes at the beginning of 
each line, and uses empty lines to indicate the end of a message, while HTTP/2 
(RFC 7540) may encode the metadata and the content of an event using 
PUSH_PROMISE/HEADERS and DATA frame .

[Qin]: Good analysis, I think we need to decide whether we should define 
generic pub sub mechanism or transport specific pub sub mechanism. Do you have 
any suggestion on this?

[KAI]: I think the generic pub-sub mechanism (or maybe the term framework is 
more appropriate) is more important at this point, which should also cover the 
direction of providing more fine-grained control. One thing that just strikes 
me after taking a quick look at rabbitMQ is that "pub/sub" means different 
things in different contexts. It is important we understand what are the 
requirements of generic pub/sub in the ALTO framework.

[KAI]: When we discuss "pub/sub" with SSE and HTTP/2, which is a one-to-one 
client-serve

Re: [alto] ALTO Draft ReCharter WG review

2021-03-07 Thread Li Gang
Hi, Kai and Qin,

 

Thanks for triggering the discussion on  the 2nd item of the recharter text.

I agree that it would be better to define a generic pub/sub framework 
irrespective of specific transport protocol.

We can start with a simple pub/sub mechanism, which is driven by concrete use 
cases and then consider to extend as needed.

 

Some of my thoughts are inline.

 

Li Gang

 

From: alto [mailto:alto-boun...@ietf.org] On Behalf Of kai...@scu.edu.cn
Sent: Friday, March 5, 2021 11:03 AM
To: Qin Wu
Cc: alto-cha...@ietf.org; alto-...@ietf.org; IETF ALTO
Subject: Re: [alto] ALTO Draft ReCharter WG review

 

Hi Qin, 

 

Thanks for the comments. A quick summary of my response is 

 

1. "Pub/sub" means different things in different contexts and I think we must 
clarify what it means in the context of distributing ALTO information. 

2. There are two ways of realizing complex "pub/sub" of ALTO information but I 
think they are fundamentally different deployment settings for one generic 
framework (whose details are, unfortunately, not thought through yet). 

 

Please see the details inline. 

 

Best, 

Kai 






-Original Messages-
From:"Qin Wu" 
Sent Time:2021-03-04 22:21:06 (Thursday)
To: "kai...@scu.edu.cn" 
Cc: "alto-cha...@ietf.org" , "alto-...@ietf.org" 
, "IETF ALTO" 
Subject: Re: [alto] ALTO Draft ReCharter WG review

Kai: 

发件人: kai...@scu.edu.cn [mailto:kai...@scu.edu.cn] 
发送时间: 2021年3月3日 21:40
收件人: Qin Wu 
抄送: IETF ALTO ; alto-cha...@ietf.org; alto-...@ietf.org
主题: Re: [alto] ALTO Draft ReCharter WG review 

  

Dear all, 

  

Below are some comments on the 2nd item in the recharter text. 

  

As far as I know, the ALTO incremental update extension (RFC 8895) already 
provides a mechanism to enable the "pub-sub" of ALTO information, using 
Server-Sent Events (SSE). I see there are multiple directions indicated by the 
new charter item: 

[Qin]: Thanks for clarifying the difference between SSE and pub sub proposed in 
the new proposed charter item. 

1. Decouple the "pub-sub" protocol with the underlying mechanism. 

Besides SSE, other mechanisms can also be used to realize the "pub-sub" of ALTO 
information, such as HTTP/2, HTTP/3 or the methods mentioned in the charter 
text. Thus, a direct extension is to define the abstract format of control 
messages and data messages (i.e., WHAT information should be provided but not 
HOW), and allow different underlying protocols to use protocol-specific 
encodings. 

For example, SSE encodes the metadata (e.g., content-type and stream id) and 
the content of an event using "event:" and "data:" prefixes at the beginning of 
each line, and uses empty lines to indicate the end of a message, while HTTP/2 
(RFC 7540) may encode the metadata and the content of an event using 
PUSH_PROMISE/HEADERS and DATA frame . 

[Qin]: Good analysis, I think we need to decide whether we should define 
generic pub sub mechanism or transport specific pub sub mechanism. Do you have 
any suggestion on this? 

[KAI]: I think the generic pub-sub mechanism (or maybe the term framework is 
more appropriate) is more important at this point, which should also cover the 
direction of providing more fine-grained control. One thing that just strikes 
me after taking a quick look at rabbitMQ is that "pub/sub" means different 
things in different contexts. It is important we understand what are the 
requirements of generic pub/sub in the ALTO framework. 

[KAI]: When we discuss "pub/sub" with SSE and HTTP/2, which is a one-to-one 
client-server communication, the focus of the "pub/sub" here is simple: what 
are the messages and how the client can control the subscribed information. 
However, with message queues (e.g., rabbitMQ), the communication pattern may be 
more complex: a message can be sent to multiple queues without knowing exactly 
who is subscribing. I see two ways to realize the more complex "pub/sub" 
requirement for ALTO information. 

rabbitMQ: https://www.rabbitmq.com/tutorials/tutorial-three-python.html 

[KAI]: CASE A: First, the client application may use deploy its own "pub/sub" 
system, and the ALTO client simply serves as a producer by forwarding the ALTO 
messages to the "pub/sub" system. In this way, the problem is reduced to the 
one-to-one "pub/sub" problem. 

[KAI]: CASE B: Second, ALTO servers may natively support the "pub/sub" of ALTO 
information. In this case, an ALTO server may need to handle events such as 
join/leave of clients that subscribe to the same ALTO information. For example, 
for a client that just subscribes to a network map, the server should send the 
whole map instead of incremental updates. 

[KAI]: Both approaches have pros and cons. The first is simple on the server 
side but may be less efficient (because of trian

Re: [alto] ALTO Draft ReCharter WG review

2021-03-04 Thread 刘鹏


Hi Qin,




Please see inline.








Peng Liu | 刘鹏

China Mobile | 移动研究院

mobile phone:13810146105

email:  liupeng...@chinamobile.com

 



发件人: Qin Wu

时间: 2021/03/03(星期三)17:11

收件人: 刘鹏;

抄送人: IETF ALTO;

主题: RE: RE: [alto] ALTO Draft ReCharter WG review 

 

Hi, Peng: 

 

 

发件人: 刘鹏 [mailto:liupeng...@chinamobile.com] 
 发送时间: 2021年3月2日 11:41
 收件人: Qin Wu 
 抄送: IETF ALTO 
 主题: Re: RE: [alto] ALTO Draft ReCharter WG review   

  

 

Hi Qin, 

Thanks you. I still have some questions, please see my reply inline below.  

 

   

 

 

Peng Liu | 刘鹏  

 

China Mobile | 移动研究院  

 

mobile phone:13810146105  

 

email:  liupeng...@chinamobile.com

   

 

 

Hi WG,   

 

Here are some considerations of recharter: 

I believe that the multi domain problem is worthy of attention. At present, 
operators also research in it, which may involve guaranteeing  end-to-end 
network service in the future, such as delay, bandwidth, etc. There are some 
researches on cross domain deterministic network in the industry, which need 
some support from management and control plane. 

[Qin]: thanks for sharing your use case, I think we may have many multi-domain 
applications.  Multiple domain setting is not only referred to multiple 
administrative domains belonging to the same operator but also referred to 
cross operator domains. 

[Peng]: Yes, we can easily find the usecase of cross operators domains such as 
home broadband. 

Detnet can be a good use case for muit-domain setting, we may also consider 
many other  use cases such as traffic from source to destination spanning 
across multiple administrative domain, the computing and storage are 
distributed in different administrative domain 

[Peng]: DetNet WG only solves the problem of single domain, because multi 
domain brings much more challenge to the deterministic latency guarantee. It 
may be difficult to implement strict multi domain deterministic latency 
guarantee now, but we may gradually optimize it.  

  

[Qin-1]Yes, you are right, reading Detnet charter,  its scope did focuses on 
single administrative control domain or within a closed group of administrative 
control domain. I believe RAW WG also focuses on single domain issue. 

 [Peng-1]  It is a challenge but valuable I think, we also initiated a work 
item“Requirements and framework of  Deterministic QoS in large-scale 
telecommunications networking for IMT-2020 networks and beyond"   in ITU-T, 
which includes discussing the multi domain requirments in deterministic 
network.  

Which require resource discovery or multi domain SFC case. 

As stipulated by RFC7971, there is the network consisting of multiple domains 
and in many cases it is not possible to collect information across network 
borders.  This issue can be addressed by deploying ALTO server in each domain 
with hierarchy design or mesh design, and allow server to server communication. 

In addition, we need to consider multi domain connectivity discovery, multi 
domain service discovery. 

  

[Peng]: I agree that it is difficult 'to collect information across network 
borders', and can you explain more about the "hierarchy design or mesh design"? 
  

For the 'multi domain connectivity discovery, multi domain 
service discovery', is there any usecase or requirements can be found now? 

[Qin-1]:In hierarchy design, ALTO servers in the domain partitions (e.g., each 
local domain) gather local information and send it to centralized ALTO server. 

The mesh design, is more like peer to peer pattern design, ALTO servers may be 
set up in each domain independently, and gathering the network information from 
other connected adjacent domains. 

Multi-domain connectivity discovery, multi service discovery is the solutions 
proposed for the corresponding use case. multi-service discovery is more 
related to ALTO server discovery, I think we may leverage existing mechanism 
proposed in RFC8686. Multi-connectivity discovery is to expand ALTO path vector 
mechanism to multi domain setting. Special requirements for multi-domain 
setting is to carry network information across domain which include domain 
identifier information, we may also consider to carry compute information, 
which help combine network information and compute information for service edge 
discovery. 

[Peng-1] : Good idea and I think it may help the network and benifit some new 
services in the furture.

Who is the provider of Alto service is related to the deployment and 
cooperation mode. It may be difficult for operators to give too much  detailed 
network information now. If the Alto service belongs to the operator, it may be 
used to help manage its own network. If Alto service belong to non operators, I 
think the issue of how to cooperate needs further discussion. 

[Qin]:I think one good use case we have is MOWIE use case, i.e., adjust the 
bitrate to  improve Cloud gaming QoE experience based on abstract network 
informatio

Re: [alto] ALTO Draft ReCharter WG review

2021-03-04 Thread Qin Wu
Hi,
发件人: Qiao Xiang [mailto:xiang...@gmail.com]
发送时间: 2021年3月5日 0:03
收件人: Qin Wu 
抄送: 刘鹏 ; Y. Richard Yang ; IETF 
ALTO 
主题: Re: [alto] ALTO Draft ReCharter WG review

Sorry, I missed one comment:

Qin: I believe your case require server to server communication for end-to-end 
interdomain routing.

My comment: I think we used BGP to provide the e2e interdomain routing 
information.

[Qin Wu]: Understand,  we don’t need to change route exchange protocol across 
domain, BGP is the wonderful protocol for this job.

Best
Qiao

On Thu, Mar 4, 2021 at 11:57 PM Qiao Xiang 
mailto:xiang...@gmail.com>> wrote:
Hi Qin,

Thank you so much for the feedback. Please see my responses inline.

On Thu, Mar 4, 2021 at 9:22 PM Qin Wu 
mailto:bill...@huawei.com>> wrote:
Thanks Qiao for sharing your project on Unicorn and thought on multi-domain 
setting.
My impression in your implementation is each domain name and first ingress node 
in such domain will be carried in the ALTO response message.
First, for domain name, I do not believe we need that in the ALTO response 
message. Our setting here is each domain has an ALTO server, and the ALTO 
clients at the aggregator have separate connections to different ALTO servers. 
In this way, by maintaining a (domain, ALTO  server) mapping, the aggregator 
can differentiate responses from different domains. Second, for ingress node, 
the client needs to specify the ingress and the (srcIP, dstIP) pair in the 
query first so that the ALTO server knows what information to return. And I 
should also clarify that although we use ODL-ALTO for our system, but the path 
vector extension is not implemented exactly following the specification since 
it was not fully stabilized then.

[Qin Wu]: I think we can use BGP for inter domain route exchange, we can use 
ALTO path vector for multi-domain peer selection or path selection. Right now, 
I think path vector hasn’t been designed for multi-domain setting, if my 
understanding is correct.
But PCEP has already supported multi-domain path computation.

@Jensen is the core developer and can comment further on this, as well as the 
ODL implementation.

One thing I want to highlight is
Unicorn has already been deployed in several cities of USA in 2018 and 
implemented in the ODL open source.
I should clarify that this deployment is pre-production, and the demonstration 
scenario is at SC18 and SC19, where we are at the conference cities (Dallas and 
Denver), and orchestrate traffic from there back to a Caltech LHC site (we 
manually separate this site into two domains to create a 3-domain scenario for 
demonstration purpose.)

[Qin Wu]: I see. Thank Qiao for clarification.
Quote from 
https://datatracker.ietf.org/doc/draft-xiang-alto-multidomain-analytics/
“
   The authors build an ALTO server on top of the OpenDaylight Software
   Defined Network controller.  The ALTO server collects the network
   state information from the OpenDaylight controller, e.g., topology,
   policy and traffic statistics, processes the collected information
   into resource abstraction, and sends the abstraction back to the ALTO
   client at the resource orchestrator.

The Unicorn framework has been deployed and
   demonstrated in small federation networks connecting Dallas, Texas,
   Los Angles, California, and Denver, Colorado at different
   conventions.  For example, in 2018, the federation in the
   demonstration is composed of three member networks.  Network 1 is in
   Dallas, Texas, and Network 2 and network 3 are in Los Angeles,
   California.  Network 1 is connected to network 2 through a layer-2
   WAN circuit with a 100 Gbps bandwidth, provisioned by several
   providers such as SCinet, CenturyLink and CENIC.  Network 1 is a
   temporal science network in the CMS experiment, while network 2 and 3
   are long-running CMS Tier-2 sites.
”
I believe your case require server to server communication for end-to-end 
interdomain routing.

Secondly, as for network information exposure in multi-domain setting, I think
1. 3GPP Network Exposure Function is a good example for network information 
exposure, but it is part of 5G core which enables data exchange between UE and 
application server and does not extend to other domain.
2. ZSM multi-domain network and service management can be another concrete 
example for multiple domain network information exposure which can be used to 
have a quick
response to network anomaly or reroute the traffic to the less congested path 
[https://www.etsi.org/deliver/etsi_gs/ZSM/001_099/002/01.01.01_60/gs_ZSM002v010101p.pdf].
3. PCE has similar design for multi-domain setting, which allows PCE to PCE 
communication.

Thank you again for the pointers. I'll take a look at ZSM and PCE soon.


Best
Qiao

-Qin
发件人: Qiao Xiang [mailto:xiang...@gmail.com<mailto:xiang...@gmail.com>]
发送时间: 2021年3月3日 0:18
收件人: 刘鹏 mailto:liupeng...@chinamobile.com>>
抄送: Y. Richard Yang mailto:y...@cs.yale.edu>>; IETF ALTO 
mailto:alto@i

Re: [alto] ALTO Draft ReCharter WG review

2021-03-04 Thread kaigao
Hi Qin,




Thanks for the comments. A quick summary of my response is




1. "Pub/sub" means different things in different contexts and I think we must 
clarify what it means in the context of distributing ALTO information.

2. There are two ways of realizing complex "pub/sub" of ALTO information but I 
think they are fundamentally different deployment settings for one generic 
framework (whose details are, unfortunately, not thought through yet).




Please see the details inline.




Best,

Kai



-Original Messages-
From:"Qin Wu" 
Sent Time:2021-03-04 22:21:06 (Thursday)
To: "kai...@scu.edu.cn" 
Cc: "alto-cha...@ietf.org" , "alto-...@ietf.org" 
, "IETF ALTO" 
Subject: Re: [alto] ALTO Draft ReCharter WG review



Kai:

发件人: kai...@scu.edu.cn [mailto:kai...@scu.edu.cn]
发送时间: 2021年3月3日 21:40
收件人: Qin Wu 
抄送: IETF ALTO ; alto-cha...@ietf.org; alto-...@ietf.org
主题: Re: [alto] ALTO Draft ReCharter WG review

 

Dear all,

 

Below are some comments on the 2nd item in the recharter text.

 

As far as I know, the ALTO incremental update extension (RFC 8895) already 
provides a mechanism to enable the "pub-sub" of ALTO information, using 
Server-Sent Events (SSE). I see there are multiple directions indicated by the 
new charter item:

[Qin]: Thanks for clarifying the difference between SSE and pub sub proposed in 
the new proposed charter item.

1. Decouple the "pub-sub" protocol with the underlying mechanism.

 

Besides SSE, other mechanisms can also be used to realize the "pub-sub" of ALTO 
information, such as HTTP/2, HTTP/3 or the methods mentioned in the charter 
text. Thus, a direct extension is to define the abstract format of control 
messages and data messages (i.e., WHAT information should be provided but not 
HOW), and allow different underlying protocols to use protocol-specific 
encodings.

 

For example, SSE encodes the metadata (e.g., content-type and stream id) and 
the content of an event using "event:" and "data:" prefixes at the beginning of 
each line, and uses empty lines to indicate the end of a message, while HTTP/2 
(RFC 7540) may encode the metadata and the content of an event using 
PUSH_PROMISE/HEADERS and DATA frame .

[Qin]: Good analysis, I think we need to decide whether we should define 
generic pub sub mechanism or transport specific pub sub mechanism. Do you have 
any suggestion on this?




[KAI]: I think the generic pub-sub mechanism (or maybe the term framework is 
more appropriate) is more important at this point, which should also cover the 
direction of providing more fine-grained control. One thing that just strikes 
me after taking a quick look at rabbitMQ is that "pub/sub" means different 
things in different contexts. It is important we understand what are the 
requirements of generic pub/sub in the ALTO framework.




[KAI]: When we discuss "pub/sub" with SSE and HTTP/2, which is a one-to-one 
client-server communication, the focus of the "pub/sub" here is simple: what 
are the messages and how the client can control the subscribed information. 
However, with message queues (e.g., rabbitMQ), the communication pattern may be 
more complex: a message can be sent to multiple queues without knowing exactly 
who is subscribing. I see two ways to realize the more complex "pub/sub" 
requirement for ALTO information.




rabbitMQ: https://www.rabbitmq.com/tutorials/tutorial-three-python.html




[KAI]: CASE A: First, the client application may use deploy its own "pub/sub" 
system, and the ALTO client simply serves as a producer by forwarding the ALTO 
messages to the "pub/sub" system. In this way, the problem is reduced to the 
one-to-one "pub/sub" problem.




[KAI]: CASE B: Second, ALTO servers may natively support the "pub/sub" of ALTO 
information. In this case, an ALTO server may need to handle events such as 
join/leave of clients that subscribe to the same ALTO information. For example, 
for a client that just subscribes to a network map, the server should send the 
whole map instead of incremental updates.




[KAI]: Both approaches have pros and cons. The first is simple on the server 
side but may be less efficient (because of triangle routing) and complex on the 
client side (client must handle data consistency to support dynamic 
subscribers). I think the generic framework should contain two aspects:




[KAI] 1. Control of ALTO information: a server-client protocol which is similar 
to RFC 8895 but maybe with some extended capabilities.

[KAI] 2. Distribution of ALTO information: a MQ-like protocol that controls how 
the ALTO information can be efficiently and consistently delivered to 
subscribers.




[KAI] I think the connection between these two aspects is a logical entity 
called ALTO Exchange (following the term used by rabbitMQ). This entity ca

Re: [alto] ALTO Draft ReCharter WG review

2021-03-04 Thread Jensen Zhang
t; think
>>
>> 1. 3GPP Network Exposure Function is a good example for network
>> information exposure, but it is part of 5G core which enables data exchange
>> between UE and application server and does not extend to other domain.
>>
>> 2. ZSM multi-domain network and service management can be another
>> concrete example for multiple domain network information exposure which can
>> be used to have a quick
>>
>> response to network anomaly or reroute the traffic to the less congested
>> path [
>> https://www.etsi.org/deliver/etsi_gs/ZSM/001_099/002/01.01.01_60/gs_ZSM002v010101p.pdf
>> ].
>>
>> 3. PCE has similar design for multi-domain setting, which allows PCE to
>> PCE communication.
>>
>>
>> Thank you again for the pointers. I'll take a look at ZSM and PCE soon.
>
>

> Best
> Qiao
>
>
>> -Qin
>>
>> *发件人:* Qiao Xiang [mailto:xiang...@gmail.com]
>> *发送时间:* 2021年3月3日 0:18
>> *收件人:* 刘鹏 
>> *抄送:* Y. Richard Yang ; IETF ALTO ; Qin
>> Wu 
>> *主题:* Re: [alto] ALTO Draft ReCharter WG review
>>
>>
>>
>> Hi Peng, Qin and Richard,
>>
>>
>>
>> Very good discussion! Richard and I have been working with folks from CMS
>> and ESNet (a large global multi-domain science network) to design network
>> information exposure abstractions and mechanisms in multi-domain
>> networks, with privacy requirements considered. The basic idea stems from
>> the ALTO path-vector extension but goes beyond to take privacy into
>> consideration. The following are some pointers.
>>
>>
>>
>> [1] "Toward Fine-Grained, Privacy-Preserving, Efficient Multi-Domain
>> Network Resource Discovery", IEEE JSAC, 2019. (
>> https://ieeexplore.ieee.org/abstract/document/8756056)
>> [2] "Resource Orchestration for Multi-Domain, Exascale, Geo-Distributed
>> Data Analytics", (
>> https://datatracker.ietf.org/doc/draft-xiang-alto-multidomain-analytics/)
>>
>>
>>
>> For the pointers above, the privacy requirement considered in this work
>> is that the network information of multiple domains should be exposed to
>> applications as a complete, unified aggregation, appearing as much as
>> possible as from a single (virtual) network. We design a network
>> information obfuscation mechanism so that the application is not able to
>> associate any network resource bottleneck information to any domain,
>> reducing the risk of exposing network vulnerability.
>>
>>
>>
>> In addition, we also studied how to control the routing across multiple
>> domains to achieve more flexible end-to-end interdomain routing.
>> Essentially, we propose a mechanism that allows networks to expose their
>> available interdomain routes, just as BGP looking glasses, so that
>> applications can control them. In this setting, we consider the privacy
>> setting where each network's BGP export policies are private, and design
>> interesting algorithms for applications to select the best policy-compliant
>> routes without knowing the export policies. The following is the pointer
>> for this study:
>>
>>
>>
>> [3] "Toward Optimal Software-Defined Interdomain Routing". INFOCOM 2020 (
>> https://ieeexplore.ieee.org/abstract/document/9155486)
>>
>>
>>
>> Above are our current efforts on extending ALTO to multi-domain settings.
>> It would be great if we can know more about the industry efforts on network
>> information exposure in multi-domain settings, and the privacy requirements
>> of operators. This would be extremely helpful to push this extension
>> forward! :-)
>>
>>
>>
>>
>>
>>
>>
>> Best
>>
>> Qiao
>>
>>
>>
>> On Tue, Mar 2, 2021 at 1:14 PM 刘鹏  wrote:
>>
>> Hi Richard,
>>
>>
>>
>> Thank you. please see my reply inline below.
>>
>>
>>
>>
>>
>> Peng Liu | 刘鹏
>>
>> China Mobile | 移动研究院
>>
>> mobile phone:13810146105
>>
>> email: * liupeng...@chinamobile.com *
>>
>>
>>
>> 发件人: Y. Richard Yang 
>>
>> 时间: 2021/03/02(星期二)07:36
>>
>> 收件人: 刘鹏 ;
>>
>> 抄送人: IETF ALTO ;Qin Wu ;
>>
>> 主题: Re: [alto] ALTO Draft ReCharter WG review
>>
>> Dear Peng,
>>
>>
>>
>> Thank you so much for the feedback. Please see below.
>>
>>
>>
>> On Fri, Feb 26, 2021 at 9:23 PM 刘鹏  wrote:
>>
>> Hi WG,
>>
>>
>>
>> Here are some consi

Re: [alto] ALTO Draft ReCharter WG review -- ALTO Data Model

2021-03-04 Thread Dhruv Dhody
Hi Jensen,




>> Yes the YANG needs to follow whatever decision is taken regarding the
>> ALTO server-to-server communication. There is also a high-level
>> decision that if we have a single YANG model for ALTO that can be used
>> by both client and server or have independent yang models: one for
>> client and another for server.
>>
>
> My personal feeling is that the configuration requirements for the ALTO
> server and client are very different. e.g., The ALTO server needs to be
> configured which services it can provide, while the ALTO client needs to be
> configured which servers and services it would like to request. So I'm not
> sure if we should define a single YANG model for both client and server.
> But I notice that PCEP defines a single model for both PCE and PCC. From
> your experience, which decision is better for ALTO?
>
>

Dhruv: To me, this would be dependent on what we do with ALTO server-to-server
communication. If one server is acting as a client and would need
management in the same way as a stand-alone ALTO client, then a single
model helps avoid duplication.




>> Using the YANG model for monitoring purposes (status, error,
>> statistics) at the ALTO client/server is quite useful.
>>
>
> Thanks for your suggestion. From your experience, which kind of
> information should not be monitored using the YANG model? For example, if
> the client wants to record all the historical requests, should we use the
> YANG model to do it? Or we should only use the YANG model to track the
> immediate status?
>
>
Dhruv: I doubt the ALTO client remembers the past request. YANG cant model
data that doesn't exist. Correct me if I am mistaken. The immediate status,
the statistics, the last error, is what you would usually find!

Thanks!
Dhruv

Thanks,
> Jensen
>
>
>>
>> Thanks,
>> Dhruv
>>
>> > It would be great if people can share further comments or their own
>> interesting use cases.
>> >
>> > [1] https://tools.ietf.org/html/draft-ietf-pce-pcep-yang-15
>> > [2]
>> https://tools.ietf.org/html/draft-ietf-netconf-http-client-server-06
>> >
>> > Best regards,
>> > Jensen
>> >
>> >
>> > On Mon, Feb 22, 2021 at 9:51 PM Qin Wu  wrote:
>> >>
>> >> Hi, :
>> >>
>> >> We have requested one hour session for ALTO WG meeting in the upcoming
>> IETF 110, which is arranged on Friday, March 12, 14:30-15:30(UTC).
>> >>
>> >> The goal is to boil down ALTO recharter and have consensus on charter
>> contents in IETF 110.
>> >>
>> >> To get this goal, an updated inline draft charter text for ALTO has
>> just been posted to this list,
>> >>
>> >> This charter has received a couple of rounds of informal review from
>> WG members, chairs and our Ads from brief to deep thorough, 5 new chartered
>> items have been listed.
>> >>
>> >> We would like to solicit feedback on these new chartered items and
>> your use case, deployment, idea corresponding to these new chartered items.
>> >>
>> >> Sharing your past deployment story will also be appreciated.
>> >>
>> >>
>> >>
>> >>
>> 
>> >>
>> >> The ALTO working group was established in 2008 to devise a
>> request/response protocol to allow a host to benefit from a server that is
>> more cognizant of the network infrastructure than the host is.
>> >>
>> >>
>> >>
>> >> The working group has developed an HTTP-based protocol and recent work
>> has reported large-scale deployment of ALTO based solutions supporting
>> applications such as content distribution networks (CDN).
>> >>
>> >>
>> >>
>> >> ALTO is now proposed as a component for cloud-based interactive
>> applications, large-scale data analytics, multi-cloud SD-WAN deployment,
>> and distributed
>> >>
>> >> computing. In all these cases, exposing network information such as
>> abstract topologies and network function deployment location helps
>> applications.
>> >>
>> >>
>> >>
>> >> To support these emerging uses, extensions are needed, and additional
>> functional and architectural features need to be considered as follows:
>> >>
>> >>
>> >>
>> >> o Protocol extensions to support a richer and extensible set of policy
>> attributes in ALTO information update request and response. Such policy
>> attributes may indicate information dependency (e.g., ALTO path-cost/QoS
>> properties with dependency on real-time network  indications), optimization
>> criteria (e.g., lowest latency/throughput network performance objective),
>> and constraints (e.g., relaxation bound of optimization criteria, domain or
>> network node to be traversed, diversity and redundancy of paths).
>> >>
>> >>
>> >>
>> >> o Protocol extensions for facilitating operational automation tasks
>> and improving transport efficiency. In particular, extensions to provide
>> "pub/sub" mechanisms to allow the client to request and receive a diverse
>> types (such as event-triggered/sporadic, continuous), continuous,
>> customized feed of publisher-generated information. Efforts 

Re: [alto] ALTO Draft ReCharter WG review

2021-03-04 Thread Qiao Xiang
Sorry, I missed one comment:

Qin: I believe your case require server to server communication for
end-to-end interdomain routing.

My comment: I think we used BGP to provide the e2e interdomain routing
information.


Best
Qiao

On Thu, Mar 4, 2021 at 11:57 PM Qiao Xiang  wrote:

> Hi Qin,
>
> Thank you so much for the feedback. Please see my responses inline.
>
> On Thu, Mar 4, 2021 at 9:22 PM Qin Wu  wrote:
>
>> Thanks Qiao for sharing your project on Unicorn and thought on
>> multi-domain setting.
>>
>> My impression in your implementation is each domain name and first
>> ingress node in such domain will be carried in the ALTO response message.
>>
> First, for domain name, I do not believe we need that in the ALTO response
> message. Our setting here is each domain has an ALTO server, and the ALTO
> clients at the aggregator have separate connections to different ALTO
> servers. In this way, by maintaining a (domain, ALTO  server) mapping, the
> aggregator can differentiate responses from different domains. Second, for
> ingress node, the client needs to specify the ingress and the (srcIP,
> dstIP) pair in the query first so that the ALTO server knows what
> information to return. And I should also clarify that although we use
> ODL-ALTO for our system, but the path vector extension is not implemented
> exactly following the specification since it was not fully stabilized then.
>
> @Jensen is the core developer and can comment further on this, as well as
> the ODL implementation.
>
>
>> One thing I want to highlight is
>>
>> Unicorn has already been deployed in several cities of USA in 2018 and
>> implemented in the ODL open source.
>>
> I should clarify that this deployment is pre-production, and the
> demonstration scenario is at SC18 and SC19, where we are at the conference
> cities (Dallas and Denver), and orchestrate traffic from there back to a
> Caltech LHC site (we manually separate this site into two domains to create
> a 3-domain scenario for demonstration purpose.)
>
>
>> Quote from
>> https://datatracker.ietf.org/doc/draft-xiang-alto-multidomain-analytics/
>>
>> “
>>
>>The authors build an ALTO server on top of the OpenDaylight Software
>>
>>Defined Network controller.  The ALTO server collects the network
>>
>>state information from the OpenDaylight controller, e.g., topology,
>>
>>policy and traffic statistics, processes the collected information
>>
>>into resource abstraction, and sends the abstraction back to the ALTO
>>
>>client at the resource orchestrator.
>>
>>
>>
>> The Unicorn framework has been deployed and
>>
>>demonstrated in small federation networks connecting Dallas, Texas,
>>
>>Los Angles, California, and Denver, Colorado at different
>>
>>conventions.  For example, in 2018, the federation in the
>>
>>demonstration is composed of three member networks.  Network 1 is in
>>
>>Dallas, Texas, and Network 2 and network 3 are in Los Angeles,
>>
>>California.  Network 1 is connected to network 2 through a layer-2
>>
>>WAN circuit with a 100 Gbps bandwidth, provisioned by several
>>
>>providers such as SCinet, CenturyLink and CENIC.  Network 1 is a
>>
>>temporal science network in the CMS experiment, while network 2 and 3
>>
>>are long-running CMS Tier-2 sites.
>>
>> ”
>>
>> I believe your case require server to server communication for end-to-end
>> interdomain routing.
>>
>>
>>
>> Secondly, as for network information exposure in multi-domain setting, I
>> think
>>
>> 1. 3GPP Network Exposure Function is a good example for network
>> information exposure, but it is part of 5G core which enables data exchange
>> between UE and application server and does not extend to other domain.
>>
>> 2. ZSM multi-domain network and service management can be another
>> concrete example for multiple domain network information exposure which can
>> be used to have a quick
>>
>> response to network anomaly or reroute the traffic to the less congested
>> path [
>> https://www.etsi.org/deliver/etsi_gs/ZSM/001_099/002/01.01.01_60/gs_ZSM002v010101p.pdf
>> ].
>>
>> 3. PCE has similar design for multi-domain setting, which allows PCE to
>> PCE communication.
>>
>>
>> Thank you again for the pointers. I'll take a look at ZSM and PCE soon.
>
>
> Best
> Qiao
>
>
>> -Qin
>>
>> *发件人:* Qiao Xiang [mailto:xiang...@gmail.com]
>> *发送时间:* 2021年3月3日 0:18

Re: [alto] ALTO Draft ReCharter WG review

2021-03-04 Thread Qiao Xiang
Hi Qin,

Thank you so much for the feedback. Please see my responses inline.

On Thu, Mar 4, 2021 at 9:22 PM Qin Wu  wrote:

> Thanks Qiao for sharing your project on Unicorn and thought on
> multi-domain setting.
>
> My impression in your implementation is each domain name and first ingress
> node in such domain will be carried in the ALTO response message.
>
First, for domain name, I do not believe we need that in the ALTO response
message. Our setting here is each domain has an ALTO server, and the ALTO
clients at the aggregator have separate connections to different ALTO
servers. In this way, by maintaining a (domain, ALTO  server) mapping, the
aggregator can differentiate responses from different domains. Second, for
ingress node, the client needs to specify the ingress and the (srcIP,
dstIP) pair in the query first so that the ALTO server knows what
information to return. And I should also clarify that although we use
ODL-ALTO for our system, but the path vector extension is not implemented
exactly following the specification since it was not fully stabilized then.

@Jensen is the core developer and can comment further on this, as well as
the ODL implementation.


> One thing I want to highlight is
>
> Unicorn has already been deployed in several cities of USA in 2018 and
> implemented in the ODL open source.
>
I should clarify that this deployment is pre-production, and the
demonstration scenario is at SC18 and SC19, where we are at the conference
cities (Dallas and Denver), and orchestrate traffic from there back to a
Caltech LHC site (we manually separate this site into two domains to create
a 3-domain scenario for demonstration purpose.)


> Quote from
> https://datatracker.ietf.org/doc/draft-xiang-alto-multidomain-analytics/
>
> “
>
>The authors build an ALTO server on top of the OpenDaylight Software
>
>Defined Network controller.  The ALTO server collects the network
>
>state information from the OpenDaylight controller, e.g., topology,
>
>policy and traffic statistics, processes the collected information
>
>into resource abstraction, and sends the abstraction back to the ALTO
>
>client at the resource orchestrator.
>
>
>
> The Unicorn framework has been deployed and
>
>demonstrated in small federation networks connecting Dallas, Texas,
>
>Los Angles, California, and Denver, Colorado at different
>
>conventions.  For example, in 2018, the federation in the
>
>demonstration is composed of three member networks.  Network 1 is in
>
>Dallas, Texas, and Network 2 and network 3 are in Los Angeles,
>
>California.  Network 1 is connected to network 2 through a layer-2
>
>WAN circuit with a 100 Gbps bandwidth, provisioned by several
>
>providers such as SCinet, CenturyLink and CENIC.  Network 1 is a
>
>temporal science network in the CMS experiment, while network 2 and 3
>
>are long-running CMS Tier-2 sites.
>
> ”
>
> I believe your case require server to server communication for end-to-end
> interdomain routing.
>
>
>
> Secondly, as for network information exposure in multi-domain setting, I
> think
>
> 1. 3GPP Network Exposure Function is a good example for network
> information exposure, but it is part of 5G core which enables data exchange
> between UE and application server and does not extend to other domain.
>
> 2. ZSM multi-domain network and service management can be another concrete
> example for multiple domain network information exposure which can be used
> to have a quick
>
> response to network anomaly or reroute the traffic to the less congested
> path [
> https://www.etsi.org/deliver/etsi_gs/ZSM/001_099/002/01.01.01_60/gs_ZSM002v010101p.pdf
> ].
>
> 3. PCE has similar design for multi-domain setting, which allows PCE to
> PCE communication.
>
>
> Thank you again for the pointers. I'll take a look at ZSM and PCE soon.


Best
Qiao


> -Qin
>
> *发件人:* Qiao Xiang [mailto:xiang...@gmail.com]
> *发送时间:* 2021年3月3日 0:18
> *收件人:* 刘鹏 
> *抄送:* Y. Richard Yang ; IETF ALTO ; Qin
> Wu 
> *主题:* Re: [alto] ALTO Draft ReCharter WG review
>
>
>
> Hi Peng, Qin and Richard,
>
>
>
> Very good discussion! Richard and I have been working with folks from CMS
> and ESNet (a large global multi-domain science network) to design network
> information exposure abstractions and mechanisms in multi-domain
> networks, with privacy requirements considered. The basic idea stems from
> the ALTO path-vector extension but goes beyond to take privacy into
> consideration. The following are some pointers.
>
>
>
> [1] "Toward Fine-Grained, Privacy-Preserving, Efficient Multi-Domain
> Network Resource Discovery", IEEE JSAC, 2019. (
&

Re: [alto] ALTO Draft ReCharter WG review

2021-03-04 Thread Qin Wu
Kai:
发件人: kai...@scu.edu.cn [mailto:kai...@scu.edu.cn]
发送时间: 2021年3月3日 21:40
收件人: Qin Wu 
抄送: IETF ALTO ; alto-cha...@ietf.org; alto-...@ietf.org
主题: Re: [alto] ALTO Draft ReCharter WG review


Dear all,



Below are some comments on the 2nd item in the recharter text.



As far as I know, the ALTO incremental update extension (RFC 8895) already 
provides a mechanism to enable the "pub-sub" of ALTO information, using 
Server-Sent Events (SSE). I see there are multiple directions indicated by the 
new charter item:
[Qin]: Thanks for clarifying the difference between SSE and pub sub proposed in 
the new proposed charter item.

1. Decouple the "pub-sub" protocol with the underlying mechanism.



Besides SSE, other mechanisms can also be used to realize the "pub-sub" of ALTO 
information, such as HTTP/2, HTTP/3 or the methods mentioned in the charter 
text. Thus, a direct extension is to define the abstract format of control 
messages and data messages (i.e., WHAT information should be provided but not 
HOW), and allow different underlying protocols to use protocol-specific 
encodings.



For example, SSE encodes the metadata (e.g., content-type and stream id) and 
the content of an event using "event:" and "data:" prefixes at the beginning of 
each line, and uses empty lines to indicate the end of a message, while HTTP/2 
(RFC 7540) may encode the metadata and the content of an event using 
PUSH_PROMISE/HEADERS and DATA frame .

[Qin]: Good analysis, I think we need to decide whether we should define 
generic pub sub mechanism or transport specific pub sub mechanism. Do you have 
any suggestion on this?

I think this requirement may help integrating ALTO in network management 
platforms (such as OpenDaylight, Kubernetes, and ETSI ZSM*) which design their 
own pub-sub systems for reasons such as consistency or ease of development. It 
would be great if there is an interest in this direction from 
companies/organizations.

[Qin]: I can see The 3GPP has defined a Service-Based Architecture (SBA), 
whereby the control plane functionality and common data repositories of a 5G 
network are delivered by way of a set of interconnected Network Functions 
(NFs),pub sub mechanism has been well adopted in 3GPP interface.

Also in the public cloud, popular pub/sub implementations has been widely 
deployed,e.g., rabbitMQ (AMQP), mosquitto (MQTT), ejabberd (XMPP), and ZeroMQ. 
We also see many pub sub mechanism or extension has been developed in IETF, 
e.g., YANG Push, draft-ietf-dots-telemetry, draft-ietf-ace-mqtt-tls-profile.

* The integration fabric of ETSI ZSM provides pub-sub support but ZSM also 
allows services to use their own pub-sub mechanisms.



2. Enable more fine-grained control of pub-sub.



In RFC 8895, there are two types of commands which only defines WHAT 
information to subscribe:



- add: Make one or more new requests to receive the incremental updates.

- remove: Terminate the subscription of one or more previously-made requests.



In the meantime, the updates will be continuously sent to the client whenever a 
server sees fit.



The charter text proposes to enable ALTO clients to request and receive "a 
diverse types (such as event-triggered/sporadic, continuous), continuous, 
customized feed of publisher-generated information". It seems to me that the 
new extension wants to allow clients to specify not only WHAT information to be 
subscribed but also WHEN/HOW the information should be delivered (e.g., Notify 
me the latest value every 5 second.).

[Qin]:Good point, I think fine grained control of pub-sub allows not only 
periodical subscription, but also on demand subscription, which is the missing 
piece in the existing SSE incremental update.

Personally I find both directions to be interesting and useful. It would be 
great if they can be supported by real use cases.



Just my two cents.



Best,

Kai


-Original Messages-
From:"Qin Wu" mailto:bill...@huawei.com>>
Sent Time:2021-02-22 21:50:44 (Monday)
To: "IETF ALTO" mailto:alto@ietf.org>>
Cc: "alto-cha...@ietf.org<mailto:alto-cha...@ietf.org>" 
mailto:alto-cha...@ietf.org>>, 
"alto-...@ietf.org<mailto:alto-...@ietf.org>" 
mailto:alto-...@ietf.org>>
Subject: [alto] ALTO Draft ReCharter WG review
Hi, :
We have requested one hour session for ALTO WG meeting in the upcoming IETF 
110, which is arranged on Friday, March 12, 14:30-15:30(UTC).
The goal is to boil down ALTO recharter and have consensus on charter contents 
in IETF 110.
To get this goal, an updated inline draft charter text for ALTO has just been 
posted to this list,

This charter has received a couple of rounds of informal review from WG 
members, chairs and our Ads from brief to deep thorough, 5 new chartered items 
have been listed.
We would like to solicit feedback on these new chartered items and 

Re: [alto] ALTO Draft ReCharter WG review

2021-03-04 Thread Qin Wu
Hi, Wei:
Thanks for sharing your SD-WAN use case, very good use case, I think. This case 
reminds me the LOOP (Local Optimizations on Path Segments) effort in the IETF, 
which is very similar to CDNI use case, if my understanding is correct,
We can query from SD-WAN Edge peer for its capability and footprint.
To support redirect traffic to the right network node (e.g., Payment gateway) 
and when SDWAN edge is partitioned into multiple instances, SDWAN instance ID 
need to be returned.

-Qin
发件人: Wei Wang [mailto:weiwan...@foxmail.com]
发送时间: 2021年3月4日 13:57
收件人: xiangq27 
抄送: liupengyjy ; alto ; Qin Wu 

主题: Re: [alto] ALTO Draft ReCharter WG review

Hi all,

I think SD-WAN can be covered by ALTO rechartered work item. SD-WAN can 
connects the user to any application wherever it resides from the data center 
to the cloud, and assesses the best path meeting the ideal performance needs 
for a specific application. SD-WAN can also be used for cross domain scenario.
For example, in some cloud-based WAN communications, stitching multiple 
overlay tunnels in each domain are used for traffic policy enforcement matters 
such as optimizing traffic distribution or to select the best SD-WAN Edge for 
best user experience. A SD-WAN Edge can be partitioned into multiple instance, 
for some instance which can redirect traffic to the payment GW to offer better 
quality of service. ALTO protocol can be the best option for SD-WAN Edge 
selection.

Best Regards,
Wei
China Telecom



发件人: Qiao Xiang [mailto:xiang...@gmail.com]
发送时间: 2021年3月3日 0:18
收件人: 刘鹏 mailto:liupeng...@chinamobile.com>>
抄送: Y. Richard Yang mailto:y...@cs.yale.edu>>; IETF ALTO 
mailto:alto@ietf.org>>; Qin Wu 
mailto:bill...@huawei.com>>
主题: Re: [alto] ALTO Draft ReCharter WG review

Hi Peng, Qin and Richard,

Very good discussion! Richard and I have been working with folks from CMS and 
ESNet (a large global multi-domain science network) to design network 
information exposure abstractions and mechanisms in multi-domain networks, with 
privacy requirements considered. The basic idea stems from the ALTO path-vector 
extension but goes beyond to take privacy into consideration. The following are 
some pointers.

[1] "Toward Fine-Grained, Privacy-Preserving, Efficient Multi-Domain Network 
Resource Discovery", IEEE JSAC, 2019. 
(https://ieeexplore.ieee.org/abstract/document/8756056)
[2] "Resource Orchestration for Multi-Domain, Exascale, Geo-Distributed Data 
Analytics", 
(https://datatracker.ietf.org/doc/draft-xiang-alto-multidomain-analytics/)

For the pointers above, the privacy requirement considered in this work is that 
the network information of multiple domains should be exposed to applications 
as a complete, unified aggregation, appearing as much as possible as from a 
single (virtual) network. We design a network information obfuscation mechanism 
so that the application is not able to associate any network resource 
bottleneck information to any domain, reducing the risk of exposing network 
vulnerability.

In addition, we also studied how to control the routing across multiple domains 
to achieve more flexible end-to-end interdomain routing. Essentially, we 
propose a mechanism that allows networks to expose their available interdomain 
routes, just as BGP looking glasses, so that applications can control them. In 
this setting, we consider the privacy setting where each network's BGP export 
policies are private, and design interesting algorithms for applications to 
select the best policy-compliant routes without knowing the export policies. 
The following is the pointer for this study:

[3] "Toward Optimal Software-Defined Interdomain Routing". INFOCOM 2020 
(https://ieeexplore.ieee.org/abstract/document/9155486)

Above are our current efforts on extending ALTO to multi-domain settings. It 
would be great if we can know more about the industry efforts on network 
information exposure in multi-domain settings, and the privacy requirements of 
operators. This would be extremely helpful to push this extension forward! :-)



Best
Qiao

On Tue, Mar 2, 2021 at 1:14 PM 刘鹏 
mailto:liupeng...@chinamobile.com>> wrote:
Hi Richard,

Thank you. please see my reply inline below.


Peng Liu | 刘鹏
China Mobile | 移动研究院
mobile phone:13810146105
email:  liupeng...@chinamobile.com<mailto:liupeng...@chinamobile.com>

发件人: Y. Richard Yang<mailto:y...@cs.yale.edu>
时间: 2021/03/02(星期二)07:36
收件人: 刘鹏<mailto:liupeng...@chinamobile.com>;
抄送人: IETF ALTO<mailto:alto@ietf.org>;Qin Wu<mailto:bill...@huawei.com>;
主题: Re: [alto] ALTO Draft ReCharter WG review
Dear Peng,

Thank you so much for the feedback. Please see below.

On Fri, Feb 26, 2021 at 9:23 PM 刘鹏 
mailto:liupeng...@chinamobile.com>> wrote:
Hi WG,

Here are some considerations of recharter:
I believe that the multi domain problem is worthy of attention.

It is good info.

At present, operato

Re: [alto] ALTO Draft ReCharter WG review

2021-03-04 Thread Qin Wu
Thanks Qiao for sharing your project on Unicorn and thought on multi-domain 
setting.
My impression in your implementation is each domain name and first ingress node 
in such domain will be carried in the ALTO response message.
One thing I want to highlight is
Unicorn has already been deployed in several cities of USA in 2018 and 
implemented in the ODL open source.
Quote from 
https://datatracker.ietf.org/doc/draft-xiang-alto-multidomain-analytics/
“
   The authors build an ALTO server on top of the OpenDaylight Software
   Defined Network controller.  The ALTO server collects the network
   state information from the OpenDaylight controller, e.g., topology,
   policy and traffic statistics, processes the collected information
   into resource abstraction, and sends the abstraction back to the ALTO
   client at the resource orchestrator.

The Unicorn framework has been deployed and
   demonstrated in small federation networks connecting Dallas, Texas,
   Los Angles, California, and Denver, Colorado at different
   conventions.  For example, in 2018, the federation in the
   demonstration is composed of three member networks.  Network 1 is in
   Dallas, Texas, and Network 2 and network 3 are in Los Angeles,
   California.  Network 1 is connected to network 2 through a layer-2
   WAN circuit with a 100 Gbps bandwidth, provisioned by several
   providers such as SCinet, CenturyLink and CENIC.  Network 1 is a
   temporal science network in the CMS experiment, while network 2 and 3
   are long-running CMS Tier-2 sites.
”
I believe your case require server to server communication for end-to-end 
interdomain routing.

Secondly, as for network information exposure in multi-domain setting, I think
1. 3GPP Network Exposure Function is a good example for network information 
exposure, but it is part of 5G core which enables data exchange between UE and 
application server and does not extend to other domain.
2. ZSM multi-domain network and service management can be another concrete 
example for multiple domain network information exposure which can be used to 
have a quick
response to network anomaly or reroute the traffic to the less congested path 
[https://www.etsi.org/deliver/etsi_gs/ZSM/001_099/002/01.01.01_60/gs_ZSM002v010101p.pdf].
3. PCE has similar design for multi-domain setting, which allows PCE to PCE 
communication.

-Qin
发件人: Qiao Xiang [mailto:xiang...@gmail.com]
发送时间: 2021年3月3日 0:18
收件人: 刘鹏 
抄送: Y. Richard Yang ; IETF ALTO ; Qin Wu 

主题: Re: [alto] ALTO Draft ReCharter WG review

Hi Peng, Qin and Richard,

Very good discussion! Richard and I have been working with folks from CMS and 
ESNet (a large global multi-domain science network) to design network 
information exposure abstractions and mechanisms in multi-domain networks, with 
privacy requirements considered. The basic idea stems from the ALTO path-vector 
extension but goes beyond to take privacy into consideration. The following are 
some pointers.

[1] "Toward Fine-Grained, Privacy-Preserving, Efficient Multi-Domain Network 
Resource Discovery", IEEE JSAC, 2019. 
(https://ieeexplore.ieee.org/abstract/document/8756056)
[2] "Resource Orchestration for Multi-Domain, Exascale, Geo-Distributed Data 
Analytics", 
(https://datatracker.ietf.org/doc/draft-xiang-alto-multidomain-analytics/)

For the pointers above, the privacy requirement considered in this work is that 
the network information of multiple domains should be exposed to applications 
as a complete, unified aggregation, appearing as much as possible as from a 
single (virtual) network. We design a network information obfuscation mechanism 
so that the application is not able to associate any network resource 
bottleneck information to any domain, reducing the risk of exposing network 
vulnerability.

In addition, we also studied how to control the routing across multiple domains 
to achieve more flexible end-to-end interdomain routing. Essentially, we 
propose a mechanism that allows networks to expose their available interdomain 
routes, just as BGP looking glasses, so that applications can control them. In 
this setting, we consider the privacy setting where each network's BGP export 
policies are private, and design interesting algorithms for applications to 
select the best policy-compliant routes without knowing the export policies. 
The following is the pointer for this study:

[3] "Toward Optimal Software-Defined Interdomain Routing". INFOCOM 2020 
(https://ieeexplore.ieee.org/abstract/document/9155486)

Above are our current efforts on extending ALTO to multi-domain settings. It 
would be great if we can know more about the industry efforts on network 
information exposure in multi-domain settings, and the privacy requirements of 
operators. This would be extremely helpful to push this extension forward! :-)



Best
Qiao

On Tue, Mar 2, 2021 at 1:14 PM 刘鹏 
mailto:liupeng...@chinamobile.com>> wrote:
Hi Richard,

Thank you. please see my reply

Re: [alto] ALTO Draft ReCharter WG review -- ALTO Data Model

2021-03-03 Thread Jensen Zhang
Hi Dhruv,

Thanks a lot for your feedback.


On Thu, Mar 4, 2021 at 2:07 PM Dhruv Dhody  wrote:

> Hi Jensen,
>
> Thanks for starting this thread. It is great that you are thinking of
> similar questions as I was :)
>
> On Wed, Mar 3, 2021 at 9:03 PM Jensen Zhang 
> wrote:
> >
> > Dear all,
> >
> > I would like to make some comments on the 3rd recharter item.
> >
> > This item is going to propose YANG data models for ALTO configuration
> and management. Most of this kind of YANG data models for communication
> protocols like PCEP [1] and HTTP [2] will support both client and server
> configuration. One of the open issues for ALTO is:
> >
> > whether we should also provide the data model for the ALTO client
> configuration.
> >
>
> If the ALTO client is a function that can be placed in an entity that
> uses YANG-based techniques for configuration, status check, and
> monitoring. It makes sense for us to provide support for ALTO-client
> in YANG model. Some of the use-cases you are already highlighting
> below. For some like P2P tracker not soo much!
>

Thanks for your help to clarify the requirement on when we need the YANG
model.


>
> > For some of the traditional ALTO use cases like p2p, I think the YANG
> data model only for the ALTO server is enough. It can help the network
> operator easily configure and manage ALTO services. The data model for the
> ALTO client may not be necessary because the client is usually not under
> the control of the network operator. However, there are two cases where
> people may be interested in the data model for the ALTO client:
> >
> > 1. The multi-domain setting is a potential use case. But it depends on
> how we are going to design the server-to-server communication.
> >
> >   (a) If we are going to reuse the current ALTO framework, then the
> architecture could be similar to the PCE-based architecture, i.e., each
> ALTO domain should initiate an entity that can be an alto-server,
> alto-client, or alto-server-and-client. And for the alto-client or
> alto-server-and-client entity, the operator could configure the list of
> peered alto-server/alto-server-and-client entity directly, or how to
> discover the peers. The operator could also configure which information the
> client entity is interested in and would like to fetch from the peers.
> >
> >   (b) If we are going to completely redesign the communication protocol
> among ALTO servers, we may need specific data models for the configuration
> of this new protocol. The traditional roles of the ALTO client and server
> may no longer be applicable.
> >
>
> Yes the YANG needs to follow whatever decision is taken regarding the
> ALTO server-to-server communication. There is also a high-level
> decision that if we have a single YANG model for ALTO that can be used
> by both client and server or have independent yang models: one for
> client and another for server.
>

My personal feeling is that the configuration requirements for the ALTO
server and client are very different. e.g., The ALTO server needs to be
configured which services it can provide, while the ALTO client needs to be
configured which servers and services it would like to request. So I'm not
sure if we should define a single YANG model for both client and server.
But I notice that PCEP defines a single model for both PCE and PCC. From
your experience, which decision is better for ALTO?


>
> BTW RFC 7971 includes this -
>
>Cascaded servers: An ALTO server may itself include an ALTO
>client and query other ALTO servers, e.g., for certain
>destinations.  This results is a cascaded deployment of ALTO
>servers, as further explained below.
>
>
Yes, this is a simple or special case of the multi-domain setting. In this
case, the ALTO server can use the legacy ALTO protocol to communicate with
other ALTO servers. But there are some limitations in more practical
settings. So the 4th recharter item is proposed to try to address them.


>
> > 2. The other use case could come from the network-application
> integration. More specifically, the multi-service operator (e.g., Comcast,
> Telefonica) who can offer both application service (e.g., TV, CDN) and
> network service can be an example. In such a case, the application service
> operator may have some collaboration with the network operator on the
> protocol configuration level.
> >
> >   For example, in a CDN-ISP collaboration setting (@Luis can comment on
> it), the CDN operator may request the network operator to install a new
> ALTO service to compute on-demand ALTO information resources based on new
> parameters dynamically. And in the meantime, the CDN operator may also
> configure its own ALTO client to periodically send requests to the new ALTO
> service or use the pub/sub mechanism (e.g. SSE). And the CDN operator may
> want the ALTO client to report some operational status/statistics like when
> the last request is done, whether the last response is out-dated, how many
> 

Re: [alto] ALTO Draft ReCharter WG review -- ALTO Data Model

2021-03-03 Thread Dhruv Dhody
Hi Jensen,

Thanks for starting this thread. It is great that you are thinking of
similar questions as I was :)

On Wed, Mar 3, 2021 at 9:03 PM Jensen Zhang  wrote:
>
> Dear all,
>
> I would like to make some comments on the 3rd recharter item.
>
> This item is going to propose YANG data models for ALTO configuration and 
> management. Most of this kind of YANG data models for communication protocols 
> like PCEP [1] and HTTP [2] will support both client and server configuration. 
> One of the open issues for ALTO is:
>
> whether we should also provide the data model for the ALTO client 
> configuration.
>

If the ALTO client is a function that can be placed in an entity that
uses YANG-based techniques for configuration, status check, and
monitoring. It makes sense for us to provide support for ALTO-client
in YANG model. Some of the use-cases you are already highlighting
below. For some like P2P tracker not soo much!

> For some of the traditional ALTO use cases like p2p, I think the YANG data 
> model only for the ALTO server is enough. It can help the network operator 
> easily configure and manage ALTO services. The data model for the ALTO client 
> may not be necessary because the client is usually not under the control of 
> the network operator. However, there are two cases where people may be 
> interested in the data model for the ALTO client:
>
> 1. The multi-domain setting is a potential use case. But it depends on how we 
> are going to design the server-to-server communication.
>
>   (a) If we are going to reuse the current ALTO framework, then the 
> architecture could be similar to the PCE-based architecture, i.e., each ALTO 
> domain should initiate an entity that can be an alto-server, alto-client, or 
> alto-server-and-client. And for the alto-client or alto-server-and-client 
> entity, the operator could configure the list of peered 
> alto-server/alto-server-and-client entity directly, or how to discover the 
> peers. The operator could also configure which information the client entity 
> is interested in and would like to fetch from the peers.
>
>   (b) If we are going to completely redesign the communication protocol among 
> ALTO servers, we may need specific data models for the configuration of this 
> new protocol. The traditional roles of the ALTO client and server may no 
> longer be applicable.
>

Yes the YANG needs to follow whatever decision is taken regarding the
ALTO server-to-server communication. There is also a high-level
decision that if we have a single YANG model for ALTO that can be used
by both client and server or have independent yang models: one for
client and another for server.

BTW RFC 7971 includes this -

   Cascaded servers: An ALTO server may itself include an ALTO
   client and query other ALTO servers, e.g., for certain
   destinations.  This results is a cascaded deployment of ALTO
   servers, as further explained below.


> 2. The other use case could come from the network-application integration. 
> More specifically, the multi-service operator (e.g., Comcast, Telefonica) who 
> can offer both application service (e.g., TV, CDN) and network service can be 
> an example. In such a case, the application service operator may have some 
> collaboration with the network operator on the protocol configuration level.
>
>   For example, in a CDN-ISP collaboration setting (@Luis can comment on it), 
> the CDN operator may request the network operator to install a new ALTO 
> service to compute on-demand ALTO information resources based on new 
> parameters dynamically. And in the meantime, the CDN operator may also 
> configure its own ALTO client to periodically send requests to the new ALTO 
> service or use the pub/sub mechanism (e.g. SSE). And the CDN operator may 
> want the ALTO client to report some operational status/statistics like when 
> the last request is done, whether the last response is out-dated, how many 
> versions are updated for the current information resource (Not quite sure if 
> this info should be in the scope of the ALTO data model). It makes more sense 
> to do these kinds of things via the configuration protocol instead of another 
> ALTO protocol extension.
>

Using the YANG model for monitoring purposes (status, error,
statistics) at the ALTO client/server is quite useful.

Thanks,
Dhruv

> It would be great if people can share further comments or their own 
> interesting use cases.
>
> [1] https://tools.ietf.org/html/draft-ietf-pce-pcep-yang-15
> [2] https://tools.ietf.org/html/draft-ietf-netconf-http-client-server-06
>
> Best regards,
> Jensen
>
>
> On Mon, Feb 22, 2021 at 9:51 PM Qin Wu  wrote:
>>
>> Hi, :
>>
>> We have requested one hour session for ALTO WG meeting in the upcoming IETF 
>> 110, which is arranged on Friday, March 12, 14:30-15:30(UTC).
>>
>> The goal is to boil down ALTO recharter and have consensus on charter 
>> contents in IETF 110.
>>
>> To get this goal, an updated inline draft charter text 

Re: [alto] ALTO Draft ReCharter WG review

2021-03-03 Thread Wei Wang
Hi all,


  I think SD-WAN can be covered by ALTO rechartered work item. 
SD-WAN can connects the user to any application wherever it resides from the 
data center to the cloud, and assesses the best path meeting the ideal 
performance needs for a specific application. SD-WAN can also be used for cross 
domain scenario.
  For example, in some cloud-based WAN communications, stitching 
multiple overlay tunnels in each domain are used for traffic policy enforcement 
matters such as optimizing traffic distribution or to select the best SD-WAN 
Edge for best user experience. A SD-WAN Edge can be partitioned into multiple 
instance, for some instance which can redirect traffic to the payment GW to 
offer better quality of service. ALTO protocol can be the best option for 
SD-WAN Edge selection.


Best Regards,
Wei
China Telecom
 


 

 

 
??: Qiao Xiang [mailto:xiang...@gmail.com] 
 : 2021??3??3??  0:18
 ??:  https://ieeexplore.ieee.org/abstract/document/8756056)
 [2] "Resource Orchestration for Multi-Domain, Exascale, Geo-Distributed Data 
Analytics", 
(https://datatracker.ietf.org/doc/draft-xiang-alto-multidomain-analytics/)
   

 
  
For the pointers above, the privacy requirement considered in this work is that 
the network information of multiple domains should be exposed to applications 
as a complete, unified aggregation, appearing as much as possible  as from a 
single (virtual) network. We design a network information obfuscation mechanism 
so that the application is not able to associate any network resource 
bottleneck information to any domain, reducing the risk of exposing network 
vulnerability.
 
  

 
  
In addition, we also studied how to control the routing across multiple domains 
to achieve more flexible end-to-end interdomain routing. Essentially, we 
propose a mechanism that allows networks to expose their available  interdomain 
routes, just as BGP looking glasses, so that applications can control them. In 
this setting, we consider the privacy setting where each network's BGP export 
policies are private, and design interesting algorithms for applications to 
select the  best policy-compliant routes without knowing the export policies. 
The following is the pointer for this study:
 
  

 
  
[3] "Toward Optimal Software-Defined Interdomain Routing". INFOCOM 2020 
(https://ieeexplore.ieee.org/abstract/document/9155486) 
 
  

 
  
Above are our current efforts on extending ALTO to multi-domain settings. It 
would be great if we can know more about the industry efforts on network 
information exposure in multi-domain settings, and the privacy requirements  of 
operators. This would be extremely helpful to push this extension forward! :-)
 
 
  

 
  

 
  

 
  
Best
 
  
Qiao
 
 
 

   
On Tue, Mar 2, 2021 at 1:14 PM  https://www.ietf.org/mailman/listinfo/alto
  
 

 
  

 
 
-- 

-- 
 
  
=
 
  
| Y. Richard Yang http://www.cs.yale.edu/~yry/|
 
  
=
 
 
 
 
 
 
___
 alto mailing list
 alto@ietf.org
 https://www.ietf.org/mailman/listinfo/alto
  
 

 
  

 
 
-- 
   
Qiao Xiang
 Professor,
 
 
  
School of Informatics,
 
  
Xiamen University___
alto mailing list
alto@ietf.org
https://www.ietf.org/mailman/listinfo/alto


Re: [alto] ALTO Draft ReCharter WG review -- ALTO Data Model

2021-03-03 Thread Jensen Zhang
Dear all,

I would like to make some comments on the 3rd recharter item.

This item is going to propose YANG data models for ALTO configuration and
management. Most of this kind of YANG data models for communication
protocols like PCEP [1] and HTTP [2] will support both client and server
configuration. One of the open issues for ALTO is:

*whether we should also provide the data model for the ALTO client
configuration*.

For some of the traditional ALTO use cases like p2p, I think the YANG data
model only for the ALTO server is enough. It can help the network operator
easily configure and manage ALTO services. The data model for the ALTO
client may not be necessary because the client is usually not under the
control of the network operator. However, there are two cases where people
may be interested in the data model for the ALTO client:

1. The multi-domain setting is a potential use case. But it depends on how
we are going to design the server-to-server communication.

  (a) If we are going to reuse the current ALTO framework, then the
architecture could be similar to the PCE-based architecture, i.e., each
ALTO domain should initiate an entity that can be an alto-server,
alto-client, or alto-server-and-client. And for the alto-client or
alto-server-and-client entity, the operator could configure the list of
peered alto-server/alto-server-and-client entity directly, or how to
discover the peers. The operator could also configure which information the
client entity is interested in and would like to fetch from the peers.

  (b) If we are going to completely redesign the communication protocol
among ALTO servers, we may need specific data models for the configuration
of this new protocol. The traditional roles of the ALTO client and server
may no longer be applicable.

2. The other use case could come from the network-application integration.
More specifically, the multi-service operator (e.g., Comcast, Telefonica)
who can offer both application service (e.g., TV, CDN) and network service
can be an example. In such a case, the application service operator may
have some collaboration with the network operator on the protocol
configuration level.

  For example, in a CDN-ISP collaboration setting (@Luis can comment on
it), the CDN operator may request the network operator to install a new
ALTO service to compute on-demand ALTO information resources based on new
parameters dynamically. And in the meantime, the CDN operator may also
configure its own ALTO client to periodically send requests to the new ALTO
service or use the pub/sub mechanism (e.g. SSE). And the CDN operator may
want the ALTO client to report some operational status/statistics like when
the last request is done, whether the last response is out-dated, how many
versions are updated for the current information resource (Not quite sure
if this info should be in the scope of the ALTO data model). It makes more
sense to do these kinds of things via the configuration protocol instead of
another ALTO protocol extension.

It would be great if people can share further comments or their own
interesting use cases.

[1] https://tools.ietf.org/html/draft-ietf-pce-pcep-yang-15
[2] https://tools.ietf.org/html/draft-ietf-netconf-http-client-server-06

Best regards,
Jensen


On Mon, Feb 22, 2021 at 9:51 PM Qin Wu  wrote:

> Hi, :
>
> We have requested one hour session for ALTO WG meeting in the upcoming
> IETF 110, which is arranged on Friday, March 12, 14:30-15:30(UTC).
>
> The goal is to boil down ALTO recharter and have consensus on charter
> contents in IETF 110.
>
> To get this goal, an updated inline draft charter text for ALTO has just
> been posted to this list,
>
> This charter has received a couple of rounds of informal review from WG 
> members, chairs and our Ads from brief to deep thorough, 5 new chartered 
> items have been listed.
>
> We would like to solicit feedback on these new chartered items and your
> use case, deployment, idea corresponding to these new chartered items.
>
> Sharing your past deployment story will also be appreciated.
>
>
>
>
> 
>
> The ALTO working group was established in 2008 to devise a
> request/response protocol to allow a host to benefit from a server that is
> more cognizant of the network infrastructure than the host is.
>
>
>
> The working group has developed an HTTP-based protocol and recent work has
> reported large-scale deployment of ALTO based solutions supporting
> applications such as content distribution networks (CDN).
>
>
>
> ALTO is now proposed as a component for cloud-based interactive
> applications, large-scale data analytics, multi-cloud SD-WAN deployment,
> and distributed
>
> computing. In all these cases, exposing network information such as
> abstract topologies and network function deployment location helps
> applications.
>
>
>
> To support these emerging uses, extensions are needed, and additional
> 

Re: [alto] ALTO Draft ReCharter WG review

2021-03-03 Thread kaigao
By the way, below are the links to some documents that are mentioned in the 
previous email.




[1] https://tools.ietf.org/html/rfc8895

RFC 8895: Application-Layer Traffic Optimization (ALTO) Incremental Updates 
Using Server-Sent Events (SSE)




[2] https://tools.ietf.org/html/rfc7540

RFC 7540: Hypertext Transfer Protocol Version 2 (HTTP/2)




[3] 
https://www.etsi.org/deliver/etsi_gs/ZSM/001_099/002/01.01.01_60/gs_ZSM002v010101p.pdf

ETSI ZSM Architecture (See B.4 and B.5 for pub-sub in ZSM)




[4] 
https://docs.opendaylight.org/projects/controller/en/latest/dev-guide.html#messaging-patterns

OpenDaylight MD-SAL




[5] https://kubemq.io/

KubeMQ: the native message broker for Kubernetes




[2]







-Original Messages-
From:kai...@scu.edu.cn
Sent Time:2021-03-03 21:39:30 (Wednesday)
To: "Qin Wu" 
Cc: "alto-cha...@ietf.org" , "alto-...@ietf.org" 
, "IETF ALTO" 
Subject: Re: [alto] ALTO Draft ReCharter WG review



Dear all,




Below are some comments on the 2nd item in the recharter text.




As far as I know, the ALTO incremental update extension (RFC 8895) already 
provides a mechanism to enable the "pub-sub" of ALTO information, using 
Server-Sent Events (SSE). I see there are multiple directions indicated by the 
new charter item:




1. Decouple the "pub-sub" protocol with the underlying mechanism.




Besides SSE, other mechanisms can also be used to realize the "pub-sub" of ALTO 
information, such as HTTP/2, HTTP/3 or the methods mentioned in the charter 
text. Thus, a direct extension is to define the abstract format of control 
messages and data messages (i.e., WHAT information should be provided but not 
HOW), and allow different underlying protocols to use protocol-specific 
encodings.




For example, SSE encodes the metadata (e.g., content-type and stream id) and 
the content of an event using "event:" and "data:" prefixes at the beginning of 
each line, and uses empty lines to indicate the end of a message, while HTTP/2 
(RFC 7540) may encode the metadata and the content of an event using 
PUSH_PROMISE/HEADERS and DATA frame .




I think this requirement may help integrating ALTO in network management 
platforms (such as OpenDaylight, Kubernetes, and ETSI ZSM*) which design their 
own pub-sub systems for reasons such as consistency or ease of development. It 
would be great if there is an interest in this direction from 
companies/organizations.




* The integration fabric of ETSI ZSM provides pub-sub support but ZSM also 
allows services to use their own pub-sub mechanisms.




2. Enable more fine-grained control of pub-sub.




In RFC 8895, there are two types of commands which only defines WHAT 
information to subscribe:




- add: Make one or more new requests to receive the incremental updates.

- remove: Terminate the subscription of one or more previously-made requests.




In the meantime, the updates will be continuously sent to the client whenever a 
server sees fit.




The charter text proposes to enable ALTO clients to request and receive "a 
diverse types (such as event-triggered/sporadic, continuous), continuous, 
customized feed of publisher-generated information". It seems to me that the 
new extension wants to allow clients to specify not only WHAT information to be 
subscribed but also WHEN/HOW the information should be delivered (e.g., Notify 
me the latest value every 5 second.).




Personally I find both directions to be interesting and useful. It would be 
great if they can be supported by real use cases.




Just my two cents.




Best,

Kai




-Original Messages-
From:"Qin Wu" 
Sent Time:2021-02-22 21:50:44 (Monday)
To: "IETF ALTO" 
Cc: "alto-cha...@ietf.org" , "alto-...@ietf.org" 

Subject: [alto] ALTO Draft ReCharter WG review



Hi, :

We have requested one hour session for ALTO WG meeting in the upcoming IETF 
110, which is arranged on Friday, March 12, 14:30-15:30(UTC).

The goal is to boil down ALTO recharter and have consensus on charter contents 
in IETF 110.

To get this goal, an updated inline draft charter text for ALTO has just been 
posted to this list,

This charter has received a couple of rounds of informal review from WG 
members, chairs and our Ads from brief to deep thorough, 5 new chartered items 
have been listed.

We would like to solicit feedback on these new chartered items and your use 
case, deployment, idea corresponding to these new chartered items.

Sharing your past deployment story will also be appreciated.

 



The ALTO working group was established in 2008 to devise a request/response 
protocol to allow a host to benefit from a server that is more cognizant of the 
network infrastructure than the host is.

 

The working group has developed an HTTP-based protocol and 

Re: [alto] ALTO Draft ReCharter WG review

2021-03-03 Thread kaigao
Dear all,




Below are some comments on the 2nd item in the recharter text.




As far as I know, the ALTO incremental update extension (RFC 8895) already 
provides a mechanism to enable the "pub-sub" of ALTO information, using 
Server-Sent Events (SSE). I see there are multiple directions indicated by the 
new charter item:




1. Decouple the "pub-sub" protocol with the underlying mechanism.




Besides SSE, other mechanisms can also be used to realize the "pub-sub" of ALTO 
information, such as HTTP/2, HTTP/3 or the methods mentioned in the charter 
text. Thus, a direct extension is to define the abstract format of control 
messages and data messages (i.e., WHAT information should be provided but not 
HOW), and allow different underlying protocols to use protocol-specific 
encodings.




For example, SSE encodes the metadata (e.g., content-type and stream id) and 
the content of an event using "event:" and "data:" prefixes at the beginning of 
each line, and uses empty lines to indicate the end of a message, while HTTP/2 
(RFC 7540) may encode the metadata and the content of an event using 
PUSH_PROMISE/HEADERS and DATA frame .




I think this requirement may help integrating ALTO in network management 
platforms (such as OpenDaylight, Kubernetes, and ETSI ZSM*) which design their 
own pub-sub systems for reasons such as consistency or ease of development. It 
would be great if there is an interest in this direction from 
companies/organizations.




* The integration fabric of ETSI ZSM provides pub-sub support but ZSM also 
allows services to use their own pub-sub mechanisms.




2. Enable more fine-grained control of pub-sub.




In RFC 8895, there are two types of commands which only defines WHAT 
information to subscribe:




- add: Make one or more new requests to receive the incremental updates.

- remove: Terminate the subscription of one or more previously-made requests.




In the meantime, the updates will be continuously sent to the client whenever a 
server sees fit.




The charter text proposes to enable ALTO clients to request and receive "a 
diverse types (such as event-triggered/sporadic, continuous), continuous, 
customized feed of publisher-generated information". It seems to me that the 
new extension wants to allow clients to specify not only WHAT information to be 
subscribed but also WHEN/HOW the information should be delivered (e.g., Notify 
me the latest value every 5 second.).




Personally I find both directions to be interesting and useful. It would be 
great if they can be supported by real use cases.




Just my two cents.




Best,

Kai




-Original Messages-
From:"Qin Wu" 
Sent Time:2021-02-22 21:50:44 (Monday)
To: "IETF ALTO" 
Cc: "alto-cha...@ietf.org" , "alto-...@ietf.org" 

Subject: [alto] ALTO Draft ReCharter WG review



Hi, :

We have requested one hour session for ALTO WG meeting in the upcoming IETF 
110, which is arranged on Friday, March 12, 14:30-15:30(UTC).

The goal is to boil down ALTO recharter and have consensus on charter contents 
in IETF 110.

To get this goal, an updated inline draft charter text for ALTO has just been 
posted to this list,

This charter has received a couple of rounds of informal review from WG 
members, chairs and our Ads from brief to deep thorough, 5 new chartered items 
have been listed.

We would like to solicit feedback on these new chartered items and your use 
case, deployment, idea corresponding to these new chartered items.

Sharing your past deployment story will also be appreciated.

 



The ALTO working group was established in 2008 to devise a request/response 
protocol to allow a host to benefit from a server that is more cognizant of the 
network infrastructure than the host is.

 

The working group has developed an HTTP-based protocol and recent work has 
reported large-scale deployment of ALTO based solutions supporting applications 
such as content distribution networks (CDN).

 

ALTO is now proposed as a component for cloud-based interactive applications, 
large-scale data analytics, multi-cloud SD-WAN deployment, and distributed

computing. In all these cases, exposing network information such as abstract 
topologies and network function deployment location helps applications.

 

To support these emerging uses, extensions are needed, and additional 
functional and architectural features need to be considered as follows:

 

o Protocol extensions to support a richer and extensible set of policy 
attributes in ALTO information update request and response. Such policy 
attributes may indicate information dependency (e.g., ALTO path-cost/QoS 
properties with dependency on real-time network  indications), optimization 
criteria (e.g., lowest latency/throughput network performance objective), and 
constraints 

Re: [alto] ALTO Draft ReCharter WG review

2021-03-03 Thread Qin Wu
Hi, Peng:
发件人: 刘鹏 [mailto:liupeng...@chinamobile.com]
发送时间: 2021年3月2日 11:41
收件人: Qin Wu 
抄送: IETF ALTO 
主题: Re: RE: [alto] ALTO Draft ReCharter WG review

Hi Qin,
Thanks you. I still have some questions, please see my reply inline below.

Peng Liu | 刘鹏
China Mobile | 移动研究院
mobile phone:13810146105
email:  liupeng...@chinamobile.com<mailto:liupeng...@chinamobile.com>

Hi WG,
Here are some considerations of recharter:
I believe that the multi domain problem is worthy of attention. At present, 
operators also research in it, which may involve guaranteeing end-to-end 
network service in the future, such as delay, bandwidth, etc. There are some 
researches on cross domain deterministic network in the industry, which need 
some support from management and control plane.
[Qin]: thanks for sharing your use case, I think we may have many multi-domain 
applications. Multiple domain setting is not only referred to multiple 
administrative domains belonging to the same operator but also referred to 
cross operator domains.

[Peng]: Yes, we can easily find the usecase of cross operators domains such as 
home broadband.
Detnet can be a good use case for muit-domain setting, we may also consider 
many other use cases such as traffic from source to destination spanning across 
multiple administrative domain, the computing and storage are distributed in 
different administrative domain

[Peng]: DetNet WG only solves the problem of single domain, because multi 
domain brings much more challenge to the deterministic latency guarantee. It 
may be difficult to implement strict multi domain deterministic latency 
guarantee now, but we may gradually optimize it.



[Qin-1]Yes, you are right, reading Detnet charter,  its scope did focuses on 
single administrative control domain or within a closed group of administrative 
control domain. I believe RAW WG also focuses on single domain issue.

Which require resource discovery or multi domain SFC case.

As stipulated by RFC7971, there is the network consisting of multiple domains 
and in many cases it is not possible to collect information across network 
borders.  This issue can be addressed by deploying ALTO server in each domain 
with hierarchy design or mesh design, and allow server to server communication.

In addition, we need to consider multi domain connectivity discovery, multi 
domain service discovery.



[Peng]: I agree that it is difficult 'to collect information across network 
borders', and can you explain more about the "hierarchy design or mesh design"?

For the 'multi domain connectivity discovery, multi domain 
service discovery', is there any usecase or requirements can be found now?

[Qin-1]:In hierarchy design, ALTO servers in the domain partitions (e.g., each 
local domain) gather local information and send it to centralized ALTO server.

The mesh design, is more like peer to peer pattern design, ALTO servers may be 
set up in each domain independently, and gathering the network information from 
other connected adjacent domains.

Multi-domain connectivity discovery, multi service discovery is the solutions 
proposed for the corresponding use case. multi-service discovery is more 
related to ALTO server discovery, I think we may leverage existing mechanism 
proposed in RFC8686. Multi-connectivity discovery is to expand ALTO path vector 
mechanism to multi domain setting. Special requirements for multi-domain 
setting is to carry network information across domain which include domain 
identifier information, we may also consider to carry compute information, 
which help combine network information and compute information for service edge 
discovery.
Who is the provider of Alto service is related to the deployment and 
cooperation mode. It may be difficult for operators to give too much detailed 
network information now. If the Alto service belongs to the operator, it may be 
used to help manage its own network. If Alto service belong to non operators, I 
think the issue of how to cooperate needs further discussion.
[Qin]:I think one good use case we have is MOWIE use case, i.e., adjust the 
bitrate to improve Cloud gaming QoE experience based on abstract network 
information to be exposed. For this use case, we can see a good collaboration 
between OTT provider and network operation, Probably they sign agreement for 
the mutual benefits reason. Also network operator will provide aggregate and 
abstract network information and expose very few information to the client, 
this is what ALTO is designed for.
The proposed work items related to MOWIE, feel free to review and evaluate it'
[Peng]: Thanks. I talked to Gang about MOWIE before.  It involves some new 
cooperation modes, which are worthy of further discussion and exploration in 
details.
[Qin-1]:Besides MOWIE which require collaboration between OTT and network 
provider, we can also envision that the network provider or MSO deploy some 
content service or TV servic

Re: [alto] ALTO Draft ReCharter WG review

2021-03-02 Thread Qiao Xiang
Hi Peng, Qin and Richard,

Very good discussion! Richard and I have been working with folks from CMS
and ESNet (a large global multi-domain science network) to design network
information exposure abstractions and mechanisms in multi-domain
networks, with privacy requirements considered. The basic idea stems from
the ALTO path-vector extension but goes beyond to take privacy into
consideration. The following are some pointers.

[1] "Toward Fine-Grained, Privacy-Preserving, Efficient Multi-Domain
Network Resource Discovery", IEEE JSAC, 2019. (
https://ieeexplore.ieee.org/abstract/document/8756056)
[2] "Resource Orchestration for Multi-Domain, Exascale, Geo-Distributed
Data Analytics", (
https://datatracker.ietf.org/doc/draft-xiang-alto-multidomain-analytics/)

For the pointers above, the privacy requirement considered in this work is
that the network information of multiple domains should be exposed to
applications as a complete, unified aggregation, appearing as much as
possible as from a single (virtual) network. We design a network
information obfuscation mechanism so that the application is not able to
associate any network resource bottleneck information to any domain,
reducing the risk of exposing network vulnerability.

In addition, we also studied how to control the routing across multiple
domains to achieve more flexible end-to-end interdomain routing.
Essentially, we propose a mechanism that allows networks to expose their
available interdomain routes, just as BGP looking glasses, so that
applications can control them. In this setting, we consider the privacy
setting where each network's BGP export policies are private, and design
interesting algorithms for applications to select the best policy-compliant
routes without knowing the export policies. The following is the pointer
for this study:

[3] "Toward Optimal Software-Defined Interdomain Routing". INFOCOM 2020 (
https://ieeexplore.ieee.org/abstract/document/9155486)

Above are our current efforts on extending ALTO to multi-domain settings.
It would be great if we can know more about the industry efforts on network
information exposure in multi-domain settings, and the privacy requirements
of operators. This would be extremely helpful to push this extension
forward! :-)



Best
Qiao

On Tue, Mar 2, 2021 at 1:14 PM 刘鹏  wrote:

> Hi Richard,
>
> Thank you. please see my reply inline below.
>
>
> Peng Liu | 刘鹏
> China Mobile | 移动研究院
> mobile phone:13810146105
> email: * liupeng...@chinamobile.com *
>
>
> 发件人: Y. Richard Yang 
> 时间: 2021/03/02(星期二)07:36
> 收件人: 刘鹏 ;
> 抄送人: IETF ALTO ;Qin Wu ;
> 主题: Re: [alto] ALTO Draft ReCharter WG review
>
> Dear Peng,
>
> Thank you so much for the feedback. Please see below.
>
> On Fri, Feb 26, 2021 at 9:23 PM 刘鹏  wrote:
>
>> Hi WG,
>>
>>
>> Here are some considerations of recharter:
>>
>> I believe that the multi domain problem is worthy of attention.
>>
>
> It is good info.
>
>
>> At present, operators also research in it, which may involve guaranteeing
>> end-to-end network service in the future, such as delay, bandwidth, etc.
>> There are some researches on cross domain deterministic network in the
>> industry, which need some support from management and control plane.
>>
>
>  Do you want to share some pointers?
>
> [Peng] As Qin said, it is hard to collect information across network
> borders.
>
> Just taking deterministic network as an example, it is hard to applying
> synchronization, unified forwarding strategy in multi domain, so there
> are some works need to be done with management plane. Due to the large
> scale and multi domains or operators, the management system may be
> distributed.
>
> A potential way is to consider negotiating the forwarding time of each
> domain in advance and carrying time stamp in the message to control the
> forwarding path of each domain. While it needs some agreements like
> contracts to prevent one party from tampering with and denying the
> management content.
>
> Beside this, there may be others use case. I'm not sure if Alto servers
> are willing to do those work, but it may be helpful to collect or configure
> some key information.
>
> Who is the provider of Alto service is related to the deployment and
>> cooperation mode. It may be difficult for operators to give too much
>> detailed network information now. If the Alto service belongs to the
>> operator, it may be used to help manage its own network. If Alto service
>> belong to non operators, I think the issue of how to cooperate needs
>> further discussion.
>>
>>
>> It looks that you want to consider both modes: multidomains but single
> operator (i.e., intra-cooperation) and multidomains and multiple operators.
&

Re: [alto] ALTO Draft ReCharter WG review

2021-03-01 Thread 刘鹏




Hi Qin,

Thanks you. I still have some questions, please see my reply inline below.








Peng Liu | 刘鹏

China Mobile | 移动研究院

mobile phone:13810146105

email:  liupeng...@chinamobile.com


 

 

 

Hi WG,

 

Here are some considerations of recharter: 

I believe that the multi domain problem is worthy of attention. At present, 
operators also research in it, which may involve guaranteeing  end-to-end 
network service in the future, such as delay, bandwidth, etc. There are some 
researches on cross domain deterministic network in the industry, which need 
some support from management and control plane. 

[Qin]: thanks for sharing your use case, I think we may have many multi-domain 
applications.  Multiple domain setting is not only referred to multiple 
administrative domains belonging to the same operator but also referred to 
cross operator domains.



[Peng]: Yes, we can easily find the usecase of cross operators domains such as 
home broadband. 

Detnet can be a good use case for muit-domain setting, we may also consider 
many other  use cases such as traffic from source to destination spanning 
across multiple administrative domain, the computing and storage are 
distributed in different administrative domain



[Peng]: DetNet WG only solves the problem of single domain, because multi 
domain brings much more challenge to the deterministic latency guarantee. It 
may be difficult to implement strict multi domain deterministic latency 
guarantee now, but we may gradually optimize it.  

Which require resource discovery or multi domain SFC case. 

As stipulated by RFC7971, there is the network consisting of multiple domains 
and in many cases it is not possible to collect information across network 
borders.  This issue can be addressed by deploying ALTO server in each domain 
with hierarchy design or mesh design, and allow server to server communication. 

In addition, we need to consider multi domain connectivity discovery, multi 
domain service discovery.




[Peng]: I agree that it is difficult 'to collect information across network 
borders', and can you explain more about the "hierarchy design or mesh design"? 
 

 For the 'multi domain connectivity discovery, multi domain service 
discovery', is there any usecase or requirements can be found now?


 

Who is the provider of Alto service is related to the deployment and 
cooperation mode. It may be difficult for operators to give too much  detailed 
network information now. If the Alto service belongs to the operator, it may be 
used to help manage its own network. If Alto service belong to non operators, I 
think the issue of how to cooperate needs further discussion. 

[Qin]:I think one good use case we have is MOWIE use case, i.e., adjust the 
bitrate to  improve Cloud gaming QoE experience based on abstract network 
information to be exposed. For this use case, we can see a good collaboration 
between OTT provider and network operation, Probably they sign agreement for 
the mutual benefits reason. Also network  operator will provide aggregate and 
abstract network information and expose very few information to the client, 
this is what ALTO is designed for. 

The proposed work items related to MOWIE, feel free to review and evaluate it'

[Peng]: Thanks. I talked to Gang about MOWIE before.  It involves some new 
cooperation modes, which are worthy of further discussion and exploration in 
details. 

o Protocol extensions to support a richer and extensible set of policy 
attributes in ALTO  information update request and response. Such policy 
attributes may indicate information dependency (e.g., ALTO path-cost/QoS 
properties with dependency on real-time network  indications), optimization 
criteria (e.g., lowest latency/throughput network performance  objective), and 
constraints (e.g., relaxation bound of optimization criteria, domain or network 
node to be traversed, diversity and redundancy of paths). 

o Protocol extensions for facilitating operational automation tasks and 
improving transport  efficiency. In particular, extensions to provide "pub/sub" 
mechanisms to allow the client to request and receive a diverse types (such as 
event-triggered/sporadic, continuous), continuous, customized feed of 
publisher-generated information. Efforts developed  in other working groups 
such as MQTT Publish / Subscribe Architecture, WebSub, Subscription to YANG 
Notifications will be considered, and issues such as scalability (e.g., using 
unicast or broadcast/multicast, and periodicity of object updates) should be 
considered.  

” 

Thanks! 

Regards, 

Peng  

 

   

 

 

Peng Liu | 刘鹏  

 

China Mobile | 移动研究院  

 

mobile phone:13810146105  

 

email:  liupeng...@chinamobile.com

 

   

 

 

发件人: Qin Wu  

 

时间: 2021/02/22(星期一)21:45  

 

收件人: IETF ALTO;  

 

抄送人: alto-chairs;alto-ads;  

 

主题: [alto] ALTO Draft ReCharter WG review

 Hi, : 

 We have requested one hour session for ALTO WG mee

Re: [alto] ALTO Draft ReCharter WG review

2021-03-01 Thread Y. Richard Yang
Dear Peng,

Thank you so much for the feedback. Please see below.

On Fri, Feb 26, 2021 at 9:23 PM 刘鹏  wrote:

> Hi WG,
>
>
> Here are some considerations of recharter:
>
> I believe that the multi domain problem is worthy of attention.
>

It is good info.


> At present, operators also research in it, which may involve guaranteeing
> end-to-end network service in the future, such as delay, bandwidth, etc.
> There are some researches on cross domain deterministic network in the
> industry, which need some support from management and control plane.
>

 Do you want to share some pointers?

Who is the provider of Alto service is related to the deployment and
> cooperation mode. It may be difficult for operators to give too much
> detailed network information now. If the Alto service belongs to the
> operator, it may be used to help manage its own network. If Alto service
> belong to non operators, I think the issue of how to cooperate needs
> further discussion.
>
>
> It looks that you want to consider both modes: multidomains but single
operator (i.e., intra-cooperation) and multidomains and multiple operators.
Regardless, I agree that it is important for the work to clarify on the
privacy requirements.

Richard




> Regards,
>
> Peng
>
> Peng Liu | 刘鹏
> China Mobile | 移动研究院
> mobile phone:13810146105
> email: * liupeng...@chinamobile.com *
>
>
> 发件人: Qin Wu 
> 时间: 2021/02/22(星期一)21:45
> 收件人: IETF ALTO ;
> 抄送人: alto-chairs ;alto-ads ;
> 主题: [alto] ALTO Draft ReCharter WG review
>
> Hi, :
>
> We have requested one hour session for ALTO WG meeting in the upcoming
> IETF 110, which is arranged on Friday, March 12, 14:30-15:30(UTC).
>
> The goal is to boil down ALTO recharter and have consensus on charter
> contents in IETF 110.
>
> To get this goal, an updated inline draft charter text for ALTO has just
> been posted to this list,
>
> This charter has received a couple of rounds of informal review from WG 
> members, chairs and our Ads from brief to deep thorough, 5 new chartered 
> items have been listed.
>
> We would like to solicit feedback on these new chartered items and your
> use case, deployment, idea corresponding to these new chartered items.
>
> Sharing your past deployment story will also be appreciated.
>
>
>
>
> 
>
> The ALTO working group was established in 2008 to devise a
> request/response protocol to allow a host to benefit from a server that is
> more cognizant of the network infrastructure than the host is.
>
>
>
> The working group has developed an HTTP-based protocol and recent work has
> reported large-scale deployment of ALTO based solutions supporting
> applications such as content distribution networks (CDN).
>
>
>
> ALTO is now proposed as a component for cloud-based interactive
> applications, large-scale data analytics, multi-cloud SD-WAN deployment,
> and distributed
>
> computing. In all these cases, exposing network information such as
> abstract topologies and network function deployment location helps
> applications.
>
>
>
> To support these emerging uses, extensions are needed, and additional
> functional and architectural features need to be considered as follows:
>
>
>
> o Protocol extensions to support a richer and extensible set of policy
> attributes in ALTO information update request and response. Such policy
> attributes may indicate information dependency (e.g., ALTO path-cost/QoS
> properties with dependency on real-time network  indications), optimization
> criteria (e.g., lowest latency/throughput network performance objective),
> and constraints (e.g., relaxation bound of optimization criteria, domain or
> network node to be traversed, diversity and redundancy of paths).
>
>
>
> o Protocol extensions for facilitating operational automation tasks and
> improving transport efficiency. In particular, extensions to provide
> "pub/sub" mechanisms to allow the client to request and receive a diverse
> types (such as event-triggered/sporadic, continuous), continuous,
> customized feed of publisher-generated information. Efforts developed in
> other working groups such as MQTT Publish / Subscribe Architecture, WebSub,
> Subscription to YANG Notifications will be considered, and issues such as
> scalability (e.g., using unicast or broadcast/multicast, and periodicity of
> object updates) should be considered.
>
>
>
> o The working group will investigate the configuration, management, and
> operation of ALTO systems and may develop suitable data models.
>
>
>
> o Extensions to ALTO services to support multi-domain settings. ALTO

Re: [alto] ALTO Draft ReCharter WG review

2021-02-28 Thread Qin Wu
Hi, Peng:
Thanks for kicking off the discussion, see my reply inline below.

发件人: 刘鹏 [mailto:liupeng...@chinamobile.com]
发送时间: 2021年2月27日 10:23
收件人: IETF ALTO ; Qin Wu 
主题: Re: [alto] ALTO Draft ReCharter WG review

Hi WG,

Here are some considerations of recharter:
I believe that the multi domain problem is worthy of attention. At present, 
operators also research in it, which may involve guaranteeing end-to-end 
network service in the future, such as delay, bandwidth, etc. There are some 
researches on cross domain deterministic network in the industry, which need 
some support from management and control plane.
[Qin]: thanks for sharing your use case, I think we may have many multi-domain 
applications. Multiple domain setting is not only referred to multiple 
administrative domains belonging to the same operator but also referred to 
cross operator domains.
Detnet can be a good use case for muit-domain setting, we may also consider 
many other use cases such as traffic from source to destination spanning across 
multiple administrative domain, the computing and storage are distributed in 
different administrative domain
Which require resource discovery or multi domain SFC case.

As stipulated by RFC7971, there is the network consisting of multiple domains 
and in many cases it is not possible to collect information across network 
borders.  This issue can be addressed by deploying ALTO server in each domain 
with hierarchy design or mesh design, and allow server to server communication.

In addition, we need to consider multi domain connectivity discovery, multi 
domain service discovery.
Who is the provider of Alto service is related to the deployment and 
cooperation mode. It may be difficult for operators to give too much detailed 
network information now. If the Alto service belongs to the operator, it may be 
used to help manage its own network. If Alto service belong to non operators, I 
think the issue of how to cooperate needs further discussion.
[Qin]:I think one good use case we have is MOWIE use case, i.e., adjust the 
bitrate to improve Cloud gaming QoE experience based on abstract network 
information to be exposed. For this use case, we can see a good collaboration 
between OTT provider and network operation, Probably they sign agreement for 
the mutual benefits reason. Also network operator will provide aggregate and 
abstract network information and expose very few information to the client, 
this is what ALTO is designed for.
The proposed work items related to MOWIE, feel free to review and evaluate it
“
o Protocol extensions to support a richer and extensible set of policy 
attributes in ALTO information update request and response. Such policy 
attributes may indicate information dependency (e.g., ALTO path-cost/QoS 
properties with dependency on real-time network  indications), optimization 
criteria (e.g., lowest latency/throughput network performance objective), and 
constraints (e.g., relaxation bound of optimization criteria, domain or network 
node to be traversed, diversity and redundancy of paths).

o Protocol extensions for facilitating operational automation tasks and 
improving transport efficiency. In particular, extensions to provide "pub/sub" 
mechanisms to allow the client to request and receive a diverse types (such as 
event-triggered/sporadic, continuous), continuous, customized feed of 
publisher-generated information. Efforts developed in other working groups such 
as MQTT Publish / Subscribe Architecture, WebSub, Subscription to YANG 
Notifications will be considered, and issues such as scalability (e.g., using 
unicast or broadcast/multicast, and periodicity of object updates) should be 
considered.
”
Thanks!
Regards,
Peng

Peng Liu | 刘鹏
China Mobile | 移动研究院
mobile phone:13810146105
email:  liupeng...@chinamobile.com<mailto:liupeng...@chinamobile.com>

发件人: Qin Wu<mailto:bill...@huawei.com>
时间: 2021/02/22(星期一)21:45
收件人: IETF ALTO<mailto:alto@ietf.org>;
抄送人: 
alto-chairs<mailto:alto-cha...@ietf.org>;alto-ads<mailto:alto-...@ietf.org>;
主题: [alto] ALTO Draft ReCharter WG review
Hi, :
We have requested one hour session for ALTO WG meeting in the upcoming IETF 
110, which is arranged on Friday, March 12, 14:30-15:30(UTC).
The goal is to boil down ALTO recharter and have consensus on charter contents 
in IETF 110.
To get this goal, an updated inline draft charter text for ALTO has just been 
posted to this list,

This charter has received a couple of rounds of informal review from WG 
members, chairs and our Ads from brief to deep thorough, 5 new chartered items 
have been listed.
We would like to solicit feedback on these new chartered items and your use 
case, deployment, idea corresponding to these new chartered items.
Sharing your past deployment story will also be appreciated.


The ALTO working group was established in 2008 to devi

Re: [alto] ALTO Draft ReCharter WG review

2021-02-26 Thread 刘鹏


Normal   07.8 磅   0   2  false   false   false  
EN-US   ZH-CN   X-NONE  
   MicrosoftInternetExplorer4   





 

Hi WG,


  

Here are some considerations of recharter:  

I believe that the multi domain problem is worthy of attention. At present, 
operators also research in it, which may involve guaranteeing end-to-end 
network service in the future, such as delay, bandwidth, etc. There are some 
researches on cross domain deterministic network in the industry, which need 
some support from management and control plane.  

Who is the provider of Alto service is related to the deployment and 
cooperation mode. It may be difficult for operators to give too much detailed 
network information now. If the Alto service belongs to the operator, it may be 
used to help manage its own network. If Alto service belong to non operators, I 
think the issue of how to cooperate needs further discussion.


  

Regards,  

Peng








Peng Liu | 刘鹏

China Mobile | 移动研究院

mobile phone:13810146105

email:  liupeng...@chinamobile.com

 



发件人: Qin Wu

时间: 2021/02/22(星期一)21:45

收件人: IETF ALTO;

抄送人: alto-chairs;alto-ads;

主题: [alto] ALTO Draft ReCharter WG review 

 

Hi, : 

We have requested one hour session for ALTO WG meeting in the upcoming IETF 
110, which is arranged on Friday, March 12,  14:30-15:30(UTC).  

The goal is to boil down ALTO recharter and have consensus on charter contents 
in IETF 110. 

To get this goal, an updated inline draft charter text for ALTO has just been 
posted to this list,  

This charter has received a couple of rounds of informal review from WG 
members, chairs and our Ads from brief to deep thorough, 5 new chartered items 
have been listed. 

We would like to solicit feedback on these new chartered items and your use 
case, deployment, idea corresponding to these  new chartered items. 

Sharing your past deployment story will also be appreciated. 

  


 

The ALTO working group was established in 2008 to devise a request/response 
protocol to allow a host to benefit from a server that is more cognizant  of 
the network infrastructure than the host is.  

  

The working group has developed an HTTP-based protocol and recent work has 
reported large-scale deployment of ALTO based solutions supporting applications 
 such as content distribution networks (CDN).  

  

ALTO is now proposed as a component for cloud-based interactive applications, 
large-scale data analytics, multi-cloud SD-WAN deployment, and distributed  

computing. In all these cases, exposing network information such as abstract 
topologies and network function deployment location helps applications.  

  

To support these emerging uses, extensions are needed, and additional 
functional and architectural features need to be considered as follows: 

  

o Protocol extensions to support a richer and extensible set of policy 
attributes in ALTO information update request and response. Such policy 
attributes  may indicate information dependency (e.g., ALTO path-cost/QoS 
properties with dependency on real-time network  indications), optimization 
criteria (e.g., lowest latency/throughput network performance objective), and 
constraints (e.g., relaxation bound of optimization  criteria, domain or 
network node to be traversed, diversity and redundancy of paths).  

  

o Protocol extensions for facilitating operational automation tasks and 
improving transport efficiency. In particular, extensions to provide "pub/sub"  
mechanisms to allow the client to request and receive a diverse types (such as 
event-triggered/sporadic, continuous), continuous, customized feed of 
publisher-generated information. Efforts developed in other working groups such 
as MQTT Publish / Subscribe  Architecture, WebSub, Subscription to YANG 
Notifications will be considered, and issues such as scalability (e.g., using 
unicast or broadcast/multicast, and periodicity of object updates) should be 
considered.  

  

o The working group will investigate the configuration, management, and 
operation of ALTO systems and may develop suitable data models. 

  

o Extensions to ALTO services to support multi-domain settings. ALTO is 
currently specified for a single ALTO server in a single administrative domain, 
 but a network may consist of  

multiple domains and the

[alto] ALTO Draft ReCharter WG review

2021-02-22 Thread Qin Wu
Hi, :
We have requested one hour session for ALTO WG meeting in the upcoming IETF 
110, which is arranged on Friday, March 12, 14:30-15:30(UTC).
The goal is to boil down ALTO recharter and have consensus on charter contents 
in IETF 110.
To get this goal, an updated inline draft charter text for ALTO has just been 
posted to this list,

This charter has received a couple of rounds of informal review from WG 
members, chairs and our Ads from brief to deep thorough, 5 new chartered items 
have been listed.
We would like to solicit feedback on these new chartered items and your use 
case, deployment, idea corresponding to these new chartered items.
Sharing your past deployment story will also be appreciated.


The ALTO working group was established in 2008 to devise a request/response 
protocol to allow a host to benefit from a server that is more cognizant of the 
network infrastructure than the host is.

The working group has developed an HTTP-based protocol and recent work has 
reported large-scale deployment of ALTO based solutions supporting applications 
such as content distribution networks (CDN).

ALTO is now proposed as a component for cloud-based interactive applications, 
large-scale data analytics, multi-cloud SD-WAN deployment, and distributed
computing. In all these cases, exposing network information such as abstract 
topologies and network function deployment location helps applications.

To support these emerging uses, extensions are needed, and additional 
functional and architectural features need to be considered as follows:

o Protocol extensions to support a richer and extensible set of policy 
attributes in ALTO information update request and response. Such policy 
attributes may indicate information dependency (e.g., ALTO path-cost/QoS 
properties with dependency on real-time network  indications), optimization 
criteria (e.g., lowest latency/throughput network performance objective), and 
constraints (e.g., relaxation bound of optimization criteria, domain or network 
node to be traversed, diversity and redundancy of paths).

o Protocol extensions for facilitating operational automation tasks and 
improving transport efficiency. In particular, extensions to provide "pub/sub" 
mechanisms to allow the client to request and receive a diverse types (such as 
event-triggered/sporadic, continuous), continuous, customized feed of 
publisher-generated information. Efforts developed in other working groups such 
as MQTT Publish / Subscribe Architecture, WebSub, Subscription to YANG 
Notifications will be considered, and issues such as scalability (e.g., using 
unicast or broadcast/multicast, and periodicity of object updates) should be 
considered.

o The working group will investigate the configuration, management, and 
operation of ALTO systems and may develop suitable data models.

o Extensions to ALTO services to support multi-domain settings. ALTO is 
currently specified for a single ALTO server in a single administrative domain, 
but a network may consist of
multiple domains and the potential information sources may not be limited to a 
certain domain. The working group will investigate extending the ALTO framework 
to (1) specify multi-ALTO-server protocol flow and usage guidelines when an 
ALTO service involves network paths spanning multiple domains with multiple 
ALTO servers, and (2) extend or introduce ALTO
services allowing east-west interfaces for multiple ALTO server integration and 
collaboration. The specifications and extensions should use existing services 
whenever possible. The specifications and extensions should consider realistic 
complexities including incremental deployment, dynamicity, and security issues 
such as access control, authorization (e.g., an ALTO server provides 
information for a network that the server has no authorization), and privacy 
protection in multi-domain settings.

o The working group will update RFC 7971 to provide operational considerations 
for recent protocol extensions (e.g., cost calendar, unified properties, and 
path vector) and new extensions that the WG develops. New considerations will 
include decisions about the set of information resources (e.g., what metrics to 
use), notification of changes either in proactive or reactive mode (e.g., pull 
the backend, or trigger just-in-time measurements), aggregation/processing of 
the collected information  (e.g., compute information and network information 
)according to the clients' requests, and integration with new transport 
mechanisms (e.g., HTTP/2 and HTTP/3).

When the WG considers standardizing information that the ALTO server could 
provide, the following criteria are important
to ensure real feasibility:

- Can the ALTO server realistically provide (measure or derive) that 
information?

- Is it information that the ALTO client cannot find easily some other way?

- Is the distribution of