In today's Internet the commercial aspect of routing is gaining more and more importance. Commercial agreements between ISPs (i.e.transit and peering agreements) influence the inter-domain routing policies which are now driven by monetary aspects as well as global resource and performance optimization. To allow scalability and protect business critical topology information, hierarchical routing and topology aggregation became a fundamental issue in modern inter-domain networks. In this paper, we introduce a pricing mechanism that takes into account the effects of load dependent internal costs on the domain income and allows ISPs to set link prices during the topology aggregation process. We adapt a Continuous Action Reinforcement Learning Automata (CARLA), to operate in this framework as a tool used by ISP operators to learn the best price according to the network state. The reinforcement signal is proportional only to the domain's utility (i.e. profit) and thus does not need any central authority or sensitive information exchange among domains. Simulation results show that one ISP using CARLA can significantly improve its utility compared to other ISPs that statically choose their link prices. When two ISPs employ the same CARLA they can reach an equilibrium strategy while still improving their utilities.
Gurzi, P, Steenhaut, K, Nowe, A & Vrancx, P 2011, Learning a Pricing Strategy in Multi-Domain DWDM Networks. in Ieee (ed.), 18th IEEE Workshop on Local & Metropolitan Area Networks (LANMAN), 2011. IEEE Xplore, pp. 1-6, IEEE Workshop on Local & Metropolitan Area Networks 2011, United States, 20/10/11. <http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=6076922>
Gurzi, P., Steenhaut, K., Nowe, A., & Vrancx, P. (2011). Learning a Pricing Strategy in Multi-Domain DWDM Networks. In Ieee (Ed.), 18th IEEE Workshop on Local & Metropolitan Area Networks (LANMAN), 2011 (pp. 1-6). IEEE Xplore. http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=6076922
@inproceedings{a738c2e1580c498395733e0d3745f2a0,
title = "Learning a Pricing Strategy in Multi-Domain DWDM Networks",
abstract = "In today's Internet the commercial aspect of routing is gaining more and more importance. Commercial agreements between ISPs (i.e.transit and peering agreements) influence the inter-domain routing policies which are now driven by monetary aspects as well as global resource and performance optimization. To allow scalability and protect business critical topology information, hierarchical routing and topology aggregation became a fundamental issue in modern inter-domain networks. In this paper, we introduce a pricing mechanism that takes into account the effects of load dependent internal costs on the domain income and allows ISPs to set link prices during the topology aggregation process. We adapt a Continuous Action Reinforcement Learning Automata (CARLA), to operate in this framework as a tool used by ISP operators to learn the best price according to the network state. The reinforcement signal is proportional only to the domain's utility (i.e. profit) and thus does not need any central authority or sensitive information exchange among domains. Simulation results show that one ISP using CARLA can significantly improve its utility compared to other ISPs that statically choose their link prices. When two ISPs employ the same CARLA they can reach an equilibrium strategy while still improving their utilities.",
keywords = "Multi-Domain Networks, Continuous Action Reinforcement Learning, Contract Routing",
author = "Pasquale Gurzi and Kris Steenhaut and Ann Nowe and Peter Vrancx",
note = "IEEE; IEEE Workshop on Local & Metropolitan Area Networks 2011, LANMAN ; Conference date: 20-10-2011",
year = "2011",
month = nov,
day = "15",
language = "English",
isbn = "978-1-4577-1264-7",
pages = "1--6",
editor = "Ieee",
booktitle = "18th IEEE Workshop on Local & Metropolitan Area Networks (LANMAN), 2011",
publisher = "IEEE Xplore",
}