-
Ranking Across Different Content Types: The Robust Beauty of Multinomial Blending
Authors:
Jan Malte Lichtenberg,
Giuseppe Di Benedetto,
Matteo Ruffini
Abstract:
An increasing number of media streaming services have expanded their offerings to include entities of multiple content types. For instance, audio streaming services that started by offering music only, now also offer podcasts, merchandise items, and videos. Ranking items across different content types into a single slate poses a significant challenge for traditional learning-to-rank (LTR) algorith…
▽ More
An increasing number of media streaming services have expanded their offerings to include entities of multiple content types. For instance, audio streaming services that started by offering music only, now also offer podcasts, merchandise items, and videos. Ranking items across different content types into a single slate poses a significant challenge for traditional learning-to-rank (LTR) algorithms due to differing user engagement patterns for different content types. We explore a simple method for cross-content-type ranking, called multinomial blending (MB), which can be used in conjunction with most existing LTR algorithms. We compare MB to existing baselines not only in terms of ranking quality but also from other industry-relevant perspectives such as interpretability, ease-of-use, and stability in dynamic environments with changing user behavior and ranking model retraining. Finally, we report the results of an A/B test from an Amazon Music ranking use-case.
△ Less
Submitted 17 August, 2024;
originally announced August 2024.
-
Decentralized Multi-Party Multi-Network AI for Global Deployment of 6G Wireless Systems
Authors:
Merim Dzaferagic,
Marco Ruffini,
Nina Slamnik-Krijestorac,
Joao F. Santos,
Johann Marquez-Barja,
Christos Tranoris,
Spyros Denazis,
Thomas Kyriakakis,
Panagiotis Karafotis,
Luiz DaSilva,
Shashi Raj Pandey,
Junya Shiraishi,
Petar Popovski,
Soren Kejser Jensen,
Christian Thomsen,
Torben Bach Pedersen,
Holger Claussen,
Jinfeng Du,
Gil Zussman,
Tingjun Chen,
Yiran Chen,
Seshu Tirupathi,
Ivan Seskar,
Daniel Kilper
Abstract:
Multiple visions of 6G networks elicit Artificial Intelligence (AI) as a central, native element. When 6G systems are deployed at a large scale, end-to-end AI-based solutions will necessarily have to encompass both the radio and the fiber-optical domain. This paper introduces the Decentralized Multi-Party, Multi-Network AI (DMMAI) framework for integrating AI into 6G networks deployed at scale. DM…
▽ More
Multiple visions of 6G networks elicit Artificial Intelligence (AI) as a central, native element. When 6G systems are deployed at a large scale, end-to-end AI-based solutions will necessarily have to encompass both the radio and the fiber-optical domain. This paper introduces the Decentralized Multi-Party, Multi-Network AI (DMMAI) framework for integrating AI into 6G networks deployed at scale. DMMAI harmonizes AI-driven controls across diverse network platforms and thus facilitates networks that autonomously configure, monitor, and repair themselves. This is particularly crucial at the network edge, where advanced applications meet heightened functionality and security demands. The radio/optical integration is vital due to the current compartmentalization of AI research within these domains, which lacks a comprehensive understanding of their interaction. Our approach explores multi-network orchestration and AI control integration, filling a critical gap in standardized frameworks for AI-driven coordination in 6G networks. The DMMAI framework is a step towards a global standard for AI in 6G, aiming to establish reference use cases, data and model management methods, and benchmarking platforms for future AI/ML solutions.
△ Less
Submitted 15 April, 2024;
originally announced July 2024.
-
ML-based handover prediction over a real O-RAN deployment using RAN Intelligent controller
Authors:
Merim Dzaferagic,
Bruno Missi Xavier,
Diarmuid Collins,
Vince D'Onofrio,
Magnos Martinello,
Marco Ruffini
Abstract:
O-RAN introduces intelligent and flexible network control in all parts of the network. The use of controllers with open interfaces allow us to gather real time network measurements and make intelligent/informed decision. The work in this paper focuses on developing a use-case for open and reconfigurable networks to investigate the possibility to predict handover events and understand the value of…
▽ More
O-RAN introduces intelligent and flexible network control in all parts of the network. The use of controllers with open interfaces allow us to gather real time network measurements and make intelligent/informed decision. The work in this paper focuses on developing a use-case for open and reconfigurable networks to investigate the possibility to predict handover events and understand the value of such predictions for all stakeholders that rely on the communication network to conduct their business. We propose a Long-Short Term Memory Machine Learning approach that takes standard Radio Access Network measurements to predict handover events. The models were trained on real network data collected from a commercial O-RAN setup deployed in our OpenIreland testbed. Our results show that the proposed approach can be optimized for either recall or precision, depending on the defined application level objective. We also link the performance of the Machine Learning (ML) algorithm to the network operation cost. Our results show that ML-based matching between the required and available resources can reduce operational cost by more than 80%, compared to long term resource purchases.
△ Less
Submitted 14 April, 2024;
originally announced April 2024.
-
Routing and Spectrum Allocation in Broadband Quantum Entanglement Distribution
Authors:
Rohan Bali,
Ashley N. Tittelbaugh,
Shelbi L. Jenkins,
Anuj Agrawal,
Jerry Horgan,
Marco Ruffini,
Daniel C. Kilper,
Boulat A. Bash
Abstract:
We investigate resource allocation for quantum entanglement distribution over an optical network. We characterize and model a network architecture that employs a single quasi-deterministic time-frequency heralded Einstein-Podolsky-Rosen (EPR) pair source, and develop a routing scheme for distributing entangled photon pairs over such a network. We focus on max-min fairness in entanglement distribut…
▽ More
We investigate resource allocation for quantum entanglement distribution over an optical network. We characterize and model a network architecture that employs a single quasi-deterministic time-frequency heralded Einstein-Podolsky-Rosen (EPR) pair source, and develop a routing scheme for distributing entangled photon pairs over such a network. We focus on max-min fairness in entanglement distribution and compare the performance of various spectrum allocation schemes by examining the max-min and median number of EPR-pairs assigned by them, and the Jain index associated with this assignment. Since this presents an NP-hard problem, we identify two approximation algorithms that outperform others in minimum and mean EPR-pair rate distribution and are comparable to others in the Jain index. We also analyze how the network size and connectivity affect these metrics using Watts-Strogatz random graphs. We find that a spectrum allocation approach that achieves high minimum EPR-pair rate can perform significantly worse when the median EPR-pair rate, Jain index, and runtimes are considered.
△ Less
Submitted 12 April, 2024;
originally announced April 2024.
-
Low-Latency Upstream Scheduling in Multi-Tenant, SLA Compliant TWDM PON
Authors:
Arijeet Ganguli,
Marco Ruffini
Abstract:
We present a multi-tenant multi-wavelength upstream transmission scheme for virtualised PONs, enabling compliance with latency-oriented Service Level Agreements (SLAs). Our analysis highlights an important trade-off between single-channel vs. multi-channel PONs, depending on ONUs tuning time.
We present a multi-tenant multi-wavelength upstream transmission scheme for virtualised PONs, enabling compliance with latency-oriented Service Level Agreements (SLAs). Our analysis highlights an important trade-off between single-channel vs. multi-channel PONs, depending on ONUs tuning time.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Demonstration of Cooperative Transport Interface using open-source 5G OpenRAN and virtualised PON network
Authors:
Frank Slyne,
Kevin O Sullivan,
Merim Dzaferagic,
Bruce Richardson,
Marcin Wrzeszcz,
Brendan Ryan,
Niall Power,
Robin Giller,
Marco Ruffini
Abstract:
We demonstrate a real-time, converged 5G-PON through the Cooperative Transport Interface, synchronising 5G and PON-DBA upstream schedulers. This innovative approach, implemented using 5G and PON open network implementations, significantly enhances network resource allocation, reducing latency.
We demonstrate a real-time, converged 5G-PON through the Cooperative Transport Interface, synchronising 5G and PON-DBA upstream schedulers. This innovative approach, implemented using 5G and PON open network implementations, significantly enhances network resource allocation, reducing latency.
△ Less
Submitted 19 January, 2024;
originally announced January 2024.
-
Cross-Domain AI for Early Attack Detection and Defense Against Malicious Flows in O-RAN
Authors:
Bruno Missi Xavier,
Merim Dzaferagic,
Irene Vilà,
Magnos Martinello,
Marco Ruffini
Abstract:
Only the chairs can edit In the fight against cyber attacks, Network Softwarization (NS) is a flexible and adaptable shield, using advanced software to spot malicious activity in regular network traffic. However, the availability of comprehensive datasets for mobile networks, which are fundamental for the development of Machine Learning (ML) solutions for attack detection near their source, is sti…
▽ More
Only the chairs can edit In the fight against cyber attacks, Network Softwarization (NS) is a flexible and adaptable shield, using advanced software to spot malicious activity in regular network traffic. However, the availability of comprehensive datasets for mobile networks, which are fundamental for the development of Machine Learning (ML) solutions for attack detection near their source, is still limited. Cross-Domain Artificial Intelligence (AI) can be the key to address this, although its application in Open Radio Access Network (O-RAN) is still at its infancy. To address these challenges, we deployed an end-to-end O-RAN network, that was used to collect data from the RAN and the transport network. These datasets allow us to combine the knowledge from an in-network ML traffic classifier for attack detection to bolster the training of an ML-based traffic classifier specifically tailored for the RAN. Our results demonstrate the potential of the proposed approach, achieving an accuracy rate of 93%. This approach not only bridges critical gaps in mobile network security but also showcases the potential of cross-domain AI in enhancing the efficacy of network security measures.
△ Less
Submitted 17 January, 2024;
originally announced January 2024.
-
Progress on Integrating Quantum Communications in Optical Systems Testbeds
Authors:
Jerry Horgan,
Dmitrii Briantcev,
Aleksandra Kaszubowska-Anandarajah,
Marco Ruffini,
Dan Kilper
Abstract:
Experimental methods are being developed to enable quantum communication systems research in testbeds. We describe testbed architectures for emerging quantum technologies and how they can integrate with existing fibre optical testbeds, specifically OpenIreland.
Experimental methods are being developed to enable quantum communication systems research in testbeds. We describe testbed architectures for emerging quantum technologies and how they can integrate with existing fibre optical testbeds, specifically OpenIreland.
△ Less
Submitted 28 November, 2023;
originally announced November 2023.
-
Routing and Spectrum Allocation in Broadband Degenerate EPR-Pair Distribution
Authors:
Rohan Bali,
Ashley Tittelbaugh,
Shelbi L. Jenkins,
Anuj Agrawal,
Jerry Horgan,
Marco Ruffini,
Daniel Kilper,
Boulat A. Bash
Abstract:
We investigate resource allocation for quantum entanglement distribution over an optical network. We characterize and model a network architecture that employs a single quasideterministic time-frequency heralded EPR-pair source, and develop a routing scheme for distributing entangled photon pairs over such a network. We focus on fairness in entanglement distribution, and compare both the performan…
▽ More
We investigate resource allocation for quantum entanglement distribution over an optical network. We characterize and model a network architecture that employs a single quasideterministic time-frequency heralded EPR-pair source, and develop a routing scheme for distributing entangled photon pairs over such a network. We focus on fairness in entanglement distribution, and compare both the performance of various spectrum allocation schemes as well as their Jain index.
△ Less
Submitted 24 November, 2023;
originally announced November 2023.
-
Double Clipping: Less-Biased Variance Reduction in Off-Policy Evaluation
Authors:
Jan Malte Lichtenberg,
Alexander Buchholz,
Giuseppe Di Benedetto,
Matteo Ruffini,
Ben London
Abstract:
"Clipping" (a.k.a. importance weight truncation) is a widely used variance-reduction technique for counterfactual off-policy estimators. Like other variance-reduction techniques, clipping reduces variance at the cost of increased bias. However, unlike other techniques, the bias introduced by clipping is always a downward bias (assuming non-negative rewards), yielding a lower bound on the true expe…
▽ More
"Clipping" (a.k.a. importance weight truncation) is a widely used variance-reduction technique for counterfactual off-policy estimators. Like other variance-reduction techniques, clipping reduces variance at the cost of increased bias. However, unlike other techniques, the bias introduced by clipping is always a downward bias (assuming non-negative rewards), yielding a lower bound on the true expected reward. In this work we propose a simple extension, called $\textit{double clipping}$, which aims to compensate this downward bias and thus reduce the overall bias, while maintaining the variance reduction properties of the original estimator.
△ Less
Submitted 3 September, 2023;
originally announced September 2023.
-
Metro Access Network with Convergence of Coherent and Analog RoF Data Services
Authors:
Amol Delmade,
Frank Slyne,
Colm Browning,
Daniel Kilper Liam Barry,
Marco Ruffini
Abstract:
Efficient use of spectral resources will be an important aspect of converged access network deployment. This work analyzes the performance of variable bandwidth Analog Radio-over-Fiber signals transmitted in the unfilled spectral spaces of telecom-grade ROADM channels dedicated for coherent signals transmission over the OpenIreland testbed.
Efficient use of spectral resources will be an important aspect of converged access network deployment. This work analyzes the performance of variable bandwidth Analog Radio-over-Fiber signals transmitted in the unfilled spectral spaces of telecom-grade ROADM channels dedicated for coherent signals transmission over the OpenIreland testbed.
△ Less
Submitted 24 October, 2023; v1 submitted 21 August, 2023;
originally announced August 2023.
-
Resource Cooperation in MEC and SDN based Vehicular Networks
Authors:
Beiran Chen,
Marco Ruffini
Abstract:
Internet of Things (IoT) systems require highly scalable infrastructure to adaptively provide services to meet various performance requirements. Combining Software-Defined Networking (SDN) with Mobile Edge Cloud (MEC) technology brings more flexibility for IoT systems. We present a four-tier task processing architecture for MEC and vehicular networks, which includes processing tasks locally within…
▽ More
Internet of Things (IoT) systems require highly scalable infrastructure to adaptively provide services to meet various performance requirements. Combining Software-Defined Networking (SDN) with Mobile Edge Cloud (MEC) technology brings more flexibility for IoT systems. We present a four-tier task processing architecture for MEC and vehicular networks, which includes processing tasks locally within a vehicle, on neighboring vehicles, on an edge cloud, and on a remote cloud. The flexible network connection is controlled by SDN. We propose a CPU resource allocation algorithm, called Partial Idle Resource Strategy (PIRS) with Vehicle to Vehicle (V2V) communications, based on Asymmetric Nash Bargaining Solution (ANBS) in Game Theory. PIRS encourages vehicles in the same location to cooperate by sharing part of their spare CPU resources. In our simulations, we adopt four applications running on the vehicles to generate workload. We compare the proposed algorithm with Non-Cooperation Strategy (NCS) and All Idle Resource Strategy (AIRS). In NCS, the vehicles execute tasks generated by the applications in their own On-Board Units (OBU), while in AIRS vehicles provide all their CPU resources to help other vehicles offloading requests. Our simulation results show that our PIRS strategy can execute more tasks on the V2V layer and lead to fewer number of task (and their length) to be offloaded to the cloud, reaching up to 28% improvement compared to NCS and up to 10% improvement compared to AIRS.
△ Less
Submitted 8 August, 2023;
originally announced August 2023.
-
Self-Normalizing Neural Network, Enabling One Shot Transfer Learning for Modeling EDFA Wavelength Dependent Gain
Authors:
Agastya Raj,
Zehao Wang,
Frank Slyne,
Tingjun Chen,
Dan Kilper,
Marco Ruffini
Abstract:
We present a novel ML framework for modeling the wavelength-dependent gain of multiple EDFAs, based on semi-supervised, self-normalizing neural networks, enabling one-shot transfer learning. Our experiments on 22 EDFAs in Open Ireland and COSMOS testbeds show high-accuracy transfer-learning even when operated across different amplifier types.
We present a novel ML framework for modeling the wavelength-dependent gain of multiple EDFAs, based on semi-supervised, self-normalizing neural networks, enabling one-shot transfer learning. Our experiments on 22 EDFAs in Open Ireland and COSMOS testbeds show high-accuracy transfer-learning even when operated across different amplifier types.
△ Less
Submitted 21 October, 2023; v1 submitted 4 August, 2023;
originally announced August 2023.
-
Two-tier PON virtualisation with scheduler synchronization supporting application-level ultra-low latency in MEC based Cloud-RAN, using MESH-PON
Authors:
Sandip Das,
Frank Slyne,
Daniel Kilper,
Marco Ruffini
Abstract:
Ultra-low end-to-end latency is one of the most important requirements in 5G networks and beyond to support latency-critical applications. Cloud-RAN and MEC are considered as the key driving technology that can help reduce end-to-end latency. However, the use of MEC nodes poses radical changes to the access network architecture. As it brings the processing and the networking services closer to the…
▽ More
Ultra-low end-to-end latency is one of the most important requirements in 5G networks and beyond to support latency-critical applications. Cloud-RAN and MEC are considered as the key driving technology that can help reduce end-to-end latency. However, the use of MEC nodes poses radical changes to the access network architecture. As it brings the processing and the networking services closer to the edge, it often requires network functions (for example, the CU/DU stack and the application processing) to be distributed across different MEC sites. Therefore, a novel transport mechanism is needed to efficiently coordinate and connect network functions across MEC nodes.
In order to address this challenge, we propose a novel two-tier virtualized PON transport method with schedulers coordination over a virtualised and sliced MESH-PON architecture. While a MESH-PON architecture enables direct communication between MEC nodes that are hosting CU/DU and/or the application processing, our method provides a two tier virtualised PON transport scheme with coordinated schedulers. This approach greatly reduces latency incurred in transporting signals across the different PON tiers, while maintaining the flexibility of the multi-tier methods. We show that our proposed scheme can achieve end-to-end application-level latency below 1ms or 2ms, depending on the network configurations.
△ Less
Submitted 11 March, 2023;
originally announced March 2023.
-
Experimental Demonstration of ML-Based DWDM System Margin Estimation
Authors:
Jasper Müller,
Frank Slyne,
Kaida Kaeval,
Sebastian Troia,
Tobias Fehenberger,
Jörg-Peter Elbers,
Daniel C. Kilper,
Marco Ruffini,
Carmen Mas-Machuca
Abstract:
SNR margins between partially and fully loaded DWDM systems are estimated without detailed knowledge of the network. The ML model, trained on simulation data, achieves accurate predictions on experimental data with an RMSE of 0.16 dB.
SNR margins between partially and fully loaded DWDM systems are estimated without detailed knowledge of the network. The ML model, trained on simulation data, achieves accurate predictions on experimental data with an RMSE of 0.16 dB.
△ Less
Submitted 16 February, 2023;
originally announced February 2023.
-
Optical Networks and Interconnects
Authors:
Carmen Mas-Machuca,
Lena Wosinska,
Marco Ruffini,
Jiajia Chen
Abstract:
The rapid evolution of communication technologies such as 5G and beyond, rely on optical networks to support the challenging and ambitious requirements that include both capacity and reliability. This chapter begins by giving an overview of the evolution of optical access networks, focusing on Passive Optical Networks (PONs). The development of the different PON standards and requirements aiming a…
▽ More
The rapid evolution of communication technologies such as 5G and beyond, rely on optical networks to support the challenging and ambitious requirements that include both capacity and reliability. This chapter begins by giving an overview of the evolution of optical access networks, focusing on Passive Optical Networks (PONs). The development of the different PON standards and requirements aiming at longer reach, higher client count and delivered bandwidth are presented. PON virtualization is also introduced as the flexibility enabler. Triggered by the increase of bandwidth supported by access and aggregation network segments, core networks have also evolved, as presented in the second part of the chapter. Scaling the physical infrastructure requires high investment and hence, operators are considering alternatives to optimize the use of the existing capacity. This chapter introduces different planning problems such as Routing and Spectrum Assignment problems, placement problems for regenerators and wavelength converters, and how to offer resilience to different failures. An overview of control and management is also provided. Moreover, motivated by the increasing importance of data storage and data processing, this chapter also addresses different aspects of optical data center interconnects. Data centers have become critical infrastructure to operate any service. They are also forced to take advantage of optical technology in order to keep up with the growing capacity demand and power consumption. This chapter gives an overview of different optical data center network architectures as well as some expected directions to improve the resource utilization and increase the network capacity.
△ Less
Submitted 15 February, 2023;
originally announced February 2023.
-
Experimental Demonstration of Network Convergence with Coherent and AnalogRadio-over-Fibre signals For Densified 5.5G/6G Small Cell Networks
Authors:
Frank Slyne,
Colm Browning,
Amol Delmade,
Liam P. Barry,
Marco Ruffini
Abstract:
In this work we analyse and demonstrate the coexistence of digital coherent and analogue radio over fibre signals over an access-metro transmission network and field fibre. We analyse how the spectral proximity of the two signals and the non-ideal filter alignment of typical telecomms-grade ROADMs affect the signal performance. Our results show that coexistence is indeed possible, although perform…
▽ More
In this work we analyse and demonstrate the coexistence of digital coherent and analogue radio over fibre signals over an access-metro transmission network and field fibre. We analyse how the spectral proximity of the two signals and the non-ideal filter alignment of typical telecomms-grade ROADMs affect the signal performance. Our results show that coexistence is indeed possible, although performance deteriorates with the increase in number of ROADMs in the network topology. Thus, while todays access-metro networks will be able to support future 5.5 and 6G cell densification operating at mmWave and THz frequency, using spectral efficient analogue radio over fibre transmission, there will be trade-offs to be considered. In our experiment setup, we show that the limit for ARoF accessible performance is reached after transmission over 3 ROADMs and a total of 49 km of fibre.
△ Less
Submitted 9 February, 2023;
originally announced February 2023.
-
Employing Channel Probing to Derive End-of-Life Service Margins for Optical Spectrum Services. To appear in OPTICA Journal of Optical Communications and Networking
Authors:
K. Kaeval,
F. Slyne,
S. Troia,
E. Kenny,
K. Große,
H. Griesser,
D. C. Kilper,
M. Ruffini,
J-J Pedreno-Manresa,
S. K. Patri,
G. Jervan
Abstract:
Optical Spectrum as a Service (OSaaS) spanning over multiple transparent optical network domains, can significantly reduce the investment and operational costs of the end-to-end service. Based on the black-link approach, these services are empowered by reconfigurable transceivers and the emerging disaggregation trend in optical transport networks. This work investigates the accuracy aspects of the…
▽ More
Optical Spectrum as a Service (OSaaS) spanning over multiple transparent optical network domains, can significantly reduce the investment and operational costs of the end-to-end service. Based on the black-link approach, these services are empowered by reconfigurable transceivers and the emerging disaggregation trend in optical transport networks. This work investigates the accuracy aspects of the channel probing method used in Generalized Signal to Noise Ratio (GSNR)-based OSaaS characterization in terrestrial brownfield systems. OSaaS service margins to accommodate impacts from enabling neighboring channels and end-of-life channel loads are experimentally derived in a systematic lab study carried out in the Open Ireland testbed. The applicability of the lab-derived margins is then verified in the HEAnet production network using a 400 GHz wide OSaaS. Finally, the probing accuracy is tested by depleting the GSNR margin through power adjustments utilizing the same 400 GHz OSaaS in the HEAnet live network. A minimum of 0.92 dB and 1.46 dB of service margin allocation is recommended to accommodate the impacts of enabling neighboring channels and end-of-life channel loads. Further 0.6 dB of GSNR margin should be allocated to compensate for probing inaccuracies.
△ Less
Submitted 9 February, 2023;
originally announced February 2023.
-
Machine Learning-based Early Attack Detection Using Open RAN Intelligent Controller
Authors:
Bruno Missi Xavier,
Merim Dzaferagic,
Diarmuid Collins,
Giovanni Comarela,
Magnos Martinello,
Marco Ruffini
Abstract:
We design and demonstrate a method for early detection of Denial-of-Service attacks. The proposed approach takes advantage of the OpenRAN framework to collect measurements from the air interface (for attack detection) and to dynamically control the operation of the Radio Access Network (RAN). For that purpose, we developed our near-Real Time (RT) RAN Intelligent Controller (RIC) interface. We appl…
▽ More
We design and demonstrate a method for early detection of Denial-of-Service attacks. The proposed approach takes advantage of the OpenRAN framework to collect measurements from the air interface (for attack detection) and to dynamically control the operation of the Radio Access Network (RAN). For that purpose, we developed our near-Real Time (RT) RAN Intelligent Controller (RIC) interface. We apply and analyze a wide range of Machine Learning algorithms to data traffic analysis that satisfy the accuracy and latency requirements set by the near-RT RIC. Our results show that the proposed framework is able to correctly classify genuine vs. malicious traffic with high accuracy (i.e., 95%) in a realistic testbed environment, allowing us to detect attacks already at the Distributed Unit (DU), before malicious traffic even enters the Centralized Unit (CU).
△ Less
Submitted 3 February, 2023;
originally announced February 2023.
-
Energy Efficient SDN and SDR Joint Adaptation of CPU Utilization Based on Experimental Data Analytics
Authors:
Beiran Chen,
Frank Slyne,
Marco Ruffini
Abstract:
In this paper we propose a hybrid softwarized architecture of Network Function Virtualization (NFV) where Software-Defined Networking (SDN) and Software-Defined Radio (SDR) components are integrated to form a cloud-based communication system. We analyze CPU utilization and power consumption in the OpenIreland testbed for different parameter settings and use case scenarios of this NFV architecture.…
▽ More
In this paper we propose a hybrid softwarized architecture of Network Function Virtualization (NFV) where Software-Defined Networking (SDN) and Software-Defined Radio (SDR) components are integrated to form a cloud-based communication system. We analyze CPU utilization and power consumption in the OpenIreland testbed for different parameter settings and use case scenarios of this NFV architecture. The experiment results show different behaviour between SDN data plane switching and SDR in terms of CPU utilization and parallelization, which provides insights for processing aggregation and power savings when integrating them together in a cloud-based system. We then propose a power saving scheme with flexible CPU allocation that can reduce the overall power consumption of the system. Our results show that our proposed NFV architecture and its power saving scheme can save up to 20% power consumption compared to conventional scheme where SDN and SDR are separately deployed.
△ Less
Submitted 3 February, 2023;
originally announced February 2023.
-
A Novel low-latency DBA for Virtualised PON implemented through P4 In-Network Processing
Authors:
D. R. Mafioletti,
F. Slyne,
R. Giller,
M. OHanlon,
B. Ryan,
M. Ruffini
Abstract:
We present a novel dual-DBA allocation, with a fast P4-enabled scheduler to provide low latency upstream grant allocations. We show latency reduction of 37% and 43%, respectively, compared to standard and virtual PONs
We present a novel dual-DBA allocation, with a fast P4-enabled scheduler to provide low latency upstream grant allocations. We show latency reduction of 37% and 43%, respectively, compared to standard and virtual PONs
△ Less
Submitted 18 January, 2023;
originally announced January 2023.
-
Demonstration of a low latency bandwidth allocation mechanism for mission critical applications in virtual PONs with P4 programmable hardware
Authors:
D. R. Mafioletti,
F. Slyne,
R. Giller,
M. OHanlon,
D. Coyle,
B. Ryan,
M. Ruffini
Abstract:
We provide a real-time demonstration of a low-latency PON DBA mechanism, optimised for virtual PONs. Our implementation mixes P4 programmable data plane and software-based virtual DBA to provide efficient fast-track allocation for low latency applications
We provide a real-time demonstration of a low-latency PON DBA mechanism, optimised for virtual PONs. Our implementation mixes P4 programmable data plane and software-based virtual DBA to provide efficient fast-track allocation for low latency applications
△ Less
Submitted 18 January, 2023;
originally announced January 2023.
-
Connected OFCity Challenge: an updated perspective on technology for connected cities
Authors:
M. Ruffini,
C. Xie,
L. shi,
J. S. Wey
Abstract:
This paper gives an update on technologies discussed during three OFC events, called 'The Connected OFCity Challenge', from 2016 to 2018. It focuses on research development and field deployment of Passive Optical Networks and Cloud-Based technologies.
This paper gives an update on technologies discussed during three OFC events, called 'The Connected OFCity Challenge', from 2016 to 2018. It focuses on research development and field deployment of Passive Optical Networks and Cloud-Based technologies.
△ Less
Submitted 18 January, 2023;
originally announced January 2023.
-
Real-time, low latency virtual DBA hypervisor for SLA-compliant multi-service operations over shared Passive Optical Networks
Authors:
Arijeet Ganguli,
Frank Slyne,
Marco Ruffini
Abstract:
We present a heuristic algorithm for a PON upstream scheduling hypervisor,supporting low latency services with strict service-level agreement. The algorithm achieves near-optimal performance while running in only 3.5 us, thus operating in real-time.
We present a heuristic algorithm for a PON upstream scheduling hypervisor,supporting low latency services with strict service-level agreement. The algorithm achieves near-optimal performance while running in only 3.5 us, thus operating in real-time.
△ Less
Submitted 17 January, 2023;
originally announced January 2023.
-
ML Approach for Power Consumption Prediction in Virtualized Base Stations
Authors:
Merim Dzaferagic,
Jose A. Ayala-Romero,
Marco Ruffini
Abstract:
The flexibility introduced with the Open Radio Access Network (O-RAN) architecture allows us to think beyond static configurations in all parts of the network. This paper addresses the issue related to predicting the power consumption of different radio schedulers, and the potential offered by O-RAN to collect data, train models, and deploy policies to control the power consumption. We propose a b…
▽ More
The flexibility introduced with the Open Radio Access Network (O-RAN) architecture allows us to think beyond static configurations in all parts of the network. This paper addresses the issue related to predicting the power consumption of different radio schedulers, and the potential offered by O-RAN to collect data, train models, and deploy policies to control the power consumption. We propose a black-box (Neural Network) model to learn the power consumption function. We compare our approach with a known hand-crafted solution based on domain knowledge. Our solution reaches similar performance without any previous knowledge of the application and provides more flexibility in scenarios where the system behavior is not well understood or the domain knowledge is not available.
△ Less
Submitted 13 January, 2023;
originally announced January 2023.
-
Fairness Guaranteed and Auction-based x-haul and Cloud Resource Allocation in Multi-tenant O-RANs
Authors:
Sourav Mondal,
Marco Ruffini
Abstract:
The open-radio access network (O-RAN) embraces cloudification and network function virtualization for base-band function processing by dis-aggregated radio units (RUs), distributed units (DUs), and centralized units (CUs). These enable the cloud-RAN vision in full, where multiple mobile network operators (MNOs) can install their proprietary or open RUs, but lease on-demand computational resources…
▽ More
The open-radio access network (O-RAN) embraces cloudification and network function virtualization for base-band function processing by dis-aggregated radio units (RUs), distributed units (DUs), and centralized units (CUs). These enable the cloud-RAN vision in full, where multiple mobile network operators (MNOs) can install their proprietary or open RUs, but lease on-demand computational resources for DU-CU functions from commonly available open-clouds via open x-haul interfaces. In this paper, we propose and compare the performances of min-max fairness and Vickrey-Clarke-Groves (VCG) auction-based x-haul and DU-CU resource allocation mechanisms to create a multi-tenant O-RAN ecosystem that is sustainable for small, medium, and large MNOs. The min-max fair approach minimizes the maximum OPEX of RUs through cost-sharing proportional to their demands, whereas the VCG auction-based approach minimizes the total OPEX for all resources utilized while extracting truthful demands from RUs. We consider time-wavelength division multiplexed (TWDM) passive optical network (PON)-based x-haul interfaces where PON virtualization technique is used to flexibly provide optical connections among RUs and edge-clouds at macro-cell RU locations as well as open-clouds at the central office locations. Moreover, we design efficient heuristics that yield significantly better economic efficiency and network resource utilization than conventional greedy resource allocation algorithms and reinforcement learning-based algorithms.
△ Less
Submitted 15 March, 2023; v1 submitted 2 January, 2023;
originally announced January 2023.
-
Fair Effect Attribution in Parallel Online Experiments
Authors:
Alexander Buchholz,
Vito Bellini,
Giuseppe Di Benedetto,
Yannik Stein,
Matteo Ruffini,
Fabian Moerchen
Abstract:
A/B tests serve the purpose of reliably identifying the effect of changes introduced in online services. It is common for online platforms to run a large number of simultaneous experiments by splitting incoming user traffic randomly in treatment and control groups. Despite a perfect randomization between different groups, simultaneous experiments can interact with each other and create a negative…
▽ More
A/B tests serve the purpose of reliably identifying the effect of changes introduced in online services. It is common for online platforms to run a large number of simultaneous experiments by splitting incoming user traffic randomly in treatment and control groups. Despite a perfect randomization between different groups, simultaneous experiments can interact with each other and create a negative impact on average population outcomes such as engagement metrics. These are measured globally and monitored to protect overall user experience. Therefore, it is crucial to measure these interaction effects and attribute their overall impact in a fair way to the respective experimenters. We suggest an approach to measure and disentangle the effect of simultaneous experiments by providing a cost sharing approach based on Shapley values. We also provide a counterfactual perspective, that predicts shared impact based on conditional average treatment effects making use of causal inference techniques. We illustrate our approach in real world and synthetic data experiments.
△ Less
Submitted 15 October, 2022;
originally announced October 2022.
-
Schedulers Synchronization Supporting Ultra Reliable Low Latency Communications (URLLC) in Cloud-RAN over Virtualised Mesh PON
Authors:
Sandip Das,
Frank Slyne,
Daniel Kilper,
Marco Ruffini
Abstract:
We propose a mechanism to support URLLC Open-RAN ultra-low latency over a MESH-PON, serving dense deployment of small cell and MEC nodes in an access network. We show the possibility, under given assumptions, to achieve application-to-application end-to-end latency below 1ms.
We propose a mechanism to support URLLC Open-RAN ultra-low latency over a MESH-PON, serving dense deployment of small cell and MEC nodes in an access network. We show the possibility, under given assumptions, to achieve application-to-application end-to-end latency below 1ms.
△ Less
Submitted 23 August, 2022;
originally announced August 2022.
-
Low-variance estimation in the Plackett-Luce model via quasi-Monte Carlo sampling
Authors:
Alexander Buchholz,
Jan Malte Lichtenberg,
Giuseppe Di Benedetto,
Yannik Stein,
Vito Bellini,
Matteo Ruffini
Abstract:
The Plackett-Luce (PL) model is ubiquitous in learning-to-rank (LTR) because it provides a useful and intuitive probabilistic model for sampling ranked lists. Counterfactual offline evaluation and optimization of ranking metrics are pivotal for using LTR methods in production. When adopting the PL model as a ranking policy, both tasks require the computation of expectations with respect to the mod…
▽ More
The Plackett-Luce (PL) model is ubiquitous in learning-to-rank (LTR) because it provides a useful and intuitive probabilistic model for sampling ranked lists. Counterfactual offline evaluation and optimization of ranking metrics are pivotal for using LTR methods in production. When adopting the PL model as a ranking policy, both tasks require the computation of expectations with respect to the model. These are usually approximated via Monte-Carlo (MC) sampling, since the combinatorial scaling in the number of items to be ranked makes their analytical computation intractable. Despite recent advances in improving the computational efficiency of the sampling process via the Gumbel top-k trick, the MC estimates can suffer from high variance. We develop a novel approach to producing more sample-efficient estimators of expectations in the PL model by combining the Gumbel top-k trick with quasi-Monte Carlo (QMC) sampling, a well-established technique for variance reduction. We illustrate our findings both theoretically and empirically using real-world recommendation data from Amazon Music and the Yahoo learning-to-rank challenge.
△ Less
Submitted 12 May, 2022;
originally announced May 2022.
-
Optimal Slicing of Virtualised Passive Optical Networks to Support Dense Deployment of Cloud-RAN and Multi-Access Edge Computing
Authors:
Sandip Das,
Frank Slyne,
Marco Ruffini
Abstract:
The commercialization of Cloud-RAN, and Open-RAN in particular, is a key factor to enable 5G cell densification, by providing lower cost and more agile deployment of small cells. In addition, the adoption of MEC is important to support ultra-low latency and high reliability required by mission-critical applications, which constitute a milestone of the 5G and beyond vision of a fully connected soci…
▽ More
The commercialization of Cloud-RAN, and Open-RAN in particular, is a key factor to enable 5G cell densification, by providing lower cost and more agile deployment of small cells. In addition, the adoption of MEC is important to support ultra-low latency and high reliability required by mission-critical applications, which constitute a milestone of the 5G and beyond vision of a fully connected society. However, connecting antenna site, C-RAN processing and MEC at low cost is challenging, as it requires high-capacity, low latency connectivity delivered through a highly inter-connected topology. While PON is being considered as a solution for providing low-cost connectivity to C-RAN, they only allow data transmission from the endpoints (for example hosting RU at the antenna site) towards a central node (e.g., the central office, hosting computing equipment), thus cannot support traffic from RU towards MEC end nodes that could host DU and possibly CU and network core. This led to research into the evolution of PON architectures with the ability to provide direct communications between endpoints, thus supporting mesh traffic patterns required by MEC installations. In this context, virtualization plays a key role in enabling efficient resource allocation (i.e. optical transmission capacity) to endpoints, according to their communication patterns. In this article, we address the challenge of dynamic allocation of virtual PON slices over mesh-PON architectures to support C-RAN and MEC nodes. We make use of a mixed analytical-iterative model to compute optimal virtual PON slice allocation, with the objective of minimizing the use of MEC node resources, while meeting a target latency threshold (100 $μs$ in our scenario). Our method is particularly effective in reducing computation time, enabling virtual PON slice allocation in timescales compatible with real-time or near real-time operations.
△ Less
Submitted 22 March, 2022;
originally announced March 2022.
-
A Min-Max Fair Resource Allocation Framework for Optical x-haul and DU/CU in Multi-tenant O-RANs
Authors:
Sourav Mondal,
Marco Ruffini
Abstract:
The recently proposed open-radio access network (O-RAN) architecture embraces cloudification and network function virtualization techniques to perform the base-band function processing by dis-aggregated radio units (RUs), distributed units (DUs), and centralized units (CUs). This enables the cloud-RAN vision in full, where mobile network operators (MNOs) could install their own RUs, but then lease…
▽ More
The recently proposed open-radio access network (O-RAN) architecture embraces cloudification and network function virtualization techniques to perform the base-band function processing by dis-aggregated radio units (RUs), distributed units (DUs), and centralized units (CUs). This enables the cloud-RAN vision in full, where mobile network operators (MNOs) could install their own RUs, but then lease on-demand computational resources for the processing of DU and CU functions from commonly available open-cloud (O-Cloud) servers via open x-haul interfaces due to variation of load over the day. This creates a multi-tenant scenario where multiple MNOs share networking as well as computational resources. In this paper, we propose a framework that dynamically allocates x-haul and DU/CU resources in a multi-tenant O-RAN ecosystem with min-max fairness guarantees. This framework ensures that a maximum number of RUs get sufficient resources while minimizing the OPEX for their MNOs. Moreover, in order to provide an access network architecture capable of sustaining low-latency and high capacity between RUs and edge-computing devices, we consider time-wavelength division multiplexed (TWDM) passive optical network (PON)-based x-haul interfaces where the PON virtualization technique is used to provide a direct optical connection between end-points. This creates a virtual mesh interconnection among all the nodes such that the RUs can be connected to the Edge-Clouds at macro-cell RU locations as well as to the O-Cloud servers at the central office locations. Furthermore, we analyze the system performance with our proposed framework and show that MNOs can operate with a better cost-efficiency than baseline greedy resource allocation with uniform cost-sharing.
△ Less
Submitted 22 February, 2022; v1 submitted 18 January, 2022;
originally announced January 2022.
-
Moving the Network to the Cloud: the Cloud Central Office Revolution and its Implications for the Optical Layer
Authors:
M. Ruffini,
F. Slyne
Abstract:
SDN and NFV have recently changed the way we operate networks. By decoupling control and data plane operations and virtualising their components, they have opened up new frontiers towards reducing network ownership costs and improving usability and efficiency. Recently, their applicability has moved towards public telecommunications networks, with concepts such as the cloud-CO that have pioneered…
▽ More
SDN and NFV have recently changed the way we operate networks. By decoupling control and data plane operations and virtualising their components, they have opened up new frontiers towards reducing network ownership costs and improving usability and efficiency. Recently, their applicability has moved towards public telecommunications networks, with concepts such as the cloud-CO that have pioneered its use in access and metro networks: an idea that has quickly attracted the interest of network operators. By merging mobile, residential and enterprise services into a common framework, built around commoditised data centre types of architectures, future embodiments of this CO virtualisation concept could achieve significant capital and operational cost savings, while providing customised network experience to high-capacity and low-latency future applications.
This tutorial provides an overview of the various frameworks and architectures outlining current network disaggregation trends that are leading to the virtualisation/cloudification of central offices. It also provides insight on the virtualisation of the access-metro network, showcasing new software functionalities like the virtual \ac{DBA} mechanisms for \acp{PON}. In addition, we explore how it can bring together different network technologies to enable convergence of mobile and optical access networks and pave the way for the integration of disaggregated ROADM networks. Finally, this paper discusses some of the open challenges towards the realisation of networks capable of delivering guaranteed performance, while sharing resources across multiple operators and services.
△ Less
Submitted 16 November, 2021;
originally announced November 2021.
-
Optical Front/Mid-haul with Open Access-Edge Server Deployment Framework for Sliced O-RAN
Authors:
Sourav Mondal,
Marco Ruffini
Abstract:
The fifth-generation of mobile radio technologies is expected to be agile, flexible, and scalable while provisioning ultra-reliable and low-latency communication (uRLLC), enhanced mobile broadband (eMBB), and massive machine type communication (mMTC) applications. An efficient way of implementing these is by adopting cloudification, network function virtualization, and network slicing techniques w…
▽ More
The fifth-generation of mobile radio technologies is expected to be agile, flexible, and scalable while provisioning ultra-reliable and low-latency communication (uRLLC), enhanced mobile broadband (eMBB), and massive machine type communication (mMTC) applications. An efficient way of implementing these is by adopting cloudification, network function virtualization, and network slicing techniques with open-radio access network (O-RAN) architecture where the base-band processing functions are disaggregated into virtualized radio unit (RU), distributed unit (DU), and centralized unit (CU) over front/mid-haul interfaces. However, cost-efficient solutions are required for designing front/mid-haul interfaces and time-wavelength division multiplexed (TWDM) passive optical network (PON) appears as a potential candidate. Therefore, in this paper, we propose a framework for the optimal placement of RUs based on long-term network statistics and connecting them to open access-edge servers for hosting the corresponding DUs and CUs over front/mid-haul interfaces while satisfying the diverse QoS requirements of uRLLC, eMBB, and mMTC slices. In turn, we formulate a two-stage integer programming problem and time-efficient heuristics for users to RU association and flexible deployment of the corresponding DUs and CUs. We evaluate the O-RAN deployment cost and latency requirements with our TWDM-PON-based framework against urban, rural, and industrial areas and show its efficiency over the optical transport network (OTN)-based framework.
△ Less
Submitted 8 May, 2022; v1 submitted 18 October, 2021;
originally announced October 2021.
-
Ranker-agnostic Contextual Position Bias Estimation
Authors:
Oriol Barbany Mayor,
Vito Bellini,
Alexander Buchholz,
Giuseppe Di Benedetto,
Diego Marco Granziol,
Matteo Ruffini,
Yannik Stein
Abstract:
Learning-to-rank (LTR) algorithms are ubiquitous and necessary to explore the extensive catalogs of media providers. To avoid the user examining all the results, its preferences are used to provide a subset of relatively small size. The user preferences can be inferred from the interactions with the presented content if explicit ratings are unavailable. However, directly using implicit feedback ca…
▽ More
Learning-to-rank (LTR) algorithms are ubiquitous and necessary to explore the extensive catalogs of media providers. To avoid the user examining all the results, its preferences are used to provide a subset of relatively small size. The user preferences can be inferred from the interactions with the presented content if explicit ratings are unavailable. However, directly using implicit feedback can lead to learning wrong relevance models and is known as biased LTR. The mismatch between implicit feedback and true relevances is due to various nuisances, with position bias one of the most relevant. Position bias models consider that the lack of interaction with a presented item is not only attributed to the item being irrelevant but because the item was not examined. This paper introduces a method for modeling the probability of an item being seen in different contexts, e.g., for different users, with a single estimator. Our suggested method, denoted as contextual (EM)-based regression, is ranker-agnostic and able to correctly learn the latent examination probabilities while only using implicit feedback. Our empirical results indicate that the method introduced in this paper outperforms other existing position bias estimators in terms of relative error when the examination probability varies across queries. Moreover, the estimated values provide a ranking performance boost when used to debias the implicit ranking data even if there is no context dependency on the examination probabilities.
△ Less
Submitted 28 July, 2021;
originally announced July 2021.
-
Optimal virtual PON slicing to support ultra-low latency mesh traffic pattern in MEC-based Cloud-RAN
Authors:
Sandip Das,
Marco Ruffini
Abstract:
As progressive densification of cells, deployment of Cloud-RAN and \ac{MEC} are coming into reality to support the ultra-low latency with high reliability in 5G and beyond, it generates mesh traffic pattern across fronthaul network. This led to evolution of PON architectural enhancements with virtualization in order to support such mesh traffic pattern. However, allocation of virtual PON slices dy…
▽ More
As progressive densification of cells, deployment of Cloud-RAN and \ac{MEC} are coming into reality to support the ultra-low latency with high reliability in 5G and beyond, it generates mesh traffic pattern across fronthaul network. This led to evolution of PON architectural enhancements with virtualization in order to support such mesh traffic pattern. However, allocation of virtual PON slices dynamically over such mesh-PON based fronthaul transport is becoming a research challenge. In this paper, we provide a mixed analytical-iterative model to compute optimal virtual PON slice allocation, providing mesh access connectivity with ultra-low end-to-end latency in next-generation MEC-based Cloud-RAN. Our proposed method can compute optimal virtual PON slice allocation in timescales compatible with real-time or near real-time operations.
△ Less
Submitted 1 June, 2021;
originally announced June 2021.
-
Experimental Demonstration of RAN Functional Split over virtual PON Transport Network
Authors:
Line Larsen,
Frank Slyne,
Ghizlane Mountaser,
Marco Ruffini,
Toktam Mahmoodi
Abstract:
Cloud-Radio Access Networks (Cloud-RANs) are separating the mobile networks base station functions into three units, the connection between the two of them is referred to as the fronthaul network. This work demonstrates the transmission of user data transport blocks between the distributed Medium Access Control (MAC) layer and local Physical (PHY) layer in the radiounit over a Passive Optical Netw…
▽ More
Cloud-Radio Access Networks (Cloud-RANs) are separating the mobile networks base station functions into three units, the connection between the two of them is referred to as the fronthaul network. This work demonstrates the transmission of user data transport blocks between the distributed Medium Access Control (MAC) layer and local Physical (PHY) layer in the radiounit over a Passive Optical Network (PON). PON networks provide benefits in terms of economy and flexibility when used for Cloud-RAN fronthaul transport. However, the PON upstream scheduling can introduce additional latency that might not satisfy the requirements imposed by Cloud-RAN functional split. In this work we demonstrate how our virtual Dynamic Bandwidth Allocation(DBA) concept can be used to effectively communicate with the mobile Long Term Evolution (LTE) scheduler, adopting the well known cooperative DBA mechanism, to reduce the PON latency to satisfactory values. Thus, our results show the feasibility ofusing PON technology as transport medium of the fronthaul for the MAC/PHY functional split, in a fully virtualised environment.Further background traffic is added, so that measurements show a more realistic scenario. The obtained round trip times indicates that using PON at fronthaul might be limited to the distance of 11km for a synchronised scenario, or no compliance for a non-synchronised scenario.
△ Less
Submitted 9 April, 2021;
originally announced April 2021.
-
PON Virtualisation with EAST-WEST Communications for Low-Latency Converged Multi-Access Edge Computing (MEC)
Authors:
Sandip Das,
Marco Ruffini
Abstract:
We propose a virtual-PON based Mobile Fronthaul (MFH) architecture that allows direct communications between edge points (enabling EAST-WEST communication). Dynamic slicing improves service multiplexing while supporting ultra-low latency under 100$μ$s between cells and MEC nodes.
We propose a virtual-PON based Mobile Fronthaul (MFH) architecture that allows direct communications between edge points (enabling EAST-WEST communication). Dynamic slicing improves service multiplexing while supporting ultra-low latency under 100$μ$s between cells and MEC nodes.
△ Less
Submitted 13 April, 2020;
originally announced April 2020.
-
Hierarchical Methods of Moments
Authors:
Matteo Ruffini,
Guillaume Rabusseau,
Borja Balle
Abstract:
Spectral methods of moments provide a powerful tool for learning the parameters of latent variable models. Despite their theoretical appeal, the applicability of these methods to real data is still limited due to a lack of robustness to model misspecification. In this paper we present a hierarchical approach to methods of moments to circumvent such limitations. Our method is based on replacing the…
▽ More
Spectral methods of moments provide a powerful tool for learning the parameters of latent variable models. Despite their theoretical appeal, the applicability of these methods to real data is still limited due to a lack of robustness to model misspecification. In this paper we present a hierarchical approach to methods of moments to circumvent such limitations. Our method is based on replacing the tensor decomposition step used in previous algorithms with approximate joint diagonalization. Experiments on topic modeling show that our method outperforms previous tensor decomposition methods in terms of speed and model quality.
△ Less
Submitted 17 October, 2018;
originally announced October 2018.
-
Generating Synthetic but Plausible Healthcare Record Datasets
Authors:
Laura Aviñó,
Matteo Ruffini,
Ricard Gavaldà
Abstract:
Generating datasets that "look like" given real ones is an interesting tasks for healthcare applications of ML and many other fields of science and engineering. In this paper we propose a new method of general application to binary datasets based on a method for learning the parameters of a latent variable moment that we have previously used for clustering patient datasets. We compare our method w…
▽ More
Generating datasets that "look like" given real ones is an interesting tasks for healthcare applications of ML and many other fields of science and engineering. In this paper we propose a new method of general application to binary datasets based on a method for learning the parameters of a latent variable moment that we have previously used for clustering patient datasets. We compare our method with a recent proposal (MedGan) based on generative adversarial methods and find that the synthetic datasets we generate are globally more realistic in at least two senses: real and synthetic instances are harder to tell apart by Random Forests, and the MMD statistic. The most likely explanation is that our method does not suffer from the "mode collapse" which is an admitted problem of GANs. Additionally, the generative models we generate are easy to interpret, unlike the rather obscure GANs. Our experiments are performed on two patient datasets containing ICD-9 diagnostic codes: the publicly available MIMIC-III dataset and a dataset containing admissions for congestive heart failure during 7 years at Hospital de Sant Pau in Barcelona.
△ Less
Submitted 4 July, 2018;
originally announced July 2018.
-
An Overview on Application of Machine Learning Techniques in Optical Networks
Authors:
Francesco Musumeci,
Cristina Rottondi,
Avishek Nag,
Irene Macaluso,
Darko Zibar,
Marco Ruffini,
Massimo Tornatore
Abstract:
Today's telecommunication networks have become sources of enormous amounts of widely heterogeneous data. This information can be retrieved from network traffic traces, network alarms, signal quality indicators, users' behavioral data, etc. Advanced mathematical tools are required to extract meaningful information from these data and take decisions pertaining to the proper functioning of the networ…
▽ More
Today's telecommunication networks have become sources of enormous amounts of widely heterogeneous data. This information can be retrieved from network traffic traces, network alarms, signal quality indicators, users' behavioral data, etc. Advanced mathematical tools are required to extract meaningful information from these data and take decisions pertaining to the proper functioning of the networks from the network-generated data. Among these mathematical tools, Machine Learning (ML) is regarded as one of the most promising methodological approaches to perform network-data analysis and enable automated network self-configuration and fault management. The adoption of ML techniques in the field of optical communication networks is motivated by the unprecedented growth of network complexity faced by optical networks in the last few years. Such complexity increase is due to the introduction of a huge number of adjustable and interdependent system parameters (e.g., routing configurations, modulation format, symbol rate, coding schemes, etc.) that are enabled by the usage of coherent transmission/reception technologies, advanced digital signal processing and compensation of nonlinear effects in optical fiber propagation. In this paper we provide an overview of the application of ML to optical communications and networking. We classify and survey relevant literature dealing with the topic, and we also provide an introductory tutorial on ML for researchers and practitioners interested in this field. Although a good number of research papers have recently appeared, the application of ML to optical networks is still in its infancy: to stimulate further work in this area, we conclude the paper proposing new possible research directions.
△ Less
Submitted 1 December, 2018; v1 submitted 21 March, 2018;
originally announced March 2018.
-
Complex Systems Science meets 5G and IoT
Authors:
Nicola Marchetti,
Irene Macaluso,
Nicholas Kaminski,
Merim Dzaferagic,
M. Majid Butt,
Marco Ruffini,
Saul Friedner,
Julie Bradford,
Andrea Zanella,
Michele Zorzi,
Linda Doyle
Abstract:
We propose a new paradigm for telecommunications, and develop a framework drawing on concepts from information (i.e., different metrics of complexity) and computational (i.e., agent based modeling) theory, adapted from complex system science. We proceed in a systematic fashion by dividing network complexity understanding and analysis into different layers. Modelling layer forms the foundation of t…
▽ More
We propose a new paradigm for telecommunications, and develop a framework drawing on concepts from information (i.e., different metrics of complexity) and computational (i.e., agent based modeling) theory, adapted from complex system science. We proceed in a systematic fashion by dividing network complexity understanding and analysis into different layers. Modelling layer forms the foundation of the proposed framework, supporting analysis and tuning layers. The modelling layer aims at capturing the significant attributes of networks and the interactions that shape them, through the application of tools such as agent-based modelling and graph theoretical abstractions, to derive new metrics that holistically describe a network. The analysis phase completes the core functionality of the framework by linking our new metrics to the overall network performance. The tuning layer augments this core with algorithms that aim at automatically guiding networks toward desired conditions. In order to maximize the impact of our ideas, the proposed approach is rooted in relevant, near-future architectures and use cases in 5G networks, i.e., Internet of Things (IoT) and self-organizing cellular networks.
△ Less
Submitted 31 October, 2017;
originally announced October 2017.
-
Clustering Patients with Tensor Decomposition
Authors:
Matteo Ruffini,
Ricard Gavaldà,
Esther Limón
Abstract:
In this paper we present a method for the unsupervised clustering of high-dimensional binary data, with a special focus on electronic healthcare records. We present a robust and efficient heuristic to face this problem using tensor decomposition. We present the reasons why this approach is preferable for tasks such as clustering patient records, to more commonly used distance-based methods. We run…
▽ More
In this paper we present a method for the unsupervised clustering of high-dimensional binary data, with a special focus on electronic healthcare records. We present a robust and efficient heuristic to face this problem using tensor decomposition. We present the reasons why this approach is preferable for tasks such as clustering patient records, to more commonly used distance-based methods. We run the algorithm on two datasets of healthcare records, obtaining clinically meaningful results.
△ Less
Submitted 29 August, 2017;
originally announced August 2017.
-
Multi-Dimensional Convergence in Future 5G Networks
Authors:
Marco Ruffini
Abstract:
Future 5G services are characterised by unprecedented need for high rate, ubiquitous availability, ultra-low latency and high reliability. The fragmented network view that is widespread in current networks will not stand the challenge posed by next generations of users. A new vision is required, and this paper provides an insight on how network convergence and application-centric approaches will p…
▽ More
Future 5G services are characterised by unprecedented need for high rate, ubiquitous availability, ultra-low latency and high reliability. The fragmented network view that is widespread in current networks will not stand the challenge posed by next generations of users. A new vision is required, and this paper provides an insight on how network convergence and application-centric approaches will play a leading role towards enabling the 5G vision. The paper, after expressing the view on the need for an end-to-end approach to network design, brings the reader into a journey on the expected 5G network requirements and outlines some of the work currently carried out by main standardisation bodies. It then proposes the use of the concept of network convergence for providing the overall architectural framework to bring together all the different technologies within a unifying and coherent network ecosystem. The novel interpretation of multi-dimensional convergence we introduce leads us to the exploration of aspects of node consolidation and converged network architectures, delving into details of optical-wireless integration and future convergence of optical data centre and access-metro networks. We then discuss how ownership models enabling network sharing will be instrumental in realising the 5G vision. The paper concludes with final remarks on the role SDN will play in 5G and on the need for new business models that reflect the application-centric view of the network. Finally, we provide some insight on growing research areas in 5G networking.
△ Less
Submitted 13 December, 2016;
originally announced December 2016.
-
Antenna, Spectrum and Capacity trade-off for Cloud-RAN Massive Distributed MIMO over Next Generation PONs
Authors:
Irene Macaluso,
Bruno Cornaglia,
Marco Ruffini
Abstract:
We propose a cost-optimal antenna vs. spectrum resource allocation strategy for mobile 5G MD-MIMO over Next-Generation PONs. Comparing wavelength overlay and shared wavelength approaches, split-PHY leads to solutions with higher mobile capacity than fronthaul.
We propose a cost-optimal antenna vs. spectrum resource allocation strategy for mobile 5G MD-MIMO over Next-Generation PONs. Comparing wavelength overlay and shared wavelength approaches, split-PHY leads to solutions with higher mobile capacity than fronthaul.
△ Less
Submitted 13 December, 2016;
originally announced December 2016.
-
A Combinatorial Optimisation Approach to Designing Dual-Parented Long-Reach Passive Optical Networks
Authors:
Hadrien Cambazard,
Deepak Mehta,
Barry O'Sullivan,
Luis Quesada,
Marco Ruffini,
David Payne,
Linda Doyle
Abstract:
We present an application focused on the design of resilient long-reach passive optical networks. We specifically consider dual-parented networks whereby each customer must be connected to two metro sites via local exchange sites. An important property of such a placement is resilience to single metro node failure. The objective of the application is to determine the optimal position of a set of m…
▽ More
We present an application focused on the design of resilient long-reach passive optical networks. We specifically consider dual-parented networks whereby each customer must be connected to two metro sites via local exchange sites. An important property of such a placement is resilience to single metro node failure. The objective of the application is to determine the optimal position of a set of metro nodes such that the total optical fibre length is minimized. We prove that this problem is NP-Complete. We present two alternative combinatorial optimisation approaches to finding an optimal metro node placement using: a mixed integer linear programming (MIP) formulation of the problem; and, a hybrid approach that uses clustering as a preprocessing step. We consider a detailed case-study based on a network for Ireland. The hybrid approach scales well and finds solutions that are close to optimal, with a runtime that is two orders-of-magnitude better than the MIP model.
△ Less
Submitted 6 September, 2011;
originally announced September 2011.