TY - GEN
T1 - Edge-to-Cloud Federated Learning with Resource-Aware Model Aggregation in MEC
AU - Ploch, Noah
AU - Troia, Sebastian
AU - Kellerer, Wolfgang
AU - Maier, Guido
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - The rapid increase in the number of connected devices paired with the adoption of Machine Learning (ML) applications dramatically augments the computation and communication requirements imposed on today's telecommunication networks. New ML techniques and networking paradigms such as Federated Learning (FL), Multi-access Edge Computing (MEC), and Software-Defined Wide Area Networks (SD-WANs) are needed to cope with these requirements. However, to run FL in MEC SD-WANs, intelligent resource management strategies and an evaluation of the impact of FL on the network resources are necessary. In this work, we discuss online resource management strategies for FL model aggregation enhanced by intermediate aggregation at edge nodes. Our analysis shows that a layer of intermediate aggregators (edge aggregators) alleviates the traffic on network links and allows us to take advantage of edge computing nodes, but the risk of congestion in the back-haul network is still high. We thus propose a new aggregation scenario deploying an aggregator overlay network and present an algorithm optimizing the routing of edge aggregators. Our proposed solution can adapt better to resource utilization in the network, achieving a decrease of the failure rate of FL training rounds by up to 15 percent while reducing cloud link congestion.
AB - The rapid increase in the number of connected devices paired with the adoption of Machine Learning (ML) applications dramatically augments the computation and communication requirements imposed on today's telecommunication networks. New ML techniques and networking paradigms such as Federated Learning (FL), Multi-access Edge Computing (MEC), and Software-Defined Wide Area Networks (SD-WANs) are needed to cope with these requirements. However, to run FL in MEC SD-WANs, intelligent resource management strategies and an evaluation of the impact of FL on the network resources are necessary. In this work, we discuss online resource management strategies for FL model aggregation enhanced by intermediate aggregation at edge nodes. Our analysis shows that a layer of intermediate aggregators (edge aggregators) alleviates the traffic on network links and allows us to take advantage of edge computing nodes, but the risk of congestion in the back-haul network is still high. We thus propose a new aggregation scenario deploying an aggregator overlay network and present an algorithm optimizing the routing of edge aggregators. Our proposed solution can adapt better to resource utilization in the network, achieving a decrease of the failure rate of FL training rounds by up to 15 percent while reducing cloud link congestion.
KW - Federated Learning (FL)
KW - Model Aggregation
KW - Multi-access-Edge Computing (MEC)
KW - Software Defined Wide Area Network (SD-WAN)
UR - http://www.scopus.com/inward/record.url?scp=85202439641&partnerID=8YFLogxK
U2 - 10.1109/ICCWorkshops59551.2024.10615545
DO - 10.1109/ICCWorkshops59551.2024.10615545
M3 - Conference contribution
AN - SCOPUS:85202439641
T3 - 2024 IEEE International Conference on Communications Workshops, ICC Workshops 2024
SP - 347
EP - 352
BT - 2024 IEEE International Conference on Communications Workshops, ICC Workshops 2024
A2 - Valenti, Matthew
A2 - Reed, David
A2 - Torres, Melissa
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 59th Annual IEEE International Conference on Communications Workshops, ICC Workshops 2024
Y2 - 9 June 2024 through 13 June 2024
ER -