Seminar : Francescomaria Faticanti, ENS-Lyon

When: 6 march 2025 2pm (6 Mars 2025)

Where: EVRY Campus, E303

Title: Orchestration of AI-based Applications in Heterogeneous and Distributed Computing Systems

Abstract: Today, distributed systems are increasingly needed to support distributed applications that involve machine learning (ML) operations for both service providers and end users. These operations include training ML models across distributed infrastructures and deploying them over the network for inference. While the training of these models, whether centralized or decentralized, has been extensively studied, the orchestration of inference models across the network remains largely unexamined. To ensure high-quality applications run effectively over these infrastructures, orchestration presents several challenges, including i) the interaction of models with other software components distributed across the network; ii) deploying such components on heterogeneous and computationally limited resources; and iii) adapting orchestration strategies to continuous changes in the data fed into these models. This seminar aims at exploring and discussing these methodological and technological challenges in the design of algorithmic solutions for orchestrating AI-based applications within distributed computing systems.