一句话：提出 MARQ 框架，让开发者声明不同 QoR 的 AI 服务链，并在运行时自动选择以满足实时约束。
任务关键型 AI 软件具有统计性，结果质量（QoR）可调，但必须满足执行截止期等严格约束；移动与边缘场景中网络和资源波动使权衡更复杂。MARQ 允许软件工程师声明多条具有不同 QoR 与资源需求的候选 AI 服务链，每条链由微服务封装的 AI 服务组成。框架在运行时根据当前资源状况自动进行动态优化与链选择。评估表明，MARQ 能在实时条件下有效选择服务链并维持应用约束，服务链选择加速达 100 倍，QoR 较现有方法平均提升 10%。
AI-based mission-critical software exposes a blessing and a curse: its inherent statistical nature allows for flexibility in result quality, yet the mission-critical importance demands adherence to stringent constraints such as execution deadlines. This creates a space for trade-offs between the Quality of Result (QoR)-a metric that quantifies the quality of a computational outcome-and other application attributes like execution time and energy, particularly in real-time scenarios. Fluctuating resource constraints, such as data transfer to a remote server over unstable network connections, are prevalent in mobile and edge computing environments-encompassing use cases like Vehicle-to-Everything, drone swarms, or social-VR scenarios. We introduce a novel approach that enables software engineers to easily specify alternative AI service chains-sequences of AI services encapsulated in microservices aiming to achieve a predefined goal-with varying QoR and resource requirements. Our methodology facilitates dynamic optimization at runtime, which is automatically driven by the MARQ framework. Our evaluations show that MARQ can be used effectively for the dynamic selection of AI service chains in real-time while maintaining the required application constraints of mission-critical AI software. Notably, our approach achieves a 100x acceleration in service chain selection and an average 10% improvement in QoR compared to existing methods.
DOI 原文 ·
@inproceedings{paperbot8916,
title = {MARQ: Engineering Mission-Critical AI-Based Software with Automated Result Quality Adaptation},
author = {Uwe Gropengießer and Elias Dietz and Florian Brandherm and Achref Doula and Osama Abboud and Xun Xiao and Max Mühlhäuser},
booktitle = {ICSE},
year = {2025},
doi = {10.1109/icse55347.2025.00182}
}