paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Generating Realistic and Diverse Tests for LiDAR-Based Perception Systems

为基于 LiDAR 的感知系统生成真实且多样的测试
ICSE 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE)2023匹配度 3/10 · 论文聚焦于 LiDAR 感知系统的测试用例生成与 oracle 构造,属于 ML 系统测试与调试方向,但未涉及用户核心关注的静态分析、Agentic/LLM 程序、浮点程序分析或贝叶斯程序分析。仅与“PL→AI 在 ML 系统中应用”有较弱关联,且不涉及 LLM 或形式化验证。引用 15 inbox
Garrett Christian, Trey Woodlief, Sebastian Elbaum
crossref: 2026-09-12dblp: 2026-09-12

AI 速览

一句话:以真实数据突变并保持真实性不变式,自动构造 oracle,为 LiDAR 感知系统高效生成真实多样的测试用例。

自主系统依赖感知组件理解环境,而感知误判曾导致严重的系统级失败。现有感知软件测试方法存在两方面不足:难以高效生成能反映真实世界性能的测试数据,且多样性不足以覆盖稀有但安全攸关的长尾场景;这对提供 3D 扫描、可在各种光照下工作的 LiDAR 感知系统尤为突出。本文提出一种新的 LiDAR 感知系统测试方法:以现有真实世界数据为基础,通过保持真实性不变式的突变生成真实且多样的测试用例,从而产生数据集中罕见的输入,并自动构造 oracle 以识别感知性能中潜在的安全攸关问题。作者实现了该方法并为五个先进 LiDAR 感知系统生成了超过 50,000 个测试输入,实验表明它能高效生成可触发实际部署后会产生真实后果的感知错误的用例,且误报率较低。

问题
现有感知软件测试方法难以高效生成贴近真实世界性能的测试数据,多样性也不足以覆盖稀有但安全攸关的长尾场景,LiDAR 感知系统尤为明显。
方法
以真实世界数据为基础,通过保持真实性不变式的突变生成真实且多样的测试输入,并自动构造能够识别感知性能中潜在安全攸关问题的 oracle。
评估
在五个先进 LiDAR 感知系统上生成超过 50,000 个测试输入,验证其能高效发现可能导致真实后果的感知错误,同时保持较低的误报率。
原文摘要(Abstract)

Autonomous systems rely on a perception component to interpret their surroundings, and when misinterpretations occur, they can and have led to serious and fatal system-level failures. Yet, existing methods for testing perception software remain limited in both their capacity to efficiently generate test data that translates to real-world performance and in their diversity to capture the long tail of rare but safety-critical scenarios. These limitations are particularly evident for perception systems based on LiDAR sensors, which have emerged as a crucial component in modern autonomous systems due to their ability to provide a 3D scan of the world and operate in all lighting conditions. To address these limitations, we introduce a novel approach for testing LiDAR-based perception systems by leveraging existing real-world data as a basis to generate realistic and diverse test cases through mutations that preserve realism invariants while generating inputs rarely found in existing data sets, and automatically crafting oracles that identify potentially safety-critical issues in perception performance. We implemented our approach to assess its ability to identify perception failures, generating over 50,000 test inputs for five state-of-the-art LiDAR-based perception systems. We found that it efficiently generated test cases that yield errors in perception that could result in real consequences if these systems were deployed and does so at a low rate of false positives.

链接与引用

DOI 原文 · DBLP

BibTeX
@inproceedings{ChristianWE23,
  title = {Generating Realistic and Diverse Tests for LiDAR-Based Perception Systems},
  author = {Garrett Christian and Trey Woodlief and Sebastian Elbaum},
  booktitle = {ICSE},
  year = {2023},
  doi = {10.1109/icse48619.2023.00217}
}