一句话:提出行为引导的模糊测试技术 BehAVExplor,通过无监督行为建模与能量机制提升自动驾驶系统测试中违规的多样性并减少冗余失败。
现有自动驾驶系统(ADS)测试方法主要关注搜索安全违规,却忽视了生成测试用例的多样性,容易产生大量冗余用例与冗余失败,从而降低测试效率并增加失败分析成本。本文提出行为引导的模糊测试技术 BehAVExplor,旨在探索被测 ADS 所控自车(ego vehicle)的不同行为并检测多样化的违规。方法上,作者设计了高效的无监督模型 BehaviorMiner,从给定场景中提取时序特征,并通过基于聚类的抽象将相似行为归并为抽象状态;当新测试用例触发新行为(如覆盖新的抽象状态)时,该用例被加入种子语料库。针对行为多样性与一般违规反馈之间可能存在的冲突,论文进一步提出能量机制来指导种子选择与变异,其中种子的能量刻画其优劣程度。作者在工业级 ADS Apollo 与 LGSVL 仿真环境上开展评估,实验结果表明 BehAVExplor 相比当前最优方法能够有效发现更多样化的违规。
Testing Autonomous Driving Systems (ADSs) is a critical task for ensuring the reliability and safety of autonomous vehicles. Existing methods mainly focus on searching for safety violations while the diversity of the generated test cases is ignored, which may generate many redundant test cases and failures. Such redundant failures can reduce testing performance and increase failure analysis costs. In this paper, we present a novel behavior-guided fuzzing technique (BehAVExplor) to explore the different behaviors of the ego vehi- cle (i.e., the vehicle controlled by the ADS under test) and detect diverse violations. Specifically, we design an efficient unsupervised model, called BehaviorMiner, to characterize the behavior of the ego vehicle. BehaviorMiner extracts the temporal features from the given scenarios and performs a clustering-based abstraction to group behaviors with similar features into abstract states. A new test case will be added to the seed corpus if it triggers new behav- iors (e.g., cover new abstract states). Due to the potential conflict between the behavior diversity and the general violation feedback, we further propose an energy mechanism to guide the seed selec- tion and the mutation. The energy of a seed quantifies how good it is. We evaluated BehAVExplor on Apollo, an industrial-level ADS, and LGSVL simulation environment. Empirical evaluation results show that BehAVExplor can effectively find more diverse violations than the state-of-the-art.