一句话:系统复现并比较九种 Android API 兼容性问题检测方法,发现工具能力差异大、结果重叠小。
Android 生态碎片化导致大量 API 引发的兼容性问题,但现有自动检测方法是否有效、可复现并可靠尚不清楚。本文通过文献综述识别出九种相关方法,基于其原始数据集进行复现,并在包含真实兼容性问题的通用数据集上开展实证比较。结果表明,这些工具确实可以被复现,但其检测能力差异显著,不同工具报告的结果仅存在少量重叠。该证据说明,社区仍需投入更多努力才能实现可靠的兼容性问题检测。
Fragmentation is a serious problem in the Android ecosystem. This problem is mainly caused by the fast evolution of the system itself and the various customizations independently maintained by different smartphone manufacturers. Many efforts have attempted to mitigate its impact via approaches to automatically pinpoint compatibility issues in Android apps. Unfortunately, at this stage, it is still unknown if this objective has been fulfilled, and the existing approaches can indeed be replicated and reliably leveraged to pinpoint compatibility issues in the wild. We, therefore, propose to fill this gap by first conducting a literature review within this topic to identify all the available approaches. Among the nine identified approaches, we then try our best to reproduce them based on their original datasets. After that, we go one step further to empirically compare those approaches against common datasets with real-world apps containing compatibility issues. Experimental results show that existing tools can indeed be reproduced, but their capabilities are quite distinct, as confirmed by the fact that there is only a small overlap of the results reported by the selected tools. This evidence suggests that more efforts should be spent by our community to achieve sound compatibility issues detection.
@inproceedings{paperbot7432,
title = {Automatically detecting API-induced compatibility issues in Android apps: a comparative analysis (replicability study)},
author = {Pei Liu and Yanjie Zhao and Haipeng Cai and Mattia Fazzini and John Grundy and Li Li},
booktitle = {ISSTA},
year = {2022},
doi = {10.1145/3533767.3534407}
}