一句话：提出视觉差分一致性测试预言并实现模糊测试工具 Janus，在主流浏览器中发现 31 个非崩溃渲染缺陷。
浏览器渲染正确性难以保证，常出现渲染缺陷。传统差分测试因同一 HTML 在不同浏览器中本就可能渲染出不同结果，难以直接用于渲染缺陷检测。本文提出视觉差分一致性（Visual Delta Consistency）测试预言，其核心洞察是：对 HTML 文件所做的任何修改都应一致地影响各浏览器的渲染结果；若两个 HTML 文件仅有细微差异，则所有浏览器应表现一致——要么都渲染相同，要么都渲染不同。基于该洞察，作者实现了模糊测试工具 Janus，它构造仅含细微修改的 HTML 文件对，观察各浏览器对应渲染页面的变化状态以检测缺陷。在 Chrome、Safari 和 Firefox 上评估，Janus 共检测到 31 个非崩溃渲染缺陷，其中 24 个被确认、8 个已修复。
Rendering lies at the heart of our modern web experience. However, the correctness of browser rendering is not always guaranteed, often leading to rendering bugs. Traditional differential testing, while successful in various domains, falls short when applied to rendering bug detection because an HTML file is likely yield different rendered outcomes across different browsers. This paper introduces Visual Delta Consistency, a test oracle to detect rendering bugs in web browsers, aiming to make rendered pages across browsers comparable. Our key insight is that any modifications made to an HTML file should uniformly influence rendering outcomes across browsers. Specifically, when presented with two HTML files that differ only by minor modifications, the reaction of all browsers should be consistent, i.e., either all browsers render them identically or all render them differently. Based on this insight, We implemented it as a practical fuzzer named Janus. It constructs pairs of slightly modified HTML files and observes the change statuses of the corresponding rendered pages across browsers for bug detection. We evaluated it on three widely-used browsers, i.e., Chrome, Safari, and Firefox. In total, Janus detected 31 non-crash rendering bugs, out of which 24 confirmed with 8 fixed.
DOI 原文 ·
@inproceedings{paperbot8693,
title = {Janus: Detecting Rendering Bugs in Web Browsers via Visual Delta Consistency},
author = {Chijin Zhou and Quan Zhang and Bingzhou Qian and Yu Jiang},
booktitle = {ICSE},
year = {2025},
doi = {10.1109/icse55347.2025.00013}
}