一句话：结合开发者调查情感与审查遥测，识别代码审查“感觉过慢”的阈值：受访者 diff 审查时间的第75百分位（超过24小时）与满意度密切相关。
本文报告 Meta 的一项大规模研究，目标是在公司规模上减少代码审查耗时。研究每季度调查开发者，并融合开发者体验调查中的情感数据与 diff review 工具的遥测数据，回答“diff review 何时让人感觉太慢”。仅从情感数据看，84.7% 的开发者对其 diff 处于审查中的时间感到满意。将每位受访者的调查结果与其遥测数据关联后，作者发现满意度与该受访者 diff 审查时间的第75百分位密切相关，即那些超过24小时的审查。该结果为后续用 nudges 加速审查提供了依据。
We describe a large-scale study to reduce the amount of time code review takes. Each quarter at Meta we survey developers. Combining sentiment data from a developer experience survey and telemetry data from our diff review tool, we address, “When does a diff review feel too slow?” From the sentiment data alone, we learn that 84.7% of developers are satisfied with the time their diffs spend in review. By enriching the survey results with telemetry for each respondent, we determined that sentiment is closely associated with the 75th percentile time in review for that respondent’s diffs, ie those that take more than 24 hours.
DOI 原文 ·
@inproceedings{paperbot7060,
title = {Using nudges to accelerate code reviews at scale},
author = {Qianhua Shan and David Sukhdeo and Qianying Huang and Seth Rogers and Lawrence Chen and Elise Paradis and Peter C. Rigby and Nachiappan Nagappan},
booktitle = {FSE},
year = {2022},
doi = {10.1145/3540250.3549104}
}