一句话:提出硬件加速单元GSCore,协同算法优化高效执行3D高斯泼溅渲染管线。
3D高斯泼溅(3D Gaussian Splatting)能实现高质量辐射场渲染,但其渲染管线计算量大,难以在移动端等资源受限设备上广泛部署。本文通过深入分析基于高斯的辐射场渲染,提出硬件加速单元GSCore,并将高斯形状感知求交测试、分层排序和子瓦片跳过等算法优化与硬件协同设计。作者用商用28nm工艺实现并综合该设计,在多种合成与真实场景、不同图像分辨率下进行评估。结果表明,GSCore相比移动消费级GPU平均加速15.86×,同时面积显著更小、能耗更低。
This paper presents GSCore, a hardware acceleration unit that efficiently executes the rendering pipeline of 3D Gaussian Splatting with algorithmic optimizations. GSCore builds on the observations from an in-depth analysis of Gaussian-based radiance field rendering to enhance computational efficiency and bring the technique to wide adoption. In doing so, we present several optimization techniques, Gaussian shape-aware intersection test, hierarchical sorting, and subtile skipping, all of which are synergistically integrated with GSCore. We implement the hardware design of GSCore, synthesize it using a commercial 28nm technology, and evaluate the performance across a range of synthetic and real-world scenes with varying image resolutions. Our evaluation results show that GSCore achieves a 15.86× speedup on average over the mobile consumer GPU with a substantially smaller area and lower energy consumption.
@inproceedings{LeeLL0S24,
title = {GSCore: Efficient Radiance Field Rendering via Architectural Support for 3D Gaussian Splatting},
author = {Junseo Lee and Seokwon Lee and Jungi Lee and Junyong Park and Jaewoong Sim},
booktitle = {ASPLOS},
year = {2024},
doi = {10.1145/3620666.3651385}
}