paperbot · PL 论文追踪

全部论文 待读 收藏

P2 CLM: Removing the GPU Memory Barrier for 3D Gaussian Splatting

CLM:消除 3D Gaussian Splatting 的 GPU 内存壁垒
ASPLOS Proceedings of the 31st ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 22026匹配度 1/10 · 该论文聚焦于3D高斯泼溅的GPU内存管理与卸载策略,属于图形学/系统体系结构方向,与用户关注的静态分析、程序分析、形式化验证、浮点程序分析及LLM/Agent与PL交叉等方向几乎无关。引用 5 inbox
Hexu Zhao, Xiwen Min, Xiaoteng Liu, Moonjun Gong, Yiming Li, Ang Li, Saining Xie, Jinyang Li, Aurojit Panda
crossref: 2026-09-12dblp: 2026-09-12arxiv: 2026-09-12

AI 速览

一句话:提出 CLM,通过按需卸载高斯到 CPU 内存并重叠通信与计算,使单张消费级 GPU 渲染亿级高斯大场景。

3D Gaussian Splatting(3DGS)渲染速度快且质量高,但大场景或复杂场景所需内存常超出多数 GPU 容量,难以扩展。CLM 提出一种单卡可渲染大场景的系统:将高斯点卸载到 CPU 内存,仅在需要时载入 GPU,并基于 3DGS 的内存访问模式设计新的卸载策略。该策略支持高效流水线,使 GPU 到 CPU 的通信、GPU 计算和 CPU 计算相互重叠,同时利用访问模式减少通信量。评估表明,CLM 能在单张消费级 RTX4090 上渲染需要 1.02 亿个高斯点的大场景,并达到当前最优的重建质量;代码已开源。

问题
大场景或复杂场景的 3DGS 渲染需要大量高斯数据,其内存需求超出大多数 GPU 的显存容量,导致单卡难以扩展。
方法
将高斯点卸载到 CPU 内存并按需加载,基于 3DGS 内存访问模式设计卸载与通信削减策略,实现 GPU-CPU 通信、GPU 计算与 CPU 计算重叠的流水线。
评估
在单张 RTX4090 上渲染含 1.02 亿个高斯点的大场景,报告达到当前最优的重建质量,并开源代码。
原文摘要(Abstract)

3D Gaussian Splatting (3DGS) is an increasingly popular novel view synthesis approach due to its fast rendering time, and high-quality output. However, scaling 3DGS to large (or intricate) scenes is challenging due to its substantial memory requirement, which exceeds the memory capacity of most GPUs. In this paper, we describe CLM, a system that allows 3DGS to render large scenes using a single consumer-grade GPU, e.g., RTX4090. It does so by offloading Gaussians to CPU memory, and loading them into GPU memory only when necessary. To improve performance and reduce communication overheads, CLM uses a novel offloading strategy based on insights into 3DGS's memory access patterns. This strategy enables efficient pipelining, which overlaps GPU-to-CPU communication, GPU computation and CPU computation. Furthermore, CLM exploits these access patterns to reduce communication volume. Our evaluation shows that the resulting implementation can render a large scene that requires 102 million Gaussians on a single RTX4090 and achieve state-of-the-art reconstruction quality. The code is open-sourced at: https://github.com/nyu-systems/CLM-GS

链接与引用

DOI 原文 · arXiv · PDF(开放获取) · DBLP

BibTeX
@inproceedings{abs-2511-04951,
  title = {CLM: Removing the GPU Memory Barrier for 3D Gaussian Splatting},
  author = {Hexu Zhao and Xiwen Min and Xiaoteng Liu and Moonjun Gong and Yiming Li and Ang Li and Saining Xie and Jinyang Li and Aurojit Panda},
  booktitle = {ASPLOS},
  year = {2026},
  doi = {10.1145/3779212.3790140}
}