PointSplat 是一种面向人体的紧凑高斯泼溅方法,提供预训练模型和推理流程,支持 DNA-Rendering 和 THuman2.0 等人体数据集上的新视角合成。

Stars

46

7 天增长

暂无数据

Fork 数

1

开放 Issue

1

开源协议

Apache-2.0

最近更新

2026-07-14

AI 仓库情报摘要
FR-AI / ANALYSIS

为什么值得关注

该方法实现了人体头像的紧凑表示,并被 ECCV 2026 收录,提供了实用的推理流程和预训练检查点。

适合谁使用

  • 三维人体建模研究人员
  • 计算机图形学从业者
  • 新视角合成系统的开发者
  • 关注高斯泼溅技术的 ECCV 参会者

典型使用场景

  • 从稀疏视点重建高保真人体头像
  • 为虚拟试穿或远程临场进行新视角合成
  • 人体三维模型的紧凑存储与渲染

项目优势

  • 紧凑的高斯表示降低了内存占用
  • 提供了预训练检查点,便于直接推理
  • 支持多种人体数据集(DNA-Rendering、THuman2.0)
  • 发表在顶级会议 ECCV 2026

使用前须知

  • 仅提供推理代码,未包含训练流程
  • 需要从外部参考进行特定的数据集准备
  • 依赖 Hugging Face 的大文件下载用于示例数据

README 快速开始

PointSplat: Compact Gaussian Splatting via Human-Centric Prediction

ECCV 2026

Yujie Guo1, Yudong Jin1, Lingteng Qiu3, Zehong Shen1, Zhen Xu1, Jing Zhang2, Xianchao Shen2, Hujun Bao1, Sida Peng1, Xiaowei Zhou1†

1Zhejiang University    2ByteDance    3CUHK, Shenzhen

†Corresponding author

⚙️ Installation

Create a conda environment and install the dependencies:

conda create -n pointsplat python=3.10 -y
conda activate pointsplat
pip install -r requirements.txt

📦 Checkpoint

Download the pretrained checkpoint with:

hf download Yujie0012/PointSplat_pretrained_weights pointsplat_mixed.pt \
  --local-dir pretrained

You can also download the checkpoint manually. Either way, the final layout should be:

pretrained/
└── pointsplat_mixed.pt

🚀 Inference

Inference on DNA-Rendering

Step 1: Download example data.

Download the DNA-Rendering example package from PointSplat_example_data with:

hf download Yujie0012/PointSplat_example_data DNA_Rendering_example.zip \
  --repo-type dataset \
  --local-dir datasets
unzip datasets/DNA_Rendering_example.zip -d datasets

Expected data layout:

datasets/DNA_Rendering_example/
├── validation_index.json
├── scenes/
│   └── /
│       ├── transforms.json
│       └── images/
│           └── /
│               └── 000030.webp
└── masks/
    └── /
        └── fmasks/
            └── /
                └── 000030.png

[!TIP] To test the model on more DNA-Rendering scenes, follow the processed DNA-Rendering dataset instructions in Diffuman4D.

Step 2: Run the inference script.

CUDA_VISIBLE_DEVICES=0 python -m src.main \
  +experiment=pointsplat_renbody \
  output_dir=experiments/eval_pointsplat_dna_rendering \
  dataset.roots='[datasets/DNA_Rendering_example]' \
  checkpointing.pretrained_

项目描述

[ECCV 2026] PointSplat: Compact Gaussian Splatting via Human-Centric Prediction

相关仓库与替代方案

根据分类、Topic 和编程语言匹配的相似项目。

MoonshotAI
精选
MoonshotAI GitHub avatar

Kimi-K3

Kimi K3 is an open-weight, 2.8T-parameter native multimodal agentic model with a 1M-token context window, designed for frontier coding, knowledge work, and reasoning tasks.

AI 与机器学习AI 智能体
3,348
xuchonglang
精选
xuchonglang GitHub avatar

investing-for-beginners

A structured investing guide for Chinese beginners covering US stocks, options, and cryptocurrency, with focus on foundational concepts and risk awareness.

区块链与 Web3
2,739
Krishnagangwal
精选
Krishnagangwal GitHub avatar

CS-Fundamentals

A curated collection of Computer Science fundamentals (PDFs, notes, cheatsheets, interview question banks) for placement preparation, covering seven core subjects plus general resources.

数据与数据库数据库与存储
2,326