whatisgithub

What is gld?

cvlab-kaist/gld — explained in plain English

Analysis updated 2026-05-18

196PythonAudience · researcherComplexity · 5/5Setup · hard

In one sentence

A research method that generates realistic new-angle views of a scene from a few photos by running diffusion inside a geometry-aware feature space, converging 4.4 times faster than standard approaches.

Mindmap

mindmap
  root((GLD))
    What it does
      Novel view synthesis
      Few input photos
      Depth and 3D output
    Approach
      Geometry-aware feature space
      Diffusion denoising
      Pre-trained decoders
    Performance
      4.4x faster convergence
    Requirements
      GPU 48GB+
      Python
      HuggingFace weights
    Audience
      Computer vision researchers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Generate novel-viewpoint images of a scene from a handful of input photographs

USE CASE 2

Produce depth maps and 3D structure alongside rendered images for a reconstruction pipeline

USE CASE 3

Benchmark a geometry-aware diffusion approach against standard novel view synthesis methods

USE CASE 4

Run the included demo to reconstruct a 3D scene from sample images

What is it built with?

PythonPyTorchHuggingFace

How does it compare?

cvlab-kaist/gldnolangz/pixel2motion6-robot/jie_3d_nav
Stars196193190
LanguagePythonPythonPython
Setup difficultyhardmoderatehard
Complexity5/53/54/5
Audienceresearcherdesignerdeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1h+

Requires a GPU with at least 48 GB of memory, such as an A100 or A6000.

So what is it?

GLD (Geometric Latent Diffusion) is a research implementation of a novel technique for generating new viewpoints of a scene from just a few input photographs. The core problem it addresses is called novel view synthesis: given images of an object or scene from certain angles, produce realistic images from angles you do not have photos of, along with accurate depth and 3D structure. The approach works differently from common video-generation methods. Instead of using a general-purpose image compression layer, GLD operates inside the feature space of models that already understand geometry, specifically models trained to estimate depth from images. A diffusion model, which works by gradually denoising random patterns into coherent outputs, learns to generate new viewpoints directly in this geometry-aware space. The pre-trained geometry models then decode these outputs into both rendered images and 3D depth maps without additional training. This design reportedly converges 4.4 times faster during training than standard approaches. You would use this if you are a computer vision researcher working on 3D reconstruction, novel view synthesis, or scene understanding. Running the demo requires a GPU with at least 48 GB of memory, such as an A100 or A6000. The codebase is written in Python and pre-trained model weights are downloadable from HuggingFace. The demo generates 3D scene reconstructions from included sample images.

Copy-paste prompts

Prompt 1
Explain how GLD uses a geometry-aware feature space instead of a general image compression layer.
Prompt 2
Help me download the pre-trained GLD weights from HuggingFace and run the demo.
Prompt 3
Walk me through what GPU requirements I need to run GLD's novel view synthesis demo.
Prompt 4
Compare GLD's training convergence speed to a standard diffusion-based view synthesis method.

Frequently asked questions

What is gld?

A research method that generates realistic new-angle views of a scene from a few photos by running diffusion inside a geometry-aware feature space, converging 4.4 times faster than standard approaches.

What language is gld written in?

Mainly Python. The stack also includes Python, PyTorch, HuggingFace.

How hard is gld to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is gld for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.