whatisgithub

What is p3d-bench?

spatiaos/p3d-bench — explained in plain English

Analysis updated 2026-05-18

25JavaScriptAudience · researcherComplexity · 4/5Setup · hard

In one sentence

A research benchmark and dataset that test whether AI models can generate accurate, adjustable parametric 3D models from text or images.

Mindmap

mindmap
  root((P3D-Bench))
    What it does
      3D generation benchmark
      Parametric model scoring
      Public HuggingFace dataset
    Tasks
      Text to 3D
      Image to 3D
      Assembly of parts
    Scoring
      Geometry accuracy
      Topology
      Semantic alignment
      Part level accuracy
    Findings
      Assembly is hardest
      Dimensions often wrong
      Weak part modeling
    Audience
      AI researchers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Evaluate how well a new text-to-3D model produces exact, editable dimensions rather than just a rough shape.

USE CASE 2

Compare multiple AI models on their ability to assemble multi-part 3D structures correctly.

USE CASE 3

Score an image-to-3D model across geometry, topology, semantic alignment, and part-level accuracy.

What is it built with?

PythonJavaScript

How does it compare?

spatiaos/p3d-benchbrunosimon/stylized-low-polydeno2026/comfyui-deno-custom-nodes
Stars252525
LanguageJavaScriptJavaScriptJavaScript
Last pushed2023-02-11
MaintenanceDormant
Setup difficultyhardmoderateeasy
Complexity4/52/52/5
Audienceresearcherdevelopervibe coder

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1h+

Requires API keys for the AI models being tested plus optional heavy geometry, rendering, and CAD libraries for full scoring.

So what is it?

P3D-Bench is a research benchmark that tests how well AI models can generate 3D objects from written descriptions or images. It was released in June 2026 by researchers at Nanjing University and Envision, along with a public dataset on HuggingFace and evaluation code in this repository. Most 3D benchmarks only check whether an AI produces something that looks roughly correct. P3D-Bench goes further by testing whether AI can write code that produces a parametric 3D model, meaning a design that encodes exact dimensions, construction steps, and how separate parts relate to each other. This matters because a parametric model can be adjusted and rebuilt consistently, rather than just being a fixed shape that cannot easily be changed. The benchmark covers three types of tasks. In Text-to-3D, a model receives a written description and must output a parametric 3D program. In Image-to-3D, it works from a photo of an object. In Assembly-3D, it must combine multiple parts into a single coherent structure. There are 400 text cases, 400 image cases, and 203 hand-annotated assembly cases. Each output is scored across four areas: geometry accuracy (are the dimensions right), topology (does the shape have the correct structure), semantic alignment checked from multiple viewpoints, and part-level accuracy (are the individual pieces correct in number and shape). The evaluation found three consistent patterns across the AI models tested. Assembly tasks are the hardest: models fail to correctly compose multiple parts together. Models can often capture the overall shape of a target object but miss the precise measurements the input specified. Part-level modeling is the weakest point across all models, with consistent failures on both part geometry and part count. To use the benchmark, you install the Python package, supply API keys for whichever AI model you want to test, download the dataset from HuggingFace, and run evaluations from the command line. Flags let you independently choose the task type, 3D output format, and which scoring metric to apply. Optional dependency groups handle the heavier geometry, rendering, and CAD libraries needed for full scoring.

Copy-paste prompts

Prompt 1
Install P3D-Bench and run the Text-to-3D evaluation against my model using its default scoring metric.
Prompt 2
Download the P3D-Bench dataset from HuggingFace and show me how to run the Assembly-3D task.
Prompt 3
Explain how P3D-Bench scores part-level accuracy and why models tend to fail there.
Prompt 4
Set up P3D-Bench's optional geometry and rendering dependency groups for full scoring on my machine.

Frequently asked questions

What is p3d-bench?

A research benchmark and dataset that test whether AI models can generate accurate, adjustable parametric 3D models from text or images.

What language is p3d-bench written in?

Mainly JavaScript. The stack also includes Python, JavaScript.

How hard is p3d-bench to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is p3d-bench for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.