whatisgithub

What is gemma-4-31b-uncensored-nvfp4-dflash?

aeon-7/gemma-4-31b-uncensored-nvfp4-dflash — explained in plain English

Analysis updated 2026-05-18

23PythonAudience · developerComplexity · 5/5LicenseSetup · hard

In one sentence

A ready-to-run Docker container for self-hosting an uncensored Gemma 4 31B AI model on DGX Spark, sped up with speculative decoding.

Mindmap

mindmap
  root((repo))
    What it does
      Packages Gemma 4 31B model
      Adds DFlash speed-up
      Runs on vLLM engine
    Tech stack
      Python
      Docker
      vLLM
      DGX Spark GPU
    Use cases
      Self-host uncensored LLM
      OpenAI-compatible API server
      Coding and reasoning tasks
    Audience
      ML engineers
      Self-hosters
    Setup
      Download model weights
      Pull Docker image
      Run with GPU flags
    Performance
      Speculative decoding
      Benchmark tables
      Higher throughput

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Self-host an uncensored large language model on DGX Spark hardware.

USE CASE 2

Serve an OpenAI-compatible chat completions API for coding and reasoning tasks.

USE CASE 3

Run speculative decoding to speed up token generation significantly.

What is it built with?

PythonDockervLLMCUDA

How does it compare?

aeon-7/gemma-4-31b-uncensored-nvfp4-dflashaaravkashyap12/advise-project-approachabu-rayhan-alif/django-saas-kit
Stars232323
LanguagePythonPythonPython
Setup difficultyhardeasymoderate
Complexity5/52/53/5
Audiencedeveloperdeveloperdeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1h+

Requires an NVIDIA DGX Spark / GB10 machine, Docker, and downloaded model weights.

Apache 2.0 license: use freely for any purpose, including commercial use, as long as you keep the copyright and license notices.

So what is it?

This repository packages a pre-configured container (a self-contained software environment) for running a large AI language model called Gemma 4 31B on NVIDIA's DGX Spark hardware. The container combines two things: a fine-tuned, uncensored version of the model called Deckard Heretic, and a speed-boosting technique called DFlash (speculative decoding), which uses a smaller draft model to predict multiple tokens at once, then verifies them in parallel, roughly tripling single-request speed and more than doubling throughput at high concurrency compared to the baseline. The container runs on vLLM, an engine designed for efficient AI inference, the process of generating text from a model. It exposes an OpenAI-compatible API endpoint, meaning any tool or code that already works with OpenAI's API can point at this container instead, with no code changes. Supported capabilities include chat completions, tool calling, vision and video input, reasoning traces, and structured JSON output. You would use this if you have access to a DGX Spark machine and want to self-host a high-performance, uncensored large language model for coding, math, reasoning, or text tasks. Setup involves downloading the model weights, pulling the Docker image, and starting a container with a few configuration variables such as memory usage and context length. The README includes detailed benchmark tables comparing performance with and without the DFlash speed-up.

Copy-paste prompts

Prompt 1
Walk me through downloading the model weights and starting this container.
Prompt 2
Explain what speculative decoding with DFlash does and why it speeds things up.
Prompt 3
Help me tune GPU_MEMORY_UTILIZATION and MAX_NUM_SEQS for my hardware.
Prompt 4
Show me an example curl request to the OpenAI-compatible chat completions endpoint.

Frequently asked questions

What is gemma-4-31b-uncensored-nvfp4-dflash?

A ready-to-run Docker container for self-hosting an uncensored Gemma 4 31B AI model on DGX Spark, sped up with speculative decoding.

What language is gemma-4-31b-uncensored-nvfp4-dflash written in?

Mainly Python. The stack also includes Python, Docker, vLLM.

What license does gemma-4-31b-uncensored-nvfp4-dflash use?

Apache 2.0 license: use freely for any purpose, including commercial use, as long as you keep the copyright and license notices.

How hard is gemma-4-31b-uncensored-nvfp4-dflash to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is gemma-4-31b-uncensored-nvfp4-dflash for?

Mainly developer.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.