Nova3D

What is Nova3D?

Nova3D is an open-source client for nova3d.xyz that generates 3D assets as executable construction procedures rather than a single, merged mesh. It produces Blender-native Python scripts and returns a structured GLB where parts are named and separately addressable.

The core purpose of this client is to connect to the hosted Nova3D pipeline (by default) so you can generate editable, part-aware 3D outputs from either text prompts or reference images.

Key Features

• Editable, part-aware 3D outputs: The pipeline outputs a structured GLB with named, separately addressable parts, designed for targeted edits (e.g., changing one part without re-generating everything).
• Script-native generation (prompt-to-code / image-to-code): Instead of diffusion-style “image-to-3D” that yields a single merged mesh, Nova3D generates Blender Python scripts that represent the construction procedure.
• Uses Blender’s scene graph as the native representation: The client aligns its output model with Blender’s scene graph, which supports a logical hierarchy and scene-level editing workflows.
• Model/LLM agnostic client workflow: The generation harness can switch between LLM backends via settings (e.g., Claude 3.5, GPT-4o, or Gemini 1.5 Pro), with validation/execution handled by the pipeline.
• Integrated web viewport editor: Includes a built-in Three.js editor with transform tools, snapping, and material editing.
• Reference-image guidance: Lets you attach a photo to guide the spatial logic of the generated script.
• Local in-browser caching: Models are cached in the browser so you can view your history even after remote URLs expire.

How to Use Nova3D

1. Run the client locally: Clone the repository, install dependencies (flutter pub get), and start the local web UI.
   • The quick start notes that port 5555 is required for OAuth redirect authorization.
2. Sign in: Open the local URL, then sign in using Google or Email.
3. Add an API key in settings: The client supports adding API keys for OpenAI, Anthropic, or Gemini.
4. Provide input and generate: Enter a prompt (and optionally attach a reference image) and run the generation flow.
5. Edit and review results: Use the integrated viewport editor for transforms/snapping/material editing, and rely on local caching to revisit previous generations.

To deploy a production build for static hosting, the repository includes a command to build the Flutter web app (flutter build web --release).

Use Cases

• Editable asset generation for workflows that require hierarchy: Generate 3D models where parts are named and parented so you can adjust individual components without regenerating the full result.
• Prompt-driven or photo-guided 3D ideation: Use text prompts or attach reference images to influence the spatial logic of the generated construction scripts.
• Material iteration with a PBR-oriented mapping workflow: Work with outputs designed to support material mapping rather than relying on baked vertex colors.
• Rapid review and adjustment in a browser: Use the integrated Three.js viewport editor (transform tools, snapping, and material editing) without leaving the client.
• Local browsing of previous generations: Leverage in-browser caching to keep viewing history even when remote URLs expire.

FAQ

• Does Nova3D output a single merged mesh? No. The pipeline is described as producing a structured GLB with separately addressable parts, generated from Blender-native Python scripts.

• Can I use different LLM providers? Yes. The client is described as model-agnostic, with settings allowing switching between backends such as Claude 3.5, GPT-4o, or Gemini 1.5 Pro.

• What local setup is needed for sign-in? The quick start notes that port 5555 is required for OAuth redirect authorization, and it specifically warns that using localhost:5555 can cause Google Sign-In to fail due to OAuth origin policies.

• Where does the client send generation requests by default? By default, it communicates with the hosted nova3d.xyz API. A custom backend can be targeted by setting API_BASE_URL via --dart-define.

• Is there a way to influence generation with an image? Yes. The client supports reference images so you can attach a photo to guide the spatial logic of the generated script.

Alternatives

• Image-to-3D diffusion tools that output a single merged mesh: These tend to focus on producing one consolidated geometry result, which differs from Nova3D’s part-aware, editable outputs.
• OpenSCAD/CSG-style systems focused on solid modeling: Approaches in this category can prioritize manifold solids, but may trade off organic-shape flexibility and detailed hierarchy/material editability.
• Prompt-to-CAD or procedural CAD tools: If your primary goal is editable procedural construction, look for tools that support script-like or parametric workflows rather than purely generative mesh outputs.
• Standalone 3D modeling/editing tools paired with importable procedural results: For workflows where you already use Blender or other DCC tools, you can treat Nova3D as the generation step and then refine outputs in a modeling environment—though the key difference is Nova3D’s generation of Blender-native scripts and part-aware GLB structure.