You've got questions? We've got answers!
Explore our comprehensive documentation for in-depth information about Ludo.ai and its powerful features.3D Asset Generator
Introduction
The 3D Generator is a powerful tool within the Ludo.ai platform that allows you to create 3D assets for your games using text prompts, images, or a combination of both. It leverages an advanced AI model to generate models with PBR (Physically Based Rendering) textures, including albedo, metallic, and roughness maps.
Key Features:
- Text-to-3D: Create models directly from descriptive text prompts.
- Image-to-3D: Transform 2D images into 3D models.
- Texture Generation: Add new PBR textures to your own models or change the texture of previously generated models.
- Interactive 3D Viewer: View your generated models from any angle in a fully interactive 3D space.
- Download Options: Download models in various formats (GLB, STL, PLY, OBJ, OFF).
- Favorites System: Save your best creations for easy access.
- In-Platform Image Editor: Modify your input images before 3D transformation (accessible via "Open in Editor").
Getting Started
- Access the 3D Generator: Log into your Ludo.ai account and select "3D Asset Generator" from the main menu.
- Choose a Generation Mode: Select the tab for the type of generation you want to perform: "Text to 3D", "Image to 3D", or "Texture Generation".
- Provide Input:
- Text to 3D: Enter a text description of the 3D model you want to create.
- Image to 3D: Click "Choose reference image" and upload or choose an image. For best results, use a clear image of a single subject.
- Texture Generation: Choose a reference model and describe the new texture you want to apply.
- Set Advanced Options (Optional): Before generating, you can adjust the Advanced options panel to control mesh complexity (max triangles, adaptive decimation) and texture quality (type, resolution). This allows you to create models that are optimized for your game's performance needs, from simple low-poly shapes to more detailed assets.
- Click "Start New Generation": Ludo.ai will process your input and create the 3D model.
- View, Refine, and Download: Use the interactive viewer to inspect your model, then download it or use the contextual options to refine it further.
Text-to-3D
This mode creates a 3D model based solely on your text input. The process involves two steps: first generating a 2D concept image from your prompt, and then converting that image into a 3D model.
How to Use
- Select the "Text to 3D" tab.
- Enter your text prompt in the input box. Be as specific as possible.
- Click "Start New Generation".
- Ludo.ai will generate a 2D preview image based on your prompt. If you're not satisfied, you can edit the prompt and click "Start New Generation" again.
- Once you have a 2D image you like, click the "Generate 3D Object" button on that image to begin the conversion.
- The final 3D model will be generated. You can then view, refine, or download the result.
Example Prompts
- "A low-poly, cartoonish treasure chest with gold trim and a skull emblem."
- "A futuristic spaceship with glowing blue engines and a sleek, metallic hull."
- "A black cartoon lego stormtrooper"
- "A whimsical mushroom house with glowing windows."
Tips
- The prompt should focus on a single subject. The generator cannot generate scenes or environments.
- Use adjectives to describe the desired shape, color, material, style, and any specific features. For example, instead of "sword," try "ornate elven sword with a glowing blue blade and a golden hilt."
- Experiment with different wording. Rephrasing or adding/removing keywords can significantly impact the initial 2D image and the final 3D model.
Image-to-3D
This mode uses a 2D image as the primary input for creating a 3D model. The AI analyzes the image, automatically removes the background, and attempts to extrapolate its 3D form.
How to Use
- Select the "Image to 3D" tab.
- Click "Choose reference image" and upload a 2D image from your computer or choose one from your favorites in Ludo.
- (Optional) Click "Open in Editor" to make adjustments to the image before generating the 3D model. You can use masking tools and text prompts to guide the AI's edits.
- Click "Generate".
- Ludo.ai will process the input image, remove the background, and then generate a 3D model based on it.
- View, refine, or download the 3D model.
Best Practices
- Use images with a single, clearly defined subject. The object should be fully visible.
- The subject can be over a background (it will be automatically removed), but there should be a clear distinction between the subject and background for best results.
- The AI will not be able to process images of scenes or environments, and the results will be unpredictable.
- Your uploaded images should have a resolution of at least 512x512 for optimal quality.
- Use the "Open in Editor" feature to remove or change unwanted elements before generating the 3D model.
Texture Generation
This generation mode allows you to upload your own 3D asset or choose one of your previously generated assets, and generate new PBR textures for it. The mesh (shape) of the original model will not be modified.
How to Use:
- Select the "Texture Generation" tab.
- Click on "Choose reference model" to select a 3D model, either one you've uploaded or a previous generation.
- Enter a text prompt describing the desired texture in the "Describe the model texture here" box.
- Note that the texture of the input model (if any) will be ignored. Your prompt should describe the new texture, not modifications to the existing one.
- Click "Start New Generation".
- Ludo.ai will generate a new 3D model, keeping the original mesh but applying the new texture.
Tips:
- For best results, your prompt should describe both the asset and its texture. For example: "A cartoonish dinosaur with purple and green skin."
- However, describing only the texture should still produce good results. For example: "purple and green skin."
- Be specific and use adjectives to define color, material, and style.
How to Upload 3D Models
The "Texture Generation" mode allow you to upload your own 3D assets for modification. The uploaded 3D files must contain a single subject. Files with multiple models or entire scenes will produce unexpected and low-quality results.
Limitations
We have the following restrictions on the 3D models that can be uploaded:
- File Types: obj, ply, stl, 3ds, gltf, glb, fbx, off, dae, ctm, x3d.
- File Content: The file should contain only the subject 3D model.
- Mesh Complexity: For best performance, meshes should have fewer than 100,000 vertices.
- File Size: Maximum file size is 20MB.
Preparing Your Model for Upload (Using Blender)
You can use a free tool like Blender to reliably prepare and export your model in a supported format:
- Open your model in Blender (
File > OpenorFile > Import > ...). - In the editor, delete any undesirable objects (like cameras, lights, or background elements), keeping only the main subject.
- Export the model to the glTF format (
File > Export > glTF 2.0 (.glb/.gltf)). - In the export options panel (usually on the right), apply the following settings:
Include > Limit to >Check the Renderable Objects box.Transform >Check the +Y Up box.Data > Materials > Materials >Select No Export.Data >Uncheck Shape Keys, Skinning, and Compression.Animation >Uncheck Use Animation.
- Select your file path and click the export button.
Re-topology
The Optimize Model option (also known as re-topology) allows you to change the complexity of an existing 3D model, optimizing it for your needs. You can simplify a high-poly mesh or refine a low-poly one. You can also adjust the type and resolution of texture maps.
The new object will have a shape and texture that is very similar to the original one, but with adjusted complexity and textures.
To use it, click the "Optimize Model" button (wrench icon) on a 3D generation, choose the new options in the dialog (Max triangles, Adaptive decimation, Texture type, Resolution — see the "Advanced Generation & Optimize Model Options" section for details), and click "Process".
When finished, the new result will replace the original. You can do this process again for further adjustments. Note that the data of the object is never destroyed during this process. You can re-topology to a low triangle count and then to a higher triangle count and it will still work as expected.
Advanced Generation & Optimize Model Options
To give you precise control over the quality and performance of your 3D models, the 3D Generator features an "Advanced" options panel. You can find this panel below the main prompt area. These settings allow you to define the complexity of the model's geometry (mesh) and the quality of its textures, ensuring the generated asset is optimized for your game engine or use case.
The panel is divided into two main categories:
Mesh Quality
This group of settings controls the geometric complexity of your 3D model. Mesh Quality is only available for the "Text to 3D" and "Image to 3D" tabs — in "Texture Generation" the original mesh is preserved, so these controls are hidden.
- Max triangles: Sets the maximum number of triangles (polygons) for the final mesh. The slider ranges from 1,000 to 200,000. A lower number (e.g., 5,000) creates a low-poly model ideal for performance, while higher values allow for more complex and detailed shapes.
- Adaptive decimation: This slider (range 0.0 to 1.0) controls how aggressively the AI simplifies the mesh.
- A value of 0.0 disables it, and the AI will aim for the "Max triangles" value.
- Higher values allow the AI to tolerate more simplification, resulting in a mesh with fewer triangles while preserving detail.
Texture
These settings define the quality and type of the texture maps generated for your model.
- Type: (Default: PBR) Determines the kind of texture maps to create:
- PBR: Generates a full set of Physically Based Rendering (PBR) maps (albedo, metallic, roughness). This is best for realistic materials.
- Color: Generates an albedo (color) map only.
- None: Generates no texture, resulting in a plain, untextured mesh. This will result in a significantly faster generation.
- Resolution: Sets the size of the generated texture maps. You can choose between 1024 (1K) and 2048 (2K). Higher resolutions provide sharper details but result in larger file sizes.
How to Use These Options
These settings can be used in two different workflows:
-
For New Generations (Text-to-3D, Image-to-3D, Texture Generation): Set these options before you click "Start New Generation." This ensures the model is created with your desired complexity and texture settings from the start, saving you time on optimization later.
-
For Optimize Model: The "Optimize Model" option applies these settings to a previously generated model. Choose your reference model, click the "Optimize Model" button (wrench icon) on a generation, adjust the settings to your new requirements, and click "Process." This will create a new version of your model with the updated topology and texture resolution, which is perfect for creating different Levels of Detail (LODs) for your game.
Viewing and Interacting with Results
After generating a 3D model, it will appear in the results area with several interaction options:
- Asset Preview: The main preview area displays the generated asset.
- View Modes (Toggle): Click the small thumbnail in the corner of the preview to switch between:
- Video View: A rotating video preview of the rendered, textured asset.
- Image View: The 2D source/concept image used for the generation.
- Clicking on the rendered model itself opens the interactive 3D viewer in a full-screen overlay. There you can click-and-drag to rotate the model freely, and use the wire-frame toggle to inspect the model's underlying mesh and topology.
- Add to Favorites (Heart): Saves the current model to your Ludo.ai Favorites.
- Contextual Menu (...): Provides:
- Download 3D Object: Opens a dialog to download the current 3D model in your chosen format (GLB, STL, PLY, OBJ, OFF).
- Delete: Removes the asset from your generation history.
- Action Bar (below the asset): Quick actions on the current model:
- Optimize Model: Opens the Optimize Model dialog to change mesh complexity and texture settings (see the "Re-topology" section).
- Re-texture: Opens the Texture Generation tab with the current model pre-selected.
- Generate New Model: Pre-populates the form with the same source image and advanced parameters, ready to launch a new generation with a different result.
- Create 3D Model: Available on results that are still 2D images — runs the image-to-3D conversion on the current concept.
- Edit Image: Available on 2D results — opens the integrated Image Editor to refine the source image before generating a 3D model.
Downloading Models
Ludo.ai's 3D Generator allows you to download your generated models in several popular 3D file formats:
- GLB: A binary format for glTF that includes the model's geometry and PBR textures (albedo, metallic, roughness). This is the recommended format for use in modern game engines and 3D software.
- STL: A common format for 3D printing, containing only surface geometry (no color or texture information).
- PLY: A flexible format that can store color and other data per vertex, often used for 3D scanned data.
- OBJ: A widely supported legacy format for representing 3D geometry.
- OFF: A simple text-based format for describing polyhedral objects.
Important Note: Only the GLB format will include the PBR textures you see in the viewer. All other formats will export only the mesh (the shape of the model without colors or textures).
When choosing a format, consider the following:
- For use in game engines (like Unity, Unreal, Godot) or 3D software: GLB is the best choice.
- For 3D printing: STL is the most widely accepted format.
Note on Unity Integration: To directly import GLB files with PBR materials into a Unity project, you will likely need to install the
Unity glTFastpackage from the Unity Package Manager. You can find it here.Tips for Effective 3D Generation
To get the most out of the 3D Generator, it's important to use the right workflow for your goal. Here are some best practices:
-
Start with a Single, Clear Subject The generator is designed to create individual assets, not complex scenes. For all generation modes, ensure your prompt or input image focuses on one primary object (e.g., "a treasure chest," "a character model," "a sci-fi rifle").
-
Master the "Text-to-3D" Two-Step Flow Remember that Text-to-3D is a two-step process: Prompt -> 2D Image -> 3D Model. The quality of your final 3D model is highly dependent on the 2D image it's based on.
- If the 2D image isn't right (e.g., it's at a bad angle, or the design is wrong), don't click "Create 3D Model" yet.
- Instead, edit your text prompt and click "Start New Generation" again to get a better 2D concept first.
- If you are overall happy with the image but want to adjust details, you can also refine it with the "Edit Image" action.
-
Optimize Your "Image-to-3D" Inputs When using Image-to-3D, your source image is the blueprint.
- Use clear, high-resolution images (at least 512x512) where the subject is distinct from the background.
- Use the "Open in Editor" feature in the reference-image selector to clean up your image, remove unwanted background elements, or make adjustments before generating the 3D model.
-
Use the Right Tool for Iteration Use the specialized actions to refine your model:
- To change the texture only: Use the "Re-texture" action (or the "Texture Generation" tab). This will keep your mesh and apply a new PBR texture based on your prompt.
- To get a new shape and texture from the same image: Use the "Generate New Model" action. This pre-populates the form with the same source image and advanced parameters, so you can quickly run another generation — great for getting a few options from one concept.
- To optimize the model: Use the "Optimize Model" action. This is the perfect tool to change the mesh complexity and texture size of an existing model to make it game-ready.
-
Use "Advanced" Options for Game-Ready Assets Don't ignore the "Advanced" panel. Set these options before generating to save time on optimization.
- For Performance: Set "Max triangles" to a lower value (e.g., 10,000) and use "Adaptive decimation" to create efficient, low-poly assets.
- For Quality: Increase "Resolution" to 2048 for hero assets.
- For Engine Needs: If your engine doesn't need PBR, switch "Texture" "Type" to "Color" (for albedo only) or "None" (for a plain mesh).
-
Be Descriptive in All Prompts This applies to all modes, not just the initial generation.
- Initial Prompt: "A low-poly, cartoonish treasure chest with gold trim and a golden skull emblem".
- Texture Prompt: "A rusty, pitted metal texture with glowing blue magical runes".
-
Download the Right Format For game development, always download in GLB format. The GLB file is the only format that packages the model's geometry (mesh) along with its PBR texture maps (albedo, metallic, roughness). Other formats like STL or OBJ will only export the mesh, without any colors or textures.
-
Troubleshooting
Model not generating:
- Check your internet connection: Ensure you have a stable internet connection, as the 3D Generator requires it to function.
- Try again: Try generating again with the same inputs.
Errors with uploaded models:
- There are limitations around the models you can upload to Ludo. Try preparing/exporting your model before upload using Blender, as described in "How to Upload 3D Models".
Results are not what you expected:
- Rephrase your prompt: Try different wording, add more descriptive details, or be more specific about certain aspects.
- Use a reference image: If you already have a particular design in mind, provide a visual reference for the AI.
- Iterate: Use the "Generate New 3D Model", "Re-texture", and "Re-topology" features to explore variations and refine the model.
Slow generation times:
- Server load: High server traffic can sometimes lead to slower generation times. Your generation will be added to the list of results even if you go to a different page in Ludo or close the browser. Make sure to reload the page if you don't see your result.
Download issues:
- Browser settings: Check your browser settings to make sure downloads are allowed and that you know where downloaded files are saved.
- Download taking too long: Model export can take some time until the model starts to download. Wait at least 10 seconds.
Unexpected errors:
- Refresh the page: Sometimes a simple page refresh can resolve minor glitches.
- Log out and back in: If refreshing doesn't work, try logging out of your Ludo.ai account and then logging back in.
If problems persist, please contact Ludo.ai support or join our Discord server for assistance: https://discord.gg/FmTPyugsrR. When reporting an issue, provide as much detail as possible, including your inputs if relevant, the steps you took leading to the problem, and any error messages you encountered.
Use Cases in Game Development
- Rapid Prototyping: Quickly create placeholder 3D assets to test gameplay mechanics, level layouts, or overall game feel without investing significant time in detailed modeling.
- Concept Visualization: Bring your game ideas to life in 3D early in the development process. This helps visualize the game's aesthetic and can be used for pitching or team communication.
- Asset Customization: Generate variations of existing assets to add diversity to your game world. For example, you could create multiple versions of a base character model with different clothing, accessories, or color schemes.
- Inspiration and Exploration: Experiment with different styles, themes, and concepts to spark new ideas and push creative boundaries. The 3D Generator can be a powerful tool for brainstorming and exploring uncharted territory.
- Character and Object Design: Create unique characters, creatures, props, and environmental elements. The AI can generate designs that you might not have considered otherwise.
- Level Design: Generate 3D models of buildings, structures, or natural formations to populate your game environments. This can be especially helpful for quickly blocking out levels or creating variations of environment assets.
Image Editing with the Integrated Image Editor
Before generating 3D models from images, you can refine your 2D input using Ludo.ai's integrated Image Editor. This powerful tool allows you to make precise adjustments to your images, ensuring they are optimized for the 3D generation process.
Accessing the Image Editor
Upload an Image: In the 3D Generator, select the Image-to-3D tab and then click on "Choose reference image" and upload your desired image.
Open in Editor: Once the image is uploaded, click on the "Open in Editor" button located next to the image preview.
3D Asset Generation in Ask Ludo
In addition to the dedicated 3D Generator tool, you can begin the 3D asset creation process directly within Ludo.ai's Ask Ludo chat interface (both the standalone version and the one integrated into the Game Concept tool). This workflow is designed for a more conversational and iterative approach to asset ideation.
The process has been updated for a more controlled, two-step workflow:
How to Use It:
- Access Ask Ludo: Open the Ask Ludo chat interface.
- Request a 3D Model: Type a natural language request for the asset you want. Be descriptive to get a better visual.
- Examples:
- "Generate a 3D model of a wooden treasure chest."
- "I need a 3D asset of a futuristic motorcycle."
- "Create a low-poly 3D model of a fantasy character."
- Examples:
- Receive a 2D Image: The AI will process your request and generate a high-quality 2D image of the requested asset, not a 3D model directly. This image serves as a visual concept or "render" of your idea.
- Convert to 3D:
- Interact with the generated image to reveal its context menu.
- Select the "Generate 3D Asset" option.
- This action will send the image to the 3D Asset Generator, which will then convert it into a true 3D model that you can view, refine, and download.
Benefits of this Workflow:
- Conversational Ideation: Brainstorm and refine the look of your asset conversationally.
- Faster Visual Iteration: Quickly generate multiple 2D concepts in the chat before committing to the more time-intensive 3D conversion.
- Seamless Integration: Move smoothly from a chat-based idea to a functional 3D asset within the Ludo.ai ecosystem.
