It’s beyond doubt that, in the recent years, the creative process has become deeply linked to artificial intelligence. AI has simply become an integral part of our creative workflow. We can create videos with AI, create music and we can create various forms of artwork and design. More precisely, we can use AI to generate 3D models of objects, environments or assets.
AI 3D generators represent a big leap forward because they not only simplify the process, but also make it significantly more efficient. Moreover, they make 3D modeling accessible to anyone who’s interested in this field. Graphic designers, visual artists, game developers, visual content creators and all tech enthusiasts can now take advantage of these revolutionary tools and transform their vision into reality.
Without further ado, here’s a list of 7 AI tools that can generate 3D models from text, image or video:
Luma AI
Luma AI represents one of the most interesting tools you can find for generating 3D assets. What makes it so interesting? Well, the diversity of tools and methods to create 3D content with applicability in various industries: gaming, e-commerce, real estate, augmented and virtual reality and more.
With Luma AI you can:
- Turn text into 3D.
- Convert traditional videos to interactive 3D scenes or models.
- Generate 3D flythrough videos.
Using Genie, its generative AI 3D model, you can quickly convert words into 3D assets. The UI is divided in two main sections: Imagine (to create) and Creations (to see what you’ve created). All you have to do is:
- Insert your text in the text field and click on Create.
- Choose one of the 4 variants generated by clicking on it.
- Adjust your settings from the right side panel and hit the Download button.
The platform allows you to export your files as FBX, GLTF, USDZ, BLEND, STL and OBJ.
Without a doubt, one of the most exciting features is represented by the flythrough videos. Through its iPhone app, Luma gives you the possibility to create cinematic 3D flythroughs from simple videos. If you want to enhance your real estate listings, simply record a video tour of your space with your iPhone and load it into the app. Next, mixing Generative 3D AI and Neural Radiance Field (NeRF), Luma will generate a smooth, professional-looking drone flythrough of the property.
Pros
- Impressive options to generate 3D objects and environments.
- It’s fast. It can generate 4 3D variants, based on text prompt, in under 30 seconds.
- Modern, intuitively-designed platform.
- It’s free to use.
Cons
- Not so many customization options as other tools.
Pricing
At the time of writing this article, Luma AI is a free software that can be used by anyone who creates an account on the platform. The two iPhone apps are also free to use, with in-app purchases available.
Using the video to 3D API costs $1/capture.
CSM
Cube by CSM is a 3D model generator adequate for game studios, developers, 3D artists and all those passionate about this field. Why does this AI tool represent a great option? Because it places at the users’ disposal a multitude of possibilities to generate 3D assets. Basically you can turn any photo, sketch and text input into a 3D model. Here are some of the things you can accomplish:
- Convert text/stylized text to 3D.
- Convert image to 3D (PNG, JPG/JPEG and WebP support).
- Convert real-time sketch to 3D.
- Animate 3D models.
- AI 3D world renderer.
- AI retexturing.
- High-resolution text to image.
Generating a 3D asset from a text input is really easy to accomplish.
- Add your text in the text field or use the Randomize button for inspiration.
- Hover over one of the four preview images and click on Get 3D.
- In the 3D Assets tab, click on the generated image and choose your preferred spin.
- Preview the mesh.
- Generate the final mesh.
You can download your 3D model in the OBJ, GLB and USDZ formats.
Pros
- The numerous combinations available to generate 3D assets.
- The intuitive design that makes it easy to use.
- The interpretation of prompts is impressively accurate.
- The fact that it automatically generates 4 variations of the original image.
Cons
- Certain features require 3D modelling skills.
- Generating a high-res 3D mesh isn’t exactly fast (between 1.5 and 2 hours).
Pricing
CSM comes with a free version called Tinkerer, which provides access to text to 3D and image to 3D features. If you want to enjoy premium features, you’ll have to upgrade to one of the two paid plans:
- Maker: $20/month
- Creative Pro: $60/month
Meshcapade
Meshcapade is a tool particularly developed to create 3D avatars. To help you accomplish your task, the software uses the Skinned Multi-Person Linear (SMPL) model. This represents a entire family of 3D body, face, hand and foot models that are learned from hundreds of thousands of detailed 3D scans.
Meshcapade makes it possible to generate 3D models in 4 main ways:
- Editor. Use one of the built-in models and customize it.
- Photos. Create 3D avatars from 2D images. You can upload your own PNG/JPG images, take a photo or select a sample one.
- Scans. Drag and drop your scans and turn them into 3D models. Only the OBJ format is currently supported.
- Videos. Generate 3D avatars from 2D videos. You can upload MP4/MOV files or choose a sample video.
The interface is clear, with the features on the left and right side and the model in the center. Here’s how you can create an avatar using the Editor option:
- From the left side menu, select the gender and the measurement system.
- Adjust the basic measurements to match your preferences. Simply drag the sliders to the left or right until you find the right match. If you exceed certain values, the software will let you know that the final result may be inaccurate. You can also adjust the Experimental measurements, such as shoulder length or ankle girth, but the body shape may turn out unrealistic.
- From the right side menu you can choose from various motions, textures and poses available.
- Click on Save in the top left. Give it a name and click on Create avatar.
- Hit the Download button.
You can export your avatar in two output formats: FBX or OBJ and also select the compatibility mode between Unreal, Unreal – no blend shapes and SMPL.
Pros
- The process of generating an avatar is not complicated at all.
- The use of measurements is simple and intuitive.
- Enough options to customize the avatar.
- Plenty of credits available from the get-go, so you can generate avatars free of charge.
Cons
- The Motion from text feature doesn’t work properly and is unable to generate the searched motions.
Pricing
Meshcapade offers you 2,000 credits after registration. Avatars generated from photos or measurements cost 100 credits, while those created from scans or videos cost 500 credits. When your credit balance drops below 500, the tool will automatically top it up to 500 each day. You can also purchase a 500-credit pack for approximately $5.
Meshy
Meshy gives you the possibility to create 3D assets with AI in various ways. The tool addresses both professionals in the filed and novices who don’t really have experience in creating 3D objects. In that sense it offers the following features:
- Text to texture. Just enter a text prompt of the desired texture and upload your model. The tool will then generate the texture in 3 minutes.
- Image to texture. This is a feature designed for visual artists and graphic designers. The toll will create a texture from art image and base model in under 10 minutes.
- Text to 3D. This feature can be used by anyone, regardless of the skills and experience. Simply type in your command, and Meshy will generate a fully-textured 3D model in less than 2 minutes.
- Image to 3D. The software will create a 3D model using just one image in under 15 minutes.
The web app has a user-friendly interface, which turns the generation process into an achievable operation for everybody. Once you finish your registration, you’re prompted with some basic questions about yourself and how you plan on using the software. After this you’re directed straight to the platform, where you can start creating. Here’s how you can generate 3D object from text:
- Click on the Text to 3D tab on the left sidebar.
- Type in your prompt in the prompt box. For optimal results try to describe as many attributes as possible, such as color, shape, size, art style. If you’re not feeling inspired, click on one of the two buttons inside the prompt box: one will extract prompts from the library, while the other one will take you to the prompt library.
- Click on Generate after your prompt is ready.
- Select one of the four preview models and click on Refine.
- Explore the refined model in 3D and, if necessary, edit the texture and mesh from the right toolbar.
- Once everything is ready, click on the Download button on the right toolbar.
You can download your 3D object in no less than 6 formats: FBX, OBJ, GIB, USDZ, STL, BLEND.
Pros
- Easy creation process.
- High-quality 3D objects generated.
- The helpful options to generate a successful prompt.
- Multiple formats to export your creation.
- You can download a good amount of 3D models in the free version.
Cons
- Refining the preview model takes some time.
- AI texture editing is not available in the free plan.
- You can’t download community models in the free plan.
Pricing
Meshy comes with a free version which provides 200 credits/month. To give you an idea, transforming a text into a 3D object requires 25 credits. Transforming an image requires 5 credits. To gain more credits, access more features and enjoy a faster generation time you can opt for one of the paid plans:
- Pro: $8/month
- Max: $24/month
- Enterprise: Custom price
Masterpiece X
Masterpiece X is a text to 3D AI generator you should definitely consider. This is because the platform makes it quick and hassle-free to generate, download and share your creations. Masterpiece X enables you to create 3D characters with animation, animals and objects and edit them in VR with its app available on MetaQuest.
To generate a 3D model is within anyone’s reach. Everything is simple and clearly laid out, without too many options and settings to overwhelm the user. There are two modes available:
- Simple. Just enter a text that describes your subject and then click on the Generate 3D Model button.
- Custom. Select your 3D model category, add mesh shape and style details, add texture details and generate your model.
At the moment you can export your 3D objects in the GLB format. Soon you should be able to download your assets in other formats such as FBX or OBJ.
Pros
- Super easy to use, ideal for non-technical users.
- Simple generation process based on prompts.
- The possibility to customize your creations in VR.
- You can download/remix already created models from the available library in the free version.
Cons
- Not all generations are accurate.
- Creating a custom 3D model can cost up to 100 credits, which is considerably higher in comparison to other tools.
- Just one output format.
Pricing
Masterpiece X offers you in the free version 250 credits. Creating a 3D model in the simple mode costs 50 credits, while in the custom mode – 100 credits. If you want to generate more models, you’ll need to upgrade to one of the three credit packs:
- 750 credits: $10.99/month
- 1500 credits: $19.99/month
- 3000 credits: $36.99/month
DeepMotion
DeepMotion is AI tool which you should include on your list if your objective is to create realistic 3D animations. The software has two main tools to help you bring digital characters to life:
- Video to 3D animation.
- Text to 3D animation.
The Animate 3D tool gives users the possibility to convert normal videos into 3D animations. The AI-based motion capture technology implemented can track full body movements, facial expressions, hand gestures and multiple subjects (up to 8 subjects).
The SayMotion tool, which is currently in a beta version, uses generative AI to turn text prompts into 3D animations. All you have to do is type in your textual commands, and let the software transform your idea into a 3D animation. It’s worth mentioning that, at this stage, you can only generate full body animations using text prompts.
There’s support for numerous animation formats, including FBX, BVH, GLB or MP4, as well as for JPG, PNG and GIF.
Creating a 3D animation using textual descriptions is quite easy to do. Here are the steps to follow:
- Enter the text prompt and click on the Generate Animation button.
- Preview the two variants and select the preferred one.
- Select character.
- Choose your animation and video export settings.
- Download your file in the desired output format.
Pros
- Creating animations from text requires no technical expertise.
- It automatically generates two variants of the animation.
- Under 1 minute to generate animation from text prompt.
Cons
- The generated animations aren’t 100% accurate.
Pricing
DeepMotion comes with a free edition called Freemium. This edition provides 60 credits per month (1 credit = 1 second of animation), a maximum video length of 20 seconds, 2-person tracking and a maximum resolution of 1080p. To get more credits and unlock other features you can opt for one of the four paid plans:
- Starter: $9/month
- Innovator: $17/month
- Professional: $39/month
- Studio: $83/month
Alpha 3D
Alpha 3D offers the opportunity to create 3D assets with generative AI and use them in any 3D software or on any AR, VR or metaverse platform. You can produce 3D models by transforming:
- text to 3D
- 2D image to 3D
As mentioned above, you can use the tool as an image to 3D AI generator. The only problem is that, at the current stage, the AI model is trained on only two object categories: shoes and furniture.
Creating 3D objects is a straightforward process. After registering, go to the main dashboard and add a new project. Give your project a name and choose your category: Anything (text to 3D), Sneakers (image/text to 3D) or Sofa (image/text to 3D).
If you’re using the text to image feature, simply enter the text that describes your 3D model. If you’re using the image to 3D feature, drag & drop or upload the 2D image you wish to transform. Just make sure to load a JPG/JPEG or PNG image with a white background for optimal results. Next simply hit the Generate button, and allow the software to create your 3D object. You can download your file in the GLB format.
Pros
- Its simplicity.
- Decent prices for the standard editions.
- You can generate up to 50 3D assets free of charge.
- Production of 3D objects is done in a timely manner.
Cons
- The image to 3D feature requires some refining and is trained only on two objects.
- For some it may be too basic and may lack editing control.
- You can’t download the generated 3D assets in the free version.
- It supports only one export format.
Pricing
Alpha 3D offers a free trial, which allows you to generate 50 3D models. If you’d like to download those models and benefit from priority support, it’s necessary to upgrade to one of the multiple subscriptions:
- Starter: $0.99/month
- Premium: $4.89/month
- Enterprise: $9.59/month
- 30.000 tokens: $27.99/month
- 100.000 tokens: $89.99/month
- 500.000 tokens: $399.99/month
Conclusion
The rise of AI-powered 3D generators has completely changed the way we perceive digital design. Thanks to their revolutionary AI capabilities and their ease of use, these platforms have made it possible for everyone to generate 3D models. It doesn’t matter if you’re a complete novice, simply by using your words, a given image or video you can create a realistic 3D object within minutes. At the same time, these tools have brought along new opportunities for graphic designers, 3D artists or game developers. They can now discover new ideas, experience creative possibilities, as well as streamline their workflow.