[ad_1]
Stability AI is releasing two versions of a new generative AI model called Stable Video 3D (SV3D). Both versions can turn image prompts into 3D video “meshes” that can show an “orbiting” 360-degree view of an object, while the more advanced version can also incorporate “specified camera paths” into its video generation, according to the company.A blog post from Stability AI shows how the model is designed to output 3D model videos of objects like fashion accessories and toy animals without being given images of the subject from all angles. “This is mainly made possible by the large-scale pre-training of generative models which enables sufficient generalization to various domains,” Stability AI’s researchers write in their report. Stable Video 3D is based on Stable Video Diffusion, which was released late last year and trained on massive datasets like LAION and LVD, according to the research report. SV3D was then further trained on a refined version of the “Objaverse” dataset, which consists of a massive range of 3D objects. The new Stable Video 3D models are already being offered for commercial use through a paid Stability membership, or can be downloaded for free for non-commercial use. In an interview with VentureBeat, Stability AI Lead Research Varun Jampani suggested the new model could be used in game development or e-commerce.
This Tweet is currently unavailable. It might be loading or has been removed.
“Stable Video 3D is a valuable tool for generating 3D assets, especially within the gaming sector,” Jampani told VentureBeat. “Additionally, it enables the production of 360-degree orbital videos, which are useful in e-commerce, providing a more immersive and interactive shopping experience.”
Recommended by Our Editors
It’s worth noting, however, that the AI might not be generating objects that are perfectly accurate to what a customer might be buying if the AI rendering is made after the product. Considering SV3D was trained on objects, it’s also unclear whether it would be able to handle images of people—and what it might create as a result.Stability AI is primarily known for its flagship image generator, Stable Diffusion. Earlier this month, AI rival Midjourney banned all Stability AI employees from its platform after it claimed Stability staff allegedly deployed “botnet-like activity” to scrape Midjourney data.
Get Our Best Stories!
Sign up for What’s New Now to get our top stories delivered to your inbox every morning.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use and Privacy Policy. You may unsubscribe from the newsletters at any time.
[ad_2]
