DeepMotion provides a motion intelligence platform that utilizes deep learning to convert video and text inputs into 3D animations for digital humans and virtual creatures. This technology simplifies the animation process, enabling creators to produce high-quality animations without the need for extensive hardware or expertise in motion capture.
Funding
Funding not disclosed
Founders
Product
Problem
Creating high-quality 3D animations for digital humans and virtual creatures traditionally requires extensive hardware, specialized expertise in motion capture, and a complex animation pipeline. This makes the animation process time-consuming, expensive, and inaccessible for many creators.
Solution
DeepMotion offers a motion intelligence platform that leverages deep learning to streamline the creation of 3D animations from video and text inputs. The platform simplifies the animation workflow, enabling users to produce realistic and dynamic animations without the need for motion capture suits or in-depth animation knowledge. By integrating a Large Language Model (LLM), the platform interprets text inputs and translates them into complex, lifelike motions. The platform also offers AI-based animation editing components, including spatial-temporal inpainting, for seamless motion continuity and refinement.
Target Audience
The primary audience includes game developers, XR creators, filmmakers, educators, and interactive media professionals who need to generate 3D animations for digital humans and virtual creatures.
Features
- AI-powered motion capture from video, converting 2D footage into 3D animation
- Generative AI text-to-3D animation, creating motions from textual descriptions
- Animate 3D integration, allowing users to combine and edit video and text-based animations
- Spatial-temporal inpainting for seamless motion continuity and refinement
- Support for a wide range of expressive motions, including subtle emotions, character traits, and complex actions
- API access for integrating the platform directly into projects and workflows
- Compatibility with game engines like Unreal Engine 5 for animation retargeting