AI Toolbox · 3D

Audio-to-3D

Free audio-to-3D AI tools for creating immersive environments, generating 3D scenes from sound, perfect for games, films, and virtual experiences.

3D AI Tools

3D Animation 3D Avatar Generation 3D Editing 3D Hair Generation 3D Mesh Generation 3D Motion Generation 3D Object Detection 3D Object Generation 3D Outpainting 3D Relighting 3D Scene Generation 3D Scene Generation 3D Object Generation 3D Segmentation 3D Style Transfer 3D Texture Generation 3D Virtual Try-On Audio-to-3D Brain-to-3D Controllable 3D Generation Image-to-3D Image-to-4D Image-to-Texture Motion Capture Motion Generation Text-to-3D Text-to-4D Text-to-Motion Text-to-Texture Text-to-Texture 3D Object Generation Video-to-3D Video-to-4D

ProbTalk3D

ProbTalk3D can generate 3D facial animations that show different emotions based on audio input! It uses a two-stage VQ-VAE model and the 3DMEAD dataset, allowing for diverse facial expressions and accurate lip-syncing.

12.09.24 · Project Page · Code · Audio-to-3D

GeneFace

GeneFace can generate high-quality 3D talking face videos from any speech audio. It solves the head-torso separation problem and provides better lip synchronization and image quality than earlier methods.

08.07.24 · Project Page · Code · Audio-to-3D · 3D Object Generation

Real3D-Portrait

Real3D-Portrait is a one-shot 3D talking portrait generation method. This one is able to generate realistic videos with natural torso movement and switchable backgrounds.

16.01.24 · Project Page · Code · Audio-to-3D · 3D Object Generation

From Audio to Photoreal Embodiment

Audio2Photoreal can generate full-bodied photorealistic avatars that gesture according to the conversational dynamics of a dyadic interaction. Given speech audio, the model is able to output multiple possibilities of gestural motion for an individual, including face, body, and hands. The results are highly photorealistic avatars that can express crucial nuances in gestures such as sneers and smirks.

03.01.24 · Project Page · Code · Audio-to-3D · 3D Object Generation · 3D Motion Generation