Bring Silent Videos to Life Sounds(Open-Source)

FoleyCrafter Sound effects are the unsung heroes of cinema and gaming, enhancing realism, impact, and emotional depth for an immersive audiovisual experience. FoleyCrafter is a video-to-audio generation framework which can produce realistic sound effects semantically relevant and synchronized with videos. Your star is our fuel! We're revving up the engines with it! FoleyCrafter: Bring Silent Videos to Life with Lifelike and Synchronized Sounds Yiming Zhang, Yicheng Gu, Yanhong Zeng†, Zhening Xing, Yuancheng Wang, Zhizheng Wu, Kai Chen† (†Corresponding Author) What's New A more powerful one 😝 . A more powerful one 😝 . Release training code. Release training code. 2024/07/01 Release the model and code of FoleyCrafter. Setup Prepare Environment Use the following command to install dependencies: # install conda environment conda env create -f requirements/environment.yaml conda activate foleycrafter # install GIT LFS for checkpoints download conda install git-lfs git lfs insta ... Read full article.