私的AI研究会 > TalkFace2
音声と1枚の顔画像を使って、顔画像がまるで話しているような動画を作成する技術「One Shot Talking Face」をローカルマシンで動かす
『One Shot Talking Face を使って音声で顔画像を動かす』 をローカルマシンに移植する
(py38_learn) python -B test_script.py --img_path ./train/image.png --audio_path ./train/audio.wav --phoneme_path ./test.json --save_dir ./train Traceback (most recent call last): File "test_script.py", line 12, in <module> from tools.interface import read_img,get_img_pose,get_pose_from_audio,get_audio_feature_from_audio,\ File "/home/mizutu/workspace_2/one-shot-talking-face/tools/interface.py", line 12, in <module> import pyworld File "/home/mizutu/anaconda3/envs/py38_learn/lib/python3.8/site-packages/pyworld/__init__.py", line 17, in <module> from .pyworld import * File "pyworld/pyworld.pyx", line 1, in init pyworld.pyworld ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 96 from C header, got 80 from PyObject
(py38_learn_test) mizutu@ubuntu-HP-ENVY:~/workspace_2$ pip install numpy==1.23.0 Collecting numpy==1.23.0 Using cached numpy-1.23.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.2 kB) Using cached numpy-1.23.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.1 MB) Installing collected packages: numpy Attempting uninstall: numpy Found existing installation: numpy 1.19.5 Uninstalling numpy-1.19.5: Successfully uninstalled numpy-1.19.5 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. openvino 2022.1.0 requires numpy<1.20,>=1.16.6, but you have numpy 1.23.0 which is incompatible. Successfully installed numpy-1.23.0
(py38_learn_test) python -B test_script.py --img_path ./train/image.png --audio_path ./train/audio.wav --phoneme_path ./train/test.json --save_dir ./train Traceback (most recent call last): File "test_script.py", line 180, in <module> test_with_input_audio_and_image(args.img_path,args.audio_path,phoneme,config.GENERATOR_CKPT,config.AUDIO2POSE_CKPT,args.save_dir) : File "/home/mizutu/anaconda3/envs/py38_learn_test/lib/python3.8/subprocess.py", line 1720, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) OSError: [Errno 8] Exec format error: './OpenFace/FeatureExtraction'
(py38_learn_test) sudo apt update : (py38_learn_test) sudo apt-get install git-lfs : 以下のパッケージが新たにインストールされます: git-lfs : (py38_learn_test) git lfs install Updated git hooks. Git LFS initialized. (py38_learn_test) git clone https://huggingface.co/camenduru/one-shot-talking-face-20.04-t4 one-shot-talking-face :