Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Train for Chinese speech #6

Open
Olivia-Ye opened this issue Apr 12, 2022 · 3 comments
Open

Train for Chinese speech #6

Olivia-Ye opened this issue Apr 12, 2022 · 3 comments

Comments

@Olivia-Ye
Copy link

I want to train on Chinese speeches. But I don't know how to convert the speech videos to the type that used for training. Could u public the processing codes for raw video?
Another question confused me is that how to generate the figure in the middle in the follow picture? I have followed Readme to complete the generation for the figure on the left side of the follow picture.
))@BEP@{2)KL}9EL@QX7IXH
And it would be better if you could provide a contrast way for our discussor.
Thanks so much.

@TheTempAccount
Copy link
Owner

You can use OpenPose or AlphaPose to get the body keypoints in OpenPose format. To generate the figure in the middle you need to train a rendering model such as Vid2Vid.

@Olivia-Ye
Copy link
Author

Thanks for your reply.
I still have a question that whether it is possible to apply the pretrained model you have provided to Chinese speeches. It’s a significant issue which decided the points of the following work that I plan to do .
Can you set up a discussion group for the discussants to help everyone solve problems?

@XuJianzhi
Copy link

I want to train on Chinese speeches. But I don't know how to convert the speech videos to the type that used for training. Could u public the processing codes for raw video? Another question confused me is that how to generate the figure in the middle in the follow picture? I have followed Readme to complete the generation for the figure on the left side of the follow picture. ))@BEP@{2)KL}9EL@QX7IXH And it would be better if you could provide a contrast way for our discussor. Thanks so much.

老哥你好,请问直接用他给的模型+中文,生成效果能用吗?
我没有能力训中文,如果您试过,效果不好,我就不试了
谢谢!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants