Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Connect chatgpt to this project to process user input information #5

Open
HarrisHongting opened this issue Aug 16, 2024 · 3 comments
Open

Comments

@HarrisHongting
Copy link

Hi @andvg3,

I hope everything is going well with you. I'm currently working on this project and trying to put ChatGPT inside to process user input. However, I didn't find any code in the project to process user input. It seems that the whole project is just doing backend processing. I am considering creating a web app to process user input and generate scenes. Can I get some advice from you?

Kind regards,

Harris

@andvg3
Copy link
Owner

andvg3 commented Aug 17, 2024

Hi,

I think it is an amazing idea to inject ChatGPT response to our LSDM model. You can do it by simply replace the input text with the ChatGPT prompts, with some decent engineering work.

Nevertheless, I have to suggest you that it would be very challenging because LSDM is an offline model and it took a few minutes to generate a scene, which may be not useful in such interactive case.

Please let me know if you have any additional questions. Thank you!

@HarrisHongting
Copy link
Author

Hi @andvg3,

python fit_custom_obj.py
--sequence_name <sequence_name>
--vertices_path data/supp/proxd_valid/vertices/<sequence_name>_verts.npy
--contact_labels_path data/supp/proxd_valid/semantics/<sequence_name>_cfs.npy
--output_dir fitting_results/
--label <num_label>
--file_name training/sdm/output/predictions/<interaction_name>.npy

In this instruction, I found that the related .npy files of <sequence_name>_verts.npy and <sequence_name>_cfs.npy in the related path are all composed of array lists. And their names are some incomprehensible numbers. This is very confusing to me. Could you please take some time to explain it to me?

Many thanks,

Harris

@andvg3
Copy link
Owner

andvg3 commented Nov 9, 2024

Hi, the .npy files are array of 3D points, which is, actually, the point cloud of the human motion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants