Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: FFMPEG DID NOT STITCH ANY VIDEO #956

Open
3 tasks done
roots-3d opened this issue Mar 6, 2024 · 11 comments
Open
3 tasks done

[Bug]: FFMPEG DID NOT STITCH ANY VIDEO #956

roots-3d opened this issue Mar 6, 2024 · 11 comments
Labels
bug Something isn't working

Comments

@roots-3d
Copy link

roots-3d commented Mar 6, 2024

Have you read the latest version of the FAQ?

  • I have visited the FAQ page right now and my issue is not present there

Is there an existing issue for this?

  • I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

Are you using the latest version of the Deforum extension?

  • I have Deforum updated to the lastest version and I still have the issue.

What happened?

Hello Deforum, thank you for the amazing art software that I use for my creations.

Error description:

In 2D and 3D modes, I can interrupt my video at any time and FFMPEG successfully stitches together the initial part of the video. This allows me to watch previews and perform some tests before choosing a final render.

2D and 3D modes are working.

In the case of Video Input, I need to let the video run until the end, in which case it completes the stitching process. However, if I use the STOP button, it gives me this bug in the terminal:

Deforum progress:  18% 10904/62007 [54:25<4:15:01,  3.34it/s]
Got a request to stitch frames to video using FFmpeg.
Frames:
/output/img2img/Deforum_20240306104116/20240306104116_%09d.png
To Video:
/output/img2img/Deforum_20240306104116/20240306104116.mp4
Stitching *video*...** FFMPEG DID NOT STITCH ANY VIDEO ** Error: local variable 'temp_file' referenced before assignment

I've been dealing with this error for a long time now, and today I'm able to detect and anticipate that this problem is recurring. The files are saved in the folder, the video is saved. However, the "update," when it fails, never returns to normal mode until I restart the program.

Steps to reproduce the problem

Error steps:
-> Play on the Automatic1111 container ( https://github.com/AbdBarho/stable-diffusion-webui-docker )
-> Extensions connected:
Deforum, ControlNet

-> Do Ensure the correct video path is set as video input.
-> Click generate.
-> Interrupt.
-> Turn on ControlNets.
-> Turn off ControlNets.
-> Click generate.
-> Interrupt.
-> BUG: The video update fails to refresh and play repeating the animation executed in the last run.

What should have happened/how would you fix it?

Restart container.

Torch version

2.1.2

On which platform are you launching the webui with the extension?

No response

Deforum settings

20240306121322_settings.txt

Webui core settings

ui-config.json

Console logs

started run_deforum
times_to_run: 1
Deforum extension for auto1111 webui
Git commit: df6a63d5
Starting job task(hrggs7a2b7aebm5)-0...
Exporting Video Frames (1 every 1) frames to /output/img2img/Deforum_20240306120808/inputframes...
Trying to extract frames from video with input FPS of 25.0. Please wait patiently.
Extracted 1879 frames from video in 2.12 seconds!
Loading 1879 input frames from /output/img2img/Deforum_20240306120808/inputframes and saving video frames to /output/img2img/Deforum_20240306120808Git commit: df6a63d5
Starting job task(ihfbzbovckup4az)-0...
Exporting Video Frames (1 every 1) frames to /output/img2img/Deforum_20240306121322/inputframes...
Trying to extract frames from video with input FPS of 25.0. Please wait patiently.
Extracted 1879 frames from video in 2.17 seconds!
Loading 1879 input frames from /output/img2img/Deforum_20240306121322/inputframes and saving video frames to /output/img2img/Deforum_20240306121322
Saving animation frames to:
/output/img2img/Deforum_20240306121322
Animation frame: 0/1879  
Seed: 2518532154
Prompt: a painting in style of van gogh depicting an acoustic guitar player. music art
Neg Prompt: signature, text, name
Using video init frame /output/img2img/Deforum_20240306121322/inputframes/1000000000.jpg
╭─────┬───┬───────╮
│Steps│CFG│Denoise│
├─────┼───┼───────┤
│ 33  │7.0│   1   │
╰─────┴───┴───────╯

  0% 0/33 [00:00<?, ?it/s]

Deforum progress:   0% 0/62007 [00:00<?, ?it/s]
  3% 1/33 [00:00<00:21,  1.46it/s]








 85% 28/33 [00:03<00:00,  8.23it/s]


Deforum progress:   1% 359/62007 [00:48<2:04:35,  8.25it/s]
 88% 29/33 [00:03<00:00,  8.25it/s]


Deforum progress:   1% 360/62007 [00:48<2:04:24,  8.26it/s]
 91% 30/33 [00:03<00:00,  8.26it/s]


Deforum progress:   1% 361/62007 [00:48<2:04:17,  8.27it/s]
 94% 31/33 [00:03<00:00,  8.27it/s]


Deforum progress:   1% 362/62007 [00:48<2:04:12,  8.27it/s]
 97% 32/33 [00:03<00:00,  8.27it/s]


Deforum progress:   1% 363/62007 [00:48<2:04:08,  8.28it/s]
100% 33/33 [00:03<00:00,  8.28it/s]
100% 33/33 [00:03<00:00,  8.27it/s]

Animation frame: 11/1879  

Seed: 3495107005

Prompt: a painting in style of van gogh depicting an acoustic guitar player. music art

Neg Prompt: signature, text, name

Using video init frame /output/img2img/Deforum_20240306120709/inputframes/1000000011.jpg

╭─────┬───┬───────╮

│Steps│CFG│Denoise│

├─────┼───┼───────┤

│ 33  │7.0│   1   │

╰─────┴───┴───────╯


  0% 0/33 [00:00<?, ?it/s]


Deforum progress:   1% 364/62007 [00:49<4:47:23,  3.57it/s]
  3% 1/33 [00:00<00:03,  8.15it/s]


Deforum progress:   1% 365/62007 [00:49<3:58:10,  4.31it/s]
  6% 2/33 [00:00<00:03,  8.25it/s]


Deforum progress:   1% 366/62007 [00:49<3:23:45,  5.04it/s]
  9% 3/33 [00:00<00:03,  8.28it/s]


Deforum progress:   1% 367/62007 [00:49<2:59:48,  5.71it/s]
 12% 4/33 [00:00<00:03,  8.28it/s]


Deforum progress:   1% 368/62007 [00:49<2:43:06,  6.30it/s]
 15% 5/33 [00:00<00:03,  8.28it/s]


Deforum progress:   1% 369/62007 [00:50<2:31:21,  6.79it/s]
 18% 6/33 [00:00<00:03,  8.28it/s]


Deforum progress:   1% 370/62007 [00:50<2:23:07,  7.18it/s]
 21% 7/33 [00:00<00:03,  8.29it/s]


Deforum progress:   1% 371/62007 [00:50<2:17:19,  7.48it/s]
 24% 8/33 [00:00<00:03,  8.29it/s]


Deforum progress:   1% 372/62007 [00:50<2:13:17,  7.71it/s]
 27% 9/33 [00:01<00:02,  8.29it/s]


Deforum progress:   1% 373/62007 [00:50<2:10:27,  7.87it/s]
 30% 10/33 [00:01<00:02,  8.29it/s]


Deforum progress:   1% 374/62007 [00:50<2:08:29,  7.99it/s]
 33% 11/33 [00:01<00:02,  8.29it/s]


Deforum progress:   1% 375/62007 [00:50<2:07:06,  8.08it/s]
 36% 12/33 [00:01<00:02,  8.29it/s]


Deforum progress:   1% 376/62007 [00:50<2:06:08,  8.14it/s]
 39% 13/33 [00:01<00:02,  8.29it/s]
 39% 13/33 [00:01<00:02,  8.28it/s]

Animation frame: 12/1879  

Seed: 3495107004

Prompt: a painting in style of van gogh depicting an acoustic guitar player. music art

Neg Prompt: signature, text, name

Using video init frame /output/img2img/Deforum_20240306120709/inputframes/1000000012.jpg


Deforum progress:   1% 376/62007 [00:51<2:20:10,  7.33it/s]

Got a request to stitch frames to video using FFmpeg.

Frames:

/output/img2img/Deforum_20240306120709/20240306120709_%09d.png

To Video:

/output/img2img/Deforum_20240306120709/20240306120709.mp4

Stitching *video*...** FFMPEG DID NOT STITCH ANY VIDEO ** Error: local variable 'temp_file' referenced before assignment





 'I have a good reason for not including the log' 

the log is inside the container

Additional information

The error occurs regardless of whether the container is on Windows or Linux.

@roots-3d roots-3d added the bug Something isn't working label Mar 6, 2024
@ElSuccerro
Copy link

Got the same problem ...

@qq2628480515
Copy link

Me, too. The previous versions were all normal. ...

@rewbs
Copy link
Contributor

rewbs commented May 15, 2024

This should be resolved with the latest Deforum (which requires a1111 v1.9). If you can please confirm I will close this issue.

@lavibeats
Copy link

I have the same issue. Today, I hoped updating my deform extension would help, but now I can't generate anything!
Screenshot 2024-05-16 091922

@rewbs
Copy link
Contributor

rewbs commented May 18, 2024

I have the same issue. Today, I hoped updating my deform extension would help, but now I can't generate anything!
Screenshot 2024-05-16 091922

That issue suggests you are on an old version of a1111. Can you check you have updates to 1.9?

@Ryden-kai
Copy link

I have updated it, but this problem still occurs

@C4l1b3r
Copy link

C4l1b3r commented Jun 28, 2024

i have same issue with a1111 deforum & forge defoeum

@VTL1618
Copy link

VTL1618 commented Jul 6, 2024

Same! Mac Os M1

@C4l1b3r
Copy link

C4l1b3r commented Jul 7, 2024

Screenshot_20240707_084254_RVNC Viewer
I was having every so often it wouldn't compile to video now it's none of them.

Happens on A1111 and forge

@C4l1b3r
Copy link

C4l1b3r commented Jul 9, 2024

when you boot automatic1111 up do you get an opencv change

if so

i did this to fix this.

goto the forge folder and then into the venv/Scripts folder. Highlight the address bar and type cmd press enter
type activate press enter
pip uninstall opencv-python
pip uninstall opencv-python-headless

pip install opencv-python==4.8.72
pip install opencv-python-headless==4.8.72

exit and run forge

all my issues have been fixed with this process

@lavibeats
Copy link

lavibeats commented Jul 9, 2024

I found my problem. Just needed to add ffmpeg Link to the settings of a1111

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

8 participants