Clarification on Speed Improvement with fused_window_process and Its Necessity for Small-Scale Tasks

[Fanqyu]

Hi, thank you for your excellent work!

I have a question regarding the fused_window_process. With the integration of the window process in the CUDA files, is the speed improvement significant? Could you provide some quantitative data to illustrate the performance gains?

Additionally, for tasks of a smaller scale, is it necessary to utilize the window process, or would it be better to use a default implementation of torch.roll?

Looking forward to your response!