Skip to content

Add Batch=32 / paged attention / and new RoPE module support to all Llama3 demo and tests #32885

Add Batch=32 / paged attention / and new RoPE module support to all Llama3 demo and tests

Add Batch=32 / paged attention / and new RoPE module support to all Llama3 demo and tests #32885

check-forbidden-imports

succeeded Nov 26, 2024 in 7s