ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
-
Updated
Oct 30, 2024 - Python
#
sparse-attention
Here are 5 public repositories matching this topic...
The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
-
Updated
Nov 29, 2024 - Python
Demo code for CVPR2023 paper "Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers"
attention-mechanism
fast-inference
sparse-neural-networks
low-rank
vision-transformer
efficient-transformers
sparse-attention
efficient-vision-transformers
-
Updated
Jul 4, 2023 - Python
Pytorch implementation of "Structural Similarity-Inspired Unfolding for Lightweight Image Super-Resolution"
-
Updated
Nov 19, 2024
Text Summarization Modeling with three different Attention Types
-
Updated
May 29, 2024 - Python
Improve this page
Add a description, image, and links to the sparse-attention topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the sparse-attention topic, visit your repo's landing page and select "manage topics."