Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PreRelease: v0.1.0 #2

Merged
merged 41 commits into from
Jul 2, 2024
Merged

PreRelease: v0.1.0 #2

merged 41 commits into from
Jul 2, 2024

Conversation

iofu728
Copy link
Contributor

@iofu728 iofu728 commented Jul 2, 2024

  • release MInference pip package;
  • add experiments details;
  • add examples;
  • add github action;

iofu728 and others added 30 commits June 5, 2024 10:05
@iofu728
Feature(MInference): build the basic MInference framework
f841592
@iofu728
Feature(MInference): support InfiniteBench
37cd987
@iofu728
Feature(MInference): add Needle in A Haystack script
f5e3595
@iofu728
Feature(MInference): add ppl script
847776d
@iofu728
Feature(MInference): add RULER
5347d8c
@iofu728
Feature(MInference): add benchmark e2e
adc194f
@iofu728
Feature(MInference): support vLLM and add examples
e48038e
@iofu728 @Starmys
Feature(MInference): Use CUDAExtention to build indexing kernel inste…
e28a73c 
…ad of PyCUDA

Co-authored-by: Chengruidong Zhang <chengzhang@microsoft.com>
@iofu728
Feature(MInference): add benchmark experiments
e3569ed
@iofu728
Feature(MInference): add onepage
ce133f3
@liyucheng09
experiments documents
db8998e
@iofu728
Feature(MInference): add search scripts
c354d98
@iofu728
Feature(MInference): add streaming example
7022371
@iofu728
Feature(MInference): update logo and demo
a7ac35d
@liyucheng09
experiment commands test passed - warning disabled
ed7a439
@iofu728
Feature(MInference): add FAQ
6053545
@iofu728
Feature(MInference): fix the bibtex
834c6ec
@iofu728 @liyucheng09 @Starmys
Feature(MInference): add license
538e476 
Co-authored-by: Yucheng Li <liyucheng09@gmail.com>
Co-authored-by: Chengruidong Zhang <chengzhang@microsoft.com>
@iofu728
Feature(MInference): support GLM-4 and Qwen2
c754284
@iofu728
Feature(MInference): fix the kv cache cpu bias issue
70f05f9
@iofu728
Feature(MInference): support kv cache cpu device
a206fb2
@iofu728
Fix(MInference): fix config get issue
abc5aba
@iofu728
Feature(MInference): update experiments details
010b708
@liyucheng09
add GLM-4 to RULER
a4cf850
@iofu728
Feature(MInference): update logo and T5 sparsity
3cf46d4
@iofu728
Feature(MInference): update the logo
ce1c243
@iofu728
Feature(MInference): update the logo
8341e4f
@iofu728
Feature(MInference): update the title
264ea01
@liyucheng09
bug fixed - GLM-4
6b401a8
@liyucheng09
bug fix - ruler with StreamingLLM
be92526
@iofu728 iofu728 added documentation Improvements or additions to documentation design design style some problem of code style feature feature labels Jul 2, 2024
@iofu728 iofu728 self-assigned this Jul 2, 2024
@iofu728 iofu728 merged commit eb922ea into main Jul 2, 2024
1 check passed
@iofu728 iofu728 deleted the hjiang/MInference branch July 2, 2024 16:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@iofu728 iofu728

Labels
design design documentation Improvements or additions to documentation feature feature style some problem of code style
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@iofu728 @liyucheng09