Skip to content

Issues: intel/neural-compressor

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

34 Open 172 Closed
34 Open 172 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Error while running Whisper model quantization with Intel neural compressor
#2056 opened Nov 5, 2024 by Shivani-k16
AssertionError of act_observer when using SmoothQuant for Llama-13b
#2033 opened Oct 16, 2024 by kyang-06
Coding error！！
#2027 opened Oct 11, 2024 by AheadSnail
Qwen/Qwen2.5-7B-Instruct model layer_wise_quant function error
#2017 opened Sep 30, 2024 by hadoop2xu
Failed to save quantized model
#2001 opened Sep 11, 2024 by lockeregg
@yiliu30
9
how to evaluate AWQ ?
#1980 opened Aug 14, 2024 by chunniunai220ml
@Kaihui-intel
7
Quantization failed
#1972 opened Aug 11, 2024 by endomorphosis
@mengniwang95
1
Any example to quantise a text embedding model on Intel Gaudi2? aitce AI TCE to handle it firstly
#1919 opened Jul 14, 2024 by sleepingcat4
@NeoZhangJianyu
2
Error in fp8 quantization: Invalid scale factor : 1.70e+06, make sure the scale is not larger than : 6.55e+04
#1907 opened Jul 9, 2024 by yyChen233
@xin3he
FP4 encoding related
#1891 opened Jul 1, 2024 by Tiantian-Han
@Kaihui-intel
PTQ with IPEX backend and XPU device is not working
#1889 opened Jun 28, 2024 by paguilomanas
@thuang6 @violetch24
3
Is there any accuracy data related to FP4?
#1835 opened Jun 3, 2024 by PhzCode
@xin3he
how to extract int8 weights from quantized model aitce AI TCE to handle it firstly
#1817 opened May 25, 2024 by chensterliu
@srinarayan-srikanthan
8
'q_config' is needed when export an INT8 model aitce AI TCE to handle it firstly
#1736 opened Apr 18, 2024 by ZhangShuoAlreadyExists
@NeoZhangJianyu
3
io.UnsupportedOperation: fileno
#1714 opened Apr 3, 2024 by jashokkumar83
@zehao-intel
1
AWQ Quantization padding error
#1699 opened Mar 26, 2024 by PatriceVignola
@mengniwang95
1
Model execution is single threaded?
#1663 opened Mar 12, 2024 by akhauriyash
@violetch24
1
neural_compressor/adaptor/ox_utils/quantizer.py dfs crash during "basic" tuning
#1621 opened Feb 22, 2024 by kmn1024
@mengniwang95
1
How to quantify google/vit-base-patch16-224 pytorch_model.bin to int8 type with neural-compressor
#1612 opened Feb 19, 2024 by yingmuying
@xin3he @Kaihui-intel
3
How to perform int8 quantisation (not uint8) using ONNX?
#1610 opened Feb 16, 2024 by paul-ang
@mengniwang95
1
AWQ quantization is very slow for ONNX LLMs
#1609 opened Feb 10, 2024 by PatriceVignola
@yuwenzho
1
Unable to save llama2 after SmoothQuant
#1600 opened Feb 2, 2024 by dellamuradario
@yuwenzho
1
how to get layer_mappings for distillation?
#1590 opened Feb 1, 2024 by Michael-Fuu
@XinyuYe-Intel
1
PostTrainingQuantConfig(quant_level='auto', device='npu', backend="onnxrt_dml_ep") produces fp32 ops.
#1580 opened Jan 26, 2024 by kleiti
@mengniwang95
1
AWQ fails on ONNX model when a MatMul node's input is a model input/initializer
#1571 opened Jan 25, 2024 by jstoecker
@thuang6 @mengniwang95
1
ProTip! Follow long discussions with comments:>50.