Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.

Commit

Permalink
add back dtype_zero_pt checkk
Browse files Browse the repository at this point in the history
  • Loading branch information
DDEle committed Jul 10, 2024
1 parent 20da116 commit 696820f
Showing 1 changed file with 12 additions and 0 deletions.
12 changes: 12 additions & 0 deletions include/experimental/group/gemm/impl/int4_dequantize_xe.hpp
Original file line number Diff line number Diff line change
Expand Up @@ -101,6 +101,18 @@ class gemm_t<
std::is_same<remove_const_t<dtype_b>, remove_const_t<int4x2>>::value ||
std::is_same<remove_const_t<dtype_b>, remove_const_t<int4x8>>::value,
"this is for 4bit matB ");
static_assert(
quant_info_.quant_mode == quant_mode::INT4_ASYM_FP_ZERO
? std::is_same_v<
remove_const_t<dtype_zero_pt>,
remove_const_t<dtype_a>>
: (std::is_same_v<
remove_const_t<dtype_zero_pt>,
remove_const_t<int4x2>> ||
std::is_same_v<
remove_const_t<dtype_zero_pt>,
remove_const_t<int4x8>>),
"this is for 4bit zero_pt ");

/******** set memory attribute **********/
static constexpr mem_space mem_space_a = mem_desc_a_t::space;
Expand Down

0 comments on commit 696820f

Please sign in to comment.