Skip to content

Commit

Permalink
v1.77009_b3972
Browse files Browse the repository at this point in the history
Context shift is now disabled properly.
Good news, because I screwed that feature I guess..
  • Loading branch information
Nexesenex committed Oct 24, 2024
1 parent 335749c commit 49c358a
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions koboldcpp.py
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@
modelbusy = threading.Lock()
requestsinqueue = 0
defaultport = 5001
KcppVersion = "1.77008"
KcppVersion = "1.77009"
LcppVersion = "b3972"
CudaSpecifics = "CuCML_ArCML_SMC2_DmmvX32Y1"
ReleaseDate = "2024/10/24"
Expand Down Expand Up @@ -1119,7 +1119,7 @@ def load_model(model_filename):

inputs.mmproj_filename = args.mmproj.encode("UTF-8") if args.mmproj else "".encode("UTF-8")
inputs.use_smartcontext = args.smartcontext
inputs.use_contextshift = (1 if args.contextshift else 0)
inputs.use_contextshift = args.contextshift

inputs.flash_attention = args.flashattention
if args.quantkv==0:
Expand Down

0 comments on commit 49c358a

Please sign in to comment.