Could I change the max_seq_length?

[asenasen123]

I need to input a length greater than the maximum sequence length.Could I need change the max_seq_length?

[Muennighoff]

Hey yes, you can increase it up to 2048.
I'm not sure if the performance will be better than just cutting your inputs to be shorter.

[asenasen123]

Hey yes, you can increase it up to 2048. I'm not sure if the performance will be better than just cutting your inputs to be shorter.

Thank for your replay. Could I increase it up to 4096? Does max_seq_length refer to the longest sequence length of tokens? If it is in Chinese, what is the approximate length limit?

[Muennighoff]

4096 will work for the sgpt-bloom models I think as they use Alibi embeddings so you could theoretically use any sequence length you want.

Yes it does

It is the same for all languages