Skip to content

Commit

Permalink
chore(deps): update tokenizers requirement from 0.19.1 to 0.20.0
Browse files Browse the repository at this point in the history
Updates the requirements on [tokenizers](https://github.com/huggingface/tokenizers) to permit the latest version.
- [Release notes](https://github.com/huggingface/tokenizers/releases)
- [Changelog](https://github.com/huggingface/tokenizers/blob/main/RELEASE.md)
- [Commits](huggingface/tokenizers@v0.19.1...v0.20.0)

---
updated-dependencies:
- dependency-name: tokenizers
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
  • Loading branch information
dependabot[bot] authored Aug 12, 2024
1 parent 214c86b commit b867050
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ rand = { version = "0.8.5", optional = true }
[dev-dependencies]
criterion = "0.5.1"
rand = "0.8.5"
tokenizers = "0.19.1"
tokenizers = "0.20.0"

[[bench]]
name = "tokenize"
Expand Down

0 comments on commit b867050

Please sign in to comment.