Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch grammar backend to Formatron #252

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

DocShotgun
Copy link
Member

@DocShotgun DocShotgun commented Nov 23, 2024

Is your pull request related to a problem? Please describe.
N/A

Why should this feature be added?
Simplify dependencies and improve grammar-constrained inference performance.

Examples
N/A

Additional context
To-do:

  • Implement regex
  • Implement JSON schema
  • Implement KBNF grammar
  • Is lru_cache needed?

* Replace LMFE's regex and JSON schema filters with Formatron's
* Remove Outlines EBNF filter in preparation for Formatron KBNF filter
* TODO: Implement Formatron KBNF filter
* Also remove empty cache clear function
@DocShotgun DocShotgun marked this pull request as ready for review November 24, 2024 19:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant