Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replacements / rewrites are behaving oddly #17

Open
alex-calderwood opened this issue Apr 26, 2024 · 1 comment
Open

Replacements / rewrites are behaving oddly #17

alex-calderwood opened this issue Apr 26, 2024 · 1 comment

Comments

@alex-calderwood
Copy link

alex-calderwood commented Apr 26, 2024

Maybe I'm just used to the new wave of GPT-4ish models, but I've noticed that with just about any request, the responses the model (one of the Geminis?) returns are highly ignorant of the insertion point. I suspect that whatever model is being used here isn't operating as well as the system did when being tested. Just a hunch. I haven't saved the results from my more elaborate usage, but here is just the first thing that I ran to try to get an example of what I'm talking about.

Story:  {In between the two mountains ____ nasty who sold the heart of the mountain to the cowherd.}
The phrase to be rewritten that fills in the blank:  {lived something}
The phrase rewritten to be more descriptive: 
Generate 8 responses. Each response must start with: { and end with: }
index.ts:134 🚀 model results:  { and there lived an elderly hermit}
{ and a hideous sorcerer named Maldred}
{ and a strange creature with emerald scales}
{ and a mysterious woman known as the Lady of the Lake}
{ and lived a powerful wizard who had mastered the dark arts}
{ and a young woman who possessed the gift of foresight}
{ and a cunning thief who stole from the rich and gave to the poor}
{ and a wise old tree that had witnessed centuries of history}

Notice how none of the results are grammatical? This is the norm.

The UI is so incredibly impressive though and the surreality of the results has been fun to play with.

@alex-calderwood
Copy link
Author

Screenshot 2024-04-25 at 9 40 54 PM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant