Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Config option to change hard limit on term retrieval #810

Open
jamesamcl opened this issue Nov 26, 2024 · 2 comments
Open

Config option to change hard limit on term retrieval #810

jamesamcl opened this issue Nov 26, 2024 · 2 comments

Comments

@jamesamcl
Copy link
Member

CC EVORA-project/ictv-ontology#16

@henrietteharmse
Copy link
Collaborator

We can look into increasing this limit may be to 10000. However, in load tests we have done last year fetching 100000 rows from 10 concurrent requests brought solr down. For that reason I will caution against implementing size=all.

@henrietteharmse
Copy link
Collaborator

A possible workaround is to make this a configurable parameter in the OLS backend. This will allow installations of OLS that could afford more hardware or installations with limited load, to change this and retrieve as many results as they want.

If such a config is added to OLS, the default behaviour (when no config is provided) should be to limit the number of results returned, with a large number of results returned only in the presence of a config.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants