Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Galexie: Add retry/backoff on resumability datastore requests #5516

Open
chowbao opened this issue Nov 5, 2024 · 0 comments
Open

Galexie: Add retry/backoff on resumability datastore requests #5516

chowbao opened this issue Nov 5, 2024 · 0 comments

Comments

@chowbao
Copy link
Contributor

chowbao commented Nov 5, 2024

If resumability encounters an error due to remote DataStore errors, during FindStart we should have a retry/backoff routine, with defaults, external config for tuning not necessary.

If after retrying the request x(threshold) times still fails we should propagate that error back to the caller.

for context, a full history data lake mayt require up to about 25 remote DataStore.Exists requests, so, to address possible transient errors due to remote link.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Backlog
Development

No branches or pull requests

1 participant