Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix partial sstable writes #31

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

fix partial sstable writes #31

wants to merge 3 commits into from

Conversation

thomasjungblut
Copy link
Owner

@thomasjungblut thomasjungblut commented Jul 31, 2024

In some failure scenarios we might have inconsistent data and index
files. This adds seeking support to recordio writers, which can be used
to rewind partially written data records.


todo testing:

  • if the last sstable partial record was never overwritten by a new record, the iterator might still return it (or at least fail the EOF assertion)
  • more boundary testing for the recordio aspect of the buffering

In some failure scenarios we might have inconsistent data and index
files. This adds seeking support to recordio writers, which can be used
to rewind partially written data records.
@thomasjungblut thomasjungblut mentioned this pull request Sep 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant