Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Zeno v2 #166

Draft
wants to merge 128 commits into
base: main
Choose a base branch
from
Draft

Zeno v2 #166

wants to merge 128 commits into from

Conversation

equals215
Copy link
Member

No description provided.

equals215 and others added 30 commits November 18, 2024 15:10
CorentinB and others added 29 commits November 25, 2024 17:33
…170)

* chore: upgrade warc lib

* pause: add working pubsub pause mechanism

* pause: discard the Range() value variable as it's not used

* pause: add handler to block a routine until resume is issued and add E2E test

* finisher: add integration with the control package for pause/resume mechanism

* finisher: get err from WaitUntilResume() and panic if err

* control: changed the pause/resume to a semaphore based approach

* finisher: changed the use of controler pause/resume

* changed package name from control to controler

* rename control.go to controler.go

* preprocessor: add pause implementation

* postprocessor: add pause implementation

* archiver: add pause implementation

* pause: discard the Range() value variable as it's not used

* controler: add diskWatcher components and unit tests

* controler: start/stop the pipeline and control it's flow ; global: moved all init logic to cmd and left main calling cmd only

* controler: diskWatcher threshold changed to 50GB

* go mod tidy

* finish dev/v2 merge and corerct postprocessor logic error

---------

Co-authored-by: Corentin Barreau <corentin.barreau24@gmail.com>
* cmd: add new logging flags ; log: change log config responsibility to log package

* cmd: add valid time suration to file rotation flag

* log: set default log output directory

* logger: init logger in control package as config will already have been init
…tines get closed on ctx then inter-routines channels get closed to avoid send on closed channel
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants