Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multiple prefixes on one cluster #1

Open
jseed opened this issue Dec 20, 2016 · 0 comments
Open

Multiple prefixes on one cluster #1

jseed opened this issue Dec 20, 2016 · 0 comments

Comments

@jseed
Copy link
Contributor

jseed commented Dec 20, 2016

It would save alot of time (and money) to run backups for multiple smaller prefixes on one cluster.
This functionality can be added by editing the step producer python script to treat the filter argument as a list of comma seperated values.
For our use case, we cannot change the current format of the backups in s3. This causes an issue as the s3 destination for backups is currently passed in an argument for each prefix.
A possible solution is to also pass in the s3 destinations as a matching list of comma seperated values, but this would require bigger changes to the step producer, as well as changes to the invoking script, as the producer currently produces only one s3path.info.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant