Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use the objects API for directory download/upload #82

Open
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

TingDaoK
Copy link
Contributor

Issue #, if available:

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

runners/s3-benchrunner-rust/src/main.rs Outdated Show resolved Hide resolved
runners/s3-benchrunner-rust/src/main.rs Outdated Show resolved Hide resolved
runners/s3-benchrunner-rust/src/transfer_manager.rs Outdated Show resolved Hide resolved
runners/s3-benchrunner-rust/src/transfer_manager.rs Outdated Show resolved Hide resolved
runners/s3-benchrunner-rust/src/transfer_manager.rs Outdated Show resolved Hide resolved
runners/s3-benchrunner-rust/src/transfer_manager.rs Outdated Show resolved Hide resolved
runners/s3-benchrunner-rust/src/transfer_manager.rs Outdated Show resolved Hide resolved
Copy link
Contributor

@graebm graebm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bunch of trivial stuff

@@ -6,12 +6,15 @@ edition = "2021"
[dependencies]

# Swap which line is commented-out to use GitHub or local aws-s3-transfer-manager
aws-s3-transfer-manager = { git = "https://github.com/awslabs/aws-s3-transfer-manager-rs.git", rev = "790ead476a104cf0b66fdd00b5b9c3636321b244" }
aws-s3-transfer-manager = { git = "https://github.com/awslabs/aws-s3-transfer-manager-rs.git", rev = "e48ef1b0cb573bd7dbb99d426824587bfc73270a" }
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there are 3 newer commits (latest is 06c087a5d53676bb048f6c512b8eb1fda63f03d5)
use one of those if you can

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks like there are some api change

runners/s3-benchrunner-rust/src/transfer_manager.rs Outdated Show resolved Hide resolved
runners/s3-benchrunner-rust/src/transfer_manager.rs Outdated Show resolved Hide resolved
runners/s3-benchrunner-rust/src/transfer_manager.rs Outdated Show resolved Hide resolved
runners/s3-benchrunner-rust/src/transfer_manager.rs Outdated Show resolved Hide resolved
runners/s3-benchrunner-rust/src/transfer_manager.rs Outdated Show resolved Hide resolved
runners/s3-benchrunner-rust/src/transfer_manager.rs Outdated Show resolved Hide resolved
runners/s3-benchrunner-rust/src/transfer_manager.rs Outdated Show resolved Hide resolved
runners/s3-benchrunner-rust/src/transfer_manager.rs Outdated Show resolved Hide resolved
match &self.handle.transfer_path {
Some(transfer_path) => {
// Use the objects API to download/upload directory directly
match workload_config.tasks[0].action {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What if first task is download but second is upload?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants