我正在尝试使用 Rusoto 从存储桶中下载文件,我正在获取文件内容:
fn get_object(client: &TestClient, bucket: &str, filename: &str) {
let get_req = GetObjectRequest {
bucket: bucket.to_owned(),
key: filename.to_owned(),
..Default::default()
};
let result = client.get_object(&get_req).sync().expect("Couldn't GET object");
let stream = result.body.unwrap();
let body = stream.concat2().wait().unwrap();
assert!(body.len() > 0);
}
如何将此 GetObjectOutput(result)
对象保存到文件中?
最佳答案
Rusoto 现在使用标准库 futures 并且不再提供 sync
方法,所以之前的答案不再有效。
读入内存
use futures::stream::TryStreamExt;
use rusoto_core::Region;
use rusoto_s3::{GetObjectRequest, S3Client, S3};
type Error = Box<dyn std::error::Error>;
type Result<T, E = Error> = std::result::Result<T, E>;
const BUCKET_NAME: &str = "my very own bucket name";
#[tokio::main]
async fn main() -> Result<()> {
let client = S3Client::new(Region::UsEast2);
let mut object = client
.get_object(GetObjectRequest {
bucket: BUCKET_NAME.into(),
..Default::default()
})
.await?;
let body = object.body.take().expect("The object has no body");
let body = body.map_ok(|b| b.to_vec()).try_concat().await?;
println!("body length: {}", body.len());
Ok(())
}
AWS_ACCESS_KEY_ID
和 AWS_SECRET_ACCESS_KEY
需要指定。我选择在代码之外设置环境变量。
流式传输到文件
use rusoto_core::Region;
use rusoto_s3::{GetObjectRequest, S3Client, S3};
use tokio::{fs::File, io};
type Error = Box<dyn std::error::Error>;
type Result<T, E = Error> = std::result::Result<T, E>;
const BUCKET_NAME: &str = "my very own bucket name";
#[tokio::main]
async fn main() -> Result<()> {
let client = S3Client::new(Region::UsEast2);
let mut object = client
.get_object(GetObjectRequest {
bucket: BUCKET_NAME.into(),
..Default::default()
})
.await?;
let body = object.body.take().expect("The object has no body");
let mut body = body.into_async_read();
let mut file = File::create("/tmp/a-place-to-write").await?;
io::copy(&mut body, &mut file).await?;
Ok(())
}
虽然 ByteStream
有一个诱人的 into_blocking_read
方法,不推荐使用。如果你试图在异步上下文中使用它,你会感到 panic ,因为它启动了一个嵌套的 Tokio 执行器。如果您在异步上下文之外使用它,它将 truncate the data除非您非常小心地使用异步运行时,但不要在中。
另见:
- Writing a chunk stream to a file asynchronously using hyper
- How do I write a futures::Stream to disk without storing it entirely in memory first?
依赖版本
[dependencies]
rusoto_s3 = "0.43.0"
rusoto_core = "0.43.0"
tokio = { version = "0.2.21", features = ["macros"] }
futures = "0.3.5"
关于file - 如何将使用 Rusoto 从 S3 下载的文件保存到我的硬盘?,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/51287360/