Struct ChunkingBlobEngine 

pub struct ChunkingBlobEngine<BS, CS> {
    blob_store: BS,
    chunk_store: CS,
    fetch_concurrency: usize,
    upload_concurrency: usize,
    avg_chunk_size: u32,
}

A BlobEngine that will first query BlobStore to retrieve more granular chunking, then use the ChunkStore to render the blob.

Fields

blob_store: BS

BlobStore that’s used.

chunk_store: CS

Used ChunkStore.

fetch_concurrency: usize

How many chunks to fetch in parallel for each reader

upload_concurrency: usize

How many chunk writes to do in parallel for each writer

avg_chunk_size: u32

The average chunk size to use when chunking writes. Uses half of that as minimum, and double as maximum.

Implementations

impl<BS, CS> ChunkingBlobEngine<BS, CS>

pub fn builder() -> ChunkingBlobEngineBuilder<BS, CS, ((), (), (), (), ())>

Create a builder for building ChunkingBlobEngine. On the builder, call .blob_store(...), .chunk_store(...), .fetch_concurrency(...)(optional), .upload_concurrency(...)(optional), .avg_chunk_size(...)(optional) to set the values of the fields. Finally, call .build() to create the instance of ChunkingBlobEngine.

Trait Implementations

impl<BS, CS> BlobEngine for ChunkingBlobEngine<BS, CS>

where BS: BlobStore, CS: ChunkStore + Clone + 'static,

fn has<'life0, 'life1, 'async_trait>( &'life0 self, digest: &'life1 B3Digest, ) -> Pin<Box<dyn Future<Output = Result<bool, Error>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Check if the blob with this digest exists.

fn open_read<'life0, 'life1, 'async_trait>( &'life0 self, digest: &'life1 B3Digest, size_hint: Option<u64>, ) -> Pin<Box<dyn Future<Output = Result<Option<Box<dyn Reader + 'static>>, Error>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Request a blob from the store for reading. An optional size_hint can be specified, allowing some implementations to optimize.

fn open_write<'a, 'async_trait>( &'a self, ) -> Pin<Box<dyn Future<Output = Box<dyn Writer + 'a>> + Send + 'async_trait>>

where Self: 'async_trait, 'a: 'async_trait,

Allows writing a new blob. Returns a crate::blobstore::Writer, which implements tokio::io::AsyncWrite and has a close method to finalize the blob and get its digest.