Module concurrent_uploads 

Concurrent blob uploads.

Structs

ConcurrentBlobUploader

The concurrent blob uploader provides a mechanism for concurrently uploading small blobs. This is useful when ingesting from sources like tarballs and archives which each blob entry must be read sequentially. Ingesting many small blobs sequentially becomes slow due to round trip time with the BlobEngine. The concurrent blob uploader will buffer small blobs in memory and upload them to the BlobEngine in the background.

Enums

Error

Constants

CONCURRENT_BLOB_UPLOAD_THRESHOLD 🔒

Files smaller than this threshold, in bytes, are uploaded to the BlobEngine in the background.

MAX_BUFFER_SIZE 🔒

The maximum amount of bytes allowed to be buffered in memory to perform async blob uploads.

Functions

upload_blob 🔒