This repository was archived by the owner on Jul 28, 2025. It is now read-only.
Add BlockBlobDatabase as TES database option #194
Draft
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This implementation can be used to store TesTasks in Azure Storage instead of PostgreSQL, and reduces Azure resource count and cost (#226 ).
Features
Implementation notes
List Blobs operation:Current limitations
ListTasks by name_prefixsince this would require downloading every single blob to get the name, or, an alternative implementation (one idea would be to store a separate blob that has all name+id tuples (which could result in contention issues for create/update/delete since a lease would need to be held), OR, to store 2 blobs for every TesTask - one for the existing TesTask, and another that's empty but has a blob name that is the TES task name with special characters encoded and the ID as the suffix, which would enable fast query byList Blobs operation, then extract the IDs from the name and then download by ID as the current LIST implementation does)