Ticket Hash: | bb6d227d92cbfb3931d17cb49e0763a05030082d | |||
Title: | Pipelined put! | |||
Status: | Open | Type: | Feature_Request | |
Severity: | UNSPECIFIED | Priority: | 2_Medium | |
Subsystem: | Backends | Resolution: | Open | |
Last Modified: | 2020-05-28 14:33:57 | |||
Version Found In: | ||||
Description: | ||||
Improve performance over high-latency links by making the
import-storage procedure not block for the response from put!
requests, but to increment a "pending responses" counter.
Then make
all calls *other* than That will enable us to
pipeline | ||||
User Comments: | ||||
alaric added on 2020-05-28 14:33:57:
If we use bokbok as a backend access protocol, we can have multiple put! requests inflight. In which case, the techniques in this ticket can be applied to snapshotting as well: https://www.kitten-technologies.co.uk/project/ugarit/tktview/97b608385736f7f946bc3b3b2a037b0b8945306e OR we could continue with the original plan, kind of, and make put! fire off a thread (subject to a concurrency limit) to do the actual put, and put any errors returned into an error queue to be returned from the next operation on that storage that returns. |