snix/tvix/store/src
Florian Klink d8ab140d25 feat(tvix/store): do not buffer blob data
Use the FastCDC::cut function to ask fastcd for cutting points as we
receive the data. Make sure to keep the last chunk in the temporary
buffer, as we might not actually cut at the end.

Also, use rayon to calculate the blake3 hash if the input data is
> 128KiB.

Change-Id: I6195f3b74eac5516965cb12d8d026aa720c8b891
Reviewed-on: https://cl.tvl.fyi/c/depot/+/8135
Reviewed-by: raitobezarius <tvl@lahfa.xyz>
Tested-by: BuildkiteCI
2023-03-10 10:58:55 +00:00
..
blobservice feat(tvix/store): add blobservice 2023-03-06 15:32:47 +00:00
chunkservice feat(tvix/store): add chunkservice 2023-03-06 15:32:47 +00:00
directoryservice feat(tvix/store): add directoryservice 2023-03-10 10:58:55 +00:00
nar feat(tvix/store): add NARCalculationService trait and impl 2023-03-10 10:58:55 +00:00
pathinfoservice feat(tvix/store): add pathinfoservice 2023-03-10 10:58:55 +00:00
proto feat(tvix/store): do not buffer blob data 2023-03-10 10:58:55 +00:00
tests chore(tvix/store): remove old implementations 2023-03-10 10:58:55 +00:00
blobreader.rs feat(tvix/store): add blobreader 2023-03-10 10:58:55 +00:00
errors.rs feat(tvix/store/blobservice): add GRPCBlobServiceWrapper 2023-03-10 10:58:55 +00:00
lib.rs chore(tvix/store): remove old implementations 2023-03-10 10:58:55 +00:00
main.rs feat(tvix/store): add --json arg 2023-03-10 10:58:55 +00:00