f34558af07
add a rpc in-flight limiter
2025-05-01 08:56:57 +02:00
e4c9a8cd53
block manager: avoid deadlock in fix_block_location ( fix #845 )
2025-02-14 17:41:50 +01:00
d0104b9f9b
block manager: write blocks only to currently active layout version ( fix #815 )
...
avoid wastefully writing blocks to nodes that will discard them as soon
as the layout migration is finished
2025-02-14 16:45:55 +01:00
620dc58560
remove async_trait for traits declared in garage_net
2025-02-05 20:22:16 +01:00
8bfc16ba7d
Merge branch 'main' into next-0.10
2024-03-28 15:01:05 +01:00
85f580cbde
[fix-buffering] change request sending strategy and fix priorities
...
remove LAS, priorize new requests but otherwise just do standard queuing
2024-03-27 16:22:40 +01:00
0d3e285d13
[fix-buffering] implement block_ram_buffer_max to avoid excessive RAM usage
2024-03-27 16:22:40 +01:00
f7cd4eb600
Merge branch 'main' into next-0.10
2024-03-26 16:34:40 +01:00
ba33bb31f1
[check-data-dir] add marker files in data directories ( fix #601 )
2024-03-20 15:20:25 +01:00
3165ab926c
[block-ref-repair] rename rc's rc field to rc_table
2024-03-19 16:20:22 +01:00
dc0b78cdb8
[block-ref-repair] Block refcount recalculation and repair
...
- We always recalculate the reference count of a block before deleting
it locally, to make sure that it is indeed zero.
- If we had to fetch a remote block but we were not able to get it,
check that refcount is indeed > 0.
- Repair procedure that checks everything
2024-03-19 16:20:22 +01:00
0038ca8a78
Merge branch 'main' into next-0.10
2024-03-18 20:19:30 +01:00
7c86ff6c37
[disable-scrub] implement a disable_scrub configuration option
2024-03-14 17:01:16 +01:00
05c92204ec
[rm-sled] Remove counted_tree_hack
2024-03-08 15:09:57 +01:00
57acc60082
[sse-c] Implement SSE-C encryption
2024-03-07 15:43:47 +01:00
4b978b7533
Merge branch 'main' into next-0.10
2024-02-26 18:55:24 +01:00
b76c0c102e
[refactor-put] add ordering tag to blocks being sent to storage nodes
2024-02-26 18:35:11 +01:00
916c67ccf4
Merge branch 'main' into next-0.10
2024-02-23 16:50:34 +01:00
6ee691e65f
[refactor-block] simplify some more
2024-02-23 12:50:10 +01:00
e9c42bca34
[refactor-block] add DataBlockStream type
2024-02-23 12:22:29 +01:00
cd1069c1d4
[refactor-block] refactor DataBlock and DataBlockPath
2024-02-23 12:15:52 +01:00
07c7895948
[refactor-block] simplify rpc_get_block
2024-02-23 11:54:40 +01:00
9b41f4ff20
[refactor-block] move read_stream_to_end to garage_net
2024-02-23 11:46:57 +01:00
93552b9275
[refactor-block] Remove redundant BlockStream type
2024-02-23 11:33:38 +01:00
eb4a6ce106
Merge branch 'main' into next-0.10
2024-02-15 14:06:34 +01:00
5ea24254a9
[import-netapp] import Netapp code into Garage codebase
2024-02-15 12:15:07 +01:00
cf2af186fc
Merge branch 'main' into next-0.10
2024-02-13 11:36:28 +01:00
22332e6c35
[dep-upgrade-202402] simplify/refactor GetObject
2024-02-05 20:26:33 +01:00
5dd200c015
layout: move block_read_nodes_of to rpc_helper to avoid double-locking
...
(in theory, this could have caused a deadlock)
2023-12-08 12:02:24 +01:00
d6d239fc79
block manager: read_block using old layout versions if necessary
2023-11-27 11:52:57 +01:00
33c8a489b0
layou: implement ack locking
2023-11-15 15:40:44 +01:00
90e1619b1e
table: take into account multiple write sets in inserts
2023-11-14 15:40:46 +01:00
3b361d2959
layout: prepare for write sets
2023-11-14 14:28:16 +01:00
8a2b1dd422
wip: split out layout management from System into separate LayoutManager
2023-11-09 12:55:36 +01:00
7f9ba49c71
block manager: remove data_dir field
2023-09-11 11:57:36 +02:00
be91ef6294
block manager: fix bug where rebalance didn't delete old copies
2023-09-07 16:04:03 +02:00
6b008b5bd3
block manager: add rebalance operation to rebalance multi-hdd setups
2023-09-07 13:44:11 +02:00
99ed18350f
block manager: refactor and fix monitoring/statistics
2023-09-07 12:41:36 +02:00
f38a31b330
block manager: avoid incorrect data_dir configs and avoid losing files
2023-09-06 17:49:30 +02:00
a44f486931
block manager: refactoring & increase max worker count to 8
2023-09-06 16:35:28 +02:00
93114a9747
block manager: refactoring
2023-09-06 16:35:28 +02:00
1b8c265c14
block manager: get rid of check_block_status
2023-09-06 16:35:28 +02:00
a09f86729c
block manager: move blocks in write_block if necessary
2023-09-06 16:35:28 +02:00
887b3233f4
block manager: use data paths from layout
2023-09-06 16:35:28 +02:00
6c420c0880
block manager: multi-directory layout computation
2023-09-06 16:35:28 +02:00
71c0188055
block manager: skeleton for multi-hdd support
2023-09-06 16:35:28 +02:00
e7e164a280
Make fsync an option for meta and data
2023-06-09 16:23:21 +02:00
9c788059e2
block/manager.rs: In is_block_compressed - check which compression_level
...
is configured on a node and check for raw block first if compression is
disabled (to help reduce syscalls during a scrub).
2023-05-09 10:28:19 +01:00
d218f475cb
block/manager.rs: Set defaults for scrub_persister.
2023-03-09 17:08:47 +00:00
148b66b843
block/manager.rs: Display scrub-next-run.
2023-03-06 13:43:09 +00:00
Quentin Dufour