Compare commits

..

64 Commits

Author SHA1 Message Date
Alex Auvolat 0e05b9bc77 cargo fmt 2021-04-17 20:30:43 +02:00
Alex Auvolat 163ee977a0 Small improvements to compression code 2021-04-14 23:37:41 +02:00
Alex 307858bf0a Merge pull request 'Compress with zstd' (#44) from trinity-1686a/garage:zstd-block into main
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/44
2021-04-14 23:27:33 +02:00
Alex Auvolat 76efb4999d re-disable drone caches 2021-04-08 20:13:28 +02:00
Alex Auvolat 6e28ea6bdc Use pre-prepared Docker image in CI to speed things up 2021-04-08 20:06:48 +02:00
Alex Auvolat 7ba80b6108 Update drone CI signature 2021-04-08 19:55:20 +02:00
Alex e2e8ea4df5 Merge pull request 'Make CI faster' (#57) from trinity-1686a/garage:improve-ci into main
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/57
2021-04-08 19:55:07 +02:00
Trinity Pointard 992284d545 use volume for cargo home
so it gets preserved between steps, and registry download is done only once
2021-04-08 17:08:26 +02:00
Trinity Pointard d4fd074000 use zstd checksumming 2021-04-08 15:44:08 +02:00
Trinity Pointard aeadb071c6 delete plain block when getting a compressed one 2021-04-08 15:42:14 +02:00
Trinity Pointard 4d5263ccf3 change extention for compressed files
set_extension don't behave verywell with extensions containing multiple dots
2021-04-08 15:42:14 +02:00
Trinity Pointard e4b66a9e28 add testing on compressible data in smoke test 2021-04-08 15:42:14 +02:00
Trinity Pointard 9215d63e3a add checksum to end of file instead of decompressing 2021-04-08 15:42:12 +02:00
Trinity Pointard 01c623e391 use BlockData instead of Vec+bool 2021-04-08 15:41:27 +02:00
Trinity Pointard de8e47435f compress blocs with zstd 2021-04-08 15:38:31 +02:00
Alex Auvolat 7560a41ab1 fix drone CI signature 2021-04-08 15:30:07 +02:00
Alex Auvolat 898fd1dc81 Skip Drone CI caching 2021-04-08 15:29:22 +02:00
Alex Auvolat af6774a511 change a few comments 2021-04-08 15:13:02 +02:00
Alex c35c472dc9 Merge pull request 'add doc comments' (#53) from trinity-1686a/garage:doc-comments into main
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/53
2021-04-08 15:01:13 +02:00
Trinity Pointard 718ae00548 change some more comments and revert changes on TableSchema 2021-04-07 13:39:34 +02:00
Alex Auvolat c3bd672d58 Reorganize code in s3_put.rs 2021-04-07 10:00:47 +02:00
Alex Auvolat 93a9f96130 remove useless comment 2021-04-06 23:38:30 +02:00
Alex 7380f3855c Merge pull request 'Use content defined chunking' (#43) from trinity-1686a/garage:content-defined-chunking into main
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/43
2021-04-06 22:18:41 +02:00
Trinity Pointard 6cbc8d6ec9 mark branch as unreachable 2021-04-06 16:53:39 +02:00
Trinity Pointard c8906f200b make most requested changes 2021-04-06 05:28:47 +02:00
Trinity Pointard 653d3d588f document garage crate 2021-04-06 05:26:48 +02:00
Trinity Pointard a74eccfd6e document api crate 2021-04-06 05:26:48 +02:00
Trinity Pointard ee9b685994 document web crate 2021-04-06 05:26:48 +02:00
Trinity Pointard 92d54770bb attempt at documenting model crate 2021-04-06 05:26:48 +02:00
Trinity Pointard 30bec0758b attempt at documenting table crate 2021-04-06 05:26:48 +02:00
Trinity Pointard b476b702c8 run cargo fmt on util and make missing doc warning 2021-04-06 05:26:47 +02:00
Trinity Pointard 7d3a951836 document rpc crate 2021-04-06 05:26:36 +02:00
Trinity Pointard f4bf987627 document util crate 2021-04-06 05:25:35 +02:00
Trinity Pointard b3b0b20d72 run fmt 2021-04-06 02:54:05 +02:00
Trinity Pointard 47d0aee9f8 change crate used for cdc
previous one seemed to output incorrect results
2021-04-06 02:50:07 +02:00
Trinity Pointard 6e0cb2dfb6 add content defined chuking 2021-04-06 02:50:07 +02:00
Alex Auvolat c4c4b7dedc Update documentation 2021-04-06 00:01:49 +02:00
Alex 8225fa2e4b Merge pull request 'Improved bootstraping procedure' (#56) from better_bootstrap into main
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/56
2021-04-05 23:50:33 +02:00
Alex Auvolat ab67bd88de Try to fix Drone 2021-04-05 23:41:50 +02:00
Alex Auvolat 0f192a96b5 small simplify 2021-04-05 23:21:25 +02:00
Alex Auvolat 7b85056942 Merge discovery loop with consul 2021-04-05 23:04:08 +02:00
Alex Auvolat 7fd1f9a869 cargo fmt 2021-04-05 20:42:57 +02:00
Alex Auvolat c5d8dc7d6d Print stats 2021-04-05 20:42:46 +02:00
Alex Auvolat fa11cb746a Cargo fmt 2021-04-05 20:35:26 +02:00
Alex Auvolat f11bd80d2a Keep old data 2021-04-05 20:33:24 +02:00
Alex Auvolat 595dc0ed0d Persist directly and not in background 2021-04-05 20:26:01 +02:00
Alex Auvolat 78eeaab5ed Install rustfmt 2021-04-05 20:00:48 +02:00
Alex Auvolat 22fbb3b892 Fix Drone CI signature 2021-04-05 19:58:42 +02:00
Alex Auvolat 0eb5baea1a Improve bootstraping: do it regularly; persist peer list 2021-04-05 19:55:53 +02:00
Alex Auvolat 7d772737a5 Add signature to Drone CI 2021-04-05 12:10:28 +02:00
Alex Auvolat 4c2d8f5a96 test2 2021-04-05 12:09:20 +02:00
Alex Auvolat 0325086dac test 2021-04-05 12:08:05 +02:00
Alex Auvolat 700925263f Drone CI badge on branch main 2021-04-05 11:45:20 +02:00
Alex Auvolat 6c83f66700 fix command for adding node 2021-04-02 23:23:14 +02:00
Alex Auvolat 55e4a93bad Section on recovering from failures 2021-04-02 19:30:29 +02:00
LUXEY Adrien 9cb9945131 [doc] Added mention that GarageHQ is hosted with Garage 2021-03-22 16:19:58 +01:00
Alex Auvolat 7f9c1d5595 publish website only in correct repo 2021-03-22 12:49:21 +01:00
Alex Auvolat 991cf1b818 fix typos 2021-03-19 17:55:10 +01:00
Alex Auvolat e26cb2640d Merge remote-tracking branch 'origin/feature/mdbook' 2021-03-19 17:49:57 +01:00
Alex 22041e924b Merge pull request 'intro.md: fix some typos, errors & dead links, plus some stylistic stuff' (#51) from adrien/garage:feature/mdbook into feature/mdbook
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/51
2021-03-19 17:14:41 +01:00
LUXEY Adrien b119e9d3c4 intro.md: fix some typos, errors & dead links, plus some stylistic stuff
modifié :         doc/book/src/intro.md
2021-03-19 16:51:05 +01:00
Quentin Dufour 3e6534d7a8 Fix garage_util description 2021-03-18 11:46:29 +01:00
Quentin Dufour 2dae4a25d6 Fix some typos 2021-03-18 11:35:50 +01:00
Quentin Dufour fcd566e89d Fix a table in the doc 2021-03-18 11:26:02 +01:00
+1 -9
View File
@@ -599,19 +599,11 @@ impl BlockManager {
Err(_) => continue,
};
let ent_type = data_dir_ent.file_type().await?;
let mut iter_name = name.split('.');
let name = iter_name
.next()
.expect("split always contain at least one item");
let corrupted = iter_name
.last()
.map(|ext| ext == "corrupted")
.unwrap_or(false);
if name.len() == 2 && hex::decode(&name).is_ok() && ent_type.is_dir() {
self.repair_aux_read_dir_rec(&data_dir_ent.path(), must_exit)
.await?;
} else if name.len() == 64 && !corrupted {
} else if name.len() == 64 {
let hash_bytes = match hex::decode(&name) {
Ok(h) => h,
Err(_) => continue,