fc8fc60f6d
emit internal error when we detect race condition ( #1053 ) ( fix #1050 )
...
i went with a `500`/`InternalError`/`Please try again.` because that is something i've seen AWS S3 report while developing other software, and i'm not convinced all clients would understand a 409 conflict properly (GET don't usually conflict)
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/1053
Co-authored-by: trinity-1686a <trinity@deuxfleurs.fr >
Co-committed-by: trinity-1686a <trinity@deuxfleurs.fr >
2025-05-30 16:24:12 +00:00
ffbce0f689
speed up UploadPartCopy
...
(cherry picked from commit db54bf96c7
2025-05-23 20:36:32 +02:00
8654eb19bf
implement repair procedure to fix inconsistent bucket aliases
2025-05-22 19:34:38 +02:00
2ade8c86f6
more resilience to inconsistent alias states
2025-05-22 19:12:05 +02:00
be16bc7a05
Merge pull request 'Fix behavior of CopyObject wrt x-amz-website-redirect-location' ( #1037 ) from Armael/garage:copy-website-redirect into main
...
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/1037
2025-05-22 13:57:28 +00:00
bfaa1ca6b7
Merge pull request 'api: lifecycle: 404 if missing lifecycle config' ( #1043 ) from ragazenta/garage:no-lifecycle-response into main
...
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/1043
2025-05-22 13:56:52 +00:00
ae3f7ee76c
api: lifecycle: 404 if missing lifecycle config
2025-05-22 19:33:54 +07:00
c6bc3f229b
Fix behavior of CopyObject wrt x-amz-website-redirect-location
2025-05-22 14:03:11 +02:00
bba9202f31
add test for punycode
2025-05-19 20:36:03 +02:00
a605a80806
support punnycode in api/web endpoint
2025-05-19 18:11:55 +02:00
539af12d21
allow punnycode in bucket name
2025-05-19 18:07:04 +02:00
9ec3f8cc3c
metadata: Create compact LMDB snapshots
...
See #1006
LMDB files never shrink, so we can end up with a large database that
contains a smaller amount of actual data.
Compacting the snapshots is an easy win: it will write faster to disk,
take less space, and if needed you can reimport an already-compacted
snapshot as the main database.
2025-04-12 23:18:50 +02:00
a7d845a999
change aws-sdk features to avoid using aws-lc which doesn't compile on i686/arm
2025-03-20 17:05:43 +01:00
12f15c4c2b
fix readme paths in cargo.toml for new crates
2025-03-05 11:00:19 +01:00
4689b10448
bump version to v1.1.0
2025-03-05 10:19:51 +01:00
c5237c31e7
Merge pull request 'Implement all HTTP preconditions in GetObject/HeadObject' ( #967 ) from fix-804 into main
...
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/967
2025-02-19 17:31:26 +00:00
f87943a39d
tests: add test for http preconditions
2025-02-19 18:26:03 +01:00
c0846c56fe
api: unify http precondition handling
2025-02-19 18:14:27 +01:00
1cb0ae10a8
Merge pull request 'fix crash in layout computation when changing all nodes of a zone to gateway mode' ( #937 ) from baptiste/garage:fix_layout_crash into main
...
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/937
Reviewed-by: Alex <lx@deuxfleurs.fr >
2025-02-19 17:09:10 +00:00
1a8f74fc94
api: GetObject: implement if-match and if-unmodified-since
2025-02-19 17:26:29 +01:00
bf27a3ec98
web: implement x-amz-website-redirect-location
2025-02-19 17:04:10 +01:00
6d38907dac
test: verify saved checksums in streaming putobject tests
2025-02-18 22:02:04 +01:00
cfe8e8d45c
api: PutObject: save trailer checksum in metadata
2025-02-18 21:56:32 +01:00
f6e805e7db
api: various fixes
2025-02-18 21:47:53 +01:00
45e10e55f9
update aws-sdk-s3 in tests and fix wrong checksumming behavior in GetObject
2025-02-18 15:33:42 +01:00
730bfee753
api: validate trailing checksum + add test for unsigned-paylad-trailer
2025-02-18 15:33:42 +01:00
ccab0e4ae5
api: fix optional \n after trailer checksum header
2025-02-18 15:33:42 +01:00
abb60dcf7e
api: remove content-encoding: aws-chunked for streaming payload
2025-02-18 15:33:42 +01:00
f8b0817ddc
api: streaming signature: fix trailer parsing
2025-02-18 12:00:41 +01:00
21c0dda16a
api: refactor: move checksumming code around again
2025-02-17 20:11:06 +01:00
658541d812
api: use checksumming in api_common::signature for put/putpart
2025-02-17 19:54:25 +01:00
c5df820e2c
api: start refactor of signature to calculate checksums earlier
2025-02-17 18:47:06 +01:00
a04d6cd5b8
api: streaming: parse unsigned streaming bodies and payload trailers
2025-02-17 16:23:24 +01:00
44a896f9b5
api: add logic to parse x-amz-content-sha256
2025-02-16 18:25:35 +01:00
cee7560fc1
api: refactor: move checksum algorithms to common
2025-02-16 17:25:55 +01:00
2f0c5ca220
signature: refactor: move constant defs to mod.rs
2025-02-16 16:34:18 +01:00
859b38b0d2
Merge pull request 'fix compilation warnings' ( #959 ) from fixes into main
...
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/959
2025-02-14 17:32:30 +00:00
2729a71d9d
fix warning in garage test
2025-02-14 18:27:00 +01:00
c9d00f5f7b
garage_api_s3: remove unused field in ListPartsQuery
2025-02-14 18:25:23 +01:00
24470377c9
garage_model: fix warning about dead code
2025-02-14 18:12:14 +01:00
5b26545abf
fix deprecated uses of chrono in lifecycle worker
2025-02-14 18:08:23 +01:00
165f9316e2
s3api: return Location in CompleteMultipartUpload ( fix #852 )
...
NB. The location returned is not guaranteed to work in all cases.
This already fixes the parse issue in #852 .
2025-02-14 18:05:07 +01:00
e4c9a8cd53
block manager: avoid deadlock in fix_block_location ( fix #845 )
2025-02-14 17:41:50 +01:00
fdf4dad728
block resync: avoid saving blocks to draining nodes
2025-02-14 16:45:55 +01:00
6820b69f30
block manager: improve read strategy to find blocks faster
2025-02-14 16:45:55 +01:00
d0104b9f9b
block manager: write blocks only to currently active layout version ( fix #815 )
...
avoid wastefully writing blocks to nodes that will discard them as soon
as the layout migration is finished
2025-02-14 16:45:55 +01:00
3fe8db9e52
Merge pull request 'web_server.rs: Added bucket domain to observability' ( #608 ) from jpds/garage:domain-web-requests into main
...
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/608
2025-02-14 14:26:08 +00:00
627a37fe9f
Merge pull request 's3 api: parse x-id query parameter and warn of any inconsistency ( fix #822 )' ( #954 ) from fix-822 into main
...
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/954
2025-02-14 14:07:01 +00:00
2f55889835
add configuration option to enable/disable monitoring bucket in web metrics
2025-02-14 14:59:00 +01:00
8b9cc5ca3f
web_server.rs: Added bucket domain to observability.
2025-02-14 14:36:20 +01:00
trinity-1686a