Commit Graph

  • e76f632907 Phase 1: Add smart prefetching foundation for ML workloads chrislu 2025-08-30 15:04:36 -07:00
  • 87021a1460 Merge branch 'master' into add-ec-vacuum add-ec-vacuum chrislu 2025-08-30 11:18:03 -07:00
  • 879d512b55 rename chrislu 2025-08-30 11:16:18 -07:00
  • bc91425632 S3 API: Advanced IAM System (#7160) Chris Lu 2025-08-30 11:15:48 -07:00
  • 87fe03f2c4 k8s: resizeHook avoids bitnami in values.yaml (#7181) Chris Lu 2025-08-29 21:14:44 -07:00
  • 40a7f09c60 chore(deps): bump tracing-subscriber from 0.3.19 to 0.3.20 in /seaweedfs-rdma-sidecar/rdma-engine (#7180) dependabot[bot] 2025-08-29 18:18:56 -07:00
  • 37423d777e chore(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.30.3 to 1.31.2 (#7176) dependabot[bot] 2025-08-27 19:30:05 -07:00
  • c63c822345 chore(deps): bump google.golang.org/protobuf from 1.36.7 to 1.36.8 (#7174) dependabot[bot] 2025-08-27 15:06:06 -07:00
  • 2ab9e3bd18 chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.37.2 to 1.38.1 (#7175) dependabot[bot] 2025-08-27 10:17:23 -07:00
  • d49f15a52b chore(deps): bump github.com/aws/aws-sdk-go-v2/credentials from 1.18.3 to 1.18.6 (#7171) dependabot[bot] 2025-08-27 10:17:12 -07:00
  • bf82edbec7 chore(deps): bump github.com/stretchr/testify from 1.10.0 to 1.11.0 (#7172) dependabot[bot] 2025-08-26 19:13:34 -07:00
  • aa438b4515 chore(deps): bump github.com/linxGnu/grocksdb from 1.10.1 to 1.10.2 (#7168) dependabot[bot] 2025-08-26 16:29:19 -07:00
  • 1aa9c80d0c chore(deps): bump github.com/ThreeDotsLabs/watermill from 1.4.7 to 1.5.0 (#7169) dependabot[bot] 2025-08-26 16:29:10 -07:00
  • d963b20950 chore(deps): bump github.com/Azure/azure-sdk-for-go/sdk/azidentity from 1.10.1 to 1.11.0 (#7170) dependabot[bot] 2025-08-26 16:29:04 -07:00
  • 9383e6fbab chore(deps): bump github.com/redis/go-redis/v9 from 9.12.0 to 9.12.1 (#7166) dependabot[bot] 2025-08-25 22:31:11 -07:00
  • ff2601c5ca chore(deps): bump github.com/minio/crc64nvme from 1.1.0 to 1.1.1 (#7167) dependabot[bot] 2025-08-25 22:30:55 -07:00
  • aee1e5dcf1 chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.86.0 to 1.87.1 (#7165) dependabot[bot] 2025-08-25 21:41:44 -07:00
  • ac449ea8d1 chore(deps): bump google.golang.org/grpc from 1.74.2 to 1.75.0 (#7164) dependabot[bot] 2025-08-25 21:41:35 -07:00
  • 0efc667e7f chore(deps): bump cloud.google.com/go/storage from 1.56.0 to 1.56.1 (#7163) dependabot[bot] 2025-08-25 21:41:28 -07:00
  • 4cd3ae27dc chore(deps): bump github.com/fluent/fluent-logger-golang from 1.10.0 to 1.10.1 (#7162) dependabot[bot] 2025-08-25 21:41:21 -07:00
  • ea08de9855 chore(deps): bump actions/dependency-review-action from 4.7.1 to 4.7.2 (#7161) dependabot[bot] 2025-08-25 20:34:19 -07:00
  • 7acebf11ea Master: volume assignment concurrency (#7159) Chris Lu 2025-08-23 21:02:30 -07:00
  • 91b88262d7 Fix volume allocation with max=0 and minFreeSpace - prevent allocate-then-delete behavior (#7147) Copilot 2025-08-23 13:03:53 -07:00
  • 41aedaa687 Shell: support regular expression for collection selection (#7158) Chris Lu 2025-08-23 11:04:24 -07:00
  • a367c39967 weed/mount: refactor to use atomic type (#7157) cui 2025-08-24 01:22:17 +08:00
  • fd1a7b5e62 Helm Chart: support wildcards for s3-ingress host by quoting value (#7155) Thilo-Alexander Ginkel 2025-08-23 18:31:14 +02:00
  • 7d509feef6 S3 API: Add integration with KMS providers (#7152) Chris Lu 2025-08-22 22:10:30 -07:00
  • 34773c8e13 S3 API: conditional read and write (#7154) Chris Lu 2025-08-22 16:58:09 -07:00
  • 50530e2553 S3 API: Add SSE-S3 (#7151) Chris Lu 2025-08-22 01:15:42 -07:00
  • 05d3ad25ce chore(deps): bump github.com/go-viper/mapstructure/v2 from 2.3.0 to 2.4.0 in /seaweedfs-rdma-sidecar (#7150) dependabot[bot] 2025-08-21 09:03:42 -07:00
  • b7b73016dd S3 API: Add SSE-KMS (#7144) Chris Lu 2025-08-21 08:28:07 -07:00
  • 111fc5c054 chore(deps): bump github.com/go-viper/mapstructure/v2 from 2.3.0 to 2.4.0 (#7149) dependabot[bot] 2025-08-21 08:26:25 -07:00
  • 2714b70955 S3 API: Add SSE-C (#7143) Chris Lu 2025-08-19 08:19:30 -07:00
  • 0748214c8e logs chrislu 2025-08-18 11:49:08 -07:00
  • e19940abca Update config.go chrislu 2025-08-18 08:38:45 -07:00
  • 03c0b37086 avoid hanging chrislu 2025-08-18 07:44:24 -07:00
  • e343035d67 set MaxVolumeCount chrislu 2025-08-17 23:31:06 -07:00
  • f2ec975b73 fix test data generation chrislu 2025-08-17 22:52:27 -07:00
  • 7a5f937c3f validate vacuum plan chrislu 2025-08-17 22:08:52 -07:00
  • 49b90bc9a3 Finds the most complete/reliable generation chrislu 2025-08-17 21:19:33 -07:00
  • e0f33846d1 Merge branch 'master' into add-ec-vacuum chrislu 2025-08-17 20:48:20 -07:00
  • 6e56cac9e5 Adding RDMA rust sidecar (#7140) Chris Lu 2025-08-17 20:45:44 -07:00
  • 6d265cc74b ensure correct next pointer chrislu 2025-08-15 10:19:43 -07:00
  • 62ed2366f3 skip file with invalid format chrislu 2025-08-15 10:19:31 -07:00
  • 8eb85415fb correct error chrislu 2025-08-15 10:19:17 -07:00
  • 9843a10f2b fix stop time chrislu 2025-08-15 01:01:07 -07:00
  • d5ded63ce3 day-advance fix chrislu 2025-08-14 23:36:52 -07:00
  • bab4f1731b add load test finding chrislu 2025-08-15 10:34:32 -07:00
  • ee9035b7f0 ensure correct next pointer chrislu 2025-08-15 10:19:43 -07:00
  • 62b7bb8fc8 skip file with invalid format chrislu 2025-08-15 10:19:31 -07:00
  • 5798952ea8 correct error chrislu 2025-08-15 10:19:17 -07:00
  • c37affaa42 fix stop time chrislu 2025-08-15 01:01:07 -07:00
  • ebdd24ce64 adjust log level chrislu 2025-08-14 23:36:59 -07:00
  • 1c09f313cc day-advance fix chrislu 2025-08-14 23:36:52 -07:00
  • 76c74ad3de err != filer_pb.ErrNotFound chrislu 2025-08-14 23:34:05 -07:00
  • b7f78d8c49 imports chrislu 2025-08-14 21:28:47 -07:00
  • fdfa089754 fix ListAllMyBucketsResult xmlns chrislu 2025-08-14 20:37:32 -07:00
  • 80db6f4d79 reduce lock scope to improve log buffer performance chrislu 2025-08-14 08:16:00 -07:00
  • 76f81ff236 fix ListAllMyBucketsResult xmlns chrislu 2025-08-14 20:37:32 -07:00
  • 543e074d60 reduce lock scope to improve log buffer performance chrislu 2025-08-14 08:16:00 -07:00
  • 18a22177b9 Fix volume server's status code returned for missing needles on EC-encoded shards (#7137) Lisandro Pin 2025-08-14 15:35:55 +02:00
  • c39d18c1da setup benchmarking chrislu 2025-08-13 21:59:54 -07:00
  • 1de251d575 sum from all shards chrislu 2025-08-13 18:48:05 -07:00
  • 722aebdf11 fix loading generational ec volumes chrislu 2025-08-13 18:31:03 -07:00
  • 66c688c656 collects metrics from ALL 6 servers/14 shards instead of just one chrislu 2025-08-13 18:11:38 -07:00
  • 5d1712e309 delete in ecj, add logs chrislu 2025-08-13 18:05:52 -07:00
  • b2d45f1f2d fix overflow chrislu 2025-08-13 18:04:48 -07:00
  • 2766504948 -v2 for volume servers chrislu 2025-08-13 18:03:03 -07:00
  • e3b45c9cbb Update .gitignore chrislu 2025-08-13 18:02:52 -07:00
  • 256b1c9c28 async persistence chrislu 2025-08-13 09:55:48 -07:00
  • 52f26187ca find master address earlier chrislu 2025-08-13 01:52:03 -07:00
  • e44a6189fa Update ec_decoder.go chrislu 2025-08-13 01:41:27 -07:00
  • 30a88615ba do not use .tmp chrislu 2025-08-13 01:27:45 -07:00
  • d7d19ea9ba ec volume deletion is generation-aware chrislu 2025-08-13 01:11:37 -07:00
  • 04b141749f explicit generation value chrislu 2025-08-13 00:57:36 -07:00
  • b616dc3d20 adjust comments chrislu 2025-08-13 00:34:41 -07:00
  • 117bba794c WriteDatFileAndVacuum chrislu 2025-08-13 00:28:12 -07:00
  • 1f8ba5c958 task ask admin for master address chrislu 2025-08-12 23:47:12 -07:00
  • c0e6d00bd3 collect ec volume total volume size chrislu 2025-08-12 22:47:10 -07:00
  • 3729e9ba25 chore(deps): bump golang.org/x/image from 0.29.0 to 0.30.0 (#7129) dependabot[bot] 2025-08-12 10:20:23 -07:00
  • 890b51eaef chore(deps): bump golang.org/x/tools from 0.35.0 to 0.36.0 (#7128) dependabot[bot] 2025-08-12 10:20:09 -07:00
  • 1485330547 Update ec_vacuum_task.go chrislu 2025-08-12 09:50:17 -07:00
  • 8213a4a2b6 use the EcVacuumLogic chrislu 2025-08-12 09:48:17 -07:00
  • 425a54019b adding EcVacuumLogic chrislu 2025-08-12 09:45:30 -07:00
  • 82907ad6ca determineGenerations() Removed chrislu 2025-08-12 09:33:40 -07:00
  • 729268d065 detection with generation info chrislu 2025-08-12 09:32:07 -07:00
  • 8a5c4a4972 add generation to TaskSource chrislu 2025-08-12 09:14:16 -07:00
  • 80bfce59ad Create NOTES.md chrislu 2025-08-12 09:13:57 -07:00
  • 35f3da108b distribute index files to all volume servers that will have shards mounted, not just one chrislu 2025-08-12 00:33:49 -07:00
  • 6bf5a6871c fix presigned signature chrislu 2025-08-11 23:57:57 -07:00
  • c8c758e639 fix hanging task detail page chrislu 2025-08-11 23:55:24 -07:00
  • 56db0a081a distribute .ecx files chrislu 2025-08-11 23:47:42 -07:00
  • 0d6ea416a7 fix retry link chrislu 2025-08-11 23:37:17 -07:00
  • 3864f89f92 chore(deps): bump golang.org/x/crypto from 0.40.0 to 0.41.0 (#7132) dependabot[bot] 2025-08-11 23:35:09 -07:00
  • d1f18f08d3 chore(deps): bump google.golang.org/protobuf from 1.36.6 to 1.36.7 (#7131) dependabot[bot] 2025-08-11 23:34:58 -07:00
  • 4f9f9ec971 fix routing chrislu 2025-08-11 22:36:48 -07:00
  • 3bbe4481f2 remove unused code chrislu 2025-08-11 21:54:21 -07:00
  • cac6a51cbf implement todos chrislu 2025-08-11 21:48:45 -07:00
  • 7780a7d652 ec vacuum workflow is correct now chrislu 2025-08-11 21:41:18 -07:00
  • 83b6a94bfe change to correct ec vacuum workflow chrislu 2025-08-11 21:14:36 -07:00