Files
spinifex/docs/hybrid-sync
Ben Duncan 48012a4058 refactor: rename all documentation from hive to spinifex
- Rename .claude/rules/hive.md → spinifex.md
- Update CLAUDE.md component description
- Rename doc directories: hive-admin-cli → spinifex-admin-cli, etc.
- Rename doc files: hive-cluster-stats, hive-code-consolidation, etc.
- Bulk update all markdown files across docs/ tree
- Update internal docs: CLUSTER-INSTALL, TESTING, DEVNOTES, BRANCHES
2026-03-18 01:19:05 +00:00
..

title, description, category, tags, resources
title description category tags resources
Hybrid Sync Synchronize data between Spinifex and AWS when network connectivity is available. Migration
hybrid
sync
s3
title url
Spinifex Repository https://github.com/mulgadc/spinifex

Hybrid Sync

Synchronize data between Spinifex and AWS when network connectivity is available.

Table of Contents


Overview

Spinifex's hybrid mode enables bidirectional data synchronization between local infrastructure and AWS cloud services. Ideal for intermittent connectivity environments.

Instructions

Push Local to Cloud

aws s3 sync s3://local-bucket/ s3://cloud-bucket/ \
  --source-region spinifex --region us-east-1

Pull Cloud to Local

aws s3 sync s3://cloud-bucket/ s3://local-bucket/ \
  --source-region us-east-1 --region spinifex

EBS Volume Backup

rsync -avz /data/ user@cloud-server:/backup/spinifex-data/

Troubleshooting

Sync fails mid-transfer

S3 sync is idempotent — re-run the same command to resume where it left off:

aws s3 sync s3://local-bucket/ s3://cloud-bucket/ \
  --source-region spinifex --region us-east-1

Only changed or missing files will be transferred on subsequent runs.

Permissions errors during sync

Verify your AWS credentials are configured for both the source and destination:

aws sts get-caller-identity --profile spinifex
aws sts get-caller-identity --profile default

Ensure the IAM user has s3:GetObject, s3:PutObject, and s3:ListBucket permissions on both buckets.