spinifex/docs/migration/hybrid-sync/README.md

title, description, category, tags, resources

title	description	category	tags	resources
Hybrid Sync	Synchronize data between Spinifex and AWS when network connectivity is available.	Migration	hybrid sync s3	title url Spinifex Repository https://github.com/mulgadc/spinifex

Hybrid Sync

Synchronize data between Spinifex and AWS when network connectivity is available.

Table of Contents

• Overview
• Instructions
• Troubleshooting

---

Overview

Spinifex's hybrid mode enables bidirectional data synchronization between local infrastructure and AWS cloud services. Ideal for intermittent connectivity environments.

Instructions

Prerequisites

• A running Spinifex cluster (see Setting Up Your Cluster)
• AWS CLI configured with the spinifex profile:

export AWS_PROFILE=spinifex

Push Local to Cloud

aws s3 sync s3://local-bucket/ s3://cloud-bucket/ \
  --source-region spinifex --region us-east-1

Pull Cloud to Local

aws s3 sync s3://cloud-bucket/ s3://local-bucket/ \
  --source-region us-east-1 --region spinifex

EBS Volume Backup

rsync -avz /data/ user@cloud-server:/backup/spinifex-data/

Troubleshooting

Sync Fails Mid Transfer

S3 sync is idempotent — re-run the same command to resume where it left off:

aws s3 sync s3://local-bucket/ s3://cloud-bucket/ \
  --source-region spinifex --region us-east-1

Only changed or missing files will be transferred on subsequent runs.