mirror of
https://github.com/mulgadc/spinifex.git
synced 2026-10-19 10:52:04 +00:00
Ben Duncan
48012a4058
- Rename .claude/rules/hive.md → spinifex.md - Update CLAUDE.md component description - Rename doc directories: hive-admin-cli → spinifex-admin-cli, etc. - Rename doc files: hive-cluster-stats, hive-code-consolidation, etc. - Bulk update all markdown files across docs/ tree - Update internal docs: CLUSTER-INSTALL, TESTING, DEVNOTES, BRANCHES
75 lines
1.7 KiB
Markdown
75 lines
1.7 KiB
Markdown
---
|
|
title: "Hybrid Sync"
|
|
description: "Synchronize data between Spinifex and AWS when network connectivity is available."
|
|
category: "Migration"
|
|
tags:
|
|
- hybrid
|
|
- sync
|
|
- s3
|
|
resources:
|
|
- title: "Spinifex Repository"
|
|
url: "https://github.com/mulgadc/spinifex"
|
|
---
|
|
|
|
# Hybrid Sync
|
|
|
|
> Synchronize data between Spinifex and AWS when network connectivity is available.
|
|
|
|
## Table of Contents
|
|
|
|
- [Overview](#overview)
|
|
- [Instructions](#instructions)
|
|
- [Troubleshooting](#troubleshooting)
|
|
|
|
---
|
|
|
|
## Overview
|
|
|
|
Spinifex's hybrid mode enables bidirectional data synchronization between local infrastructure and AWS cloud services. Ideal for intermittent connectivity environments.
|
|
|
|
## Instructions
|
|
|
|
## Push Local to Cloud
|
|
|
|
```bash
|
|
aws s3 sync s3://local-bucket/ s3://cloud-bucket/ \
|
|
--source-region spinifex --region us-east-1
|
|
```
|
|
|
|
## Pull Cloud to Local
|
|
|
|
```bash
|
|
aws s3 sync s3://cloud-bucket/ s3://local-bucket/ \
|
|
--source-region us-east-1 --region spinifex
|
|
```
|
|
|
|
## EBS Volume Backup
|
|
|
|
```bash
|
|
rsync -avz /data/ user@cloud-server:/backup/spinifex-data/
|
|
```
|
|
|
|
## Troubleshooting
|
|
|
|
## Sync fails mid-transfer
|
|
|
|
S3 sync is idempotent — re-run the same command to resume where it left off:
|
|
|
|
```bash
|
|
aws s3 sync s3://local-bucket/ s3://cloud-bucket/ \
|
|
--source-region spinifex --region us-east-1
|
|
```
|
|
|
|
Only changed or missing files will be transferred on subsequent runs.
|
|
|
|
## Permissions errors during sync
|
|
|
|
Verify your AWS credentials are configured for both the source and destination:
|
|
|
|
```bash
|
|
aws sts get-caller-identity --profile spinifex
|
|
aws sts get-caller-identity --profile default
|
|
```
|
|
|
|
Ensure the IAM user has `s3:GetObject`, `s3:PutObject`, and `s3:ListBucket` permissions on both buckets.
|