@jialin.huang
FRONT-ENDBACK-ENDNETWORK, HTTPOS, COMPUTERCLOUD, AWS, Docker
To live is to risk it all Otherwise you are just an inert chunk of randomly assembled molecules drifting wherever the Universe blows you

© 2024 jialin00.com

Original content since 2022

back
RSS

AWS Migration & Synchronization Tools

Online

need internet

  • AWS DataSync: Realtime sync
  • AWS Transfer Family: based on SFTP/FTP/FTPS, async
  • AWS Database Migration Service (DMS)
    • one-time migration
    • continuous replication (CDC, Change Data Capture)
  • AWS Application Migration Service (MGN), async
    • Formerly CloudEndure Migration
    • scenario:
      1. Agent installed at origin server
      1. Step-by-step replication
      1. Supports rollback if target location fails
  • AWS Storage Gateway: hybrid cloud, sync
    • Volume Gateway: iSCSI block storage
    • File Gateway: NFS/SMB
    • Tape Gateway: iSCSI VTL

Offline

Just Snow Family

byte KMGTPEZY B (Unit Abbreviations)

  • Snowcone 8 TB HDD
  • Snowball
    • storage optimized 80 TB HDD
    • storage optimized 210 TB SSD NVMe + 104 vCPU
    • compute optimized 28 TB SSD + 104 vCPU
  • Snowmobile:100 PB, EB-level

Related Services (but not that Precise)

minimal network connection

  • AWS Backup

    It does not rely on real-time compute resources or the continuous involvement of online services.

  • AWS VM Import/Export

    VM Import/Export is simply to convert VM images to AMI and handle the uploading and downloading of files.

    It does not require the involvement of other AWS services.

  • AWS Server Migration Service (SMS)
    • batching migration

Offline migration usually means there’s no need for real-time synchronization, but it still carries the meaning of migration. Some steps might go through the network, but the focus isn’t on synchronization, so I categorize it as offline migration.

Migration helpers

Infrastructure-focused, similar to online tools but emphasizes network infrastructure

  • AWS Direct Connect: Dedicated connection line
  • VPN: Encrypted tunnel

Specialized Tools

Tools that indirectly facilitate migration or synchronization:

  • AWS CLI
  • S3 CLI
  • AWS Application Discovery Service: plan to…
    • Agentless Collector
    • Agent-based Discovery

Decision Making

  1. < TB Scale
    • Internet transfer
    • AWS DataSync
    • Storage Gateway
  1. TBs
    • Snowball
    • Direct Connect
    • DataSync + Direct Connect
  1. PB Scale and Above
    • Snowball Edge
    • Snowmobile
  1. Use Case Scenarios
    • db migration → DMS
    • file server → DataSync/Storage Gateway
    • application server → Application Migration Service
    • sync → DataSync/DMS

References

https://jayendrapatil.com/aws-snow-family/

https://aws.amazon.com/application-discovery/?nc1=h_ls

https://aws.amazon.com/snow/?nc1=h_ls

https://docs.aws.amazon.com/transfer/latest/userguide/transfer-workflows.html

https://www.resilio.com/blog/aws-storage-gateway

https://docs.aws.amazon.com/whitepapers/latest/migrating-databases-to-amazon-aurora/planning-your-database-migration-process.html

EOF