Historical Data Synchronization Setting

Historical data synchronization is used to copy the existing files in the original Bucket to the destination Bucket one time so as to complete data migration or realize cross-region disaster recovery and disaster recovery in the same region.

Customer scenario

Historical data synchronization is used together with Incremental Data Synchronization to realize the following demands:

• Data Replication: For business reasons, data need to be migrated from one space to another space.

• Compliance requirement: A backup copy of data required by compliance requirement needs to be saved across a certain distance.

• Data backup and disaster tolerance: If you want to save or maintain a backup copy of all written data in the long-distance storage area, in case of damage caused to the storage area by catastrophes such as tsunamis or earthquakes, you can enable backup data of the long-distance off-site storage area.

• Minimize latency: Customers are in two geographic locations. To minimize the latency in accessing objects, a backup copy of the object can be maintained in a storage area that is geographically closer to the user.

Use the console to create the historical data synchronization task

1. Log into the Console->Object Storage Service->Space Management->Enter a Bucket->Advanced Setting, and navigate to the “Data Synchronization->Historical Data Synchronization” functional zone.

2. Click Create a New Task to open the dialog box of historical data synchronization rule configuration.

3. Select the region the target storage space is located and the storage space name.

4. Select Synchronization Objects

• Synchronize all files: Synchronize all files in the source storage space to the target storage space.

• Assign file name prefixes for synchronization: Synchronize files with the assigned prefixes in the source storage space to the target storage space.

  a. You can add at most 1000 prefixes. Each prefix can be at most 1022 bytes.

  b. File prefixes do not support overlapping prefixes, for example, text and test/01 are not allowed.

5. Select Overwrite or Not Overwrite.

• When the target space has a file with the same name as the source space, you can control whether to overwrite it or not.

6. Select Storage Type.

• Currently, standard storage, low-frequency storage, archiving storage and low redundancy storage (not recommended) are supported.

7. Click “Execute” to start synchronization.

View historical data synchronization task

Log into the Console->Object Storage Service->Space Management->Enter a Bucket->Advanced Setting, and navigate to the “Data Synchronization->Historical Data Synchronization” functional zone.

After a task is created, view the task progress and status in the historical data synchronization list and cancel tasks.

Description:

• Difference from Incremental Data Synchronization Incremental data synchronization is a kind of space attribute, and after enabling, the files complying with requirements will be automatically synchronized to another space. Historical data synchronization is a task, and after a task is created, it will be executed once; after execution, restart will not be allowed.

• A new task is in the initialized state. If a new file is uploaded to the source space in the initialized state, this file may not be synchronized to the target space.

• The historical data synchronization task can be canceled, but after cancellation, restart will not be allowed; the file that has been synchronized at the time of cancellation will not be deleted.