Please enable JavaScript.
Coggle requires JavaScript to display documents.
M8 - Coggle Diagram
M8
s3
The s3 sync command
ynchronizes the contents of a bucket and a directory, or the contents of two bucketsurce.
. Typically, s3 sync copies missing or outdated files or objects between the source and target.
However, you can also supply the --delete option to remove files or objects from the target that are not present in the so
object lock
you can prevent an object from being deleted or overwritten for a fixed amount of time or indefinitely. AmazonS3 Object Lock enables you to meet regulatory requirements that require WORM storage or simply to add an additional layer of protection against object changes and deletion. Amazon S3 Object Lock has been assessed by Cohasset Associates for use in environments that are subject to SEC 17a-4, CTCC, and FINRA regulations.
Amazon S3 Object Lock provides two ways to manage object retention: retention periods and legal holds.
A retention period specifies a fixed period of time during which an object remains locked. During this period, your object will be WORM-protected and can't be overwritten or deleted.
A legal hold provides the same protection as a retention period, but has no expiration date. Instead, a legal hold remains in place until you explicitly remove it. Legal holds are independent from retention periods: an object version can have both a retention period and a legal hold, one but not the other, or neither.
-
Amazon S3 Object Lock provides two retention modes: Governance and Compliance. These retention modes apply different levels of protection to your objects. You can apply either retention mode to any object version that is protected by Amazon S3 Object Lock.
In Compliance mode, a protected object version can't be overwritten or deleted by any user, including the root user in your AWS account. Once an object is locked in Compliance mode, its retention mode can't be changed and its retention period can't be shortened. Compliance mode ensures that an object version can't be overwritten or deleted for the duration of the retention period.
Governance mode, users can't overwrite or delete an object version or alter its lock settings unless they have special permissions. Governance mode enables you to protect objects against deletion by most users while still allowing you to grant some users permission to alter the retention settings or delete the object if necessary. You can also use Governance mode to test retention-period settings before creating a Compliance-mode retention period. In order to override or remove Governance-mode retention settings, a user must have the s3:BypassGovernanceMode permission and must explicitly include x-amz-bypass-governance-retention:true as a request header with any request that requires overriding Governance mode.
-
queiescen
a process of bringing the on-disk data of a physical or virtual computer into a state suitable for backups. This process might include such operations as flushing dirty buffers from the operating system's in-memory cache to disk, or other higher-level, application-specific tasks.”
stop Ec2 while snapshot
aws ec2 create-snapshot command will take a snapshot of your disk at the time that the command was issued;
-
However, due to application and OS write caching, a snapshot on a running instance might be inconsistent and result in missing or corrupted data.
Therefore, before taking the snapshot of the Processor instance, you will shut it down. This ensures a consistent snapshot
EFS
To group file shareds on myultiople file system into one common folder structure that you can access the entire dataset
data sync
You can use DataSync to transfer data at speeds up to 10 times faster than open-source tools. DataSync uses an on-premises software agent to connect to your existing storage or file systems using the Network File System (NFS) protocol, so you don’t have write scripts or modify your applications to work with AWS APIs.
You can use DataSync to copy data over AWS Direct Connect or internet links to AWS. The service enables one-time data migrations, recurring data processing workflows, and automated replication for data protection and recovery.
-
-
-
Select Amazon EFS or Amazon S3 as your AWS storage, and start moving data
-
-
-