The AWS Handbook: Learn the Ins and Outs of AWS S3 Glacier | Randomskool | AWS Lecture Series

Welcome to today's class

Today's topic: AWS S3 Glacier

Professor:

Hello student, today we will be discussing AWS S3 Glacier. It is a storage service that enables you to store and retrieve large amounts of data at very low costs.

Student:

How is it different from other storage options on AWS?

Professor:

S3 Glacier is specifically designed for long-term data storage and archival. It is significantly cheaper than other storage options such as S3 Standard or S3 Intelligent-Tiering, but it has slower retrieval times.

Student:

How long does it take to retrieve data from S3 Glacier?

Professor:

It typically takes 3-5 hours to retrieve data from S3 Glacier. However, you can use the expedited retrieval option to retrieve data in 1-5 minutes, at an additional cost.

Student:

Can I store any type of data in S3 Glacier?

Professor:

Yes, you can store any type of data in S3 Glacier. It is a good option for storing data that is not frequently accessed, such as backups, disaster recovery data, and data for regulatory compliance.

Student:

How do I access data stored in S3 Glacier?

Professor:

You can access data stored in S3 Glacier through the AWS Management Console, the AWS SDKs, or the AWS CLI. You can also set up lifecycle policies to automatically transition data to and from S3 Glacier based on your storage and access needs.

Student:

How is the data stored in S3 Glacier protected?

Professor:

S3 Glacier stores data across multiple availability zones in an AWS region, providing high durability and availability. It also offers versioning and cross-region replication, so you can store multiple versions of your data and replicate it to other regions for added protection.

Student:

That's really helpful. Thank you, Professor.

Professor:

You're welcome. I hope this has given you a good overview of AWS S3 Glacier. If you have any more questions, don't hesitate to ask.

Professor:

In addition to the features we already discussed, S3 Glacier also offers data encryption for added security. You can choose to encrypt your data at rest using server-side encryption with Amazon S3-managed keys or with keys that you manage through AWS Key Management Service.

Student:

How is the pricing for S3 Glacier calculated?

Professor:

S3 Glacier charges for storage on a per-gigabyte basis, and the price varies based on the region and the storage class you choose. There are also charges for data retrieval, data transfer, and requests made to the service. You can find more information about the pricing on the AWS website.

Student:

Can I use S3 Glacier with other AWS services?

Professor:

Yes, S3 Glacier can be used in conjunction with other AWS services. For example, you can use it as the storage destination for Amazon EBS snapshots, or you can use it as the storage location for data ingested by Amazon Kinesis Data Firehose.

Student:

Is there a way to monitor the usage and cost of S3 Glacier?

Professor:

Yes, you can use the AWS Cost and Usage Report to track your usage and cost of S3 Glacier and other AWS services. You can also set up billing alerts to receive notifications when your usage or cost exceeds a certain threshold.

Student:

How do I set up S3 Glacier for my organization?

Professor:

To set up S3 Glacier, you first need to create an AWS account if you don't already have one. Then, you can create a new S3 bucket and select the S3 Glacier storage class when you configure the bucket. You can also use the AWS Management Console, the AWS CLI, or the AWS SDKs to upload data to your S3 Glacier bucket.

Professor:

There are a few advanced topics related to S3 Glacier that you might find useful. One of these is S3 Select for S3 Glacier, which allows you to perform SQL queries on your data stored in S3 Glacier without having to retrieve the entire dataset. This can save time and reduce retrieval costs.

Student:

How does S3 Select for S3 Glacier work?

Professor:

S3 Select for S3 Glacier works by using the same SQL expressions that you would use with S3 Select on data stored in S3 Standard or S3 Intelligent-Tiering. You can use it to filter, transform, and aggregate your data, and it supports CSV, JSON, and Parquet file formats.

Student:

That sounds really useful. Are there any other advanced features of S3 Glacier?

Professor:

Another advanced feature of S3 Glacier is S3 Inventory, which allows you to generate reports about your S3 Glacier objects and their metadata. You can use S3 Inventory to list, count, and verify the existence and metadata of your objects, as well as to identify differences between versions of your objects.

Student:

Can I automate tasks with S3 Glacier?

Professor:

Yes, you can use AWS CloudWatch Events and AWS Lambda to automate tasks with S3 Glacier. For example, you can use CloudWatch Events to trigger a Lambda function to perform an action when a new object is added to your S3 Glacier bucket, or when an object is restored from S3 Glacier to S3 Standard.

Student:

That's really helpful. Thank you, Professor.

Professor:

You're welcome. I hope this has given you a more in-depth understanding of some of the advanced features and capabilities of S3 Glacier. If you have any more questions, don't hesitate to ask.

Professor:

Another advanced feature of S3 Glacier is the ability to store data in virtual tapes using the S3 Glacier Deep Archive storage class. This storage class is even lower cost than S3 Glacier, but with even slower retrieval times, making it suitable for archiving data that is rarely accessed.

Student:

How long does it take to retrieve data from S3 Glacier Deep Archive?

Professor:

It typically takes 12 hours or more to retrieve data from S3 Glacier Deep Archive. Like S3 Glacier, you can use the expedited retrieval option to retrieve data in 1-5 minutes, at an additional cost.

Student:

Are there any other differences between S3 Glacier and S3 Glacier Deep Archive?

Professor:

One main difference between S3 Glacier and S3 Glacier Deep Archive is the retrieval times. Additionally, S3 Glacier Deep Archive has a minimum storage duration of 180 days, so you cannot delete objects from this storage class within that time period.

Student:

Can I use S3 Glacier Deep Archive with other AWS services?

Professor:

Yes, you can use S3 Glacier Deep Archive with other AWS services, such as AWS Backup, Amazon EBS, and Amazon EC2. You can use it as the storage destination for backups or as the storage location for data ingested by Amazon Kinesis Data Firehose, for example.

Student:

Is there a way to monitor the usage and cost of S3 Glacier Deep Archive?

Professor:

Yes, you can use the AWS Cost and Usage Report to track your usage and cost of S3 Glacier Deep Archive and other AWS services. You can also set up billing alerts to receive notifications when your usage or cost exceeds a certain threshold.

Student:

How do I set up S3 Glacier Deep Archive for my organization?

Professor:

To set up S3 Glacier Deep Archive, you first need to create an AWS account if you don't already have one. Then, you can create a new S3 bucket and select the S3 Glacier Deep Archive storage class when you configure the bucket. You can also use the AWS Management Console, the AWS CLI, or the AWS SDKs to upload data to your S3 Glacier Deep Archive bucket.

Professor:

Now that you have a good understanding of S3 Glacier and S3 Glacier Deep Archive, let's look at some code or commands that you can use to access these storage classes.

Student:

Okay, that sounds great. What are some common ways to access S3 Glacier?

Professor:

One common way to access S3 Glacier is through the AWS SDKs. For example, in Python, you can use the boto3 library to retrieve an object from S3 Glacier like this:

codestarted import boto3; client = boto3.client('s3'); response = client.get_object(Bucket='my-bucket', Key='my-object', Tier='Standard'); data = response['Body'].read(); print(data) codeended You can also use the AWS CLI to retrieve an object from S3 Glacier like this:

 aws s3api get-object --bucket my-bucket --key my-object --tier Standard --request-payer requester outputfile.txt 

Student:

How do I access S3 Glacier Deep Archive?

Professor:

The process for accessing S3 Glacier Deep Archive is similar to accessing S3 Glacier. You can use the AWS SDKs or the AWS CLI to retrieve objects from S3 Glacier Deep Archive. For example, in Python, you can use the boto3 library like this:

codestarted import boto3; client = boto3.client('s3'); response = client.get_object(Bucket='my-bucket', Key='my-object', Tier='Deep Archive'); data = response['Body'].read(); print(data) codeended And with the AWS CLI, you can use the following command:

 aws s3api get-object --bucket my-bucket --key my-object --tier Deep Archive --request-payer requester outputfile.txt 

I hope these examples give you a good idea of how to access S3 Glacier and S3 Glacier Deep Archive using code or commands.

Conclusion

Professor:

To summarize, in this class we covered AWS S3 Glacier and S3 Glacier Deep Archive, which are storage services for long-term data storage and archival. We discussed the differences between these storage classes and the other storage options on AWS, as well as their retrieval times and pricing. We also looked at some advanced features of S3 Glacier, such as S3 Select and S3 Inventory, and how to automate tasks using CloudWatch Events and Lambda. Finally, we reviewed some code and commands that you can use to access S3 Glacier and S3 Glacier Deep Archive. I hope this class was helpful in giving you a good understanding of these storage services and how you can use them in your organization. If you have any further questions or want to learn more, don't hesitate to reach out. Thank you for joining me today.

We welcome your feedback on this lecture series. Please share any thoughts or suggestions you may have.

To view the full lecture series, please visit this link.

Share this post