Published on

Mastering S3 Command Line: Essential Commands and Examples

Authors
  • avatar
    Name
    Hieu Cao
    Twitter

Introduction

Amazon S3 (Simple Storage Service) is a powerful storage solution from AWS. Using the AWS Command Line Interface (CLI), you can efficiently manage S3 buckets and objects directly from your terminal.

1. Prerequisites

Before running S3 commands, ensure you have:

aws configure

Enter your AWS Access Key, Secret Key, Region, and Output format.

2. Working with S3 Buckets

List all S3 Buckets

aws s3 ls

Create a New Bucket

aws s3 mb s3://my-new-bucket

Delete a Bucket

aws s3 rb s3://my-new-bucket --force  # Force deletes bucket and all contents

3. Uploading and Downloading Files

Upload a Single File

aws s3 cp myfile.txt s3://my-bucket/

Upload a Directory Recursively

aws s3 cp my-folder s3://my-bucket/ --recursive

Download a File from S3

aws s3 cp s3://my-bucket/myfile.txt ./

4. Syncing Files and Folders

Sync Local Folder to S3

aws s3 sync ./local-folder s3://my-bucket/

Sync S3 Bucket to Local Directory

aws s3 sync s3://my-bucket/ ./local-folder

5. Managing Objects in S3

List All Files in a Bucket

aws s3 ls s3://my-bucket/

Delete a File from S3

aws s3 rm s3://my-bucket/myfile.txt

Delete All Files in a Bucket

aws s3 rm s3://my-bucket/ --recursive

6. Enabling Public Access and Setting Permissions

Make an Object Public

aws s3api put-object-acl --bucket my-bucket --key myfile.txt --acl public-read

Change Bucket Policy

aws s3api put-bucket-policy --bucket my-bucket --policy file://policy.json

7. Conclusion

Using the AWS CLI for S3 makes storage management efficient and scriptable. Mastering these commands will help you automate workflows and manage data effectively.

For advanced use cases, explore AWS SDKs and automation tools like Terraform!