To see the disk usage of an Amazon S3 bucket, do the following
1) Click on the bucket name
2) Click on Metrics
3) On Next Page, you will see S3 bucket disk usage.
In this case, the bucket size is 39.3 MB.
Click on objects. It will show all files/folders. Select them, them from actions, click “Calculate total size”.
To find disk usage using awscli, run
aws s3 ls s3://BUCKET_NAME_HERE --recursive --human-readable --summarize
See Amazon S3
To mount Amazon S3 bucket as a filesystem on linux, you can use s3fs.
https://github.com/s3fs-fuse/s3fs-fuse
To install s3fs on Ubuntu/Debian, run
apt install s3fs
To mount an s3 buclet, create a password file with your AWS secret key and
echo ACCESS_KEY_ID:SECRET_ACCESS_KEY > ${HOME}/.passwd-s3fs
chmod 600 ${HOME}/.passwd-s3fs
Then run
s3fs sokmount /home/boby/ -o passwd_file=${HOME}/.passwd-s3fs -o dbglevel=info -f -o curldbg -o endpoint=ap-southeast-1 -o url="https://s3-ap-southeast-1.amazonaws.com"
In above command replace
sokmount = bucket name
/home/boby/ = your mount point
ap-southeast-1 = AWS region where bucket is created.
See Amazon S3
To make an Amazon S3 bucket public, you need to modify the bucket’s policy to allow public access.
You get a blank editor. Paste the following code and click save changes to make the bucket public.
{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "AllowPublicReadAccess",
"Effect": "Allow",
"Principal": "*",
"Action": "s3:GetObject",
"Resource": "arn:aws:s3:::BUCKET_NAME_HERE/*"
}
]
}Replace BUCKET_NAME_HERE with your actual S3 Bucket name.
See Amazon S3
I was setting up a wordpress web site to use Amazon S3 + Cloudfront as CDN. I used w3 total cache plugin for this. w3 total cache plugin have option to auto create Amazon S3 bucket and cloudfront distribution, for for this, you need to give Amazon AWS API keys.
Clicking the button “Create as new bucket with distribution” will auto create s3 bucket and cloudfront for you.
if you site have images already uploaded, you need to upload them to Amazon S3. This can be done with W3 Total Cache.
If you have lot of files, upload may fail. You may need to use Amazon AWS CLI tool to do the upload.
aws s3 sync /opt/bitnami/apps/wordpress/htdocs/wp-content/uploads/ s3://your-bucket-name/wp-content/uploads/
If needed, you can upload themes and plugins folder too
aws s3 sync /opt/bitnami/apps/wordpress/htdocs/wp-content/plugins/ s3://your-bucket-name/wp-content/plugins/ aws s3 sync /opt/bitnami/apps/wordpress/htdocs/wp-content/themes/ s3://your-bucket-name/wp-content/themes/
To backup a folder to the Amazon S3 bucket, run
aws s3 cp --recursive /path/to/folder/ s3://BUCKET_NAME/NEW_FOLDER_NAME/
Example
To sync (download) a s3 bucket to your local computer, run
aws s3 sync --no-sign-request --region us-west-2 s3://BUCKET_NAME/ ./localpath/
To list all s3 buckets, run
aws s3 list
Example
root@server2 [~]# aws s3 ls
2016-04-30 09:15:38 bkjoe
2016-11-30 07:38:38 server2bc
root@server2 [~]# aws s3 ls s3://server2bc/
PRE 2017-12-22/
PRE monthly/
PRE weekly/
root@server2 [~]#