Category: Cloud – ServerOK

Amazon EC2 disk resize No space left on device

Posted on August 18, 2020 (August 18, 2020) by ServerOk

On an Amazon EC2 instamce disk usage was full.

root@ip-172-31-46-249:/# df -h
Filesystem      Size  Used Avail Use% Mounted on
udev            3.9G     0  3.9G   0% /dev
tmpfs           791M  8.9M  782M   2% /run
/dev/nvme0n1p1  9.7G  9.6G   65M 100% /
tmpfs           3.9G     0  3.9G   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           3.9G     0  3.9G   0% /sys/fs/cgroup
/dev/loop0       97M   97M     0 100% /snap/core/9665
/dev/loop1       97M   97M     0 100% /snap/core/9436
/dev/loop2       18M   18M     0 100% /snap/amazon-ssm-agent/1566
/dev/loop3       29M   29M     0 100% /snap/amazon-ssm-agent/2012
tmpfs           791M     0  791M   0% /run/user/998
tmpfs           791M     0  791M   0% /run/user/1000
root@ip-172-31-46-249:/#

root@ip-172-31-46-249:/# df -h

Filesystem Size Used Avail Use% Mounted on

udev 3.9G 0 3.9G 0% /dev

tmpfs 791M 8.9M 782M 2% /run

/dev/nvme0n1p1 9.7G 9.6G 65M 100% /

tmpfs 3.9G 0 3.9G 0% /dev/shm

tmpfs 5.0M 0 5.0M 0% /run/lock

tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup

/dev/loop0 97M 97M 0 100% /snap/core/9665

/dev/loop1 97M 97M 0 100% /snap/core/9436

/dev/loop2 18M 18M 0 100% /snap/amazon-ssm-agent/1566

/dev/loop3 29M 29M 0 100% /snap/amazon-ssm-agent/2012

tmpfs 791M 0 791M 0% /run/user/998

tmpfs 791M 0 791M 0% /run/user/1000

root@ip-172-31-46-249:/#

I increased disk size on Amazone AWS console. But disk did not get changed in EC2 instance.

root@ip-172-31-46-249:~# parted -l
Model: NVMe Device (nvme)
Disk /dev/nvme0n1: 21.5GB
Sector size (logical/physical): 512B/512B
Partition Table: msdos
Disk Flags: 

Number  Start   End     Size    Type     File system  Flags
 1      1049kB  10.7GB  10.7GB  primary  ext4         boot


root@ip-172-31-46-249:~#

root@ip-172-31-46-249:~# parted -l

Model: NVMe Device (nvme)

Disk /dev/nvme0n1: 21.5GB

Sector size (logical/physical): 512B/512B

Partition Table: msdos

Disk Flags:

Number Start End Size Type File system Flags

1 1049kB 10.7GB 10.7GB primary ext4 boot

root@ip-172-31-46-249:~#

The partition still shows 10 GB. When i try growpart, i get error

root@ip-172-31-46-249:/# growpart /dev/nvme0n1 1
mkdir: cannot create directory ‘/tmp/growpart.1889’: No space left on device
FAILED: failed to make temp dir
root@ip-172-31-46-249:/#

root@ip-172-31-46-249:/# growpart /dev/nvme0n1 1

mkdir: cannot create directory ‘/tmp/growpart.1889’: No space left on device

FAILED: failed to make temp dir

root@ip-172-31-46-249:/#

This is because disk is full. I try delete some unwanted files. But […]

Mount Amazon s3 on Linux

Posted on August 13, 2020 (August 13, 2020) by ServerOk

To mount Amazon S3 bucket as a filesystem on linux, you can use s3fs. https://github.com/s3fs-fuse/s3fs-fuse To install s3fs on Ubuntu/Debian, run

apt install s3fs

1	apt install s3fs

To mount an s3 buclet, create a password file with your AWS secret key and

echo ACCESS_KEY_ID:SECRET_ACCESS_KEY > ${HOME}/.passwd-s3fs
chmod 600 ${HOME}/.passwd-s3fs

1 2	echo ACCESS_KEY_ID:SECRET_ACCESS_KEY > ${HOME}/.passwd-s3fs chmod 600 ${HOME}/.passwd-s3fs

Then run

s3fs sokmount /home/boby/ -o passwd_file=${HOME}/.passwd-s3fs -o dbglevel=info -f -o curldbg -o endpoint=ap-southeast-1 -o url="https://s3-ap-southeast-1.amazonaws.com"

1	s3fs sokmount /home/boby/ -o passwd_file=${HOME}/.passwd-s3fs -o dbglevel=info -f -o curldbg -o endpoint=ap-southeast-1 -o url="https://s3-ap-southeast-1.amazonaws.com"

In above command replace sokmount = bucket name /home/boby/ = your mount point ap-southeast-1 […]

Amazon ECS is a container service from Amazon AWS Cloud. This allow you to run Docker containers in AWS cloud. It is like Kubernetes. Here are some good resources to get started with Amazon ECS https://github.com/nathanpeck/awesome-ecs https://ecsworkshop.com See AWS […]

AlibabaCloud DirectMail

Posted on March 9, 2020 by ServerOk

AlibabaCloud DirectMail is transactional email service from AlibabaCloud. It is like Amazon SES, MailGun, SendGrid etc… They have 3 differnt mail server hostname depending on region. Unlike other SMTP providers, they allow email using port 80.

SMTP service address (China East 1): smtpdm.aliyun.com

SMTP service address (Singapore): smtpdm-ap-southeast-1.aliyun.com

SMTP service address (Sydney): smtpdm-ap-southeast-2.aliyun.com

SMTP port: 25, 80, 465 (SSL encrypted).

SMTP service address (China East 1): smtpdm.aliyun.com

SMTP service address (Singapore): smtpdm-ap-southeast-1.aliyun.com

SMTP service address (Sydney): smtpdm-ap-southeast-2.aliyun.com

SMTP port: 25, 80, 465 (SSL encrypted).

Note: Port 25 is currently disabled to maintain ECS security. If your sending application is deployed on Alibaba […]

Whitelist an IP in Amazon AWS security group from command line

Posted on January 15, 2020 by ServerOk

To white list an IP in Amazon AWS security group using aws command line tool, run

aws ec2 authorize-security-group-ingress --group-id SECURITY_GROUP_ID_HERE --protocol tcp --port PORT_HERE --cidr IP_IN_CIDR_HERE

1	aws ec2 authorize-security-group-ingress --group-id SECURITY_GROUP_ID_HERE --protocol tcp --port PORT_HERE --cidr IP_IN_CIDR_HERE

Example

aws ec2 authorize-security-group-ingress --group-id sg-a777eee6  --protocol tcp --port 443 --cidr 94.31.33.128/27

1	aws ec2 authorize-security-group-ingress --group-id sg-a777eee6 --protocol tcp --port 443 --cidr 94.31.33.128/27

[…]

AWS Elastic Beanstalk

Posted on November 25, 2019 by ServerOk

Here are some useful command working with AWS Elastic Beanstalk

eb init = initialize environment
eb list
eb logs
eb console = open aws console
eb open = open application in web browser
eb appversion = show application versions
eb health = show health of application
eb codesource = select local or codecommit
eb deploy = deploy code
eb events = Gets recent events.
eb create = Creates a new environment.
eb labs download = download application to local computer

eb init = initialize environment

eb list

eb logs

eb console = open aws console

eb open = open application in web browser

eb appversion = show application versions

eb health = show health of application

eb codesource = select local or codecommit

eb deploy = deploy code

eb events = Gets recent events.

eb create = Creates a new environment.

eb labs download = download application to local computer

Application get stored in folder

/var/app/ondeck

1	/var/app/ondeck

[…]

Connect to Google Cloud SQL

Posted on August 10, 2019 by ServerOk

To connect to Google Cloud SQL, run

gcloud sql connect DB_INSTANE_NAME

1	gcloud sql connect DB_INSTANE_NAME

[…]

Amazon S3 CORS

Posted on July 20, 2019 by ServerOk

To enable CORS for Amazon S3 bucket, add

<?xml version="1.0" encoding="UTF-8"?>
<CORSConfiguration xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
  <CORSRule>
    <AllowedOrigin>*</AllowedOrigin>
    <AllowedMethod>PUT</AllowedMethod>
    <AllowedMethod>POST</AllowedMethod>
    <AllowedMethod>DELETE</AllowedMethod>
    <MaxAgeSeconds>1800</MaxAgeSeconds>
    <AllowedHeader>*</AllowedHeader>
  </CORSRule>
</CORSConfiguration>

<?xml version="1.0" encoding="UTF-8"?>

<AllowedMethod>DELETE</AllowedMethod>

</CORSRule>

</CORSConfiguration>

[…]