EKS Ubuntu docker log rotation

Bug #1971765 reported by suman M
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fix Released
Thomas Bechtold

Bug Description

We are using AWS EKS and Ubuntu optimized AMI for EKS, ami-0fbeb45a81e0e242f. what we noticed is docker container logs are not rotated or cleaned and because of that we are seeing disk pressure on nodes. we also don't see any /etc/docker/daemon.json file for this AMI. Is this issue addressed in another version of AMI or is there any workaround. Please any thoughts would be helpful. Thanks

Changed in cloud-images:
assignee: nobody → Tomáš Virtus (virtustom)
Revision history for this message
Tomáš Virtus (virtustom) wrote :

Hello Suman. Can you please share more details?

- Which region is the AMI ami-0fbeb45a81e0e242f registered to?

- Can you double-check this AMI ID is really a Ubuntu for EKS AMI?

- Is this EKS 1.22?

Revision history for this message
suman M (sumanubuntu01) wrote :

Thanks Tomas for getting back, please see below for more information

EKS version : 1.21
Region: US-EAST-1
AMI: ami-0fbeb45a81e0e242f
AMI NAME: ubuntu-eks/k8s_1.21/images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220201

what I see is that daemon configuration is not set that means it is using default logger which means no log rotation, which causing logs to grow and causing the disk pressure on the nodes. Please see here for docker daemon settings

attaching details regarding ami and logs

Revision history for this message
suman M (sumanubuntu01) wrote :

Hi Tom,

  Any update on this? Thanks

Changed in cloud-images:
assignee: Tomáš Virtus (virtustom) → Thomas Bechtold (toabctl)
importance: Undecided → High
status: New → In Progress
Revision history for this message
Thomas Bechtold (toabctl) wrote :

This should be fixed with the AMIs having serial 20220518.1 . Please reopen if you still have this problem.

Changed in cloud-images:
status: In Progress → Fix Released
Revision history for this message
suman M (sumanubuntu01) wrote :

Thank you Thomas, we will get this tested and get back to you. Appreciate your help here.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.