Comment 8 for bug 1749900

Revision history for this message
Ramkantha R Guthi (rkrguthi) wrote :

From: Ramakantha Guthi <email address hidden>
Date: Thursday, March 8, 2018 at 12:15 PM
To: Prashanth Nageshappa <email address hidden>, Himanshu Bahukhandi <email address hidden>, Santosh Gupta <email address hidden>, Sundaresan Rajangam <email address hidden>
Cc: Rudra Rugge <email address hidden>, Abhay Joshi <email address hidden>, Viswanath KJ <email address hidden>, Srinivasan Dhamotharan <email address hidden>, Soumit Mishra <email address hidden>, Kamlesh Parmar <email address hidden>, Contrail Systems Analytics Team <email address hidden>, Ritam Gangopadhyay <email address hidden>, Jeba Paulaiyan <email address hidden>
Subject: Re: CAN production server reached 100% disk space

HI Prasanth / Santosh / Sundar

I have updated LP # 1749900 . I think we can ignore stale images option as logs shows most of the space under /var/lib/docker/aufs/diff occupoied by active containers.

Per earlier Himanshu email need more answers on

1. Zookeeper snapshot files in controller container (~38G)
/var/lib/zookeeper/version-2/

2. Contrail Collector process crash files in the analytics container (~80G)
 /var/crashes/core.contrail-collec.*

3. Cassandra database table in the analyticsdb container (~80G)
/var/lib/cassandra/data/ContrailAnalyticsCql/statstablebystrtagv3-3028f790891111e78c7b0f519d1da8b1
   Also from /var/lib/docker/afus/diff shows active conainer images taking ~120G ..

Currently issues 1 & 2 are not seen in customer setup as they moved from CSO 3.0 to CSO 3.2.1 . If possible it would be good to know it these #1 and #2 issues fixed in CSO 3.2.1 build ?

Thanks
Ram