Comment 0 for bug 1405998

Revision history for this message
Larry Michel (lmic) wrote :

From pserv.log, there are 660227 such errors during a short period of time: ~ 1 hour and 34 minutes:

===========================================================
ubuntu@maas-trusty-back-may22:~$ grep " Unhandled error in Deferred" /var/log/maas/pserv.log|grep "2014-12-26" | wc -l
680227
===========================================================

There are also 386375 oops files.

They start at
2014-12-26 21:35:17+0000 [-] Unhandled error in Deferred
and end at
2014-12-26 22:09:40+0000 [-] Unhandled error in Deferred:

This is one entry:
===========================================================
2014-12-26 21:49:59+0000 [-] Unhandled error in Deferred:
2014-12-26 21:49:59+0000 [-] Unhandled Error
        Traceback (most recent call last):
          File "/usr/lib/python2.7/threading.py", line 783, in __bootstrap
            self.__bootstrap_inner()
          File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
            self.run()
          File "/usr/lib/python2.7/threading.py", line 763, in run
            self.__target(*self.__args, **self.__kwargs)
        --- <exception caught here> ---
          File "/usr/lib/python2.7/dist-packages/twisted/python/threadpool.py", line 191, in _worker
            result = context.call(ctx, function, *args, **kwargs)
          File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 118, in callWithContext
            return self.currentContext().callWithContext(ctx, func, *args, **kw)
          File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 81, in callWithContext
            return func(*args,**kw)
          File "/usr/lib/python2.7/dist-packages/oops/publishers.py", line 38, in result
            return publisher(report)
          File "/usr/lib/python2.7/dist-packages/oops_datedir_repo/repository.py", line 133, in publish
            self.serializer.write(report, open(filename + '.tmp', 'wb'))
        exceptions.IOError: [Errno 24] Too many open files: '/var/log/maas/oops/2014-12-26/OOPS-9157e9b65c315009c17fbf642a0f0f46.tmp'
===========================================================

There were also 18 occurrences on 12/21 and 36 oops files.

This is for maas: 1.7.1~rc1+bzr3313-0ubuntu1~trusty1