ubuntu-bug eucalyptus-common attaches massive files

Bug #541486 reported by Scott Moser on 2010-03-18
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
apport (Ubuntu)
Undecided
Unassigned
Lucid
Undecided
Unassigned
eucalyptus (Ubuntu)
Low
Dustin Kirkland 
Lucid
Low
Dustin Kirkland 

Bug Description

Once bug 520775 is fixed so that someone can successfully run it, running 'ubuntu-bug eucalyptus-common' (or any binary package with eucalyptus as source) will attach massive files in /var/log: axis2c.log cc.log cloud-debug.log cloud-output.log httpd-cc_error_log .

$ ls -h --size axis2c.log cc.log cloud-debug.log cloud-output.log httpd-cc_error_log | cat
 14M axis2c.log
 32M cc.log
9.3M cloud-debug.log
8.5M cloud-output.log
4.0K httpd-cc_error_log

The above is from a fairly idle cloud (2 systems, maybe 6 instances run ever, 4 images loaded).

I don't know if this is desirable or not. While the logs may be useful, it seems to me that uploading dozens of megabytes is just going to make the user less likely to use the tool.

ProblemType: Bug
.etc.eucalyptus.eucalyptus.cc.conf: CC_NAME="cluster1"
Architecture: amd64
Date: Thu Mar 18 15:35:56 2010
DistroRelease: Ubuntu 10.04
EasilyReproduced: Yes
Package: eucalyptus-common 1.6.2-0ubuntu13 [modified: usr/share/apport/package-hooks/source_eucalyptus.py]
ProcEnviron:
 LANG=en_US.UTF-8
 SHELL=/bin/bash
ProcVersionSignature: Ubuntu 2.6.32-16.25-server
SourcePackage: eucalyptus
UECDescSetup: No
Uname: Linux 2.6.32-16-server x86_64

Scott Moser (smoser) wrote :
Scott Moser (smoser) wrote :

(note, i manually modified /usr/share/apport/package-hooks/source_eucalyptus.py so I wouldn't get those attached here). If you want to see a full set of attachments, see bug 541470 .

Scott Moser (smoser) wrote :

Subscribing Matt, his initials are around the attachments of these files.

Matt, maybe you can add insight as to whether you think its sensible to attach such files ?

Matt Zimmerman (mdz) wrote :

According to the upstream developers at the time, it was considered appropriate to gather these logs for bug reports. Perhaps the real bug is that they are huge (not rotated often enough or too verbose by default)? Feel free to do as you feel is best with the apport hook in any case.

Separately, it might be nice if apport offered the option to selectively delete certain attachments where the submitter could be certain they were not relevant (or did not wish to disclose private data). I'll file a wishlist bug about that.

Matt Zimmerman (mdz) wrote :

(apport bug filed as bug 541517)

Thierry Carrez (ttx) wrote :

Agreed, we should not attach those files by default. Lots of people don't want to upload 34 Mb of log files when they report a bug, and it might indeed hinder the usage of the tool. Targeting to Lucid to keep it in scope.

Changed in eucalyptus (Ubuntu):
importance: Undecided → Low
status: New → Confirmed
Thierry Carrez (ttx) on 2010-03-19
Changed in eucalyptus (Ubuntu Lucid):
milestone: none → ubuntu-10.04-beta-2
Scott Moser (smoser) wrote :

I added an apport task, as I'd like to have this fixed by adding support for compression of files into hookutils of apport, and then use that in eucalyptus's hook.

See the attached 2 patches for my solution.

Martin Pitt (pitti) wrote :

Please note that Report objects (from the ProblemReport super class) already have that built in. To attach a file and force compression, do

  report['FooFile'] = ('/tmp/foo.log', True).

Please see

  python -c 'import problem_report; help(problem_report.ProblemReport)'

the "write" method.

Martin Pitt (pitti) wrote :

But aside from that, perhaps it might also make sense to preselect some interesting information on the hook side, or only attach the last 1 MB, or log entries from the last 24 hours?

Changed in apport (Ubuntu Lucid):
status: New → Invalid
Scott Moser (smoser) wrote :

I think at the moment we'll just want to attach the entire log. At some point the log files will hopefully be more reasonably sized by turning down debug output or such. Compression will turn 60M or so down into < 10, which isn't *too* bad.

Thanks for the report['FooFile'] syntax.

tags: added: patch
Scott Moser (smoser) wrote :

This patch contains the suggested fix, using Martin's suggestions.

Changed in eucalyptus (Ubuntu Lucid):
assignee: nobody → Dustin Kirkland (kirkland)
status: Confirmed → In Progress
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package eucalyptus - 1.6.2-0ubuntu21

---------------
eucalyptus (1.6.2-0ubuntu21) lucid; urgency=low

  * debian/source_eucalyptus.py (LP: #541486):
    - simplify questions to user.
    - give user option to not attach logs, compress them if attached.
 -- Scott Moser <email address hidden> Tue, 23 Mar 2010 18:06:20 -0400

Changed in eucalyptus (Ubuntu Lucid):
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers