openstack ansible test jobs are logging excessive amounts of data
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack-Ansible |
Fix Released
|
High
|
Jesse Pretorius |
Bug Description
The syslog and user.log files captured by the openstack ansible aio jobs are each about half a gigabyte. Together the come out to about a gigabyte. These means that in total every one of these jobs is logging about 1.1GB of data. I believe this is a factor in our recent increased disk usage on the log server which has forced us to decrease log retention to 2 months.
See http://
Ideally two things would happen here. The first is we would reduce the total amount of data being logged to something more reasonable. For comparison a neutron devstack tempest test run collects about 260MB of uncompressed log data. Second you should be compressing your logs before uploading them to the log server.
Ian Wienand (iwienand) wrote : | #1 |
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible (master) | #2 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible (master) | #3 |
Fix proposed to branch: master
Review: https:/
Changed in openstack-ansible: | |
assignee: | nobody → Jesse Pretorius (jesse-pretorius) |
status: | New → In Progress |
Changed in openstack-ansible: | |
importance: | Undecided → High |
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible (master) | #4 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit a5a5bf80b635700
Author: Jesse Pretorius <email address hidden>
Date: Wed Sep 7 08:03:49 2016 +0100
Skip V-38471 for CI execution
We skip V-38471 as it generates a huge amount of log
entries in syslog and the syslog files are gathered
in OpenStack-CI.
Related-Bug: #1620849
Change-Id: Ib2dc7f0218e1fd
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-security (master) | #5 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-security (master) | #6 |
Fix proposed to branch: master
Review: https:/
Changed in openstack-ansible: | |
assignee: | Jesse Pretorius (jesse-pretorius) → Major Hayden (rackerhacker) |
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-security (master) | #7 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 1889953f4813545
Author: Jesse Pretorius <email address hidden>
Date: Wed Sep 7 13:07:34 2016 +0100
Collect compressed logs after functional test execution
This change enables log collection within the gate so that further
analysis on gate tasks can be performed post build. This is very
useful when debugging problems and also for investigating the
consequences of patches once they've been tested.
Related-Bug: #1620849
Change-Id: I2bb923ebcd7311
Changed in openstack-ansible: | |
status: | In Progress → Fix Released |
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible-security (master) | #8 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 98fdd520a096877
Author: Major Hayden <email address hidden>
Date: Wed Sep 7 07:38:11 2016 -0500
Disable DAC change auditing
This patch disables all of the discretionary access control (DAC)
auditing in auditd. This should reduce the volume of logs created
during deployments and during OpenStack CI jobs.
The patch also corrects an incorrect key in the audit logs for
V-38568.
Closes-Bug: 1620849
Change-Id: I193f739647cfb7
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-security (stable/mitaka) | #9 |
Fix proposed to branch: stable/mitaka
Review: https:/
OpenStack Infra (hudson-openstack) wrote : | #10 |
Fix proposed to branch: stable/mitaka
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Change abandoned on openstack-ansible-security (stable/mitaka) | #11 |
Change abandoned by Major Hayden (<email address hidden>) on branch: stable/mitaka
Review: https:/
Reason: Duplicate
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-security (liberty) | #12 |
Fix proposed to branch: liberty
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible-security (stable/mitaka) | #13 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: stable/mitaka
commit ca9b7decdf77bdd
Author: Major Hayden <email address hidden>
Date: Wed Sep 7 07:38:11 2016 -0500
Disable DAC change auditing
This patch disables all of the discretionary access control (DAC)
auditing in auditd. This should reduce the volume of logs created
during deployments and during OpenStack CI jobs.
The patch also corrects an incorrect key in the audit logs for
V-38568.
Manual backport of I193f739647cfb7
Closes-Bug: 1620849
Change-Id: I77b1322874ca3c
tags: | added: in-stable-mitaka |
tags: | added: in-liberty |
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible-security (liberty) | #14 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: liberty
commit 77eaaf2262f6d97
Author: Major Hayden <email address hidden>
Date: Wed Sep 7 07:38:11 2016 -0500
Disable DAC change auditing
This patch disables all of the discretionary access control (DAC)
auditing in auditd. This should reduce the volume of logs created
during deployments and during OpenStack CI jobs.
The patch also corrects an incorrect key in the audit logs for
V-38568.
Manual backport of I193f739647cfb7
Change-Id: Ie6266dacc29b9f
Closes-Bug: 1620849
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-galera_server (master) | #15 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-haproxy_server (master) | #16 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-lxc_container_create (master) | #17 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-lxc_hosts (master) | #18 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-memcached_server (master) | #19 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-openstack_hosts (master) | #20 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-openstack_openrc (master) | #21 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_aodh (master) | #22 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_barbican (master) | #23 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_ceilometer (master) | #24 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_cinder (master) | #25 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_cloudkitty (master) | #26 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_designate (master) | #27 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_glance (master) | #28 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_gnocchi (master) | #29 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_heat (master) | #30 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_horizon (master) | #31 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_ironic (master) | #32 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_keystone (master) | #33 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_magnum (master) | #34 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_monasca (master) | #35 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_neutron (master) | #36 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_nova (master) | #37 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_rally (master) | #38 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_sahara (master) | #39 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_swift (master) | #40 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_tempest (master) | #41 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_watcher (master) | #42 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_zaqar (master) | #43 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-pip_install (master) | #44 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-pip_lock_down (master) | #45 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-rabbitmq_server (master) | #46 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-repo_build (master) | #47 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-repo_server (master) | #48 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-rsyslog_client (master) | #49 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-rsyslog_server (master) | #50 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-tests (master) | #51 |
Related fix proposed to branch: master
Review: https:/
Changed in openstack-ansible: | |
assignee: | Major Hayden (rackerhacker) → Jesse Pretorius (jesse-pretorius) |
milestone: | none → newton-rc1 |
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-rsyslog_client (master) | #52 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit b556bbcac052e75
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:56:07 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Idf85508e520562
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-rsyslog_server (master) | #53 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit ba7b4b4a36fb4a8
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:56:36 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ib9afec79a41293
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-tests (master) | #54 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit aac2f5411d015d1
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:58:01 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I323987e281eff6
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-repo_server (master) | #55 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit a1ba9fc5ad073dc
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:55:32 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ife23b1d9118bd9
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_zaqar (master) | #56 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 58670ced78a1836
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:51:02 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Iad23c574d88885
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-repo_build (master) | #57 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 322f15e246f6ae6
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:54:51 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: If6aba5dc51838d
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_watcher (master) | #58 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 968bcf84eba979b
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:50:24 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I518a677dff2722
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_swift (master) | #59 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 1690a5d5129a056
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:48:44 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ie13ecef2958a92
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_tempest (master) | #60 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 7faecd1d264477e
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:49:44 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I815d71b01def2b
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-rabbitmq_server (master) | #61 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit e533c25ce067b03
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:53:50 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I5eb6b16deaf3e0
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_keystone (master) | #62 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 07509721e8dbb25
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:38:13 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ia37c4fe369dd8c
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-pip_install (master) | #63 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 903dab08a80e84b
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:51:46 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I97d783e36b8cda
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-pip_lock_down (master) | #64 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 43c239916af3d48
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:52:21 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ibb9d639f9f4f47
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_cloudkitty (master) | #65 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 6dbf70db45a9d6c
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:30:35 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I73b927ca288faa
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_rally (master) | #66 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 6c33995f3b5014a
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:45:41 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I60842285cd915d
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_designate (master) | #67 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit a900e8cd96ea16f
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:31:14 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ia8a9f927a6c86c
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_sahara (master) | #68 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit db2407c1d922272
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:46:22 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ifb0d46c52f0cf3
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_cinder (master) | #69 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit b5ce16c94982c1b
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:28:14 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I0a084eaec2340d
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-openstack_openrc (master) | #70 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 62e3065441f3d71
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:24:29 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Id7388cb3ed6366
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-apt_package_pinning (master) | #71 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 1c01428d33a3a3f
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 09:55:37 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Related-Bug: #1620849
Change-Id: I82a3b0b4fd05db
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_magnum (master) | #72 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 84f70de1c906cd3
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:40:12 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I8f2d557b64105f
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_monasca (master) | #73 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit d670672d9965b41
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:40:50 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ic1f304611a16fa
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-haproxy_server (master) | #74 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 9714f8e5f332210
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:12:17 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ie1d80b2d5dfeee
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-memcached_server (master) | #75 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 3b32f51107e7ab2
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:19:50 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ice645e23ba4e50
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-openstack_hosts (master) | #76 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 805f73a8dee6aaf
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:23:17 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ic2e35b3c0af7d2
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-galera_client (master) | #77 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit acc80d216905d20
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:05:52 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Related-Bug: #1620849
Change-Id: I5854c50807befb
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-ceph_client (master) | #78 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit b6e5451dd48ee33
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:02:13 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Related-Bug: #1620849
Change-Id: I5fdcaa98e78848
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-lxc_container_create (master) | #79 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 84b73aea3f83d96
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:14:10 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I117324c77d1539
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-lxc_hosts (master) | #80 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 101498fda5397d2
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:18:50 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ied2a2f817a88a1
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_barbican (master) | #81 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 2bf4c78088f94b7
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:26:40 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: If85a4d7fe58bfe
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_gnocchi (master) | #82 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 418b383287fbdc3
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:32:42 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: If213cc3de1b4cf
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_ironic (master) | #83 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 8cf25017e49da32
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:34:51 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I00a05dfd477403
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_aodh (master) | #84 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit f02ee507b7aadd7
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:25:52 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I44f7031abb7d30
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_heat (master) | #85 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 3668e42adf8b909
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:33:32 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I9d411d66a36508
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_horizon (master) | #86 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit f3274370baf4b2f
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:34:03 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ie733bf9e40942c
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-galera_server (master) | #87 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 45f9c76b1c2d033
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:10:38 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I5aad324d7ac653
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_neutron (master) | #88 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 52b66dd18679f2f
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:43:10 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: Ie09211a7761d75
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible (master) | #89 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 64708ec7d1efdf2
Author: Jesse Pretorius <email address hidden>
Date: Wed Sep 7 09:00:06 2016 +0100
Compress all gathered logs for CI
In order to ensure that all logs gathered do not take up
too much space on CI systems, the logs are gzipped.
In order to make them viewable via a browser from the CI
log host, the files are renamed to .txt before compressing
them.
Closes-Bug: #1620849
Change-Id: I71e629c505770b
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_ceilometer (master) | #90 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 40850a7d675d1f1
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:27:21 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I67323d66d9f681
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_nova (master) | #91 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit ec5b10fc34d7a24
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:44:51 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I867081cb1f263e
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_glance (master) | #92 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 482a97671c1e259
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:32:03 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I2ef51aa6ab35a1
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to openstack-ansible-os_trove (master) | #93 |
Related fix proposed to branch: master
Review: https:/
OpenStack Infra (hudson-openstack) wrote : Related fix merged to openstack-ansible-os_trove (master) | #94 |
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 7a34707fe4129d9
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 16 09:12:13 2016 +0100
Compress test execution logs
The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUF
from the CI jobs is recorded in the exact order of execution.
Change-Id: I4fe1743d5323ac
Related-Bug: #1620849
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/openstack-ansible-security 13.3.4 | #95 |
This issue was fixed in the openstack/
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/openstack-ansible-security 12.2.4 | #96 |
This issue was fixed in the openstack/
The bulk of the logs appears to be along the lines of
--- xenial- osic-cloud1- 4101327 audispd: node=ubuntu- xenial- osic-cloud1- 4101327 type=EOE msg=audit( 1473092029. 822:547227) : xenial- osic-cloud1- 4101327 audispd: node=ubuntu- xenial- osic-cloud1- 4101327 type=SYSCALL msg=audit( 1473092030. 022:547228) : arch=c000003e syscall=94 success=yes exit=0 a0=7ffc49f44d80 a1=6e a2=4 a3=0 items=1 ppid=26131 pid=26132 auid=3000 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4 comm="rsync" exe="/usr/ bin/rsync" key="perm_ modV-38558" xenial- osic-cloud1- 4101327 audispd: node=ubuntu- xenial- osic-cloud1- 4101327 type=CWD msg=audit( 1473092030. 022:547228) : cwd="/home/ jenkins/ workspace/ gate-openstack- ansible- openstack- ansible- aio-ubuntu- xenial- nv/logs/ host"
Sep 5 16:13:49 ubuntu-
Sep 5 16:13:50 ubuntu-
Sep 5 16:13:50 ubuntu-
----
I'm almost certain this is coming from ansible-security in [1]. mentioned in [2] at
---
With modifying the active line so that it contains yes, the audispd daemon will start logging events. The logging method depends on further setting in the same file.
---
So this seems to be behaving according to its specification, but I wonder how much verbosity is helpful, especially in CI. At the very least it compresses well (~15mb) which could be done in [1]
[1] https:/ /github. com/openstack/ openstack- ansible- security/ blob/master/ tasks/auditd. yml#L288 /access. redhat. com/solutions/ 2380591 docs.openstack. org/developer/ openstack- ansible- security/ controls- cat1.html git.openstack. org/cgit/ openstack/ openstack- ansible/ tree/scripts/ scripts- library. sh#n134
[2] https:/
[3] http://
[4] http://