openstack ansible test jobs are logging excessive amounts of data

[Clark Boylan]

The syslog and user.log files captured by the openstack ansible aio jobs are each about half a gigabyte. Together the come out to about a gigabyte. These means that in total every one of these jobs is logging about 1.1GB of data. I believe this is a factor in our recent increased disk usage on the log server which has forced us to decrease log retention to 2 months.

See http://logs.openstack.org/01/365601/3/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-xenial-nv/ea577a3/logs/host/ as an example.

Ideally two things would happen here. The first is we would reduce the total amount of data being logged to something more reasonable. For comparison a neutron devstack tempest test run collects about 260MB of uncompressed log data. Second you should be compressing your logs before uploading them to the log server.

[Ian Wienand (iwienand)]

The bulk of the logs appears to be along the lines of

---
Sep 5 16:13:49 ubuntu-xenial-osic-cloud1-4101327 audispd: node=ubuntu-xenial-osic-cloud1-4101327 type=EOE msg=audit(1473092029.822:547227):
Sep 5 16:13:50 ubuntu-xenial-osic-cloud1-4101327 audispd: node=ubuntu-xenial-osic-cloud1-4101327 type=SYSCALL msg=audit(1473092030.022:547228): arch=c000003e syscall=94 success=yes exit=0 a0=7ffc49f44d80 a1=6e a2=4 a3=0 items=1 ppid=26131 pid=26132 auid=3000 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4 comm="rsync" exe="/usr/bin/rsync" key="perm_modV-38558"
Sep 5 16:13:50 ubuntu-xenial-osic-cloud1-4101327 audispd: node=ubuntu-xenial-osic-cloud1-4101327 type=CWD msg=audit(1473092030.022:547228): cwd="/home/jenkins/workspace/gate-openstack-ansible-openstack-ansible-aio-ubuntu-xenial-nv/logs/host"
----

I'm almost certain this is coming from ansible-security in [1]. mentioned in [2] at

---
With modifying the active line so that it contains yes, the audispd daemon will start logging events. The logging method depends on further setting in the same file.
---

So this seems to be behaving according to its specification, but I wonder how much verbosity is helpful, especially in CI. At the very least it compresses well (~15mb) which could be done in [1]

[1] https://github.com/openstack/openstack-ansible-security/blob/master/tasks/auditd.yml#L288
[2] https://access.redhat.com/solutions/2380591
[3] http://docs.openstack.org/developer/openstack-ansible-security/controls-cat1.html
[4] http://git.openstack.org/cgit/openstack/openstack-ansible/tree/scripts/scripts-library.sh#n134

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/366534

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/366570

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/366534
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=a5a5bf80b635700eacecf7de228d28c184271b80
Submitter: Jenkins
Branch: master

commit a5a5bf80b635700eacecf7de228d28c184271b80
Author: Jesse Pretorius <email address hidden>
Date: Wed Sep 7 08:03:49 2016 +0100

    Skip V-38471 for CI execution

    We skip V-38471 as it generates a huge amount of log
    entries in syslog and the syslog files are gathered
    in OpenStack-CI.

    Related-Bug: #1620849
    Change-Id: Ib2dc7f0218e1fd034afea5c51664c155860350f7

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/366709

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/366725

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/366709
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-security/commit/?id=1889953f48135451a65102b7e347b2342f846190
Submitter: Jenkins
Branch: master

commit 1889953f48135451a65102b7e347b2342f846190
Author: Jesse Pretorius <email address hidden>
Date: Wed Sep 7 13:07:34 2016 +0100

    Collect compressed logs after functional test execution

    This change enables log collection within the gate so that further
    analysis on gate tasks can be performed post build. This is very
    useful when debugging problems and also for investigating the
    consequences of patches once they've been tested.

    Related-Bug: #1620849
    Change-Id: I2bb923ebcd73114c1199b14f9b769435596091eb

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/366725
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-security/commit/?id=98fdd520a096877a535495c032e8efcaa0cf40b5
Submitter: Jenkins
Branch: master

commit 98fdd520a096877a535495c032e8efcaa0cf40b5
Author: Major Hayden <email address hidden>
Date: Wed Sep 7 07:38:11 2016 -0500

    Disable DAC change auditing

    This patch disables all of the discretionary access control (DAC)
    auditing in auditd. This should reduce the volume of logs created
    during deployments and during OpenStack CI jobs.

    The patch also corrects an incorrect key in the audit logs for
    V-38568.

    Closes-Bug: 1620849
    Change-Id: I193f739647cfb7d0ce395984b51867bf6bd46cd8

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/366829

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/366840

[OpenStack Infra (hudson-openstack)]

Change abandoned by Major Hayden (<email address hidden>) on branch: stable/mitaka
Review: https://review.openstack.org/366840
Reason: Duplicate

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: liberty
Review: https://review.openstack.org/366845

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/366829
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-security/commit/?id=ca9b7decdf77bdd20c13694e348e9e21ff7a1688
Submitter: Jenkins
Branch: stable/mitaka

commit ca9b7decdf77bdd20c13694e348e9e21ff7a1688
Author: Major Hayden <email address hidden>
Date: Wed Sep 7 07:38:11 2016 -0500

    Disable DAC change auditing

    This patch disables all of the discretionary access control (DAC)
    auditing in auditd. This should reduce the volume of logs created
    during deployments and during OpenStack CI jobs.

    The patch also corrects an incorrect key in the audit logs for
    V-38568.

    Manual backport of I193f739647cfb7d0ce395984b51867bf6bd46cd8.

    Closes-Bug: 1620849
    Change-Id: I77b1322874ca3c55cc8d52476bb1eda5d86de2dc

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/366845
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-security/commit/?id=77eaaf2262f6d97be512821f26609ea4a1392f43
Submitter: Jenkins
Branch: liberty

commit 77eaaf2262f6d97be512821f26609ea4a1392f43
Author: Major Hayden <email address hidden>
Date: Wed Sep 7 07:38:11 2016 -0500

    Disable DAC change auditing

    This patch disables all of the discretionary access control (DAC)
    auditing in auditd. This should reduce the volume of logs created
    during deployments and during OpenStack CI jobs.

    The patch also corrects an incorrect key in the audit logs for
    V-38568.

    Manual backport of I193f739647cfb7d0ce395984b51867bf6bd46cd8.

    Change-Id: Ie6266dacc29b9f110b8eced8c6bd184d156e91c5
    Closes-Bug: 1620849

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367846

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367847

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367849

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367852

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367855

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367859

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367860

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367862

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367863

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367864

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367865

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367866

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367867

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367868

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367869

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367870

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367872

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367874

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367876

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367881

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367882

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367885

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367886

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367888

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367889

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367891

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367892

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367893

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367894

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367895

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367896

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367897

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367899

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367900

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367902

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367903

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/367905

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367902
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-rsyslog_client/commit/?id=b556bbcac052e75d445744d764013ec5f58559a6
Submitter: Jenkins
Branch: master

commit b556bbcac052e75d445744d764013ec5f58559a6
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:56:07 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Idf85508e52056230bdadba8bccda936f192fb37e
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367903
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-rsyslog_server/commit/?id=ba7b4b4a36fb4a81b7a167fb473a54f9a010e37d
Submitter: Jenkins
Branch: master

commit ba7b4b4a36fb4a81b7a167fb473a54f9a010e37d
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:56:36 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ib9afec79a412938c66c09cf2283121c00c449e56
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367905
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-tests/commit/?id=aac2f5411d015d1ddc76e8f39188b7da4aa98862
Submitter: Jenkins
Branch: master

commit aac2f5411d015d1ddc76e8f39188b7da4aa98862
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:58:01 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I323987e281eff6245189109e6c4b17e999739b8c
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367900
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-repo_server/commit/?id=a1ba9fc5ad073dc654b436e3ac52b0f7e017251e
Submitter: Jenkins
Branch: master

commit a1ba9fc5ad073dc654b436e3ac52b0f7e017251e
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:55:32 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ife23b1d9118bd9c22eb2b62abb2842905a77f5fd
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367894
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_zaqar/commit/?id=58670ced78a1836d2fedddbfed4314f1945831c4
Submitter: Jenkins
Branch: master

commit 58670ced78a1836d2fedddbfed4314f1945831c4
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:51:02 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Iad23c574d88885bde901c2632bcd8fe410686d6b
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367899
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-repo_build/commit/?id=322f15e246f6ae6c273474a0155a365cfe928b11
Submitter: Jenkins
Branch: master

commit 322f15e246f6ae6c273474a0155a365cfe928b11
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:54:51 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: If6aba5dc51838d1ddad961f3d2d03a702b7e5f57
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367893
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_watcher/commit/?id=968bcf84eba979ba85840498dabc5e97c565494f
Submitter: Jenkins
Branch: master

commit 968bcf84eba979ba85840498dabc5e97c565494f
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:50:24 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I518a677dff2722c2fd9f343fa67a801252edea1d
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367891
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_swift/commit/?id=1690a5d5129a0561480e21728202d490d65e42ed
Submitter: Jenkins
Branch: master

commit 1690a5d5129a0561480e21728202d490d65e42ed
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:48:44 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ie13ecef2958a926933520cceeee6bfb669b94fce
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367892
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_tempest/commit/?id=7faecd1d264477edb69b8dbe8596370cd4d10218
Submitter: Jenkins
Branch: master

commit 7faecd1d264477edb69b8dbe8596370cd4d10218
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:49:44 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I815d71b01def2b327e1792cf98e2d336c09a5b2d
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367897
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-rabbitmq_server/commit/?id=e533c25ce067b039be0f5fe788d7ee40d6fb2eca
Submitter: Jenkins
Branch: master

commit e533c25ce067b039be0f5fe788d7ee40d6fb2eca
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:53:50 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I5eb6b16deaf3e0b01d46dae86ee40b1f8e90581d
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367876
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_keystone/commit/?id=07509721e8dbb2555eb9c78db7e7c297d18209ef
Submitter: Jenkins
Branch: master

commit 07509721e8dbb2555eb9c78db7e7c297d18209ef
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:38:13 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ia37c4fe369dd8ce9d49c21a46c575707b1826d46
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367895
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-pip_install/commit/?id=903dab08a80e84b2a50a129ebfb630b715ee784d
Submitter: Jenkins
Branch: master

commit 903dab08a80e84b2a50a129ebfb630b715ee784d
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:51:46 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I97d783e36b8cda13dece1a06b94ad39ad1b46a13
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367896
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-pip_lock_down/commit/?id=43c239916af3d48a017ad80386103c5eea539748
Submitter: Jenkins
Branch: master

commit 43c239916af3d48a017ad80386103c5eea539748
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:52:21 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ibb9d639f9f4f47fa4cbc86f83f3ad358dd7054d6
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367866
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_cloudkitty/commit/?id=6dbf70db45a9d6c7b7f830ac1f9602fe08b4a8e7
Submitter: Jenkins
Branch: master

commit 6dbf70db45a9d6c7b7f830ac1f9602fe08b4a8e7
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:30:35 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I73b927ca288faabe2b1d8e15473ce7114de0873e
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367888
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_rally/commit/?id=6c33995f3b5014a885e4d0887002dfd317bfb2cf
Submitter: Jenkins
Branch: master

commit 6c33995f3b5014a885e4d0887002dfd317bfb2cf
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:45:41 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I60842285cd915d3c61b54003328408a8fc3d68f2
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367867
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_designate/commit/?id=a900e8cd96ea16f78a8d87ac8d561ecb5a4b6b24
Submitter: Jenkins
Branch: master

commit a900e8cd96ea16f78a8d87ac8d561ecb5a4b6b24
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:31:14 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ia8a9f927a6c86c5a1fca4faf4c08f57df334674e
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367889
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_sahara/commit/?id=db2407c1d92227243199d5750bf0e477c32ed40d
Submitter: Jenkins
Branch: master

commit db2407c1d92227243199d5750bf0e477c32ed40d
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:46:22 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ifb0d46c52f0cf34877c3e1961fc73084c6810e49
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367865
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_cinder/commit/?id=b5ce16c94982c1bc4557b8c78b44ce363a9568b8
Submitter: Jenkins
Branch: master

commit b5ce16c94982c1bc4557b8c78b44ce363a9568b8
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:28:14 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I0a084eaec2340dbca6acc9cd41652462d80d875f
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367860
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-openstack_openrc/commit/?id=62e3065441f3d714fd9b481288f716b60482d22e
Submitter: Jenkins
Branch: master

commit 62e3065441f3d714fd9b481288f716b60482d22e
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:24:29 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Id7388cb3ed6366c4dfb62549b03643ed6492e437
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367836
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-apt_package_pinning/commit/?id=1c01428d33a3a3f3c9cd59cb3f97d89a9af70900
Submitter: Jenkins
Branch: master

commit 1c01428d33a3a3f3c9cd59cb3f97d89a9af70900
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 09:55:37 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Related-Bug: #1620849
    Change-Id: I82a3b0b4fd05dba19bf0f44752f15b95bad647a9

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367881
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_magnum/commit/?id=84f70de1c906cd32191c3567ce5f6bb84d2ffe57
Submitter: Jenkins
Branch: master

commit 84f70de1c906cd32191c3567ce5f6bb84d2ffe57
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:40:12 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I8f2d557b64105f1c6043c27bda790f72babb78a5
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367882
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_monasca/commit/?id=d670672d9965b41c6e4eaa3c88fb1b7f6493c32f
Submitter: Jenkins
Branch: master

commit d670672d9965b41c6e4eaa3c88fb1b7f6493c32f
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:40:50 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ic1f304611a16fafc4d3867108f76e938fa832110
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367847
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-haproxy_server/commit/?id=9714f8e5f33221016329329a0cd8d4cfd64842dd
Submitter: Jenkins
Branch: master

commit 9714f8e5f33221016329329a0cd8d4cfd64842dd
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:12:17 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ie1d80b2d5dfeee40f417917bf2ad3bca85ec52cc
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367855
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-memcached_server/commit/?id=3b32f51107e7ab2ef73ec7d549c44b24b115d5a1
Submitter: Jenkins
Branch: master

commit 3b32f51107e7ab2ef73ec7d549c44b24b115d5a1
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:19:50 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ice645e23ba4e505b54ff441f577400220e658754
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367859
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-openstack_hosts/commit/?id=805f73a8dee6aaf591d1f4ba6f1f8dc98887da5c
Submitter: Jenkins
Branch: master

commit 805f73a8dee6aaf591d1f4ba6f1f8dc98887da5c
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:23:17 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ic2e35b3c0af7d2fdc0b88f3073ac9ce8a966e3e8
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367840
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_client/commit/?id=acc80d216905d20f19238af496c96d4e9f6fe667
Submitter: Jenkins
Branch: master

commit acc80d216905d20f19238af496c96d4e9f6fe667
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:05:52 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Related-Bug: #1620849
    Change-Id: I5854c50807befb7bea95613cdc9d61611550da01

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367838
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-ceph_client/commit/?id=b6e5451dd48ee337c2ee47139a4a871eddbe423d
Submitter: Jenkins
Branch: master

commit b6e5451dd48ee337c2ee47139a4a871eddbe423d
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:02:13 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Related-Bug: #1620849
    Change-Id: I5fdcaa98e78848f4b6e34ea1ffa3de7ab1bcc4a8

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367849
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-lxc_container_create/commit/?id=84b73aea3f83d961cc007f5e2fa0582979da4ecc
Submitter: Jenkins
Branch: master

commit 84b73aea3f83d961cc007f5e2fa0582979da4ecc
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:14:10 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I117324c77d1539e130f9cc6daa6f0ceadc1e4f28
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367852
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-lxc_hosts/commit/?id=101498fda5397d279a6cd7321c7d65491dd90c51
Submitter: Jenkins
Branch: master

commit 101498fda5397d279a6cd7321c7d65491dd90c51
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:18:50 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ied2a2f817a88a1326d446fe77a0f666a63a6e3d2
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367863
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_barbican/commit/?id=2bf4c78088f94b7e5808aece29a91ae42db0df6e
Submitter: Jenkins
Branch: master

commit 2bf4c78088f94b7e5808aece29a91ae42db0df6e
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:26:40 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: If85a4d7fe58bfeef99e68714bb2a3bbc94ce7a67
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367869
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_gnocchi/commit/?id=418b383287fbdc3e79bef19641d058fe1bf5ab8a
Submitter: Jenkins
Branch: master

commit 418b383287fbdc3e79bef19641d058fe1bf5ab8a
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:32:42 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: If213cc3de1b4cf500f9497452d12ab1e1f67446c
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367874
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_ironic/commit/?id=8cf25017e49da321cb2274b516df64e2a120c370
Submitter: Jenkins
Branch: master

commit 8cf25017e49da321cb2274b516df64e2a120c370
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:34:51 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I00a05dfd4774036822bc2b19f010c00bd50b31f2
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367862
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_aodh/commit/?id=f02ee507b7aadd75b813c88212aab9b5b3e0d4e4
Submitter: Jenkins
Branch: master

commit f02ee507b7aadd75b813c88212aab9b5b3e0d4e4
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:25:52 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I44f7031abb7d30701e568d5f4ac1ebc9a9225c63
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367870
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_heat/commit/?id=3668e42adf8b909fc0bcee0422a9a642c9b55c24
Submitter: Jenkins
Branch: master

commit 3668e42adf8b909fc0bcee0422a9a642c9b55c24
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:33:32 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I9d411d66a365086e739dddfc56fdc78ab30c4712
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367872
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_horizon/commit/?id=f3274370baf4b2f0e69e2f58603bf8daface709d
Submitter: Jenkins
Branch: master

commit f3274370baf4b2f0e69e2f58603bf8daface709d
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:34:03 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ie733bf9e40942cb4a302b351fee55c79aed98431
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367846
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_server/commit/?id=45f9c76b1c2d0333832c4ecf8a754f94fccd18ee
Submitter: Jenkins
Branch: master

commit 45f9c76b1c2d0333832c4ecf8a754f94fccd18ee
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:10:38 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I5aad324d7ac6535e35d635b58599f6a54436da5b
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367885
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_neutron/commit/?id=52b66dd18679f2ff0e95d445df7f20abcf7addc1
Submitter: Jenkins
Branch: master

commit 52b66dd18679f2ff0e95d445df7f20abcf7addc1
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:43:10 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: Ie09211a7761d759c71a5fcbe7062df0196e22b58
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/366570
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=64708ec7d1efdf271d463f2ae80d304149417d3d
Submitter: Jenkins
Branch: master

commit 64708ec7d1efdf271d463f2ae80d304149417d3d
Author: Jesse Pretorius <email address hidden>
Date: Wed Sep 7 09:00:06 2016 +0100

    Compress all gathered logs for CI

    In order to ensure that all logs gathered do not take up
    too much space on CI systems, the logs are gzipped.

    In order to make them viewable via a browser from the CI
    log host, the files are renamed to .txt before compressing
    them.

    Closes-Bug: #1620849
    Change-Id: I71e629c505770b8e95a6328c79d46ab45ee0300a

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367864
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_ceilometer/commit/?id=40850a7d675d1f1dd4966de3828be75f26ee713d
Submitter: Jenkins
Branch: master

commit 40850a7d675d1f1dd4966de3828be75f26ee713d
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:27:21 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I67323d66d9f6812bd1cfbfe982a931c4a5cd30ba
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367886
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_nova/commit/?id=ec5b10fc34d7a24298810c852ec2358c84825413
Submitter: Jenkins
Branch: master

commit ec5b10fc34d7a24298810c852ec2358c84825413
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:44:51 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I867081cb1f263e554f7dbe02791a46c9d2cef60f
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/367868
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_glance/commit/?id=482a97671c1e2594188331b95024b603623346a6
Submitter: Jenkins
Branch: master

commit 482a97671c1e2594188331b95024b603623346a6
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 9 10:32:03 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I2ef51aa6ab35a1a8d079fe395817d9967dfada1c
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/371344

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/371344
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_trove/commit/?id=7a34707fe4129d9a08f5351291f57d2cfb07b828
Submitter: Jenkins
Branch: master

commit 7a34707fe4129d9a08f5351291f57d2cfb07b828
Author: Jesse Pretorius <email address hidden>
Date: Fri Sep 16 09:12:13 2016 +0100

    Compress test execution logs

    The volume of logs we collect in CI jobs are extensive. This
    patch ensures that the logs collected are compressed to reduce
    the space taken in CI systems.

    PYTHONUNBUFFERED is also set to ensure that the console log
    from the CI jobs is recorded in the exact order of execution.

    Change-Id: I4fe1743d5323ac9cdb70047ae17c4c438d6e4997
    Related-Bug: #1620849

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-security 13.3.4 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-security 12.2.4 release.