Keystone logs from the node renamed after intergated with apache2

Bug #1455756 reported by Tatyanka
22
This bug affects 4 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Low
Bartłomiej Piotrowski
6.1.x
Invalid
Low
Vladimir Kuklin
7.0.x
Won't Fix
Low
Fuel Library (Deprecated)
8.0.x
Fix Released
Low
Bartłomiej Piotrowski

Bug Description

[root@nailgun ostf]# cat /etc/fuel/version.yaml
VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.1"
  openstack_version: "2014.2.2-6.1"
  api: "1.0"
  build_number: "421"
  build_id: "2015-05-15_20-55-26"
  nailgun_sha: "eca3532abfcc15dc6c55f682dd3f037235c4e858"
  python-fuelclient_sha: "38765563e1a7f14f45201fd47cf507393ff5d673"
  astute_sha: "7e3e81f2e3d4557d5d1fd61a424df95c4d265601"
  fuel-library_sha: "1645fe45f226cdd6d2829bea9912d0baa3be5033"
  fuel-ostf_sha: "9ce1800749081780b8b2a4a7eab6586583ffaf33"
  fuelmain_sha: "d249d74f9beb5935c31b8ee674eb1ed696672f6e"

steps to reproduce:

Deploy env in any configuration
Generate diagnostic snapshot, look if keystone logs are here, ssh to master node, check if keystone logs are in remote folders

Actual result:
only keystone-manage are here, so that if some ostf test fails with 401 error from keystone, there is no possibility to find what was strange in the logs

Revision history for this message
Tatyanka (tatyana-leontovich) wrote :
Changed in fuel:
importance: Undecided → High
status: New → Triaged
Changed in fuel:
assignee: Fuel Library Team (fuel-library) → Sergii Golovatiuk (sgolovatiuk)
Revision history for this message
Sergii Golovatiuk (sgolovatiuk) wrote :

This task can be split into several

1. Since we move keystone to apache it writes logs to
/var/log/apache2/keystone_wsgi_main_error.log
/var/log/apache2/keystone_wsgi_main_access.log
/var/log/keystone/admin.log
/var/log/keystone/main.log
/var/log/keystone/keystone-manage.log

2. Apache is not configured to send to syslog. Also syslog settings became useless

3. logrotate is not configured to rotate these logs.

Changed in fuel:
assignee: Sergii Golovatiuk (sgolovatiuk) → Bogdan Dobrelya (bogdando)
Revision history for this message
Sergii Golovatiuk (sgolovatiuk) wrote :

2. syslog settings in keystone configuration

Changed in fuel:
status: Triaged → Confirmed
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

Now keystone logs from syslog can be found at /var/log/user.log locally, and at /var/log/remote/node*/{admin,main}.log at remote log server. Apache also provides logrotate templates for its own logs out of box, so Fuel may leave it as is. /nothing cannot be done for the 6.1 here as there is no time left in this dev cycle to redesign keystone -> apache2 , and keystone -> syslog logging.

Changed in fuel:
importance: High → Medium
milestone: 6.1 → 7.0
summary: - Keystone logs from the node are missed in snapshot
+ Keystone logs from the node renamed after intergated with apache2
no longer affects: fuel/7.0.x
tags: added: logging release-notes
tags: added: docs
summary: - Keystone logs from the node renamed after intergated with apache2
+ Keystone logs are missing in snapshot and on master node
summary: - Keystone logs are missing in snapshot and on master node
+ Keystone logs from the node renamed after intergated with apache2
Changed in fuel:
importance: Medium → High
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/184675

Changed in fuel:
assignee: Bogdan Dobrelya (bogdando) → Vladimir Kuklin (vkuklin)
status: Confirmed → In Progress
Changed in fuel:
assignee: Vladimir Kuklin (vkuklin) → Bartlomiej Piotrowski (bpiotrowski)
Changed in fuel:
assignee: Bartlomiej Piotrowski (bpiotrowski) → Vladimir Kuklin (vkuklin)
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

Removed release notes tag as we reverted keystone under apache for the 6.1 release.

tags: removed: docs release-notes
Changed in fuel:
status: In Progress → Confirmed
Revision history for this message
Dennis Dmitriev (ddmitriev) wrote :

In 7.0, there are /var/log/keystone-all.log on node-1 (controller), /var/log/remote/node-1.test.domain.local/keystone-all.log on master node and ./10.109.5.2/var/log/docker-logs/remote/node-1.test.domain.local/keystone-all.log .

This log contains tracebacks and errors like "TRACE keystone.common.wsgi DBConnectionError: (OperationalError)" in case if mysql inaccessible, for example.

Mark this bug as invalid for 7.0.

api: '1.0'
astute_sha: b1f37a988e097175cbbd14338286017b46b584c3
auth_required: true
build_id: 2015-07-23_10-59-34
build_number: '82'
feature_groups:
- mirantis
fuel-agent_sha: bc25d3b728e823e6154bac0442f6b88747ac48e1
fuel-library_sha: 58d94955479aee4b09c2b658d90f57083e668ce4
fuel-ostf_sha: 94a483c8aba639be3b96616c1396ef290dcc00cd
fuelmain_sha: 68871248453b432ecca0cca5a43ef0aad6079c39
nailgun_sha: d1087923e45b0e6d946ce48cb05a71733e1ac113
openstack_version: 2015.1.0-7.0
production: docker
python-fuelclient_sha: 471948c26a8c45c091c5593e54e6727405136eca
release: '7.0'
release_versions:
  2015.1.0-7.0:
    VERSION:
      api: '1.0'
      astute_sha: b1f37a988e097175cbbd14338286017b46b584c3
      build_id: 2015-07-23_10-59-34
      build_number: '82'
      feature_groups:
      - mirantis
      fuel-agent_sha: bc25d3b728e823e6154bac0442f6b88747ac48e1
      fuel-library_sha: 58d94955479aee4b09c2b658d90f57083e668ce4
      fuel-ostf_sha: 94a483c8aba639be3b96616c1396ef290dcc00cd
      fuelmain_sha: 68871248453b432ecca0cca5a43ef0aad6079c39
      nailgun_sha: d1087923e45b0e6d946ce48cb05a71733e1ac113
      openstack_version: 2015.1.0-7.0
      production: docker
      python-fuelclient_sha: 471948c26a8c45c091c5593e54e6727405136eca
      release: '7.0'

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-library (master)

Change abandoned by Fuel DevOps Robot (<email address hidden>) on branch: master
Review: https://review.openstack.org/184675
Reason: This review is > 4 weeks without comment, and failed Jenkins the last time it was checked. We are abandoning this for now. Feel free to reactivate the review by pressing the restore button and leaving a 'recheck' comment to get fresh test results.

Revision history for this message
Simon Pasquier (simon-pasquier) wrote :

IMO the status of this bug should be 'Confirmed' since it's still valid for MOS 7.0. Currently /var/log/keystone-all.log doesn't contain all the logs from Keystone as described in [1].

[1] https://bugs.launchpad.net/fuel/+bug/1491282

Revision history for this message
Matthew Mosesohn (raytrac3r) wrote :

This is already fixed. Logs are in keystone_wsgi_* filenames now.

Dmitry Pyzhov (dpyzhov)
tags: added: area-library
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

verified 169 iso

Dmitry Pyzhov (dpyzhov)
Changed in fuel:
assignee: Vladimir Kuklin (vkuklin) → Bartłomiej Piotrowski (bpiotrowski)
milestone: 7.0 → 8.0
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.