Shotgun doesn't dumps subdirectories if Fabric failed on collecting files with long names

Bug #1543119 reported by Alexander Kislitsky
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Invalid
High
Fuel Sustaining
Mitaka
Won't Fix
High
Fuel Python (Deprecated)

Bug Description

If we have the following configuration in the settings.yaml:

  - type: dir
    path: /var/log
    exclude:
      - atop/
      - dump/

The subdirecory docker-logs is not included into the snapshot.

Revision history for this message
Ihor Kalnytskyi (ikalnytskyi) wrote :

(my comment from bug 1541390)

My investigations reveal the following things:

- We store snapshots in `/var/log/dump`
- Shotgun tries to download the whole `/var/log`
- Despite the fact Shotgun has `dump/` in exclusion list for `/var/log`, the real exclusion is taking place post-factum (when it's completely downloaded)
- If there're files in `/var/log/dump/`, there's a chance that path to them is too long, and that Fabric fails to retrieve them.
- As we know from my previous explanation above, Fabric tries to download `/var/log` file-by-file recursively, but if it fails to download at least one file - the whole downloading will be aborted.
- So it fails to download file due to long path (File name too long) and we miss docker-logs in the snapshot.

Dmitry Pyzhov (dpyzhov)
tags: added: tech-debt
summary: - Shotgun doesn't dumps subdirectories if 'exclude' is used for 'dir'
+ Shotgun doesn't dumps subdirectories if Fabric failed on collecting
+ files with long names
Changed in fuel:
milestone: 9.0 → 10.0
Revision history for this message
Dmitry Pyzhov (dpyzhov) wrote :

Technical debt, doesn't affect real users. Removing from Mitaka release.

Dmitry Pyzhov (dpyzhov)
Changed in fuel:
assignee: Fuel Python (Deprecated) (fuel-python) → Fuel Sustaining (fuel-sustaining-team)
Revision history for this message
Dmitry Pyzhov (dpyzhov) wrote :

Invalid as we removed shotgun from Fuel

Changed in fuel:
status: Confirmed → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.