hosts-config.sh reports Argument list too long

Bug #1856076 reported by Luke Short
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
High
Luke Short

Bug Description

Description
===========
When deploying a large Overcloud (over 400 nodes in my case), the deployment fails during step0 due to this error: "OSError: [Errno 7] Argument list too long"

It happens during this task:

```
$ less deploy_steps_playbook.yaml
    - name: HostsConfig
      script: hosts-config.sh
      environment:
        HOSTS_ENTRY: "{{ hosts_entry }}"

```

Steps to reproduce
==================
1. Deploy a large Overcloud

Expected result
===============
The script should complete successfully.

Actual result
=============
The script fails causing the entire deployment to fail.

Environment
===========
Train release
Pre-deployed servers

Logs & Configs
==============
http://paste.openstack.org/show/787468/

Luke Short (ekultails)
Changed in tripleo:
importance: Undecided → High
Revision history for this message
Luke Short (ekultails) wrote :

The underlying problem is that the HOSTS_ENTRY environment variable is passed to the remote host and it is huge because it contains a list of every Overcloud host. It follows in the format of:

<IP> <FQDN> <ANSIBLE_INVENTORY_HOSTNAME>

Here is a truncated example, as reported by the debug output of Ansible: http://paste.openstack.org/show/787479/

Revision history for this message
Oliver Walsh (owalsh) wrote :

We dad a similar issue with ssh_known_hosts in the past (which is even bigger) https://bugs.launchpad.net/tripleo/+bug/1772071

Revision history for this message
Luke Short (ekultails) wrote :
Changed in tripleo:
milestone: none → ussuri-1
status: Triaged → Fix Released
Revision history for this message
Luke Short (ekultails) wrote :

Oops. I pasted the wrong Gerrit review/patchset in my last comment.

This was actually resolved via: https://review.opendev.org/#/c/690154/

Revision history for this message
Luke Short (ekultails) wrote :
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.