Comment 8 for bug 1467505

Reproduced:

[root@nailgun pl]# cat /etc/fuel/version.yaml
VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "8.0"
  api: "1.0"
  build_number: "429"
  build_id: "429"
  fuel-nailgun_sha: "12b15b2351e250af41cc0b10d63a50c198fe77d8"
  python-fuelclient_sha: "4f234669cfe88a9406f4e438b1e1f74f1ef484a5"
  fuel-agent_sha: "df16d41cd7a9445cf82ad9fd8f0d53824711fcd8"
  fuel-nailgun-agent_sha: "92ebd5ade6fab60897761bfa084aefc320bff246"
  astute_sha: "c7ca63a49216744e0bfdfff5cb527556aad2e2a5"
  fuel-library_sha: "3eaf4f4a9b88b287a10cc19e9ce6a62298cc4013"
  fuel-ostf_sha: "214e794835acc7aa0c1c5de936e93696a90bb57a"
  fuel-mirror_sha: "b62f3cce5321fd570c6589bc2684eab994c3f3f2"
  fuelmenu_sha: "85de57080a18fda18e5325f06eaf654b1b931592"
  shotgun_sha: "63645dea384a37dde5c01d4f8905566978e5d906"
  network-checker_sha: "9f0ba4577915ce1e77f5dc9c639a5ef66ca45896"
  fuel-upgrade_sha: "616a7490ec7199f69759e97e42f9b97dfc87e85b"
  fuelmain_sha: "e8e36cff332644576d7853c80b8a53d5b955420a"

Scenario:
Install the database plugin on the master node.
Create Ubuntu, Neutron Vlan, all ceph cluster.
Add 3 nodes with contoller/ceph role.
Add 3 nodes with db role.
Add 1 compute node.
Run network verification.
Deploy changes.
Run network verification.
Run OSTF tests.
Add 1 db node and deploy changes. <- Error here

12:54:13.471686 #1720] ERROR -- : HTTP PUT failed: #<HTTP::Message:0x000000025316d0 @http_header=#<HTTP::Message::Headers:0x000000025316a8 @http_version="1.1", @body_size=0, @chunked=false, @request_method="PUT", @request_uri=#<URI::HTTPS:0x00000002531b58 URL:https://10.109.0.2:8443/api/nodes/agent/>, @request_query=nil, @request_absolute_uri=nil, @status_code=400, @reason_phrase="Bad Request", @body_type=nil, @body_charset=nil, @body_date=nil, @body_encoding=#<Encoding:UTF-8>, @is_request=false, @header_item=[["Server", "nginx"], ["Date", "Thu, 21 Jan 2016 12:54:13 GMT"], ["Content-Type", "text/html; charset=utf-8"], ["Transfer-Encoding", "chunked"], ["Connection", "keep-alive"], ["Cache-Control", "store, no-cache, must-revalidate, post-check=0, pre-check=0"], ["Pragma", "no-cache"], ["Expires", "Thu, 01 Jan 1970 00:00:00 GMT"]], @dumped=false>, @peer_cert=#<OpenSSL::X509::Certificate subject=/C=US/ST=California/O=Fuel/OU=Fuel Deployment <email address hidden>, issuer=/C=US/ST=California/O=Fuel/OU=Fuel Deployment <email address hidden>, serial=11524342662413337222, not_before=2016-01-15 12:55:53 UTC, not_after=2026-01-12 12:55:53 UTC>, @http_body=#<HTTP::Message::Body:0x00000002531630 @body="{\"message\": \"Invalid MAC is specified\", \"errors\": []}", @size=0, @positions=nil, @chunk_size=nil>>

Before deployment:
[root@nailgun pl]# fuel nodes
id | status | name | cluster | ip | mac | roles | pending_roles | online | group_id
---|----------|------------------|---------|-------------|-------------------|-------|---------------|--------|---------
11 | discover | Untitled (4a:f5) | None | 10.109.0.4 | 64:6e:02:35:4a:f5 | | | True | None
12 | discover | Untitled (aa:d8) | None | 10.109.0.22 | 64:9b:29:77:aa:d8 | | | True | None
13 | discover | Untitled (02:cd) | None | 10.109.0.23 | 64:1f:f0:0a:02:cd | | | True | None
17 | discover | Untitled (e3:02) | None | 10.109.0.24 | 64:a3:78:67:e3:02 | | | True | None
16 | discover | Untitled (09:36) | None | 10.109.0.25 | 64:e0:87:ea:09:36 | | | True | None
15 | discover | Untitled (11:d6) | None | 10.109.0.27 | 64:2e:1e:34:11:d6 | | | True | None
18 | discover | Untitled (93:1b) | None | 10.109.0.20 | 64:28:16:9b:93:1b | | | True | None
10 | discover | Untitled (2a:c7) | None | 10.109.0.8 | 64:bc:0d:fc:2a:c7 | | | True | None
14 | discover | Untitled (a8:2a) | None | 10.109.0.26 | 64:bc:cd:27:a8:2a | | | True | None

After deployment:
[root@nailgun pl]# fuel nodes
id | status | name | cluster | ip | mac | roles | pending_roles | online | group_id
---|-------------|------------------|---------|-------------|-------------------|----------------------|---------------|--------|---------
17 | provisioned | Untitled (e3:02) | 2 | 10.109.0.24 | 64:a3:78:67:e3:02 | standalone-database | | True | 2
14 | ready | Untitled (a8:2a) | 2 | 10.109.0.26 | 64:bc:cd:27:a8:2a | standalone-database | | True | 2
16 | ready | Untitled (09:36) | 2 | 10.109.0.25 | 22:0a:96:52:c4:d9 | standalone-database | | True | 2
15 | ready | Untitled (11:d6) | 2 | 10.109.0.27 | 64:2e:1e:34:11:d6 | standalone-database | | True | 2
10 | error | Untitled (2a:c7) | 2 | 10.109.0.8 | 64:bc:0d:fc:2a:c7 | ceph-osd, controller | | True | 2
18 | discover | Untitled (93:1b) | None | 10.109.0.20 | 64:28:16:9b:93:1b | | | True | None
12 | error | Untitled (aa:d8) | 2 | 10.109.0.22 | 06:7b:e1:27:d3:c8 | ceph-osd, controller | | True | 2
11 | error | Untitled (4a:f5) | 2 | 10.109.0.4 | 3a:98:f3:96:8f:91 | ceph-osd, controller | | True | 2
13 | ready | Untitled (02:cd) | 2 | 10.109.0.23 | 64:1f:f0:0a:02:cd | compute | | True | 2

Dignostic snapshot:
https://drive.google.com/a/mirantis.com/file/d/0B1CktchMwAXHaWxXS0tEQU5LR28/view?usp=sharing

Also env snapshot is available. Please contact me.