ERROR: (unpack_config)  warning: Blind faith: not fencing unseen nodes                                                                                                                                                                                                                                                                                                                          
ERROR: (unpack_config)  warning: Blind faith: not fencing unseen nodes                                                                                                                                                                                                                                                                                                                          
ERROR: (unpack_config)  warning: Blind faith: not fencing unseen nodes                                                                                                                                                                                                                                                                                                                          
ERROR: (unpack_config)  warning: Blind faith: not fencing unseen nodes                                                                                                                                                                                                                                                                                                                          
ERROR: syntax in primitive: Attribute order error: timeout must appear before any instance attribute parsing 'primitive res_ks_cf9dea1_vip ocf:heartbeat:IPaddr2 params ip=10.5.253.30 op monitor depth=0 timeout=20s interval=10s'                                                                                                                                                             
active                                                                                                                                                                                                                                                                                                                                                                                          
ERROR: grp_ks_vips refers to missing object res_ks_cf9dea1_vip                                                                                                                                                                                                                                                                                                                                  
ERROR: syntax in group: Expected at least 2 arguments near <group> parsing 'group grp_ks_vips'                                                                                                                                                                                                                                                                                                  
ERROR: group (0): Expecting an element meta_attributes, got nothing                                                                                                                                                                                                                                                                                                                             
       group (0): Invalid sequence in interleave                                                                                                                                                                                                                                                                                                                                                
       group (0): Element group failed to validate content                                                                                                                                                                                                                                                                                                                                      
       clone (3): Element resources has extra content: clone                                                                                                                                                                                                                                                                                                                                    
(main)  error: CIB did not pass schema validation                                                                                                                                                                                                                                                                                                                                               
Errors found during check: config not valid                                                                                                                                                                                                                                                                                                                                                     
INFO: commit forced                                                                                                                                                                                                                                                                                                                                                                             
Call cib_apply_diff failed (-203): Update does not conform to the configured schema                                                                                                                                                                                                                                                                                                             
<cib crm_feature_set="3.1.0" validate-with="pacemaker-3.2" epoch="13" num_updates="0" admin_epoch="0" cib-last-written="Thu Sep 12 20:54:24 2019" update-origin="juju-fc5ea9-zaza-82b7f4ad7745-2" update-client="cibadmin" update-user="root" have-quorum="1" dc-uuid="1001">                                                                                                                   
  <configuration>                                                                                                                                                                                                                                                                                                                                                                               
    <crm_config>                                                                                                                                                                                                                                                                                                                                                                                
      <cluster_property_set id="cib-bootstrap-options">                                                                                                                                                                                                                                                                                                                                         
        <nvpair id="cib-bootstrap-options-have-watchdog" name="have-watchdog" value="false"/>                                                                                                                                                                                                                                                                                                   
        <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="2.0.1-9e909a5bdd"/>                                                                                                                                                                                                                                                                                              
        <nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="corosync"/>                                                                                                                                                                                                                                                                              
        <nvpair id="cib-bootstrap-options-cluster-name" name="cluster-name" value="debian"/>                                                                                                                                                                                                                                                                                                    
        <nvpair name="no-quorum-policy" value="stop" id="cib-bootstrap-options-no-quorum-policy"/>                                                                                                                                                                                                                                                                                              
        <nvpair name="cluster-recheck-interval" value="60" id="cib-bootstrap-options-cluster-recheck-interval"/>                                                                                                                                                                                                                                                                                
        <nvpair name="stonith-enabled" value="false" id="cib-bootstrap-options-stonith-enabled"/>                                                                                                                                                                                                                                                                                               
        <nvpair id="cib-bootstrap-options-last-lrm-refresh" name="last-lrm-refresh" value="1568310506"/>                                                                                                                                                                                                                                                                                        
      </cluster_property_set>                                                                                                                                                                                                                                                                                                                                                                   
    </crm_config>                                                                                                                                                                                                                                                                                                                                                                               
    <nodes>                                                                                                                                                                                                                                                                                                                                                                                     
      <node id="1" uname="node1"/>                                                                                                                                                                                                                                                                                                                                                              
      <node id="1001" uname="juju-fc5ea9-zaza-82b7f4ad7745-3"/>                                                                                                                                                                                                                                                                                                                                 
      <node id="1000" uname="juju-fc5ea9-zaza-82b7f4ad7745-2"/>                                                                                                                                                                                                                                                                                                                                 
      <node id="1002" uname="juju-fc5ea9-zaza-82b7f4ad7745-1"/>                                                                                                                                                                                                                                                                                                                                 
    </nodes>                                                                                                                                                                                                                                                                                                                                                                                    
    <resources>                                                                                                                                                                                                                                                                                                                                                                                 
      <clone id="cl_ks_haproxy">                                                                                                                                                                                                                                                                                                                                                                
        <primitive id="res_ks_haproxy" class="lsb" type="haproxy">                                                                                                                                                                                                                                                                                                                              
          <operations>                                                                                                                                                                                                                                                                                                                                                                          
            <op name="monitor" interval="5s" id="res_ks_haproxy-monitor-5s"/>                                                                                                                                                                                                                                                                                                                   
          </operations>                                                                                                                                                                                                                                                                                                                                                                         
        </primitive>                                                                                                                                                                                                                                                                                                                                                                            
      </clone>                                                                                                                                                                                                                                                                                                                                                                                  
      <group id="grp_ks_vips"/>                                                                                                                                                                                                                                                                                                                                                                 
    </resources>                                                                                                                                                                                                                                                                                                                                                                                
    <constraints/>                                                                                                                                                                                                                                                                                                                                                                              
    <rsc_defaults>
      <meta_attributes id="rsc-options">
        <nvpair name="resource-stickiness" value="100" id="rsc-options-resource-stickiness"/>
        <nvpair name="failure-timeout" value="0" id="rsc-options-failure-timeout"/>
      </meta_attributes>
    </rsc_defaults>
  </configuration>
  <status>
    <node_state id="1001" uname="juju-fc5ea9-zaza-82b7f4ad7745-3" in_ccm="true" crmd="online" crm-debug-origin="do_update_resource" join="member" expected="member">
      <lrm id="1001">
        <lrm_resources>
          <lrm_resource id="res_ks_haproxy" type="haproxy" class="lsb">
            <lrm_rsc_op id="res_ks_haproxy_last_0" operation_key="res_ks_haproxy_start_0" operation="start" crm-debug-origin="do_update_resource" crm_feature_set="3.1.0" transition-key="3:3:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" transition-magic="0:0;3:3:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" exit-reason="" on_node="juju-fc5ea9-zaza-82b7f4ad7745-3" call-id="7" rc-code="0" op-sta$us="0" interval="0" last-run="1568310467" last-rc-change="1568310467" exec-time="90" queue-time="0" op-digest="f2317cad3d54cec5d7d7aa7d0bf35cf8"/>
            <lrm_rsc_op id="res_ks_haproxy_last_failure_0" operation_key="res_ks_haproxy_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.1.0" transition-key="3:2:7:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" transition-magic="0:0;3:2:7:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" exit-reason="" on_node="juju-fc5ea9-zaza-82b7f4ad7745-3" call-id="5" rc-cod$="0" op-status="0" interval="0" last-run="1568310467" last-rc-change="1568310467" exec-time="55" queue-time="0" op-digest="f2317cad3d54cec5d7d7aa7d0bf35cf8"/>
            <lrm_rsc_op id="res_ks_haproxy_monitor_5000" operation_key="res_ks_haproxy_monitor_5000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.1.0" transition-key="4:3:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" transition-magic="0:0;4:3:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" exit-reason="" on_node="juju-fc5ea9-zaza-82b7f4ad7745-3" call-id="8" rc-co$e="0" op-status="0" interval="5000" last-rc-change="1568310467" exec-time="38" queue-time="1" op-digest="4811cef7f7f94e3a35a70be7916cb2fd"/>
          </lrm_resource>
        </lrm_resources>
      </lrm>

      <transient_attributes id="1001">
        <instance_attributes id="status-1001"/>
      </transient_attributes>
    </node_state>
    <node_state id="1000" uname="juju-fc5ea9-zaza-82b7f4ad7745-2" in_ccm="true" crmd="online" crm-debug-origin="do_update_resource" join="member" expected="member">
      <lrm id="1000">
        <lrm_resources>
          <lrm_resource id="res_ks_haproxy" type="haproxy" class="lsb">
            <lrm_rsc_op id="res_ks_haproxy_last_0" operation_key="res_ks_haproxy_start_0" operation="start" crm-debug-origin="do_update_resource" crm_feature_set="3.1.0" transition-key="7:186:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" transition-magic="0:0;7:186:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" exit-reason="" on_node="juju-fc5ea9-zaza-82b7f4ad7745-2" call-id="22" rc-code="0" op
-status="0" interval="0" last-run="1568321040" last-rc-change="1568321040" exec-time="73" queue-time="1" op-digest="f2317cad3d54cec5d7d7aa7d0bf35cf8"/>
            <lrm_rsc_op id="res_ks_haproxy_last_failure_0" operation_key="res_ks_haproxy_monitor_5000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.1.0" transition-key="7:9:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" transition-magic="0:7;7:9:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" exit-reason="" on_node="juju-fc5ea9-zaza-82b7f4ad7745-2" call-id="19" rc-
code="7" op-status="0" interval="5000" last-run="1568310507" last-rc-change="1568321040" exec-time="0" queue-time="0" op-digest="4811cef7f7f94e3a35a70be7916cb2fd"/>
            <lrm_rsc_op id="res_ks_haproxy_monitor_5000" operation_key="res_ks_haproxy_monitor_5000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.1.0" transition-key="8:186:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" transition-magic="0:0;8:186:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" exit-reason="" on_node="juju-fc5ea9-zaza-82b7f4ad7745-2" call-id="23" r
c-code="0" op-status="0" interval="5000" last-rc-change="1568321040" exec-time="36" queue-time="0" op-digest="4811cef7f7f94e3a35a70be7916cb2fd"/>
          </lrm_resource>
        </lrm_resources>
      </lrm>
      <transient_attributes id="1000">
        <instance_attributes id="status-1000">
          <nvpair id="status-1000-fail-count-res_ks_haproxy.monitor_5000" name="fail-count-res_ks_haproxy#monitor_5000" value="1"/>
          <nvpair id="status-1000-last-failure-res_ks_haproxy.monitor_5000" name="last-failure-res_ks_haproxy#monitor_5000" value="1568321040"/>
        </instance_attributes>
      </transient_attributes>
    </node_state>
    <node_state id="1002" in_ccm="true" crmd="online" crm-debug-origin="do_update_resource" uname="juju-fc5ea9-zaza-82b7f4ad7745-1" join="member" expected="member">
      <lrm id="1002">
        <lrm_resources>
          <lrm_resource id="res_ks_haproxy" type="haproxy" class="lsb">
            <lrm_rsc_op id="res_ks_haproxy_last_0" operation_key="res_ks_haproxy_start_0" operation="start" crm-debug-origin="do_update_resource" crm_feature_set="3.1.0" transition-key="4:4:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" transition-magic="0:0;4:4:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" exit-reason="" on_node="juju-fc5ea9-zaza-82b7f4ad7745-1" call-id="7" rc-code="0" op-stat
us="0" interval="0" last-run="1568310469" last-rc-change="1568310469" exec-time="163" queue-time="0" op-digest="f2317cad3d54cec5d7d7aa7d0bf35cf8"/>
            <lrm_rsc_op id="res_ks_haproxy_last_failure_0" operation_key="res_ks_haproxy_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.1.0" transition-key="1:2:7:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" transition-magic="0:0;1:2:7:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" exit-reason="" on_node="juju-fc5ea9-zaza-82b7f4ad7745-1" call-id="5" rc-code
="0" op-status="0" interval="0" last-run="1568310467" last-rc-change="1568310467" exec-time="94" queue-time="0" op-digest="f2317cad3d54cec5d7d7aa7d0bf35cf8"/>
            <lrm_rsc_op id="res_ks_haproxy_monitor_5000" operation_key="res_ks_haproxy_monitor_5000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.1.0" transition-key="5:4:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" transition-magic="0:0;5:4:0:eacfea55-fca8-4eeb-9b2a-0d95e63eced1" exit-reason="" on_node="juju-fc5ea9-zaza-82b7f4ad7745-1" call-id="8" rc-cod
e="0" op-status="0" interval="5000" last-rc-change="1568310469" exec-time="84" queue-time="0" op-digest="4811cef7f7f94e3a35a70be7916cb2fd"/>
          </lrm_resource>
        </lrm_resources>
      </lrm>
      <transient_attributes id="1002">
        <instance_attributes id="status-1002"/>
      </transient_attributes>
    </node_state>
  </status>
</cib>
ERROR: could not replace cib (rc=78)
INFO: offending xml: <diff format="2">
  <change operation="create" path="/cib/configuration/resources" position="1">
    <group id="grp_ks_vips"/>
  </change>
</diff>

Cleaned up res_ks_haproxy:0 on juju-fc5ea9-zaza-82b7f4ad7745-3
.Cleaned up res_ks_haproxy:1 on juju-fc5ea9-zaza-82b7f4ad7745-2
Cleaned up res_ks_haproxy:2 on juju-fc5ea9-zaza-82b7f4ad7745-1
Cleaned up res_ks_haproxy:3 on juju-fc5ea9-zaza-82b7f4ad7745-1
Cleaned up res_ks_haproxy:3 on juju-fc5ea9-zaza-82b7f4ad7745-2
Cleaned up res_ks_haproxy:3 on juju-fc5ea9-zaza-82b7f4ad7745-3
Resource 'grp_ks_vips' not found
Error performing operation: No such device or address