iptables -N ironic-inspector returned non-zero exit status 1

[Waldemar Znoinski]

host os: ubuntu xenial
container os: ubuntu xenial
kolla master, commit f9956f2e103d8e95720b8312e6fdca18182d69a3
no changes to ironic.conf were made except for fixing https://bugs.launchpad.net/kolla/+bug/1613292

INFO:__main__:Kolla config strategy set to: COPY_ALWAYS
INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json
INFO:__main__:Validating config file
INFO:__main__:Copying service configuration files
INFO:__main__:Removing existing destination: /etc/ironic/ironic.conf
INFO:__main__:Copying /var/lib/kolla/config_files/ironic.conf to /etc/ironic/ironic.conf
INFO:__main__:Setting permissions for /etc/ironic/ironic.conf
INFO:__main__:Writing out command to execute
Running command: 'ironic-inspector --config-file /etc/ironic/ironic.conf'
2016-09-16 15:37:31.508 6 DEBUG ironic_inspector.main [-] Configuration: setup_logging /var/lib/kolla/venv/local/lib/python2.7/site-packages/ironic_inspector/main.py:388
2016-09-16 15:37:31.508 6 DEBUG ironic_inspector.main [-] ******************************************************************************** log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2604
2016-09-16 15:37:31.508 6 DEBUG ironic_inspector.main [-] Configuration options gathered from: log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2605
2016-09-16 15:37:31.509 6 DEBUG ironic_inspector.main [-] command line args: ['--config-file', '/etc/ironic/ironic.conf'] log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2606
2016-09-16 15:37:31.509 6 DEBUG ironic_inspector.main [-] config files: ['/etc/ironic/ironic.conf'] log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2608
2016-09-16 15:37:31.509 6 DEBUG ironic_inspector.main [-] ================================================================================ log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2609
2016-09-16 15:37:31.510 6 DEBUG ironic_inspector.main [-] auth_strategy = keystone log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.510 6 DEBUG ironic_inspector.main [-] authenticate = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.510 6 DEBUG ironic_inspector.main [-] clean_up_period = 60 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.511 6 DEBUG ironic_inspector.main [-] config_dir = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.511 6 DEBUG ironic_inspector.main [-] config_file = ['/etc/ironic/ironic.conf'] log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.511 6 DEBUG ironic_inspector.main [-] debug = True log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.511 6 DEBUG ironic_inspector.main [-] default_log_levels = ['sqlalchemy=WARNING', 'iso8601=WARNING', 'requests=WARNING', 'urllib3.connectionpool=WARNING', 'keystonemiddleware=WARNING', 'swiftclient=WARNING', 'keystoneauth=WARNING', 'ironicclient=WARNING'] log_opt_values /var/lib/kolla/venv/local/lib/pytho
n2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.512 6 DEBUG ironic_inspector.main [-] instance_format = [instance: %(uuid)s] log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.512 6 DEBUG ironic_inspector.main [-] instance_uuid_format = [instance: %(uuid)s] log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.512 6 DEBUG ironic_inspector.main [-] introspection_delay = 5 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.512 6 DEBUG ironic_inspector.main [-] introspection_delay_drivers = ^.*_ssh$ log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.513 6 DEBUG ironic_inspector.main [-] ipmi_address_fields = ['ilo_address', 'drac_host', 'cimc_address'] log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.513 6 DEBUG ironic_inspector.main [-] listen_address = 0.0.0.0 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.513 6 DEBUG ironic_inspector.main [-] listen_port = 5050 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.514 6 DEBUG ironic_inspector.main [-] log_config_append = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.514 6 DEBUG ironic_inspector.main [-] log_date_format = %Y-%m-%d %H:%M:%S log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.514 6 DEBUG ironic_inspector.main [-] log_dir = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.514 6 DEBUG ironic_inspector.main [-] log_file = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.515 6 DEBUG ironic_inspector.main [-] logging_context_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user_identity)s] %(instance)s%(message)s log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.515 6 DEBUG ironic_inspector.main [-] logging_debug_format_suffix = %(funcName)s %(pathname)s:%(lineno)d log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.515 6 DEBUG ironic_inspector.main [-] logging_default_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)s log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.515 6 DEBUG ironic_inspector.main [-] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.516 6 DEBUG ironic_inspector.main [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.516 6 DEBUG ironic_inspector.main [-] max_concurrency = 1000 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.516 6 DEBUG ironic_inspector.main [-] node_status_keep_time = 604800 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.516 6 DEBUG ironic_inspector.main [-] publish_errors = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.517 6 DEBUG ironic_inspector.main [-] rootwrap_config = /etc/ironic-inspector/rootwrap.conf log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.517 6 DEBUG ironic_inspector.main [-] ssl_cert_path = log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.517 6 DEBUG ironic_inspector.main [-] ssl_key_path = log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.517 6 DEBUG ironic_inspector.main [-] syslog_log_facility = LOG_USER log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.518 6 DEBUG ironic_inspector.main [-] timeout = 3600 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.518 6 DEBUG ironic_inspector.main [-] use_ssl = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.518 6 DEBUG ironic_inspector.main [-] use_stderr = True log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.518 6 DEBUG ironic_inspector.main [-] use_syslog = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.519 6 DEBUG ironic_inspector.main [-] verbose = True log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.519 6 DEBUG ironic_inspector.main [-] watch_log_file = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2618
2016-09-16 15:37:31.519 6 DEBUG ironic_inspector.main [-] discoverd.database = log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.519 6 DEBUG ironic_inspector.main [-] database.backend = sqlalchemy log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.520 6 DEBUG ironic_inspector.main [-] database.connection = **** log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.520 6 DEBUG ironic_inspector.main [-] database.connection_debug = 0 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.520 6 DEBUG ironic_inspector.main [-] database.connection_trace = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.521 6 DEBUG ironic_inspector.main [-] database.db_inc_retry_interval = True log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.521 6 DEBUG ironic_inspector.main [-] database.db_max_retries = 20 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.521 6 DEBUG ironic_inspector.main [-] database.db_max_retry_interval = 10 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.521 6 DEBUG ironic_inspector.main [-] database.db_retry_interval = 1 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.522 6 DEBUG ironic_inspector.main [-] database.idle_timeout = 3600 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.522 6 DEBUG ironic_inspector.main [-] database.max_overflow = 50 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.522 6 DEBUG ironic_inspector.main [-] database.max_pool_size = 5 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.522 6 DEBUG ironic_inspector.main [-] database.max_retries = -1 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.523 6 DEBUG ironic_inspector.main [-] database.min_pool_size = 1 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.523 6 DEBUG ironic_inspector.main [-] database.mysql_sql_mode = TRADITIONAL log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.523 6 DEBUG ironic_inspector.main [-] database.pool_timeout = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.523 6 DEBUG ironic_inspector.main [-] database.retry_interval = 10 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.524 6 DEBUG ironic_inspector.main [-] database.slave_connection = **** log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.524 6 DEBUG ironic_inspector.main [-] database.sqlite_db = ironic_inspector.sqlite log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.524 6 DEBUG ironic_inspector.main [-] database.sqlite_synchronous = True log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.525 6 DEBUG ironic_inspector.main [-] database.use_db_reconnect = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.525 6 DEBUG ironic_inspector.main [-] firewall.dnsmasq_interface = ens3 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.525 6 DEBUG ironic_inspector.main [-] firewall.firewall_chain = ironic-inspector log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.525 6 DEBUG ironic_inspector.main [-] firewall.firewall_update_period = 15 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.526 6 DEBUG ironic_inspector.main [-] firewall.manage_firewall = True log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.526 6 DEBUG ironic_inspector.main [-] processing.add_ports = pxe log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.526 6 DEBUG ironic_inspector.main [-] processing.always_store_ramdisk_logs = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.526 6 DEBUG ironic_inspector.main [-] processing.default_processing_hooks = ramdisk_error,root_disk_selection,scheduler,validate_interfaces,capabilities log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.527 6 DEBUG ironic_inspector.main [-] processing.disk_partitioning_spacing = True log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.527 6 DEBUG ironic_inspector.main [-] processing.enable_setting_ipmi_credentials = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.527 6 DEBUG ironic_inspector.main [-] processing.keep_ports = all log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.527 6 DEBUG ironic_inspector.main [-] processing.log_bmc_address = True log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.528 6 DEBUG ironic_inspector.main [-] processing.node_not_found_hook = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.528 6 DEBUG ironic_inspector.main [-] processing.overwrite_existing = True log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.528 6 DEBUG ironic_inspector.main [-] processing.power_off = True log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.529 6 DEBUG ironic_inspector.main [-] processing.processing_hooks = ramdisk_error,root_disk_selection,scheduler,validate_interfaces,capabilities log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.529 6 DEBUG ironic_inspector.main [-] processing.ramdisk_logs_dir = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.529 6 DEBUG ironic_inspector.main [-] processing.ramdisk_logs_filename_format = {uuid}_{dt:%Y%m%d-%H%M%S.%f}.tar.gz log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.529 6 DEBUG ironic_inspector.main [-] processing.store_data = none log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.530 6 DEBUG ironic_inspector.main [-] processing.store_data_location = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.530 6 DEBUG ironic_inspector.main [-] oslo_concurrency.disable_process_locking = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.530 6 DEBUG ironic_inspector.main [-] oslo_concurrency.lock_path = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.530 6 DEBUG ironic_inspector.main [-] ironic.auth_section = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.531 6 DEBUG ironic_inspector.main [-] ironic.auth_strategy = keystone log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.531 6 DEBUG ironic_inspector.main [-] ironic.auth_type = password log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.531 6 DEBUG ironic_inspector.main [-] ironic.cafile = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.532 6 DEBUG ironic_inspector.main [-] ironic.certfile = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.532 6 WARNING oslo_config.cfg [-] Option "identity_uri" from group "ironic" is deprecated for removal. Its value may be silently ignored in the future.
2016-09-16 15:37:31.532 6 DEBUG ironic_inspector.main [-] ironic.identity_uri = http://10.10.10.254:35357 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.532 6 DEBUG ironic_inspector.main [-] ironic.insecure = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.533 6 DEBUG ironic_inspector.main [-] ironic.ironic_url = http://localhost:6385/ log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.533 6 DEBUG ironic_inspector.main [-] ironic.keyfile = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.533 6 DEBUG ironic_inspector.main [-] ironic.max_retries = 30 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.533 6 WARNING oslo_config.cfg [-] Option "os_auth_url" from group "ironic" is deprecated for removal. Its value may be silently ignored in the future.
2016-09-16 15:37:31.534 6 DEBUG ironic_inspector.main [-] ironic.os_auth_url = http://10.10.10.254:5000/v2.0 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.534 6 DEBUG ironic_inspector.main [-] ironic.os_endpoint_type = internalURL log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.534 6 WARNING oslo_config.cfg [-] Option "os_password" from group "ironic" is deprecated for removal. Its value may be silently ignored in the future.
2016-09-16 15:37:31.534 6 DEBUG ironic_inspector.main [-] ironic.os_password = **** log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.535 6 DEBUG ironic_inspector.main [-] ironic.os_region = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.535 6 DEBUG ironic_inspector.main [-] ironic.os_service_type = baremetal log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.535 6 WARNING oslo_config.cfg [-] Option "os_tenant_name" from group "ironic" is deprecated for removal. Its value may be silently ignored in the future.
2016-09-16 15:37:31.535 6 DEBUG ironic_inspector.main [-] ironic.os_tenant_name = admin log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.535 6 DEBUG ironic_inspector.main [-] ironic.os_tenant_name = admin log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.536 6 WARNING oslo_config.cfg [-] Option "os_username" from group "ironic" is deprecated for removal. Its value may be silently ignored in the future.
2016-09-16 15:37:31.536 6 DEBUG ironic_inspector.main [-] ironic.os_username = admin log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.536 6 DEBUG ironic_inspector.main [-] ironic.retry_interval = 2 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.537 6 DEBUG ironic_inspector.main [-] ironic.timeout = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.537 6 DEBUG ironic_inspector.main [-] keystone_authtoken.admin_password = **** log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.537 6 DEBUG ironic_inspector.main [-] keystone_authtoken.admin_tenant_name = admin log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.537 6 DEBUG ironic_inspector.main [-] keystone_authtoken.admin_token = **** log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.538 6 DEBUG ironic_inspector.main [-] keystone_authtoken.admin_user = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.538 6 DEBUG ironic_inspector.main [-] keystone_authtoken.auth_admin_prefix = log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.538 6 DEBUG ironic_inspector.main [-] keystone_authtoken.auth_host = 127.0.0.1 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.538 6 DEBUG ironic_inspector.main [-] keystone_authtoken.auth_port = 35357 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.539 6 DEBUG ironic_inspector.main [-] keystone_authtoken.auth_protocol = https log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.539 6 DEBUG ironic_inspector.main [-] keystone_authtoken.auth_section = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.539 6 DEBUG ironic_inspector.main [-] keystone_authtoken.auth_type = password log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.539 6 DEBUG ironic_inspector.main [-] keystone_authtoken.auth_uri = http://10.10.10.254:5000 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.540 6 DEBUG ironic_inspector.main [-] keystone_authtoken.auth_version = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.540 6 DEBUG ironic_inspector.main [-] keystone_authtoken.cache = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.540 6 DEBUG ironic_inspector.main [-] keystone_authtoken.cafile = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.541 6 DEBUG ironic_inspector.main [-] keystone_authtoken.certfile = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.541 6 DEBUG ironic_inspector.main [-] keystone_authtoken.check_revocations_for_cached = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.541 6 DEBUG ironic_inspector.main [-] keystone_authtoken.delay_auth_decision = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.541 6 DEBUG ironic_inspector.main [-] keystone_authtoken.enforce_token_bind = permissive log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.542 6 DEBUG ironic_inspector.main [-] keystone_authtoken.hash_algorithms = ['md5'] log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.542 6 DEBUG ironic_inspector.main [-] keystone_authtoken.http_connect_timeout = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.542 6 DEBUG ironic_inspector.main [-] keystone_authtoken.http_request_max_retries = 3 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.542 6 DEBUG ironic_inspector.main [-] keystone_authtoken.identity_uri = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.543 6 DEBUG ironic_inspector.main [-] keystone_authtoken.include_service_catalog = True log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.543 6 DEBUG ironic_inspector.main [-] keystone_authtoken.insecure = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.543 6 DEBUG ironic_inspector.main [-] keystone_authtoken.keyfile = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.543 6 DEBUG ironic_inspector.main [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.544 6 DEBUG ironic_inspector.main [-] keystone_authtoken.memcache_pool_dead_retry = 300 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.544 6 DEBUG ironic_inspector.main [-] keystone_authtoken.memcache_pool_maxsize = 10 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.544 6 DEBUG ironic_inspector.main [-] keystone_authtoken.memcache_pool_socket_timeout = 3 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.544 6 DEBUG ironic_inspector.main [-] keystone_authtoken.memcache_pool_unused_timeout = 60 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.545 6 DEBUG ironic_inspector.main [-] keystone_authtoken.memcache_secret_key = **** log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.545 6 DEBUG ironic_inspector.main [-] keystone_authtoken.memcache_security_strategy = ENCRYPT log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.545 6 DEBUG ironic_inspector.main [-] keystone_authtoken.memcache_use_advanced_pool = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.546 6 DEBUG ironic_inspector.main [-] keystone_authtoken.memcached_servers = ['192.168.122.157:11211'] log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.546 6 DEBUG ironic_inspector.main [-] keystone_authtoken.region_name = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.546 6 DEBUG ironic_inspector.main [-] keystone_authtoken.revocation_cache_time = 10 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.546 6 DEBUG ironic_inspector.main [-] keystone_authtoken.signing_dir = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.547 6 DEBUG ironic_inspector.main [-] keystone_authtoken.token_cache_time = 300 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.547 6 DEBUG ironic_inspector.main [-] swift.auth_section = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.547 6 DEBUG ironic_inspector.main [-] swift.auth_type = password log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.547 6 DEBUG ironic_inspector.main [-] swift.cafile = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.548 6 DEBUG ironic_inspector.main [-] swift.certfile = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.548 6 DEBUG ironic_inspector.main [-] swift.container = ironic-inspector log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.548 6 DEBUG ironic_inspector.main [-] swift.delete_after = 0 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.548 6 DEBUG ironic_inspector.main [-] swift.insecure = False log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.549 6 DEBUG ironic_inspector.main [-] swift.keyfile = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.549 6 DEBUG ironic_inspector.main [-] swift.max_retries = 2 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.549 6 DEBUG ironic_inspector.main [-] swift.os_auth_url = log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.549 6 DEBUG ironic_inspector.main [-] swift.os_auth_version = 2 log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.550 6 DEBUG ironic_inspector.main [-] swift.os_endpoint_type = internalURL log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.550 6 DEBUG ironic_inspector.main [-] swift.os_region = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.550 6 DEBUG ironic_inspector.main [-] swift.os_service_type = object-store log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.551 6 DEBUG ironic_inspector.main [-] swift.timeout = None log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2626
2016-09-16 15:37:31.551 6 DEBUG ironic_inspector.main [-] ******************************************************************************** log_opt_values /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_config/cfg.py:2628
2016-09-16 15:37:32.143 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('token_endpoint = openstackclient.api.auth_plugin:TokenEndpoint') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.144 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v2token = keystoneauth1.loading._plugins.identity.v2:Token') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.144 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v3oauth1 = keystoneauth1.extras.oauth1._loading:V3OAuth1') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.144 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('admin_token = keystoneauth1.loading._plugins.admin_token:AdminToken') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.144 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v3oidcauthcode = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectAuthorizationCode') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.145 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v2password = keystoneauth1.loading._plugins.identity.v2:Password') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.145 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v3samlpassword = keystoneauth1.extras._saml2._loading:Saml2Password') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.145 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v3password = keystoneauth1.loading._plugins.identity.v3:Password') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.145 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v3oidcaccesstoken = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectAccessToken') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.146 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v3oidcpassword = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectPassword') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.146 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v3kerberos = keystoneauth1.extras.kerberos._loading:Kerberos') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.146 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('token = keystoneauth1.loading._plugins.identity.generic:Token') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.146 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v3oidcclientcredentials = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectClientCredentials') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.147 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v3tokenlessauth = keystoneauth1.loading._plugins.identity.v3:TokenlessAuth') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.147 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v3token = keystoneauth1.loading._plugins.identity.v3:Token') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.147 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v3totp = keystoneauth1.loading._plugins.identity.v3:TOTP') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.147 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('password = keystoneauth1.loading._plugins.identity.generic:Password') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.148 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('v3fedkerb = keystoneauth1.extras.kerberos._loading:MappedKerberos') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.150 6 WARNING ironic_inspector.main [-] Introspection data will not be stored. Change "[processing] store_data" option if this is not the desired behavior
2016-09-16 15:37:32.177 6 DEBUG oslo_db.sqlalchemy.engines [-] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_db/sqlalchemy/en
gines.py:261
2016-09-16 15:37:32.180 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('local_link_connection = ironic_inspector.plugins.local_link_connection:GenericLocalLinkConnectionHook') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.180 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('ramdisk_error = ironic_inspector.plugins.standard:RamdiskErrorHook') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.181 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('capabilities = ironic_inspector.plugins.capabilities:CapabilitiesHook') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.182 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('extra_hardware = ironic_inspector.plugins.extra_hardware:ExtraHardwareHook') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.182 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('root_disk_selection = ironic_inspector.plugins.standard:RootDiskSelectionHook') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.183 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('raid_device = ironic_inspector.plugins.raid_device:RaidDeviceDetection') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.183 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('scheduler = ironic_inspector.plugins.standard:SchedulerHook') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.183 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('validate_interfaces = ironic_inspector.plugins.standard:ValidateInterfacesHook') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.183 6 DEBUG stevedore.extension [-] found extension EntryPoint.parse('example = ironic_inspector.plugins.example:ExampleProcessingHook') _load_plugins /var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py:157
2016-09-16 15:37:32.184 6 INFO ironic_inspector.main [-] Enabled processing hooks: ['ramdisk_error', 'root_disk_selection', 'scheduler', 'validate_interfaces', 'capabilities']
2016-09-16 15:37:32.220 6 WARNING ironic_inspector.firewall [-] iptables does not support -w flag, please update it to at least version 1.4.21
2016-09-16 15:37:32.220 6 DEBUG ironic_inspector.firewall [-] Running iptables ('-D', 'INPUT', '-i', 'ens3', '-p', 'udp', '--dport', '67', '-j', 'ironic-inspector') _iptables /var/lib/kolla/venv/local/lib/python2.7/site-packages/ironic_inspector/firewall.py:42
2016-09-16 15:37:32.253 6 DEBUG ironic_inspector.firewall [-] Ignoring failed iptables ('-D', 'INPUT', '-i', 'ens3', '-p', 'udp', '--dport', '67', '-j', 'ironic-inspector'): sudo: no tty present and no askpass program specified. _iptables /var/lib/kolla/venv/local/lib/python2.7/site-packages/ironic_inspector/firewall.py:49
2016-09-16 15:37:32.255 6 DEBUG ironic_inspector.firewall [-] Running iptables ('-F', 'ironic-inspector') _iptables /var/lib/kolla/venv/local/lib/python2.7/site-packages/ironic_inspector/firewall.py:42
2016-09-16 15:37:32.300 6 DEBUG ironic_inspector.firewall [-] Ignoring failed iptables ('-F', 'ironic-inspector'): sudo: no tty present and no askpass program specified. _iptables /var/lib/kolla/venv/local/lib/python2.7/site-packages/ironic_inspector/firewall.py:49
2016-09-16 15:37:32.301 6 DEBUG ironic_inspector.firewall [-] Running iptables ('-X', 'ironic-inspector') _iptables /var/lib/kolla/venv/local/lib/python2.7/site-packages/ironic_inspector/firewall.py:42
2016-09-16 15:37:32.347 6 DEBUG ironic_inspector.firewall [-] Ignoring failed iptables ('-X', 'ironic-inspector'): sudo: no tty present and no askpass program specified. _iptables /var/lib/kolla/venv/local/lib/python2.7/site-packages/ironic_inspector/firewall.py:49
2016-09-16 15:37:32.348 6 DEBUG ironic_inspector.firewall [-] Running iptables ('-N', 'ironic-inspector') _iptables /var/lib/kolla/venv/local/lib/python2.7/site-packages/ironic_inspector/firewall.py:42
2016-09-16 15:37:32.395 6 ERROR ironic_inspector.firewall [-] iptables ('-N', 'ironic-inspector') failed: sudo: no tty present and no askpass program specified.
2016-09-16 15:37:32.397 6 CRITICAL ironic_inspector [-] CalledProcessError: Command '('sudo', 'ironic-inspector-rootwrap', '/etc/ironic-inspector/rootwrap.conf', 'iptables', '-N', 'ironic-inspector')' returned non-zero exit status 1
2016-09-16 15:37:32.397 6 ERROR ironic_inspector Traceback (most recent call last):
2016-09-16 15:37:32.397 6 ERROR ironic_inspector File "/var/lib/kolla/venv/bin/ironic-inspector", line 11, in <module>
2016-09-16 15:37:32.397 6 ERROR ironic_inspector sys.exit(main())
2016-09-16 15:37:32.397 6 ERROR ironic_inspector File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/ironic_inspector/main.py", line 465, in main
2016-09-16 15:37:32.397 6 ERROR ironic_inspector service.run(args, app)
2016-09-16 15:37:32.397 6 ERROR ironic_inspector File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/ironic_inspector/main.py", line 456, in run
2016-09-16 15:37:32.397 6 ERROR ironic_inspector self.init()
2016-09-16 15:37:32.397 6 ERROR ironic_inspector File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/ironic_inspector/main.py", line 423, in init
2016-09-16 15:37:32.397 6 ERROR ironic_inspector firewall.init()
2016-09-16 15:37:32.397 6 ERROR ironic_inspector File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/ironic_inspector/firewall.py", line 86, in init
2016-09-16 15:37:32.397 6 ERROR ironic_inspector _iptables('-N', CHAIN)
2016-09-16 15:37:32.397 6 ERROR ironic_inspector File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/ironic_inspector/firewall.py", line 45, in _iptables
2016-09-16 15:37:32.397 6 ERROR ironic_inspector subprocess.check_output(cmd, **kwargs)
2016-09-16 15:37:32.397 6 ERROR ironic_inspector File "/usr/lib/python2.7/subprocess.py", line 574, in check_output
2016-09-16 15:37:32.397 6 ERROR ironic_inspector raise CalledProcessError(retcode, cmd, output=output)
2016-09-16 15:37:32.397 6 ERROR ironic_inspector CalledProcessError: Command '('sudo', 'ironic-inspector-rootwrap', '/etc/ironic-inspector/rootwrap.conf', 'iptables', '-N', 'ironic-inspector')' returned non-zero exit status 1

[Steven Dake (sdake)]

Not part of feature set for Newton, pushing to Ocata with Critical priority.

[Waldemar Znoinski (wznoinsk)]

when manage_firewall = True in ironic.conf
then iptables commands are run with sudo, like so:
https://github.com/openstack/ironic-inspector/blob/master/ironic_inspector/firewall.py#L70

hence either iptables has to be in sudoers file or rootwrapped

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/374727

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/374727
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=326327acbaeb30ddfab34148ffcb9c3f64485deb
Submitter: Jenkins
Branch: master

commit 326327acbaeb30ddfab34148ffcb9c3f64485deb
Author: Waldemar Znoinski <email address hidden>
Date: Sun Sep 18 09:15:22 2016 +0000

    fix ironic-inspector setup

    * add ironic-inspector(-archive) source to docker image
    * pip install from above source code
    * move in-container config files to /etc/ironic-inspector
    * add sudoers file to allow ironic-rootwrap
    * copy rootwrap conf and filters from source repo

    Change-Id: Ie3cce19810b9940d06bb636b28015160fea6ddfb
    Closes-bug: #1624457
    Closes-bug: #1624833
    Closes-bug: #1624845

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla 3.0.0.0rc2 release candidate.

[Mark Goddard (mgoddard)]

This issue is still present in openstack/kolla 3.0.1 when using a binary installation.

host os: RHEL 7.3
container os: CentOS

I have the following three sudoer files in /etc/sudoers.d in the image kolla/centos-binary-ironic-inspector:3.0.1:

$ docker run -it -u root kolla/centos-binary-ironic-inspector:3.0.1 bash

$ cat /etc/sudoers.d/ironic
Defaults:ironic !requiretty
ironic ALL = (root) NOPASSWD: /usr/bin/ironic-rootwrap /etc/ironic/rootwrap.conf *

$ cat /etc/sudoers.d/ironic-inspector
Defaults:ironic-inspector !requiretty
ironic-inspector ALL=(root) NOPASSWD: /usr/bin/ironic-inspector-rootwrap /etc/ironic-inspector/rootwrap.conf *

$ cat /etc/sudoers.d/kolla_ironic_inspector_sudoers
ironic ALL=(root) NOPASSWD: /var/lib/kolla/venv/bin/ironic-inspector-rootwrap /etc/ironic-inspector/rootwrap.conf *

The first two are from CentOS OpenStack RPMs and the third is templated out by Kolla, added by the above commit (326327acbaeb30ddfab34148ffcb9c3f64485deb). Despite this being a binary install, it's referencing the source install virtualenv directory. Looking at other Dockerfiles, I don't think we should be adding this file for binary installs.

The first specifies the ironic user and ironic rootwrap. The second specifies the ironic-inspector user and ironic-inspector rootwrap. The third specifies the ironic user and ironic-inspector rootwrap.

If I run the iptables command as the ironic-inspector user, it succeeds:

$ docker run -it -u ironic-inspector --privileged --net=host kolla/centos-binary-ironic-inspector:3.0.1 sudo ironic-inspector-rootwrap /etc/ironic-inspector/rootwrap.conf iptables -N ironic-inspector

The same command as the ironic user fails as expected.

It seems that there are two possible solutions:

1) Use the ironic-inspector user to run ironic-inspector. I don't know whether this would work on Ubuntu. Changing the user alone did not work for me, it's likely there will be some permission issues to iron out.

2) Continue to use the ironic user to run ironic-inspector and extend the file docker/ironic/ironic-inspector/ironic_sudoers to add the following:

ironic ALL=(root) NOPASSWD: /usr/bin/ironic-inspector-rootwrap /etc/ironic-inspector/rootwrap.conf *

I applied this change locally and it fixed this issue for me.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/436922

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/436922
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=5752c7eb0b1f9c5978dd4e9271ded346cea231e0
Submitter: Jenkins
Branch: master

commit 5752c7eb0b1f9c5978dd4e9271ded346cea231e0
Author: Mark Goddard <email address hidden>
Date: Wed Feb 22 02:23:05 2017 +0000

    Fix binary ironic-inspector rootwrap configuration

    When built with the binary install type (at least on CentOS), Ironic
    inspector fails to start and the container remains in a restarting
    state. The log file shows that it is failing to execute iptables, and
    analysis found that this was due to an incorrect rootwrap
    configuration. The RDO ironic inspector RPM expects Ironic inspector
    to be run as the ironic-inspector user, however Kolla uses the ironic
    user. This means that neither of the packaged ironic nor
    ironic-inspector sudoers configuration files works for us.

    Kolla currently installs a sudoers file pointing to the rootwrap
    script in the virtualenv of the source install, but of course this
    only makes sense for source installs, and should not be installed for
    binary installs.

    This change adds a second sudoers file that will work for the binary
    install type, and installs the correct sudoers file for the install
    type.

    Change-Id: I8ecd0b658b8df8f38ddf717fa9443d4dc2896984
    Closes-Bug: #1624457

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/439882

[OpenStack Infra (hudson-openstack)]

Change abandoned by Serguei Bezverkhi (<email address hidden>) on branch: stable/newton
Review: https://review.openstack.org/439882
Reason: incorrectly done cherrypick

[Steven Dake (sdake)]

https://review.openstack.org/436922 needs a revert.

This review breaks source deployments. Reopening bug.

[Mark Goddard (mgoddard)]

I just tried a source build on master and it worked for me. Could you provide more information on the breakage you're seeing?

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/ocata
Review: https://review.openstack.org/440672

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/440672
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=9ec3d110078d571068325e1f198745a6ae78f633
Submitter: Jenkins
Branch: stable/ocata

commit 9ec3d110078d571068325e1f198745a6ae78f633
Author: Mark Goddard <email address hidden>
Date: Wed Feb 22 02:23:05 2017 +0000

    Fix binary ironic-inspector rootwrap configuration

    When built with the binary install type (at least on CentOS), Ironic
    inspector fails to start and the container remains in a restarting
    state. The log file shows that it is failing to execute iptables, and
    analysis found that this was due to an incorrect rootwrap
    configuration. The RDO ironic inspector RPM expects Ironic inspector
    to be run as the ironic-inspector user, however Kolla uses the ironic
    user. This means that neither of the packaged ironic nor
    ironic-inspector sudoers configuration files works for us.

    Kolla currently installs a sudoers file pointing to the rootwrap
    script in the virtualenv of the source install, but of course this
    only makes sense for source installs, and should not be installed for
    binary installs.

    This change adds a second sudoers file that will work for the binary
    install type, and installs the correct sudoers file for the install
    type.

    Change-Id: I8ecd0b658b8df8f38ddf717fa9443d4dc2896984
    Closes-Bug: #1624457
    (cherry picked from commit 5752c7eb0b1f9c5978dd4e9271ded346cea231e0)

[Steven Dake (sdake)]

Mark,

sbezverk confirmed this patch, along with https://review.openstack.org/#/c/380774/ works in the kolla-kubernetes gate.

When sbezverk tested this originally, he attempted to backport both this patch as well as https://review.openstack.org/#/c/380774/ into a Newton image. I believe his attempt was incorrect a manual merge conflict resolution was required. Sometimes people get the manual merge conflict resolution wrong.

I think the fact that this original solution didn't follow the standard pattern in Kolla was a bit misleading.

Regards
-steve

[Steven Dake (sdake)]

Mark,

Note when I said misleading in comment #15, I meant misleading in the root cause analysis.

Regards
-steve

[Mark Goddard (mgoddard)]

Thanks for clarifying Steve. I'm putting a patch together with a 'proper' fix for this issue, using the ironic-inspector user and rebasing the ironic-inspector image directly onto openstack-base from ironic-base: https://review.openstack.org/441605. Preliminary testing looks promising.

I'll submit those two cherry pick commits to stable/newton for review.

Cheers,
Mark

[Steven Dake (sdake)]

Mark,

Would you mind confirming which cherrypicks you were going to submit for stable/newton? The reason I ask is I believe Jeffrey is planning to release 3.0.3 (stable/newton) on March 8th.

[Mark Goddard (mgoddard)]

Steve,

It's these two: https://review.openstack.org/#/c/439913/ and https://review.openstack.org/#/c/439882. I still need Serguei to reopen the second so I can submit my cherry pick.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla 4.0.0.0rc2 release candidate.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/439882
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=31681a8227a8330a18af5cdcc66abc7530f9b7ba
Submitter: Jenkins
Branch: stable/newton

commit 31681a8227a8330a18af5cdcc66abc7530f9b7ba
Author: Mark Goddard <email address hidden>
Date: Wed Feb 22 02:23:05 2017 +0000

    Fix binary ironic-inspector rootwrap configuration

    When built with the binary install type (at least on CentOS), Ironic
    inspector fails to start and the container remains in a restarting
    state. The log file shows that it is failing to execute iptables, and
    analysis found that this was due to an incorrect rootwrap
    configuration. The RDO ironic inspector RPM expects Ironic inspector
    to be run as the ironic-inspector user, however Kolla uses the ironic
    user. This means that neither of the packaged ironic nor
    ironic-inspector sudoers configuration files works for us.

    Kolla currently installs a sudoers file pointing to the rootwrap
    script in the virtualenv of the source install, but of course this
    only makes sense for source installs, and should not be installed for
    binary installs.

    This change adds a second sudoers file that will work for the binary
    install type, and installs the correct sudoers file for the install
    type.

    Change-Id: I8ecd0b658b8df8f38ddf717fa9443d4dc2896984
    Closes-Bug: #1624457
    (cherry picked from commit 5752c7eb0b1f9c5978dd4e9271ded346cea231e0)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla 3.0.3 release.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/441605
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=8b63089e1c3a55e3752229155d3a9e87d0511574
Submitter: Jenkins
Branch: master

commit 8b63089e1c3a55e3752229155d3a9e87d0511574
Author: Mark Goddard <email address hidden>
Date: Thu Mar 2 18:31:23 2017 +0000

    Use ironic-inspector user for ironic-inspector

    This change updates the ironic-inspector image to use the
    ironic-inspector user rather than the ironic user to execute the
    ironic inspector service as this more closely aligns with what is
    typically done by downstream packagers (specifically, Ubuntu and
    RDO).

    This change rebases the ironic-inspector image onto the openstack-base
    image instead of the ironic-base image. We configure an
    ironic-inspector user and use this to execute the ironic-inspector
    service. We also configure ironic-inspector to log to
    /var/log/kolla/ironic-inspector instead of the previous ironic
    location.

    Following this change we no longer need the workaround of a
    sudoers file for the binary install type that was added in change
    I8ecd0b658b8df8f38ddf717fa9443d4dc2896984.

    Change-Id: Ibdc5ba35db61f4974d4282aff34bcb5ccd952d45
    Closes-Bug: #1624457

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 5.0.0.0b2 development milestone.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla 5.0.0.0b2 development milestone.